Luke’s Dev Lab
Luke’s Dev Lab is a digital workspace and content channel dedicated to local Large Language Model (LLM) experimentation, benchmarking, and development.
Core Activities
- LLM Benchmarking: Comparative performance analysis of open-weight models in local 16GB+ setups.
- Model Optimization: Testing quantization methods (e.g., Q4_1 4-bit) and precision modes (e.g., BF16 16-bit).
- Drafting Architecture: Evaluating drafters for speculative decoding efficiency.
Recent Benchmarks
- Ternary Bonsai 27B vs. Qwen 3.6 27B MTP:
- Investigated performance differences between local LLM configurations.
- Qwen 3.6 14B (FableVibes) vs. Qwen 35B Base:
- Evaluated fine-tuned Qwen 3.6-35B A3B model (“FableVibes 14B”) against original 35B counterpart on 16GB setup.
- Detailed analysis available at FableVibes 14B (Qwen) vs. 35B Base: Local LLM Performance and Intelligence.