Ternary Bonsai 27B
Ternary Bonsai 27B is a large language model architecture evaluated for performance against Qwen 27B variants. Recent benchmarking highlights its behavior under different quantization and draft configurations.
Performance Benchmarking
Recent analysis compares Ternary Bonsai 27B against the Qwen 3.6 27B MTP model in a local 16GB setup. Key findings include:
- Drafting Configurations: Evaluated using both Q4_1 (4-bit) and BF16 (16-bit) drafters to assess efficiency and accuracy trade-offs.
- Comparative Analysis: Direct performance metrics against Qwen 3.6 27B MTP.
- Source Detail: Ternary Bonsai 27B vs. Qwen 27B: LLM Performance Benchmarking Summary