Base model race
Five open-source models competed on 50 questions from our own test set (25 electrical, 25 hotel); an open-weight judge model scored the answers. The chosen base is Qwen3.6-35B-A3B: first in electrical engineering, licensed Apache-2.0, and suited to serving both domain adapters together on one GPU.
| Model | Total | Electrical | Hotel |
|---|---|---|---|
| google/gemma-4-26B-A4B-it | 87.2 | 76.0 | 98.4 |
| Qwen/Qwen3.6-35B-A3Bchosen | 84.6 | 86.4 | 82.8 |
| google/gemma-4-12B-it | 79.6 | 64.0 | 95.2 |
| Qwen/Qwen3.5-9B | 73.8 | 72.4 | 75.2 |
| mistralai/Mistral-Small-3.2-24B-Instruct-2506 | 64.6 | 55.2 | 74.0 |
Scores out of 100 · judge: Qwen3.8-27B · 19 October 2026


