BenchmaxxingAgent eval consoleStatic eval data

Static LLM benchmark dashboard

Agentic model rankings with explicit coverage and quality gates.

Real local-model eval results for Hermes-style agent/tool-calling work. Overall leaders require eligible data in every category as the benchmark set grows.

Current Leaders

Incomplete models can win category cards, but not the overall leaderboard.

Best Agentic Tool UseEligible
Qwen3.6 35B A3B Q4 MLX
OMLX local / Qwen
Leader score90.3

2/2 benchmarks covered

Latest runJul 4, 2026
Best Agentic CodingNo data
No dataNo eligible model has results for this category.
Best Long-Term TasksNo data
No dataNo eligible model has results for this category.
Best SpeedNo data
No dataNo eligible model has results for this category.

Model Comparison

Switch categories and views without hiding dates, harnesses, coverage, or score status.

RankModelProviderOverallStatus / coverageScore railLatest runBenchmark / harnessPass rateLatency / TPSCost
01Qwen3.8 27B MLX 8bit
Version Qwen3.8-27B-MLX-8bit
OMLX local
Qwen
No dataIncomplete
2/2 benchmarks
IncompleteIncomplete
Aug 15, 2026Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1); Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0)72.0%87.3s / 3.6 tok/s$0.00
02Qwen AgentWorld 35B A3B oQ4 MLX
Version Qwen-AgentWorld-35B-A3B-oQ4
OMLX local
Qwen
No dataIncomplete
2/2 benchmarks
IncompleteIncomplete
Aug 14, 2026Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1); Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0)77.5%14.5s / 37.1 tok/s$0.00
03GPT-5.6 Luna
Version gpt-5.6-luna
OpenAI Codex
GPT
No dataIncomplete
2/2 benchmarks
IncompleteIncomplete
Aug 12, 2026Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1); Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0)87.5%11.5s / 14.3 tok/s-
04GPT-5.6 Sol
Version gpt-5.6-sol
OpenAI Codex
GPT
No dataIncomplete
2/2 benchmarks
IncompleteIncomplete
Aug 12, 2026Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1); Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0)82.5%7.78s / 14.7 tok/s-
05Qwen3.5 9B MLX 4bit
Version Qwen3.5-9B-MLX-4bit
OMLX local
Qwen
No dataIncomplete
2/2 benchmarks
IncompleteIncomplete
Jul 5, 2026Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1); Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0)76.5%16.1s / 20.7 tok/s$0.00
06Qwen3.6 27B OptiQ 4bit MLX
Version Qwen3.6-27B-OptiQ-4bit
OMLX local
Qwen
No dataIncomplete
2/2 benchmarks
IncompleteIncomplete
Jul 5, 2026Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1); Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0)82.5%53.4s / 6.4 tok/s$0.00
07GPT-5.5
Version gpt-5.5
OpenAI Codex
GPT
No dataIncomplete
2/2 benchmarks
IncompleteIncomplete
Jul 4, 2026Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0); Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1)83.5%8.41s / 13.7 tok/s-
08Ornith 1.0 35B 5bit MLX
Version Ornith-1.0-35B-5bit-mlx
OMLX local
Ornith
No dataIncomplete
2/2 benchmarks
IncompleteIncomplete
Jul 4, 2026Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1); Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0)76.0%11.4s / 22.8 tok/s$0.00
09Qwen3.6 35B A3B Q4 MLX
Version Qwen3.6-35B-A3B-UD-Q4_K_XL-mlx
OMLX local
Qwen
No dataIncomplete
2/2 benchmarks
IncompleteIncomplete
Jul 4, 2026Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0); Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1)90.5%12.9s / 28.0 tok/s$0.00
10Qwen3.6 35B A3B Q8 MLX
Version Brooooooklyn-Qwen3.6-35B-A3B-UD-Q8_K_XL-mlx
OMLX local
Qwen
No dataIncomplete
2/2 benchmarks
IncompleteIncomplete
Jul 4, 2026Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1); Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0)84.0%13.0s / 27.1 tok/s$0.00
No dataNo eligible rows are available for this chart.

Not charted

Qwen3.8 27B MLX 8bit: IncompleteQwen AgentWorld 35B A3B oQ4 MLX: IncompleteGPT-5.6 Luna: IncompleteGPT-5.6 Sol: IncompleteQwen3.5 9B MLX 4bit: IncompleteQwen3.6 27B OptiQ 4bit MLX: IncompleteGPT-5.5: IncompleteOrnith 1.0 35B 5bit MLX: IncompleteQwen3.6 35B A3B Q4 MLX: IncompleteQwen3.6 35B A3B Q8 MLX: Incomplete
RankModelProviderAgentic Tool UseStatus / coverageScore railLatest runBenchmark / harnessPass rateLatency / TPSCost
01Qwen3.6 35B A3B Q4 MLX
Version Qwen3.6-35B-A3B-UD-Q4_K_XL-mlx
OMLX local
Qwen
90.3Eligible
2/2 benchmarks
Eligible90.3
Jul 4, 2026Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0); Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1)90.5%12.9s / 28.0 tok/s$0.00
02GPT-5.6 Luna
Version gpt-5.6-luna
OpenAI Codex
GPT
87.0Eligible
2/2 benchmarks
Eligible87.0
Aug 12, 2026Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1); Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0)87.5%11.5s / 14.3 tok/s-
03Qwen3.6 35B A3B Q8 MLX
Version Brooooooklyn-Qwen3.6-35B-A3B-UD-Q8_K_XL-mlx
OMLX local
Qwen
83.4Eligible
2/2 benchmarks
Eligible83.4
Jul 4, 2026Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1); Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0)84.0%13.0s / 27.1 tok/s$0.00
04GPT-5.5
Version gpt-5.5
OpenAI Codex
GPT
81.3Eligible
2/2 benchmarks
Eligible81.3
Jul 4, 2026Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0); Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1)83.5%8.41s / 13.7 tok/s-
05Qwen3.6 27B OptiQ 4bit MLX
Version Qwen3.6-27B-OptiQ-4bit
OMLX local
Qwen
80.5Eligible
2/2 benchmarks
Eligible80.5
Jul 5, 2026Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1); Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0)82.5%53.4s / 6.4 tok/s$0.00
06GPT-5.6 Sol
Version gpt-5.6-sol
OpenAI Codex
GPT
79.3Eligible
2/2 benchmarks
Eligible79.3
Aug 12, 2026Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1); Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0)82.5%7.78s / 14.7 tok/s-
07Qwen AgentWorld 35B A3B oQ4 MLX
Version Qwen-AgentWorld-35B-A3B-oQ4
OMLX local
Qwen
75.3Eligible
2/2 benchmarks
Eligible75.3
Aug 14, 2026Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1); Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0)77.5%14.5s / 37.1 tok/s$0.00
08Ornith 1.0 35B 5bit MLX
Version Ornith-1.0-35B-5bit-mlx
OMLX local
Ornith
74.8Eligible
2/2 benchmarks
Eligible74.8
Jul 4, 2026Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1); Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0)76.0%11.4s / 22.8 tok/s$0.00
09Qwen3.5 9B MLX 4bit
Version Qwen3.5-9B-MLX-4bit
OMLX local
Qwen
74.0Eligible
2/2 benchmarks
Eligible74.0
Jul 5, 2026Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1); Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0)76.5%16.1s / 20.7 tok/s$0.00
10Qwen3.8 27B MLX 8bit
Version Qwen3.8-27B-MLX-8bit
OMLX local
Qwen
68.4Eligible
2/2 benchmarks
Eligible68.4
Aug 15, 2026Hermes Tool Contract Hard v1 (Hermes Agent Evals hermes_tool_contract_hard_v1); Hermes Tool Contract (Hermes Agent Evals hermes_tool_contract_v0)72.0%87.3s / 3.6 tok/s$0.00
01Qwen3.6 35B A3B Q4 MLX90.302GPT-5.6 Luna87.003Qwen3.6 35B A3B Q8 MLX83.404GPT-5.581.305Qwen3.6 27B OptiQ 4bit MLX80.506GPT-5.6 Sol79.307Qwen AgentWorld 35B A3B oQ4 MLX75.308Ornith 1.0 35B 5bit MLX74.809Qwen3.5 9B MLX 4bit74.010Qwen3.8 27B MLX 8bit68.4
RankModelProviderAgentic CodingStatus / coverageScore railLatest runBenchmark / harnessPass rateLatency / TPSCost
01GPT-5.5
Version gpt-5.5
OpenAI Codex
GPT
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
02GPT-5.6 Luna
Version gpt-5.6-luna
OpenAI Codex
GPT
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
03GPT-5.6 Sol
Version gpt-5.6-sol
OpenAI Codex
GPT
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
04Ornith 1.0 35B 5bit MLX
Version Ornith-1.0-35B-5bit-mlx
OMLX local
Ornith
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
05Qwen AgentWorld 35B A3B oQ4 MLX
Version Qwen-AgentWorld-35B-A3B-oQ4
OMLX local
Qwen
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
06Qwen3.5 9B MLX 4bit
Version Qwen3.5-9B-MLX-4bit
OMLX local
Qwen
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
07Qwen3.6 27B OptiQ 4bit MLX
Version Qwen3.6-27B-OptiQ-4bit
OMLX local
Qwen
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
08Qwen3.6 35B A3B Q4 MLX
Version Qwen3.6-35B-A3B-UD-Q4_K_XL-mlx
OMLX local
Qwen
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
09Qwen3.6 35B A3B Q8 MLX
Version Brooooooklyn-Qwen3.6-35B-A3B-UD-Q8_K_XL-mlx
OMLX local
Qwen
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
10Qwen3.8 27B MLX 8bit
Version Qwen3.8-27B-MLX-8bit
OMLX local
Qwen
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
No dataNo eligible rows are available for this chart.

Not charted

GPT-5.5: No dataGPT-5.6 Luna: No dataGPT-5.6 Sol: No dataOrnith 1.0 35B 5bit MLX: No dataQwen AgentWorld 35B A3B oQ4 MLX: No dataQwen3.5 9B MLX 4bit: No dataQwen3.6 27B OptiQ 4bit MLX: No dataQwen3.6 35B A3B Q4 MLX: No dataQwen3.6 35B A3B Q8 MLX: No dataQwen3.8 27B MLX 8bit: No data
RankModelProviderLong-Term TasksStatus / coverageScore railLatest runBenchmark / harnessPass rateLatency / TPSCost
01GPT-5.5
Version gpt-5.5
OpenAI Codex
GPT
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
02GPT-5.6 Luna
Version gpt-5.6-luna
OpenAI Codex
GPT
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
03GPT-5.6 Sol
Version gpt-5.6-sol
OpenAI Codex
GPT
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
04Ornith 1.0 35B 5bit MLX
Version Ornith-1.0-35B-5bit-mlx
OMLX local
Ornith
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
05Qwen AgentWorld 35B A3B oQ4 MLX
Version Qwen-AgentWorld-35B-A3B-oQ4
OMLX local
Qwen
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
06Qwen3.5 9B MLX 4bit
Version Qwen3.5-9B-MLX-4bit
OMLX local
Qwen
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
07Qwen3.6 27B OptiQ 4bit MLX
Version Qwen3.6-27B-OptiQ-4bit
OMLX local
Qwen
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
08Qwen3.6 35B A3B Q4 MLX
Version Qwen3.6-35B-A3B-UD-Q4_K_XL-mlx
OMLX local
Qwen
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
09Qwen3.6 35B A3B Q8 MLX
Version Brooooooklyn-Qwen3.6-35B-A3B-UD-Q8_K_XL-mlx
OMLX local
Qwen
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
10Qwen3.8 27B MLX 8bit
Version Qwen3.8-27B-MLX-8bit
OMLX local
Qwen
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
No dataNo eligible rows are available for this chart.

Not charted

GPT-5.5: No dataGPT-5.6 Luna: No dataGPT-5.6 Sol: No dataOrnith 1.0 35B 5bit MLX: No dataQwen AgentWorld 35B A3B oQ4 MLX: No dataQwen3.5 9B MLX 4bit: No dataQwen3.6 27B OptiQ 4bit MLX: No dataQwen3.6 35B A3B Q4 MLX: No dataQwen3.6 35B A3B Q8 MLX: No dataQwen3.8 27B MLX 8bit: No data
RankModelProviderSpeedStatus / coverageScore railLatest runBenchmark / harnessPass rateCompletion / TPSCost
01GPT-5.5
Version gpt-5.5
OpenAI Codex
GPT
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
02GPT-5.6 Luna
Version gpt-5.6-luna
OpenAI Codex
GPT
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
03GPT-5.6 Sol
Version gpt-5.6-sol
OpenAI Codex
GPT
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
04Ornith 1.0 35B 5bit MLX
Version Ornith-1.0-35B-5bit-mlx
OMLX local
Ornith
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
05Qwen AgentWorld 35B A3B oQ4 MLX
Version Qwen-AgentWorld-35B-A3B-oQ4
OMLX local
Qwen
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
06Qwen3.5 9B MLX 4bit
Version Qwen3.5-9B-MLX-4bit
OMLX local
Qwen
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
07Qwen3.6 27B OptiQ 4bit MLX
Version Qwen3.6-27B-OptiQ-4bit
OMLX local
Qwen
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
08Qwen3.6 35B A3B Q4 MLX
Version Qwen3.6-35B-A3B-UD-Q4_K_XL-mlx
OMLX local
Qwen
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
09Qwen3.6 35B A3B Q8 MLX
Version Brooooooklyn-Qwen3.6-35B-A3B-UD-Q8_K_XL-mlx
OMLX local
Qwen
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
10Qwen3.8 27B MLX 8bit
Version Qwen3.8-27B-MLX-8bit
OMLX local
Qwen
No dataNo data
0/0 benchmarks
No dataNo data
-No data---
No dataNo eligible rows are available for this chart.

Not charted

GPT-5.5: No dataGPT-5.6 Luna: No dataGPT-5.6 Sol: No dataOrnith 1.0 35B 5bit MLX: No dataQwen AgentWorld 35B A3B oQ4 MLX: No dataQwen3.5 9B MLX 4bit: No dataQwen3.6 27B OptiQ 4bit MLX: No dataQwen3.6 35B A3B Q4 MLX: No dataQwen3.6 35B A3B Q8 MLX: No dataQwen3.8 27B MLX 8bit: No data