Three cats on a ranch at sunset: Terra 6.1 sits slightly apart looking up, while Kimi K3.1 Pro and Kimi K3.1 Pro Highspeed sit together looking down

New model releases: OpenAI Terra 6.1, Kimi K3.1 Pro, and Kimi K3.1 Pro Highspeed

Summary

GPT-6.1 Terra performed roughly as expected. This might be my new default model for coding tasks. Kimi K3.1 Pro and Pro Highspeed have not impressed me; in my opinion, they are not worth using.

Terra 6.1: an upgrade over Terra 5.6

Terra 6.1 performed roughly as expected. It is an upgrade over Terra 5.6: better quality overall and significantly cheaper, with particularly good results in coding tasks. The only weak spot I observed was inconsistent results when doing extraction from unstructured data. This might be my new default model for coding tasks.

All five workloads, current run

modelmean qualitycost / tasklatency
GPT-6.1 Terra0.845$0.01716.9 s
GPT-5.6 Terra0.815$0.04218.5 s
GPT-6 Luna0.804$0.001916.8 s

Terra 6.1 scored better than Terra 5.6 on repository implementation (0.85 versus 0.79), and much better on architecture (0.60 versus 0.46). Its extraction score was slightly lower (fell from 0.96 to 0.88). On repository implementation, it was cheaper but slower: 40.1 seconds versus 28.7 seconds.

Kimi K3.1 Pro: hard to justify for these tasks

In my opinion, Kimi K3.1 Pro and Pro Highspeed are not worth using. Their quality is slightly better than Terra’s in some tasks and far below Astra’s. They cost a lot and are significantly slower than OpenAI or Anthropic models.

All five workloads, current run

modelmean qualitycost / tasklatency
GPT-6.1 Terra0.845$0.01716.9 s
Kimi K3.1 Pro0.836$0.077164.8 s
Kimi K3.1 Pro Highspeed0.836$0.233121.9 s

Kimi Pro scored higher than Terra 6.1 on extraction and matching, tied it on research, and fell behind on architecture and repository implementation. On repository implementation, regular Pro averaged 363.8 seconds, compared with Terra 6.1’s 40.1 seconds.

Pro Highspeed: a small improvement at a higher cost

Pro Highspeed is slightly better than Pro in tasks like extraction, at 3x higher costs.

On extraction, Highspeed scored 0.969 versus Pro’s 0.949, at $0.0885 versus $0.0253 per task. It averaged 45.5 seconds versus 49.2 seconds. Highspeed did not improve quality on architecture or repository implementation.

All five workloads; Astra is historical context from the previous run

modelmean qualitycost / tasklatency
GPT-6.1 Terra0.845$0.01716.9 s
Kimi K3.1 Pro0.836$0.077164.8 s
Kimi K3.1 Pro Highspeed0.836$0.233121.9 s
Astra 6 (previous run)0.892$0.17228.0 s

Astra was not rerun in this edition. Its row is historical context from the previous Release Radar, not a fresh head-to-head result. Both Kimi variants tied Astra on research; Astra’s previous scores were higher on the other four workloads.

Testing results

$0.001$0.003$0.01$0.03$0.1$0.30.70.80.91.0mean candidate cost per task, log scale, cheaper to the rightmean qualityGPT-6.1 Terra: quality 0.845, cost per task 0.0172318Terra 6.1GPT-5.6 Terra: quality 0.815, cost per task 0.0421528Terra 5.6GPT-6 Luna: quality 0.804, cost per task 0.0019182Luna 6Kimi K3.1 Pro: quality 0.836, cost per task 0.076666Kimi ProKimi K3.1 Pro Highspeed: quality 0.836, cost per task 0.23288Kimi HighspeedClaude Fable 5.1: quality 0.770, cost per task 0.314339Fable 5.1Claude Opus 5.5: quality 0.741, cost per task 0.135317Opus 5.5
Quality and candidate cost per task. Better value is up and to the right.
1s3s10s30s100s0.70.80.91.0mean model response latency, log scale, faster to the rightmean qualityGPT-6.1 Terra: quality 0.845, latency ms 16920Terra 6.1GPT-5.6 Terra: quality 0.815, latency ms 18480Terra 5.6GPT-6 Luna: quality 0.804, latency ms 16800Luna 6Kimi K3.1 Pro: quality 0.836, latency ms 164800Kimi ProKimi K3.1 Pro Highspeed: quality 0.836, latency ms 121860Kimi HighspeedClaude Fable 5.1: quality 0.770, latency ms 44560Fable 5.1Claude Opus 5.5: quality 0.741, latency ms 31640Opus 5.5
Quality and model response latency. Faster models are farther right.

Full results

modelmean qualitycost / tasklatencyArchitectureRepository implementationNoisy extractionSemantic matchingGrounded research
GPT-6.1 Terra0.845$0.01716.9 s0.6040.8500.8830.8891.000
GPT-5.6 Terra0.815$0.04218.5 s0.4620.7910.9610.8830.977
GPT-6 Luna0.804$0.001916.8 s0.4930.7110.9340.8831.000
Kimi K3.1 Pro0.836$0.077164.8 s0.5230.7960.9490.9121.000
Kimi K3.1 Pro Highspeed0.836$0.233121.9 s0.5140.7860.9690.9121.000
Kimi K2.7 Code———0.397—0.9380.8540.941
Claude Fable 5.10.770$0.31444.6 s0.4070.6860.9220.9410.895
Claude Opus 5.50.741$0.13531.6 s0.4390.7440.9340.7540.834

Methodology

We tested five workloads with eight cases per workload, repeated twice, and graded responses against task-specific criteria. Quality scores measure rubric performance, not task pass rates.

Summary charts compare all five workloads, excluding Kimi K2.7 Code because its repository implementation results were incomplete; its available scores remain in the full table. Costs exclude judging and setup, latency measures response time, and Astra results come from the previous run.

Benchmark on your own workloads

Metergraph reads the traces your AI agents already produce, finds where you overpay or lose quality, and tests model changes on your own traffic before you switch.