Skip to content
agentboards
Browse sections AI models

Compare AI models

Closed and open-weight models · Separate benchmarks · Exact tested configurations

Closed vs open models · side by side

Select up to four models below. Selections stay while you filter. Best selected result per row is highlighted: higher scores and speed, lower cost and time. A dash means no reported result.

Benchmark, cost and speed metrics across selected configurations, with units and preferred direction per row.
BenchmarkClaude Fable 5.2 (Max, Default Fallback)Closed weightsGPT-6 Astra (Max)Closed weightsKimi K3.1 ProOpen weightsDeepSeek V4.1 Flash 1017 (Max)Open weights
AA IndexComposite index · points · higher is better64.656.946.532.6
HLE-DiamondAccuracy · % · higher is better80.2%63.8%37.3%25.3%
GPQA DiamondAccuracy · % · higher is better—96.1%——
Knowledge accuracyAccuracy · % · higher is better79.1%61.6%48.9%39.6%
FrontierCode 2.0Mean rubric score · % · higher is better48.8%42.4%25.5%28.5%
Benchmark task costUSD / task · lower is better$26.54$6.24$3.68$0.60
Benchmark task timeminutes / task · lower is better46.824.338.315.1
Output speedtokens / second · higher is better97.635.631.4153.1
First answer tokenseconds · lower is better267.8232.0172.145.4
API input priceUSD / 1M tokens · lower is better$8.00$10.00$2.00$0.30
API output priceUSD / 1M tokens · lower is better$40.00$50.00$10.00$1.20

Task cost and time are weighted Intelligence Index measurements, not estimates for your workload. API token prices are separate. Open weights do not mean free inference.

Download comparison PNG

Saved on this device · Links include model configurations and board filters · Search text stays out of links · Scores refresh with the site

Saved comparisons (0/8)

Selections and filters are saved; this is not a historical score archive. Download a dated PNG to keep the results shown today.

Save a comparison to return to it later. No account needed.

    Show quality vs cost chart

    Filtered board · 103 configurations with a reported cost · Higher and further left means higher AA Index at lower benchmark cost. Green: open weights; accent: closed weights. Rings mark your selections.

    0$0.0018$6.7535$13.5053$20.2570$27.00AA Index · composite pointsWeighted benchmark task cost · USD · linear scale

    Read exact values and select models in the table below. These are evaluator task costs, not estimates for your workload.

    Show selected-model ranking chart

    AA Index · composite points, not accuracy · axis 0–70 · green: open weights · accent: closed weights

    1. Claude Fable 5.2 (Max, Default Fallback)64.6
    2. GPT-6 Astra (Max)56.9
    3. Kimi K3.1 Pro46.5
    4. DeepSeek V4.1 Flash 1017 (Max)32.6

    Showing 12 of 111 configurations · Source snapshot 2026-11-12 · Select column headings to sort

    Closed and open-weight models, exact tested settings, and separate benchmark results from Artificial Analysis.
    CompareModel / tested configurationDetails
    Claude Fable 5.2 (Max, Default Fallback)Anthropic · Closed weights64.680.2%—79.1%48.8%
    Sources & links
    Full model analysis ↗Model catalog & task guide →

    Weights access is publisher-labeled. Availability and license permissions vary. Scores retain the full tested effort and fallback setting in the model name.

    Claude Fable 5.2 (Xhigh, Default Fallback)Anthropic · Closed weights62.275.8%—78.0%47.6%
    Sources & links
    Full model analysis ↗Model catalog & task guide →

    Weights access is publisher-labeled. Availability and license permissions vary. Scores retain the full tested effort and fallback setting in the model name.

    Claude Fable 5.2 (High, Default Fallback)Anthropic · Closed weights61.873.8%—77.2%49.1%
    Sources & links
    Full model analysis ↗Model catalog & task guide →

    Weights access is publisher-labeled. Availability and license permissions vary. Scores retain the full tested effort and fallback setting in the model name.

    Gemini 4 Carbon (High)Google · Closed weights60.069.1%—58.3%40.6%
    Sources & links
    Full model analysis ↗Model catalog & task guide →

    Weights access is publisher-labeled. Availability and license permissions vary. Scores retain the full tested effort and fallback setting in the model name.

    Claude Opus 5.5 (Max, Default Fallback)Anthropic · Closed weights59.167.9%—65.5%46.4%
    Sources & links
    Full model analysis ↗Model catalog & task guide →

    Weights access is publisher-labeled. Availability and license permissions vary. Scores retain the full tested effort and fallback setting in the model name.

    Gemini 4 Carbon (Medium)Google · Closed weights58.367.4%—48.9%39.5%
    Sources & links
    Full model analysis ↗Model catalog & task guide →

    Weights access is publisher-labeled. Availability and license permissions vary. Scores retain the full tested effort and fallback setting in the model name.

    Claude Opus 5.5 (Xhigh, Default Fallback)Anthropic · Closed weights57.464.0%—65.5%43.8%
    Sources & links
    Full model analysis ↗Model catalog & task guide →

    Weights access is publisher-labeled. Availability and license permissions vary. Scores retain the full tested effort and fallback setting in the model name.

    GPT-6 Astra (Max)OpenAI · Closed weights56.963.8%96.1%61.6%42.4%
    Sources & links
    Full model analysis ↗Model catalog & task guide →

    Weights access is publisher-labeled. Availability and license permissions vary. Scores retain the full tested effort and fallback setting in the model name.

    Claude Fable 5.2 (Medium, Default Fallback)Anthropic · Closed weights56.466.3%—77.0%41.3%
    Sources & links
    Full model analysis ↗Model catalog & task guide →

    Weights access is publisher-labeled. Availability and license permissions vary. Scores retain the full tested effort and fallback setting in the model name.

    GPT-6 Astra (Xhigh)OpenAI · Closed weights55.361.5%96.3%61.0%41.4%
    Sources & links
    Full model analysis ↗Model catalog & task guide →

    Weights access is publisher-labeled. Availability and license permissions vary. Scores retain the full tested effort and fallback setting in the model name.

    GPT-6 Astra (High)OpenAI · Closed weights54.859.3%94.9%61.1%40.1%
    Sources & links
    Full model analysis ↗Model catalog & task guide →

    Weights access is publisher-labeled. Availability and license permissions vary. Scores retain the full tested effort and fallback setting in the model name.

    GPT-6.1 Sol (Max)OpenAI · Closed weights54.658.8%—61.8%40.6%
    Sources & links
    Full model analysis ↗Model catalog & task guide →

    Weights access is publisher-labeled. Availability and license permissions vary. Scores retain the full tested effort and fallback setting in the model name.

    Sources, benchmark definitions & task guides

    Artificial Analysis snapshot, checked 2026-11-12. Each row is one tested configuration. Results compare that evaluator’s setup; they do not establish universal accuracy. AA Index is a composite, and FrontierCode is a mean rubric score. Neither is a raw accuracy percentage. Missing results are not zeros.

    Costs and speed are from the same dated Artificial Analysis snapshot. Benchmark task cost includes input, cache, reasoning and answer-token costs weighted by the index evaluations. Task time includes inference and reasoning; output tokens/second is a different measure. Unknown costs and times are excluded when a maximum is set, and remain last when sorting. API prices are USD per million tokens, not subscription prices or self-hosting costs.

    • Benchmark task cost: Weighted average USD cost per Intelligence Index task, including cached and reasoning tokens. Not a quote for your task.
    • Benchmark task time: Inference time per Intelligence Index task, including reasoning. Not your task completion time.
    • Output speed: Publisher-measured output tokens per second. This is not end-to-end response time.
    • First answer token: Time until the first answer token, including reasoning delay where applicable.
    • API input price: Listed uncached API input price per million tokens, not a chat subscription price.
    • API output price: Listed API output price per million tokens. Reasoning, tools and retries can affect the bill.

    Open weights are downloadable model weights; license permissions differ. This board includes 111 current evaluated configurations with an index score, rather than every model in the catalog.

    Loading agent listings… Models and guides are ready.
    ↑↓ navigate · Enter open · Esc closeModels & guides