---
title: "Artificial Analysis alternatives for comparing LLMs | BroadRouter"
description: "Artificial Analysis alternatives compared: Arena, Epoch AI, Vals AI, OpenRouter rankings, Hugging Face and price data, by what each one measures and when to use it."
url: https://broadrouter.com/blog/artificial-analysis-alternatives/
lang: en
updated: 2026-11-15
publisher: BroadRouter (a BroadNet site); API by BroadNet Inference, https://inference.broadnet.ai
---

# Artificial Analysis alternatives: where to compare LLMs in 2026

By the BroadNet Inference team · 7 min read · Published 2026-11-15

Artificial Analysis is the main independent source for LLM speed, latency and intelligence scores per API provider. Each alternative measures something else: Arena ranks human preference, Epoch AI and Vals AI publish benchmark results, OpenRouter ranks usage, and price databases such as BroadRouter's (BroadNet's site) list prices only. Use two side by side, then test on your own data.

## Key takeaways

-   Artificial Analysis wins on measured speed and latency per provider endpoint: it times real requests and averages them over the past 5 days.
-   Arena (formerly LMArena) ranks models by blind human votes; Epoch AI and Vals AI publish benchmark scores; OpenRouter ranks by tokens processed, not quality.
-   Epoch AI offers CSV downloads under CC BY; Artificial Analysis has a free API that requires attribution.
-   BroadRouter is BroadNet's own site. Its price data lists providers' published prices with sources; it does not measure speed or quality.
-   No leaderboard replaces a test on 50 to 100 of your own inputs.

**On this page**

1.  What does Artificial Analysis do well?
2.  Which Artificial Analysis alternatives are there?
3.  How is Arena different?
4.  When are Epoch AI and Vals AI the better fit?
5.  What do OpenRouter rankings actually show?
6.  Is the Hugging Face Open LLM Leaderboard still worth using?
7.  Where do you compare Arabic models?
8.  Where does BroadRouter’s price data fit?
9.  How should you combine these sites?
10.  Where BroadNet Inference fits

Artificial Analysis is often the first stop when you compare LLM APIs, because it times real requests to each provider. But it is one lens. Other sites rank by human votes, by benchmark scores, by usage or by price, and each answers a different question. This guide sets out what each one measures, how, what data you can take away, and when to use it. Every fact below was read from the site’s own pages on 15 November 2026.

A disclosure first: BroadRouter is BroadNet’s own website. It sends developers to BroadNet Inference and publishes price data. It does not benchmark models, and it appears in this list only for prices.

## What does Artificial Analysis do well?

Artificial Analysis describes itself as “Independent analysis of AI”. Its [methodology page](https://artificialanalysis.ai/methodology) explains three things it does that few others do:

-   **Speed per provider endpoint.** Output speed is “output tokens per second over each request’s full duration”, including reasoning tokens, averaged “over the workloads we measured in the past 5 days”. Because one model “may have multiple endpoints across different providers”, you can see the same model run faster on one host than another.
-   **Latency you can compare.** It reports time to first token, time to first answer token (which includes reasoning, so reasoning and non-reasoning models compare fairly) and end-to-end time.
-   **Its own evaluations.** Intelligence Index v5.0.1 combines nine evaluations in four equally weighted groups (knowledge work, coding, science, general). Several are its own benchmarks or its own runs of others’ tasks, with stated repeat counts.

Its provider leaderboard covers “over 500 AI Model endpoints” with cost per task, time per task, first-answer-token latency, error rate, context window and licence. Prices are “the current prices listed by providers”, and its blended price uses a 7:2:1 ratio of cache-hit, input and output tokens. Change that mix in your head if your workload is output-heavy.

If you need measured speed and error rates by provider, it is hard to replace. People look for alternatives when they want a different signal: human preference, a specific domain, downloadable raw data, or a price list with a source for every row.

## Which Artificial Analysis alternatives are there?

| Site | What it measures | Method | Data you can take away | Best for |
| --- | --- | --- | --- | --- |
| [Artificial Analysis](https://artificialanalysis.ai/) | Intelligence index, output speed, latency, error rate, price per endpoint | Runs its own evaluations and timed requests; 5-day rolling speed window | Free API, attribution required | Speed and latency by provider |
| [Arena](https://arena.ai/leaderboard) (formerly LMArena) | Human preference | Two anonymous models answer, a person votes, names revealed after | Open preference datasets on Hugging Face | How answers feel to people |
| [Epoch AI Benchmarking Hub](https://epoch.ai/benchmarks) | Benchmark scores over time | Runs some benchmarks itself with Inspect; collects others from official leaderboards | CSV and a Python client; its data is CC BY | Trends and raw scores |
| [Vals AI](https://www.vals.ai/benchmarks) | Domain accuracy, cost and latency | 42 benchmarks, some private or held out | Not stated on the benchmarks page | Legal, finance, tax and other domains |
| [OpenRouter rankings](https://openrouter.ai/rankings) | Usage | Tokens processed through OpenRouter, in daily UTC buckets | Public models API with prices | What developers actually run |
| [Open LLM Leaderboard](https://huggingface.co/docs/leaderboards/open_llm_leaderboard/about) (Hugging Face) | Open-weight model scores | Six benchmarks in the Eleuther AI harness | Results and requests datasets | Comparing open checkpoints |
| [BroadRouter price data](https://broadrouter.com/data/llm-api-provider-prices/) (BroadNet’s site) | Published prices only | Read from each provider’s own pricing page, with URL, date and quote | CSV and JSON, CC BY 4.0 for the compilation | Checking a price at its source |

## How is Arena different?

Arena (lmarena.ai now redirects to arena.ai) asks real people to compare two anonymous answers and pick one. Model names appear only after the vote. That measures preference, which mixes accuracy with tone, length and formatting. Its leaderboard has separate boards, including Text, WebDev, Vision, Document and Search, and its Pareto view shows a cost per task. Arena says it has open-sourced its preference data on Hugging Face, which is useful if you want to study votes rather than read a rank.

Use it to see how a chat answer lands with people. Do not use it to choose a provider for an API: it ranks models, not hosts, and says nothing about speed on a given endpoint.

## When are Epoch AI and Vals AI the better fit?

**Epoch AI** keeps a database of benchmark results, tracking 99 benchmarks and 428 models when we checked. Some results it runs itself with the Inspect framework; the rest come from official leaderboards kept by benchmark creators. You can download the data as CSV or use its Python client. Its own data is free to reuse with credit under CC BY; externally sourced results keep their original licences. Pick Epoch when you want raw scores or a trend line, not a single index.

**Vals AI** runs 42 benchmarks across legal, finance, healthcare, coding, maths and more, and some sets are private or held out, which reduces the risk that a model was trained on the test. Its leaderboards compare accuracy, cost and latency, and its Inference Provider Index compares providers on accuracy, cost and speed. Its composite Vals Index weights sectors by their share of US GDP. Pick Vals when your task looks like one of its domains.

## What do OpenRouter rankings actually show?

Usage. Each model is ranked by “tokens it processed through the OpenRouter API”, prompt and completion together, over trailing one, seven or thirty days. The page states plainly that the rankings “do not rank models by accuracy, reasoning ability, or benchmark performance”. A model that writes long answers or runs in long agent loops climbs the table. Read it as a popularity signal and a list of models worth testing. OpenRouter also has a public models endpoint with per-model prices, which covers what OpenRouter charges, not what each host charges directly.

## Is the Hugging Face Open LLM Leaderboard still worth using?

For open-weight checkpoints, yes, with care. Hugging Face’s documentation says the first version was archived in June 2024 and replaced. The current version scores models on IFEval, BBH, MATH level 5, GPQA, MuSR and MMLU-Pro in the Eleuther AI evaluation harness, and publishes results as datasets. It evaluates model files, not hosted APIs, so it cannot tell you about price, speed or how a provider serves the model.

## Where do you compare Arabic models?

General leaderboards say little about Arabic, and Arena’s visible filters do not include a language. Two Hugging Face Spaces fill part of the gap:

-   The [Open Arabic LLM Leaderboard](https://huggingface.co/spaces/OALL/Open-Arabic-LLM-Leaderboard), run by the OALL organisation, for Arabic text.
-   The [Open Universal Arabic ASR Leaderboard](https://huggingface.co/spaces/elmresearchcenter/open_universal_arabic_asr_leaderboard), described as “a benchmark for open-source multi-dialect Arabic ASR models”, for speech recognition. BroadNet reports its Transcribe Arabic model at #2 of 37 (its September 2026 figure; the live board listed it #4 of 39 on 15 November 2026). That is BroadNet’s figure, and the board changes as models are added.

Read speech results by dialect, not just the average. [Arabic ASR word error rate explained](https://broadrouter.com/blog/arabic-asr-wer-explained/) shows how.

## Where does BroadRouter’s price data fit?

BroadRouter publishes three price resources: the [LLM API pricing pages](https://broadrouter.com/llm-api-pricing/) per model, the [price index](https://broadrouter.com/data/llm-api-price-index/) with medians and spreads, and the [raw provider price database](https://broadrouter.com/data/llm-api-provider-prices/). Every row is read from the provider’s own pricing page and stored with the source URL, the date and a verbatim quote, and a weekly script re-fetches the sources. No aggregator feed is used.

What it does not do matters as much:

-   It measures **no speed, latency, uptime or quality**. For those, use Artificial Analysis, Arena, Epoch AI or Vals AI.
-   It holds **third-party prices only**. BroadNet’s own prices are in its [pricing.json](https://inference.broadnet.ai/pricing.json?utm_source=broadrouter&utm_medium=referral&utm_campaign=blog-artificial-analysis-alternatives&utm_content=body) and on the [pricing page](https://broadrouter.com/pricing/).
-   It is **BroadNet’s site**, so treat it as a vendor’s compilation that you can check row by row, not as a neutral judge.

## How should you combine these sites?

1.  **Shortlist on quality.** Use Arena for chat feel and Epoch AI or Vals AI for task scores in your domain. Keep three to five models.
2.  **Check speed on the host you will use.** Artificial Analysis shows per-endpoint speed and latency. [LLM latency explained](https://broadrouter.com/blog/llm-latency-ttft-throughput/) covers which number matters for your app.
3.  **Check the price at the source.** Use a price database to find the providers, then open each provider’s own page. Watch cached-input and output prices, which move the bill more than input for many workloads.
4.  **Test on your own data.** Run 50 to 100 real inputs through each finalist and score them. A [benchmark](https://broadrouter.com/glossary/llm-benchmark/) predicts your results only as far as its tasks look like yours. [How to evaluate an LLM before switching](https://broadrouter.com/blog/evaluate-llm-before-switching/) gives the method, and the [20-point provider checklist](https://broadrouter.com/blog/choose-llm-api-provider-checklist/) covers limits, privacy and support.

## Where BroadNet Inference fits

BroadNet Inference is an OpenAI-compatible API, not a leaderboard. It serves a small set of models: DeepSeek V4.1 Flash (partner-hosted), GLM 5.3, Qwen3.8 27B, Gemma 4 VL 26B and two speech-to-text models. Tool calling and structured output are documented for GLM 5.3 and Qwen3.8 27B only. Self-serve accounts have no SLA, and there is no batch API or embeddings. If one of these models makes your shortlist, the $5 starting credit covers Gemma 4 VL 26B, both Transcribe models and Gemma hourly keys, so you can run step 4 on your own inputs before paying; DeepSeek, GLM and Qwen need a top-up. Prompts and answers are not retained. [Compare the models](https://broadrouter.com/models/) or [create an account](https://inference.broadnet.ai/?utm_source=broadrouter&utm_medium=referral&utm_campaign=blog-artificial-analysis-alternatives&utm_content=body).

Free tools for this

-   [LLM API cost calculator](https://broadrouter.com/tools/llm-api-cost-calculator/) Price a workload on every model at once, with cache hits, reasoning and a flat-plan check.
-   [LLM token counter](https://broadrouter.com/tools/token-counter/) Exact token counts with each model's real tokenizer, with a token view and cost.
-   [Context window calculator](https://broadrouter.com/tools/context-window-calculator/) Will it fit? Window used per model, room left for output, cost to send.

[All free tools](https://broadrouter.com/tools/)

## Terms in this article

[Token](https://broadrouter.com/glossary/token/)

A token is the unit of text a language model reads and writes: a word, part of a word, a punctuation mark or a byte sequence produced by the model's tokenizer. LLM APIs count, limit and usually bill usage in tokens.

[Latency](https://broadrouter.com/glossary/latency/)

Latency, for a language model API, is the time a request takes from being sent to the final output token being received. It is the sum of time to first token and generation time, and is usually reported as percentiles such as p50 and p95 rather than as an average.

[Speech-to-text](https://broadrouter.com/glossary/speech-to-text/)

Speech-to-text, also called automatic speech recognition (ASR), is technology that converts spoken audio into written text. A speech-to-text API accepts an audio file or stream and returns a transcript, usually priced per minute of audio. Accuracy is measured with word error rate and varies with accent, dialect and recording quality.

[Input and output tokens](https://broadrouter.com/glossary/input-and-output-tokens/)

Input tokens are the tokens a language model reads in a request, including the system prompt, conversation history, tool definitions and images. Output tokens are the tokens it generates in reply, including any reasoning. LLM APIs usually price them separately, and output usually costs more.

[Tokens per second](https://broadrouter.com/glossary/tokens-per-second/)

Tokens per second (TPS) is the rate at which a language model generates output tokens, usually measured for one request after its first token arrives. It sets how fast a reply streams once it starts. Summed across all concurrent requests it becomes system throughput; the wait before the first token is measured separately.

[LLM benchmark](https://broadrouter.com/glossary/llm-benchmark/)

An LLM benchmark is a fixed, usually public set of tasks with a scoring method, used to measure and compare language models on one skill, such as knowledge questions, coding or speech recognition. A benchmark score shows relative ability on that test, not how a model will do on your own workload.

[AI agent](https://broadrouter.com/glossary/agent/)

An AI agent is a system in which a language model directs its own steps toward a goal: it decides which tools to call, reads the results and repeats until it produces a final answer or hits a limit. A fixed script that calls a model at set points is usually called a workflow instead.

[Batch API](https://broadrouter.com/glossary/batch-api/)

A batch API is an asynchronous LLM endpoint that accepts many requests at once, usually as a file, processes them within a set window instead of immediately, and returns the results together. Providers such as OpenAI and Anthropic price batch requests at a discount to their standard APIs.

## Questions

### What is the best alternative to Artificial Analysis?

It depends on what you want to compare. For human preference, use Arena. For benchmark scores you can download, use Epoch AI. For domain tasks such as legal, finance and tax, use Vals AI. For what developers actually run, use OpenRouter rankings. For measured speed per provider, Artificial Analysis itself has no close substitute among these sites.

### Does Artificial Analysis have an API?

Yes. Its documentation (checked 15 November 2026) describes a free API "focused on model benchmarks", with a key from its Insights Platform. Attribution to artificialanalysis.ai is required for all use of the free API. A commercial API with more data is offered to partners.

### Is the Hugging Face Open LLM Leaderboard still useful?

Its first version was archived in June 2024, according to Hugging Face's documentation. Version 2 scores open-weight models on six benchmarks such as IFEval, GPQA and MMLU-Pro, with results in public datasets. It covers open-weight checkpoints, not hosted APIs, and says nothing about price or speed.

### Do OpenRouter rankings show which model is best?

No. The rankings page says they count tokens processed through OpenRouter and "do not rank models by accuracy, reasoning ability, or benchmark performance". They show popularity, which verbose models and long agent loops inflate.

### Does BroadRouter benchmark models?

No. BroadRouter is BroadNet's own website. It publishes prices read from providers' own pages, with sources and dates, plus tokenizer measurements. It does not measure speed, latency or answer quality, so it is not a substitute for Artificial Analysis or a benchmark site.

### Where can I compare Arabic models?

For Arabic text, the Open Arabic LLM Leaderboard (OALL) on Hugging Face. For Arabic speech recognition, the Open Universal Arabic ASR Leaderboard, which describes itself as a benchmark for open-source multi-dialect Arabic ASR models. Read word error rates by dialect, not just the average.

## Keep reading

-   [How to evaluate an LLM before switching providers](https://broadrouter.com/blog/evaluate-llm-before-switching/)
-   [How to choose an LLM API provider: a 20-point checklist](https://broadrouter.com/blog/choose-llm-api-provider-checklist/)
-   [How inference providers price open models: 6 compared](https://broadrouter.com/blog/llm-inference-provider-pricing-compared/)
-   [LLM latency: TTFT vs tokens per second vs end-to-end time](https://broadrouter.com/blog/llm-latency-ttft-throughput/)
-   [Arabic ASR word error rate (WER) explained](https://broadrouter.com/blog/arabic-asr-wer-explained/)
-   [Live, on request, research: read a model catalogue clearly](https://broadrouter.com/blog/understand-model-status/)
-   [LLM API SLAs compared: what Azure, Bedrock, Google and OpenAI promise](https://broadrouter.com/blog/llm-api-sla-uptime-compared/)
-   [Guide: Try BroadNet Inference in your browser, no account](https://broadrouter.com/guides/try-broadnet-inference-playground/)

Try it on your real workload. New accounts start with $5 of credit for Gemma and transcription. DeepSeek, GLM and Qwen3.8 need a top-up.

[Get started](https://inference.broadnet.ai/account/?utm_source=broadrouter&utm_medium=referral&utm_campaign=blog-artificial-analysis-alternatives&utm_content=page-cta) ·

**Sources**

-   [Artificial Analysis, home page: "Independent analysis of AI" (checked 2026-11-15)](https://artificialanalysis.ai/)
-   [Artificial Analysis, methodology: output speed, latency, 5-day window, blended price (checked 2026-11-15)](https://artificialanalysis.ai/methodology)
-   [Artificial Analysis, Intelligence Index v5.0.1 evaluations (checked 2026-11-15)](https://artificialanalysis.ai/methodology/intelligence-benchmarking)
-   [Artificial Analysis, API provider leaderboard: over 500 model endpoints (checked 2026-11-15)](https://artificialanalysis.ai/leaderboards/providers)
-   [Artificial Analysis, API documentation: free API, attribution required (checked 2026-11-15)](https://artificialanalysis.ai/documentation)
-   [Arena (formerly LMArena), how it works: blind battles, open preference datasets (checked 2026-11-15)](https://arena.ai/how-it-works)
-   [Arena leaderboard categories (checked 2026-11-15)](https://arena.ai/leaderboard)
-   [OpenRouter rankings: tokens processed, time windows, not a quality ranking (checked 2026-11-15)](https://openrouter.ai/rankings)
-   [OpenRouter API reference, list models: public catalogue with pricing (checked 2026-11-15)](https://openrouter.ai/docs/api-reference/list-available-models)
-   [Epoch AI Benchmarking Hub: internal and external results, CSV, CC BY (checked 2026-11-15)](https://epoch.ai/benchmarks)
-   [Vals AI benchmarks: 42 benchmarks, private sets, Inference Provider Index (checked 2026-11-15)](https://www.vals.ai/benchmarks)
-   [Hugging Face docs, Open LLM Leaderboard v1: archived in June 2024 (checked 2026-11-15)](https://huggingface.co/docs/leaderboards/open_llm_leaderboard/archive)
-   [Hugging Face docs, Open LLM Leaderboard (v2) tasks and results datasets (checked 2026-11-15)](https://huggingface.co/docs/leaderboards/open_llm_leaderboard/about)
-   [Open Arabic LLM Leaderboard (OALL) on Hugging Face (checked 2026-11-15)](https://huggingface.co/spaces/OALL/Open-Arabic-LLM-Leaderboard)
-   [Open Universal Arabic ASR Leaderboard on Hugging Face (checked 2026-11-15)](https://huggingface.co/spaces/elmresearchcenter/open_universal_arabic_asr_leaderboard)
-   [BroadNet Inference machine-readable prices, pricing.json (checked 2026-11-15)](https://inference.broadnet.ai/pricing.json?utm_source=broadrouter&utm_medium=referral&utm_campaign=blog-artificial-analysis-alternatives&utm_content=sources)
