---
title: "Open-weight vs closed LLMs for business - how to choose"
description: "Open-weight or closed LLMs for your business? Compare cost, control, privacy, the quality gap and lock-in, with the three ways to run open models and when each wins."
url: https://broadrouter.com/blog/open-weight-vs-closed-models/
lang: en
updated: 2026-11-14
publisher: BroadRouter (a BroadNet site); API by BroadNet Inference, https://inference.broadnet.ai
---

# Open-weight vs closed AI models for business: cost, control, risk

By the BroadNet Inference team · 4 min read · Published 2026-11-14

Closed models still lead at the frontier, but Epoch AI estimates the best open-weight models trail them by about four months. Open-weight models win on control, privacy options, version pinning and lock-in, because many providers can serve the same weights. Closed models win when you need the very best quality on hard tasks. Many businesses use both, routed by task.

## Key takeaways

-   Open-weight means the trained weights are published. It does not mean the training data or code is open.
-   Epoch AI estimated in May 2026 that top open-weight models lag closed ones by about four months on its capability index.
-   You can run open-weight models three ways: self-host, rent a dedicated GPU, or call a hosted API. Only a closed vendor can serve a closed model.
-   Lock-in is lower with open weights: if one host changes price or policy, another can serve the same model.
-   Self-hosting is cheapest only when GPUs stay busy. For spiky traffic, a hosted open-weight API usually costs less.

**On this page**

1.  What does open-weight actually mean?
2.  Open-weight vs closed models compared
3.  How big is the quality gap?
4.  What are the three ways to run an open-weight model?
5.  What does an open-weight model cost per month?
6.  Why does lock-in matter more than it looks?
7.  How do businesses combine open and closed models?
8.  Where BroadNet Inference fits

Every team building on LLMs makes this choice, often without noticing: **closed models** you can only reach through one vendor’s API, or **open-weight models** whose weights anyone can download and run. The choice affects your bill, your data path, how stable your product is, and how hard it is to leave.

## What does open-weight actually mean?

An [open-weight model](https://broadrouter.com/glossary/open-weight-model/) publishes its trained parameters. You, or any provider, can run it. That is narrower than open source: the training data and full training pipeline are usually not released.

Licences vary. Some are permissive: OpenAI’s Whisper, for example, releases code and weights [under the MIT licence](https://github.com/openai/whisper). Others restrict commercial use, user counts or fields of use. Read the licence of each model before you build on it.

A closed model’s weights stay with the vendor. You rent access through its API, or through clouds the vendor has licensed.

## Open-weight vs closed models compared

| Factor | Open-weight | Closed |
| --- | --- | --- |
| Top-end quality | Trails the frontier by months | Usually leads on the hardest tasks |
| Price per token | Often lower; hosts compete on the same model | Set by one vendor |
| Where it runs | Your servers, a rented GPU or any host | The vendor’s API or licensed clouds |
| Privacy options | Self-host, or pick a host with [zero data retention](https://broadrouter.com/glossary/zero-data-retention/) | The vendor’s terms and tiers |
| Version stability | Pin exact weights for as long as you like | The vendor retires versions on its schedule |
| Customisation | Fine-tune or quantise yourself | Only what the vendor offers |
| Lock-in | Low: several hosts serve the same weights | High: one vendor per model |
| Operations | Yours if you self-host | The vendor’s |

## How big is the quality gap?

Smaller than it used to be, but real. Stanford’s [2025 AI Index](https://hai.stanford.edu/ai-index/2025-ai-index-report/technical-performance) reported that the lead of the top closed model over the top open-weight model on the Chatbot Arena leaderboard fell from 8.04% in early January 2024 to 1.70% by February 2025. [Epoch AI](https://epoch.ai/data-insights/open-closed-eci-gap) estimated on May 29, 2026 that “the most capable open-weight models have lagged frontier closed models by an average of four months”, measured on its Epoch Capabilities Index.

In practice:

-   **Classification, extraction, summaries, translation, routine chat:** open-weight models are usually good enough, and cheaper.
-   **Coding agents and long documents:** strong open-weight options exist; test on your repos. See [the best open model for coding agents](https://broadrouter.com/blog/best-open-model-for-coding-agents/).
-   **The hardest reasoning and newest capabilities:** closed models often get there first.

Leaderboards are averages. Your 50 real test cases are the benchmark that matters.

## What are the three ways to run an open-weight model?

| Option | Best when | Watch out for |
| --- | --- | --- |
| Self-host on your own GPUs | Data must not leave your network; GPUs stay busy | Hardware, drivers, scaling, security, upgrades |
| Rent a dedicated GPU | Steady load, custom weights | You pay for idle hours |
| Hosted open-weight API | Spiky or growing traffic; fast start | You trust the host’s retention and uptime |

Self-hosting looks free per token, but a GPU costs the same whether it serves one request an hour or a thousand. It pays off at high, steady utilisation. Below that, a per-token API or a [flat-rate plan](https://broadrouter.com/blog/flat-rate-vs-pay-per-token-llm-api/) is usually cheaper.

## What does an open-weight model cost per month?

Per-token prices for hosted open-weight models are easy to compute. For 100 million input and 10 million output tokens a month on [DeepSeek V4.1 Flash](https://broadrouter.com/models/deepseek-v4.1-flash/) through BroadNet:

`100 x $0.175 + 10 x $0.52` per month, before any cache discount.

Run the same arithmetic with your closed vendor’s published per-million prices and your real token counts, or start from our [open-weight vs closed model API cost comparison](https://broadrouter.com/blog/open-weight-vs-closed-model-api-cost/), which prices one workload on GPT, Claude, Gemini, Grok and five open models. Cached input changes the result a lot: cached tokens on this model cost $0.0055 per million. The [LLM API cost calculator](https://broadrouter.com/tools/llm-api-cost-calculator/) does this for every BroadNet model, and the [LLM API pricing table](https://broadrouter.com/llm-api-pricing/) lists what other hosts charge for the same open weights.

## Why does lock-in matter more than it looks?

When a closed vendor raises prices, changes data terms or retires the model your prompts are tuned for, your options are to accept it or rewrite. With an open-weight model, you can move the same weights to another host, or in-house, and keep the same behaviour.

To keep that option real:

1.  Call models through an OpenAI-compatible SDK with the [base URL](https://broadrouter.com/glossary/base-url/) and model ID in config.
2.  Keep a regression test set and run it on every provider change.
3.  Optionally put a router such as [LiteLLM](https://broadrouter.com/guides/litellm-proxy-custom-provider/) in front, so switching is a config change.

## How do businesses combine open and closed models?

Most businesses end up with both:

-   Route high-volume, well-defined tasks (extraction, triage, summaries, agents’ routine steps) to an open-weight model.
-   Route rare, hard tasks to a closed frontier model.
-   Re-test every quarter. Given the gap Epoch measures, tasks move from the second list to the first over time.

## Where BroadNet Inference fits

BroadNet Inference is a hosted open-weight API: [DeepSeek V4.1 Flash](https://broadrouter.com/models/deepseek-v4.1-flash/), [GLM 5.3](https://broadrouter.com/models/glm-5.3/), [Qwen3.8 27B](https://broadrouter.com/models/qwen3.8-27b/) and BroadNet’s build of Google’s Gemma 4, plus two speech-to-text models, all through an [OpenAI-compatible endpoint](https://inference.broadnet.ai/docs?utm_source=broadrouter&utm_medium=referral&utm_campaign=blog-open-weight-vs-closed-models&utm_content=body). Its [privacy statement](https://www.broadnet.ai/inference-privacy) says it keeps no prompts or outputs and does not use inference data to train, fine-tune or evaluate models. DeepSeek V4.1 Flash is also available on flat plans from $1 an hour to $60 a month per session.

It does not serve closed models. If a task needs GPT, Claude or Gemini, use those vendors for that route and keep the rest on open weights. To weigh BroadNet against other providers, use the [20-point provider checklist](https://broadrouter.com/blog/choose-llm-api-provider-checklist/).

Free tools for this

-   [LLM API cost calculator](https://broadrouter.com/tools/llm-api-cost-calculator/) Price a workload on every model at once, with cache hits, reasoning and a flat-plan check.
-   [LLM token counter](https://broadrouter.com/tools/token-counter/) Exact token counts with each model's real tokenizer, with a token view and cost.
-   [Context window calculator](https://broadrouter.com/tools/context-window-calculator/) Will it fit? Window used per model, room left for output, cost to send.

[All free tools](https://broadrouter.com/tools/)

## Terms in this article

[Open-weight model](https://broadrouter.com/glossary/open-weight-model/)

An open-weight model is a machine learning model whose trained weights are published for anyone to download and run, usually under a licence with conditions. It differs from fully open-source AI, which also releases the training code and detailed information about the training data, so others can study and reproduce the model.

[Token](https://broadrouter.com/glossary/token/)

A token is the unit of text a language model reads and writes: a word, part of a word, a punctuation mark or a byte sequence produced by the model's tokenizer. LLM APIs count, limit and usually bill usage in tokens.

[AI coding agent](https://broadrouter.com/glossary/coding-agent/)

An AI coding agent is a software tool in which a language model works on a codebase in a loop: it reads files, edits them, runs commands such as tests, reads the output and decides the next step until the task is done or a limit is reached.

[Base URL](https://broadrouter.com/glossary/base-url/)

A base URL is the fixed root address of an API, such as https://api.example.com/v1, that a client puts in front of every endpoint path, such as /chat/completions. In OpenAI-compatible SDKs, changing the base URL, together with the API key and model ID, points the same code at a different provider.

[Cached input tokens](https://broadrouter.com/glossary/cached-input-tokens/)

Cached input tokens are prompt tokens that an LLM provider has recently processed and can reuse from a cache instead of computing again, usually a repeated prefix such as a system prompt or document. Providers bill them at a lower rate than new input tokens.

[Input and output tokens](https://broadrouter.com/glossary/input-and-output-tokens/)

Input tokens are the tokens a language model reads in a request, including the system prompt, conversation history, tool definitions and images. Output tokens are the tokens it generates in reply, including any reasoning. LLM APIs usually price them separately, and output usually costs more.

[Speech-to-text](https://broadrouter.com/glossary/speech-to-text/)

Speech-to-text, also called automatic speech recognition (ASR), is technology that converts spoken audio into written text. A speech-to-text API accepts an audio file or stream and returns a transcript, usually priced per minute of audio. Accuracy is measured with word error rate and varies with accent, dialect and recording quality.

[Tool calling](https://broadrouter.com/glossary/tool-calling/)

Tool calling, also called function calling, is an LLM API feature in which the model returns a structured request to run a function the developer has defined, with JSON arguments. The application runs the function and sends the result back; the model never runs code itself.

## Questions

### What is the difference between open-weight and open-source AI models?

An open-weight model publishes its trained weights so anyone can run it. An open-source model would also publish the training code and data. Most popular "open" LLMs are open-weight only, under licences that vary from permissive to restrictive.

### Are open-weight models as good as closed models?

Close, but not equal at the top. Epoch AI estimated in May 2026 that the best open-weight models trail the best closed models by about four months. On many everyday tasks the difference is small; on the hardest tasks closed models usually still lead.

### Are open-weight models cheaper?

Often per token, because many hosts compete to serve the same weights. Self-hosting is only cheaper when your GPUs stay busy; idle GPUs cost money whether you use them or not.

### Is an open-weight model more private?

It can be. You can self-host it so data never leaves your network, or choose a host with zero data retention. A closed model can only run where its vendor serves it, under the vendor's terms.

### Can I switch from a closed model to an open-weight model without rewriting code?

Usually, if the host offers an OpenAI-compatible API. Change the base URL, key and model ID, then re-test prompts, tool calls and output quality on your own test set.

## Keep reading

-   [How to choose an LLM API provider: a 20-point checklist](https://broadrouter.com/blog/choose-llm-api-provider-checklist/)
-   [LLM API data retention compared: OpenAI, Anthropic, Gemini, Mistral](https://broadrouter.com/blog/llm-api-data-retention-compared/)
-   [Flat-rate vs pay-per-token LLM API: the break-even math](https://broadrouter.com/blog/flat-rate-vs-pay-per-token-llm-api/)
-   [OpenRouter vs a flat-rate plan for AI agents: which costs less?](https://broadrouter.com/blog/openrouter-alternative-flat-rate/)
-   [Artificial Analysis alternatives: where to compare LLMs in 2026](https://broadrouter.com/blog/artificial-analysis-alternatives/)
-   [Live, on request, research: read a model catalogue clearly](https://broadrouter.com/blog/understand-model-status/)
-   [Guide: Use the OpenAI Python SDK with BroadNet Inference](https://broadrouter.com/guides/openai-python-sdk/)
-   [Guide: Route LiteLLM to BroadNet Inference (SDK and proxy)](https://broadrouter.com/guides/litellm-proxy-custom-provider/)

Try it on your real workload. New accounts start with $5 of credit for Gemma and transcription. DeepSeek, GLM and Qwen3.8 need a top-up.

[Get started](https://inference.broadnet.ai/account/?utm_source=broadrouter&utm_medium=referral&utm_campaign=blog-open-weight-vs-closed-models&utm_content=page-cta) ·

**Sources**

-   [Epoch AI, open-weight vs closed capability gap (Data Insight, May 29, 2026)](https://epoch.ai/data-insights/open-closed-eci-gap)
-   [Stanford HAI, 2025 AI Index Report, technical performance](https://hai.stanford.edu/ai-index/2025-ai-index-report/technical-performance)
-   [openai/whisper on GitHub (example of an MIT-licensed open-weight model)](https://github.com/openai/whisper)
-   [BroadNet Inference privacy statement (effective September 2026)](https://www.broadnet.ai/inference-privacy)
-   [BroadNet Inference machine-readable prices (pricing.json)](https://inference.broadnet.ai/pricing.json?utm_source=broadrouter&utm_medium=referral&utm_campaign=blog-open-weight-vs-closed-models&utm_content=sources)
