Connect SillyTavern to BroadNet Inference (Custom OpenAI-compatible)
Updated
In SillyTavern's API Connections panel, choose Chat Completion, then Custom (OpenAI-compatible) as the Chat Completion Source. Set Custom Endpoint to https://inference.broadnet.ai/v1, paste your BroadNet key, type a model ID such as broadnet/qwen3.8-27b in Enter a Model ID, click Connect, then Test Message. Set Max Response Length to 1,000 tokens or more.
SillyTavern is an open-source chat front end, popular for character chat and roleplay. Its Custom (OpenAI-compatible) source connects the Chat Completion API type to any server with the generic OpenAI schema. BroadNet Inference serves standard chat completions at https://inference.broadnet.ai/v1. BroadRouter is BroadNet’s own site; the steps follow SillyTavern’s docs and its 1.19.0 release.
Setup
Get a key. Create a pay-as-you-go key in the BroadNet console, buy an hourly key, or buy an unlimited plan.
Open the API Connections panel.
Set API to Chat Completion.
Set Chat Completion Source to Custom (OpenAI-compatible).
Fill in the custom form:
Field
Value
Custom Endpoint (Base URL)
https://inference.broadnet.ai/v1
Custom API Key
your BroadNet key
Enter a Model ID
broadnet/qwen3.8-27b
Click Connect.
Test it. Click Test Message. SillyTavern sends a simple prompt to the model; a reply means the connection works.
Don’t add /chat/completions to the URL. SillyTavern’s form says that suffix is added automatically.
Type the model ID rather than picking from Available Models. That list comes from /v1/models, which BroadNet’s docs describe as catalogue metadata for monitors. When we checked it on 15 November 2026 it listed only the two transcription models, which can’t chat.
Which model to pick
Model
ID
Context
Notes
DeepSeek V4.1 Flash
broadnet/deepseek-v4.1-flash
1,048,576
Long chats; the model on the unlimited plans
Qwen3.8 27B
broadnet/qwen3.8-27b
262,144
Images; tested in Arabic by BroadNet
GLM 5.3
broadnet/glm-5.3
1,048,576
Text only; tools
BroadNet Gemma 4 VL 26B
broadnet/gemma-4-26b-a4b
32,768
Runs on the $5 free credit and the hourly key
An unlimited plan suits long sessions because you don’t pay per token: a Meteor hour costs $1, an Orbit week $15 and a Full Moon month $60. Each plan session runs one request at a time.
Settings worth changing
Max Response Length (tokens). DeepSeek V4.1 Flash, GLM 5.3 and Qwen3.8 27B reason before they answer, and the reasoning counts toward this limit. Set 1,000 or more, or you may get blank replies.
Context Size (tokens). Match it to the model in the table. SillyTavern can’t read it from BroadNet.
Prompt Post-Processing. If a model rejects a prompt because of several system messages or role order, try Merge consecutive roles first, then Semi-strict. SillyTavern’s docs note that these options drop tool calls unless you pick the “with tools” variant.
Bypass status check. If SillyTavern warns that the API isn’t working but Test Message succeeds, tick this.
Troubleshooting
401. The key is wrong, expired or out of allowance. Paste it again and click Connect.
404 or “model not found”. The URL must end in /v1, and the ID must include the broadnet/ prefix. Paid models need a top-up; the $5 credit covers only broadnet/gemma-4-26b-a4b and the two Transcribe models.
429. A pay-as-you-go key allows 30 requests a minute and 4 in flight, and the hourly key and plan sessions run one stream. See errors and retries.
Questions
Why is the Available Models list wrong or empty for BroadNet?
SillyTavern fills it from /v1/models. When we checked on 15 November 2026, BroadNet's public /v1/models listed only its two transcription models. Type the chat model ID in Enter a Model ID instead.
Which BroadNet model is best for long roleplay chats?
DeepSeek V4.1 Flash has a 1,048,576-token context and is the model on BroadNet's flat-rate unlimited plans. Qwen3.8 27B is the one BroadNet tested in Arabic, including Gulf and Egyptian dialects.
Why do replies come back blank in SillyTavern?
BroadNet's chat models except Gemma 4 VL 26B reason before answering, and the reasoning counts toward max_tokens. SillyTavern's Max Response Length sets that limit, so raise it to 1,000 tokens or more.
Are there content rules?
Yes. BroadNet's Acceptable Use Policy applies to everything sent through the API, and it explicitly covers fictional and synthetic content in its ban on sexual content involving minors.