DeepInfer
DeepSeek's production inference framework, open-sourced under Apache-2.0. It runs DeepSeek-V4.1-Flash offline on NVIDIA SM100 and Huawei Ascend 950. It does not yet include a KV cache system, prefill/decode disaggregation, or load balancing.
What's new · October 20, 2026Released Oct 20, 2026. DeepInfer is DeepSeek's production inference framework, open-sourced under Apache-2.0. It runs DeepSeek-V4.1-Flash offline on NVIDIA SM100 and Huawei Ascend 950, with batch-invariant inference, deterministic sampling, and structured outputs. It does not yet include a KV cache system, prefill/decode disaggregation, or load balancing. Free. Agent test pending.Source
No affiliate link on file. Outbound goes to github.com. Identity checked October 20, 2026. Scores were not part of that check.
Verdict
Pending agent test
Use-it-for, skip-if, and the one-line verdict publish with the test log. This page will not guess them.
- Use it for
- Not assigned
- Skip it if
- Not assigned
- Tier
- Unranked
Scores
One 0–10 score from the logged run, plus the rubric underneath. All unset.
Run score
—
out of 10 · Pending agent test
- OutputNot scored
- SpeedNot scored
- CostNot scored
- ReliabilityNot scored
Pros and cons
Pros
Pending agent test. Nothing is listed until a run is logged.
Cons
Pending agent test. Nothing is listed until a run is logged.
Best for
Not a tested recommendation. These are the jobs this tool is filed under.
Test log
No run on file.
- Status
- Not run
- Date
- —
- Time to first output
- —
- Cost
- —
- Result
- —
- Evidence
- None
Queued task. Run a fixed multi-step workflow with one tool call and one failure case. Log setup time and cost.
FAQ
What is the agent-tested verdict for DeepInfer?
Pending agent test. DeepInfer is in the catalog with its official URL, category, and pricing model. No score, pros, cons, or tier have been published.
How much does DeepInfer cost?
The pricing model on file is Open source. A dollar price is not stored until someone checks the vendor page again.
Do sponsors outrank this tool?
No. A sponsored slot is labeled and sold separately from tiers. It cannot move this listing.