AgentTested hands-on review
tool: NVIDIA Nemotron 3 Ultra
slug: nemotron-3-ultra
date: 2026-10-21
score: 7/10

Coverage: Same 4-task battery, 2 runs, through OpenRouter's free route
What we tested: Same 4-task battery, 2 runs.
Method: OpenRouter nvidia/nemotron-3-ultra-550b-a55b:free, temperature 0.

Notes:
- CPU-only box: 8 cores, 15 GB RAM, no GPU.
- Hosted; small battery

Results:
pass_rate: 6/8 (both summaries over the limit: 77 and 83 words)
latency: 1.6-11.5 s
run1.code: passed, 6/6 unit cases, wall 2.21 s, 210 out tokens
run1.reason1: passed, expect 5, wall 3.66 s, 99 out tokens
run1.reason2: passed, expect 5, wall 5.11 s, 73 out tokens
run1.summary: failed, 77 words, 3/3 key terms, wall 11.5 s, 175 out tokens
run2.code: passed, 6/6 unit cases, wall 2.57 s, 306 out tokens
run2.reason1: passed, expect 5, wall 5.07 s, 99 out tokens
run2.reason2: passed, expect 5, wall 1.57 s, 72 out tokens
run2.summary: failed, 83 words, 3/3 key terms, wall 2.29 s, 215 out tokens

Pros:
- Correct code and both trick questions in both runs

Cons:
- Ignored the 60-word limit twice
- Slower and more variable than the Super model (up to 11.5 s)

Verdict: Nemotron 3 Ultra got everything right on code and reasoning but blew the summary word limit in both runs. It was also slower than its smaller sibling. On this battery, bigger did not mean better.

Score line: 6/8, misses instruction limits on length.