ONNX Interoperability with AI Frameworks: FAQ
Export, validate, and deploy models with ONNX for cross-framework inference - opset choices, runtime checks, and common failure fixes.
NanoGPT Blog
Updates, guides, and insights
Showing
228 posts found for 'models'
Claude Opus 5: What Anthropic's Benchmarks Show
Anthropic reports gains for Claude Opus 5 in coding, computer use, knowledge work, and scientific research. See what the launch results suggest, their limits, and when Opus 5 is worth testing.
Memory Efficiency in LLMs: Study Summary
How context length, KV-cache growth, and attention choices trade memory, latency, and recall in LLMs—practical fixes for local setups.
Celeris 1: A Diffusion Model for Short AI Tasks
Celeris 1 uses diffusion-based text generation for short tasks. See its provider-reported speed results, benchmark caveats, NanoGPT limits, pricing, and a small API test.
How to Choose an AI Voice for Text-to-Speech
A practical way to compare AI voices for narration, assistants, characters, ads, and multilingual speech using previews and a repeatable audition script.
Gemini 3.6 Flash vs Gemini 3.5 Flash Lite: Which Should You Use?
Compare Gemini 3.6 Flash and Gemini 3.5 Flash Lite on benchmarks, speed, pricing, context, coding, research, and high-volume work.
Laguna S 2.1 Benchmarks: When Thinking Mode Is Worth It
See how Poolside Laguna S 2.1 performs on coding and agent benchmarks, what Thinking mode adds, what it costs, and which version to use.
OpenRouter 429 Rate Limits: What They Mean and How to Recover
Learn why OpenRouter returns 429 errors, how to tell platform limits from provider capacity, and how retries, fallbacks, and a second gateway improve recovery.
Quantize ONNX Models with ONNX Runtime
Smaller INT8 ONNX models don't guarantee faster inference—pick dynamic or static quantization based on model type, data, and hardware.
How to Build Tool-Using AI Workflows with the Responses API
A practical guide to custom tools, public MCP servers on supported OpenAI models, streaming tool calls, and stored response chains in NanoGPT's Responses API.