Blog

Stories from the gateway

Cost & Pricing

Context Bloat: Paying Repeatedly for Tokens Nobody Reads

Every token added to a prompt is billed on that call and every call after it. Where bloat accumulates and what it actually costs to leave it there.

· 8 min read
AI Agents

Context Compaction: Keeping Agents Alive Past Turn Twenty

Agent transcripts grow until quality degrades and cost climbs. What to summarise, what to drop, and what must never be compacted away.

· 9 min read
Fundamentals

Context Length vs Effective Context: The Number You Can Use

· 9 min read
Models

Context Windows Compared: Input, Output and What It Costs

· 9 min read
Fundamentals

Continuous Batching: How Servers Keep GPUs Busy

· 9 min read
Cost & Pricing

Cost Per 1K Lines of Code: A Tempting, Mostly Bad Metric

· 9 min read
Cost & Pricing

Cost Per Agent Run: Why Input Dominates the Bill

· 9 min read
Cost & Pricing

Cost Per Code Review: What Automated Review Actually Costs

· 8 min read
Cost & Pricing

Cost Per Refactor: Estimating a Multi-File Change Up Front

· 10 min read
Cost & Pricing

Cost Per Test Suite: Writing Tests Versus Fixing Them

· 10 min read
Models

Cost-Adjusted Model Scoring: Ranking by Value, Not Capability

· 9 min read
AI Agents

Critic Agent Patterns: Useful Review Without Endless Rewrites

· 9 min read
Guides

curl Recipes for LLM APIs: Debug Before You Write Code

· 9 min read
Guides

Cursor Setup Guide: Pointing It at Your Own Endpoint

· 8 min read

Ready to start?

Every model, one key. Start free and upgrade when you are ready.