Stories from the gateway
Guides
Proxying LLM Traffic: What a Gateway Has to Get Right
Putting a gateway in front of an inference provider centralises keys, budgets and routing. Here is what breaks if you get streaming, headers or cancellation wrong.
· 9 min read
Guides
Redacting Secrets From Prompts Before They Leave Your Machine
Credentials reach model context through error output, config files and git history. Pre-send scanning, why gitignore is no defence, and rotating on suspicion.
· 9 min readGuides
Streaming an OpenAI-Compatible API in TypeScript
· 9 min read
Guides
Streaming in Python: Reading SSE From an LLM API
· 9 min readGuides
Timeout Tuning for LLM Calls: Picking Numbers That Hold
· 9 min readGuides
Using an LLM for Database Schema Design, Carefully
· 9 min read
Guides
Using an LLM to Generate and Edit Config Files
· 9 min readGuides
Using LangChain With Any OpenAI-Compatible Endpoint
· 9 min readGuides
Vercel AI SDK: Wiring Up a Custom OpenAI-Compatible Provider
· 9 min read
Guides
VS Code LLM Extension Setup: Custom Endpoints That Work
· 8 min readGuides
Windsurf Setup Guide: Custom Models and the BYOK Question
· 8 min read
Guides
Writing Database Migration Scripts With an LLM
· 9 min read
Guides
Zed Setup Guide: Wiring Up a Custom Model Endpoint
· 8 min readGuides
Aider Setup Guide: Any OpenAI-Compatible Endpoint
· 8 min readReady to start?
Every model, one key. Start free and upgrade when you are ready.