Blog

Stories from the gateway

Guides

Evaluating Prompt Changes Without Fooling Yourself

You edited a prompt and the output looks better. Here is how to find out whether it actually is, with paired runs, enough samples and judges you can trust.

· 9 min read
Guides

Exponential Backoff That Works on LLM APIs

The retry algorithm in detail: full versus decorrelated jitter, deadline propagation, idempotency, what to classify as retryable, and how to test it before production does.

· 9 min read
Guides

Few-Shot Example Management: Curation Beats Quantity

· 9 min read
Guides

Function Calling in Python: A Working Implementation

· 9 min read
Guides

Function Calling in TypeScript Without Losing Type Safety

· 9 min read
Guides

Generating API Clients With an LLM Without Silent Drift

· 9 min read
Guides

Generating Regular Expressions With an LLM, Carefully

· 9 min read
Guides

GitHub Actions LLM Setup: A Workflow That Reviews PRs

· 9 min read
Guides

GitLab CI LLM Setup: Masked Variables and MR-Only Jobs

· 9 min read
Guides

Goose Setup Guide: Providers, Extensions and Safe Defaults

· 8 min read
Guides

Handling SSE Disconnects Without Losing the Response

· 9 min read
Guides

JetBrains LLM Setup: Custom Endpoints in IntelliJ IDEs

· 8 min read
Guides

JSON Schema for Tool Calls: What Providers Actually Support

· 9 min read
Guides

Kilo Code Setup Guide: Custom Endpoints and Profiles

· 8 min read

Ready to start?

Every model, one key. Start free and upgrade when you are ready.