Thinking Machines: Inkling Small (free)

thinkingmachines/inkling-small-free

Inkling Small is an open-weight multimodal mixture-of-experts model from Thinking Machines Lab, with 12B active parameters out of 276B total.

Modalities
In / out per 1MFree / Free
Context1M
ReleasedJul 30, 2026

Providers

1 provider serves this model upstream.

Providers serving this model
ProviderInput /MOutput /MCache read /MLatency P50Throughput P50Uptime
DeepInfraus · fp8$0.45$1.20$0.101.87s27 tps99.65%

Market-wide measurements, refreshed every 15 minutes. They describe who serves Inkling Small (free) in general, not how ProjectCOZY routes your requests.

Pricing

List rates per 1M tokens — what Inkling Small (free) costs pay-as-you-go elsewhere, not what you pay here.

Input
Free
per 1M tokens
Output
Free
per 1M tokens
Cache read
—
not published
Included in every pass
Inkling Small (free) is included in every ProjectCOZY pass at no extra cost — one flat rate, no per-token metering. The rates above are there for comparison.

Performance

Time to first token and output speed across every provider, over the last 3 days.

0.0s100.0s200.0s300.0s400.0s
Oct 16, 12 AMOct 16, 8 AMOct 16, 4 PMOct 17, 12 AMOct 17, 8 AMOct 17, 4 PMOct 18, 12 AMOct 18, 8 AMOct 18, 4 PMOct 19, 12 AMOct 19, 8 AM
Median 90th percentile 99th percentile
0 tok/s200 tok/s400 tok/s600 tok/s800 tok/s
Oct 16, 12 AMOct 16, 8 AMOct 16, 4 PMOct 17, 12 AMOct 17, 8 AMOct 17, 4 PMOct 18, 12 AMOct 18, 8 AMOct 18, 4 PMOct 19, 12 AMOct 19, 8 AM
Median 90th percentile 99th percentile

Uptime

100% of requests were served successfully over the last 3 days, across all providers.

Last 3 daysAvailability 99.1%
Oct 16, 9:00 AMNow
Availability over the last 24 hoursAvailability 99.76%
100% 97% 93% 90%
Oct 18, 9:50 AMNow

Apps

Tools that most often run Inkling Small (free), by tokens this week.

Activity

30.6B tokens processed market-wide in the last month.

02.0B4.0B6.0B8.0B
Sep 19Sep 24Sep 29Oct 4Oct 9Oct 14Oct 19
Tokens

FAQ

Which model id do I use for Inkling Small (free)?
thinkingmachines/inkling-small:free. Send it as the model field from any OpenAI-compatible client, against http://192.168.1.55/v1.
How much context does Inkling Small (free) hold?
1,048,576 tokens per request, of which up to 262,144 can be the response.
What can it accept and return?
Input: text, image, audio. Output: text.
What does Inkling Small (free) cost on a pass?
Nothing beyond the pass itself. Pay-as-you-go elsewhere it lists at Free per 1M input tokens and Free per 1M output tokens.
Who built Inkling Small (free)?
Thinking Machines, in the Inkling family.

Explore

Other models your pass can call.