Start free trial

OpenAI: GPT-3.5 Turbo

openai/gpt-3-5-turbo
CompareAPITry this model

GPT-3.5 Turbo is OpenAI's fastest model. It can understand and generate natural language or code, and is optimized for chat and traditional completion tasks. Training data up to Sep 2021.

Modalities
In / out per 1M$0.50 / $1.50
Context16K
ReleasedMay 28, 2023

Providers

1 provider serves this model upstream.

Providers serving this model
ProviderInput /MOutput /MCache read /MLatency P50Throughput P50Uptime
OpenAI$0.50$1.50Variable0.55s118 tps100%

Market-wide measurements, refreshed every 15 minutes. They describe who serves GPT-3.5 Turbo in general, not how ProjectCOZY routes your requests.

Pricing

List rates per 1M tokens — what GPT-3.5 Turbo costs pay-as-you-go elsewhere, not what you pay here.

Input
$0.50
per 1M tokens
Output
$1.50
per 1M tokens
Cache read
—
not published
Included in every pass
GPT-3.5 Turbo is included in every ProjectCOZY pass at no extra cost — one flat rate, no per-token metering. The rates above are there for comparison.

Performance

Time to first token and output speed across every provider, over the last 3 days.

0.0s2.5s5.0s7.5s10.0s
Oct 16, 12 AMOct 16, 8 AMOct 16, 4 PMOct 17, 12 AMOct 17, 8 AMOct 17, 4 PMOct 18, 12 AMOct 18, 8 AMOct 18, 4 PMOct 19, 12 AMOct 19, 8 AM
Median 90th percentile 99th percentile
0 tok/s100 tok/s200 tok/s300 tok/s400 tok/s
Oct 16, 12 AMOct 16, 8 AMOct 16, 4 PMOct 17, 12 AMOct 17, 8 AMOct 17, 4 PMOct 18, 12 AMOct 18, 8 AMOct 18, 4 PMOct 19, 12 AMOct 19, 8 AM
Median 90th percentile 99th percentile

Uptime

100% of requests were served successfully over the last 3 days, across all providers.

Last 3 daysAvailability 99.96%
Oct 16, 11:00 AMNow
Availability over the last 24 hoursAvailability 99.97%
100% 98% 97% 95%
Oct 18, 11:00 AMNow

Apps

Tools that most often run GPT-3.5 Turbo, by tokens this week.

MagicChat35% of tokens32.1MAI Influence ModGame · 20.9% of tokens19.2MGlobalView Next18.2% of tokens16.7MBoxy Rescue - AI Classification13.3% of tokens12.2MJanitor AIRoleplay · 12.5% of tokens11.4M

Activity

3.0B tokens processed market-wide in the last month.

0100.0M200.0M300.0M400.0M
Sep 19Sep 24Sep 29Oct 4Oct 9Oct 14Oct 19
Tokens

FAQ

Which model id do I use for GPT-3.5 Turbo?
openai/gpt-3.5-turbo. Send it as the model field from any OpenAI-compatible client, against http://192.168.1.55/v1.
How much context does GPT-3.5 Turbo hold?
16,385 tokens per request, of which up to 4,096 can be the response.
What can it accept and return?
Input: text. Output: text.
What does GPT-3.5 Turbo cost on a pass?
Nothing beyond the pass itself. Pay-as-you-go elsewhere it lists at $0.50 per 1M input tokens and $1.50 per 1M output tokens.
How current is its knowledge?
Training data runs to Sep 2021. Anything later has to come from your prompt or a tool call.
Who built GPT-3.5 Turbo?
OpenAI, in the GPT family.

Explore

Other models your pass can call.

Aion 3.5aion-labs/aion-3.5256KAionAion 3.5 Miniaion-labs/aion-3.5-mini256KAionAion-2.0aion-labs/aion-2.0128KAionAion-3.0aion-labs/aion-3.0128KAionAion-3.0-Miniaion-labs/aion-3.0-mini128KAionAion-RP 1.0 (8B)aion-labs/aion-rp-llama-3.1-8b32KAion