A
Amazon Bedrock
AGGREGATEDINFERENCE
N/A
Uptime
N/A
Rating
30-Day Uptime
96.7%2026-05-222026-06-20
Inference Latency
Amazon: Nova Micro 1.0312ms TTFT · 155 TPS
Amazon: Nova Lite 1.0346ms TTFT · 118 TPS
Amazon: Nova Lite 1.0266ms TTFT · 245 TPS
OpenAI: gpt-oss-20b13245ms TTFT · 170 TPS
OpenAI: gpt-oss-20b1247ms TTFT · 185 TPS
OpenAI: gpt-oss-120b9693ms TTFT · 156 TPS
OpenAI: gpt-oss-120b2324ms TTFT · 157 TPS
Anthropic: Claude 3 Haiku480ms TTFT · 59 TPS
Amazon: Nova 2 Lite1206ms TTFT · 115 TPS
Amazon: Nova 2 Lite452ms TTFT · 39 TPS
Writer: Palmyra X5306ms TTFT · 13 TPS
Meta: Llama 3.1 70B Instruct486ms TTFT · 13 TPS
Amazon: Nova Pro 1.0663ms TTFT · 46 TPS
Amazon: Nova Pro 1.0751ms TTFT · 107 TPS
Anthropic: Claude Haiku 4.5847ms TTFT · 59 TPS
Anthropic: Claude Haiku 4.5589ms TTFT · 104 TPS
Z.ai: GLM 51605ms TTFT · 25 TPS
Amazon: Nova Premier 1.0455ms TTFT · 11 TPS
Anthropic: Claude Sonnet 4.61644ms TTFT · 49 TPS
Anthropic: Claude Sonnet 41041ms TTFT · 50 TPS
Inference Models
| Model | Input $/M | Output $/M | TTFT | TPS |
|---|---|---|---|---|
| Amazon: Nova Micro 1.0 | $0.04 | $0.14 | — | — |
| Amazon: Nova Micro 1.0 | $0.04 | $0.14 | 312ms | 155 |
| Amazon: Nova Lite 1.0 | $0.06 | $0.24 | 346ms | 118 |
| Amazon: Nova Lite 1.0 | $0.06 | $0.24 | 266ms | 245 |
| OpenAI: gpt-oss-20b | $0.07 | $0.15 | 13245ms | 170 |
| OpenAI: gpt-oss-20b | $0.07 | $0.15 | 1247ms | 185 |
| OpenAI: gpt-oss-120b | $0.15 | $0.60 | 9693ms | 156 |
| OpenAI: gpt-oss-120b | $0.15 | $0.60 | 2324ms | 157 |
| Qwen: Qwen3 Coder 30B A3B Instruct | $0.15 | $0.60 | — | — |
| Anthropic: Claude 3 Haiku | $0.25 | $1.25 | 480ms | 59 |
| Amazon: Nova 2 Lite | $0.30 | $2.50 | 1206ms | 115 |
| Amazon: Nova 2 Lite | $0.30 | $2.50 | 452ms | 39 |
| Writer: Palmyra X5 | $0.60 | $6.00 | 306ms | 13 |
| Meta: Llama 3.1 70B Instruct | $0.72 | $0.72 | 486ms | 13 |
| Amazon: Nova Pro 1.0 | $0.80 | $3.20 | 663ms | 46 |
| Amazon: Nova Pro 1.0 | $0.80 | $3.20 | 751ms | 107 |
| Anthropic: Claude 3.5 Haiku | $0.80 | $4.00 | — | — |
| Anthropic: Claude 3.5 Haiku | $0.80 | $4.00 | — | — |
| Anthropic: Claude Haiku 4.5 | $1.00 | $5.00 | 847ms | 59 |
| Anthropic: Claude Haiku 4.5 | $1.00 | $5.00 | 589ms | 104 |
| Z.ai: GLM 5 | $1.00 | $3.20 | 1605ms | 25 |
| Amazon: Nova Premier 1.0 | $2.50 | $12.50 | 455ms | 11 |
| Anthropic: Claude Sonnet 4.6 | $3.00 | $15.00 | 1644ms | 49 |
| Anthropic: Claude Sonnet 4 | $3.00 | $15.00 | 1041ms | 50 |
| Anthropic: Claude Sonnet 4 | $3.00 | $15.00 | — | — |
| Anthropic: Claude Sonnet 4.5 | $3.00 | $15.00 | — | — |
| Anthropic: Claude Sonnet 4.5 | $3.00 | $15.00 | 1254ms | 43 |
| Anthropic: Claude Sonnet 4.5 | $3.00 | $15.00 | — | — |
| Anthropic: Claude Sonnet 4.6 | $3.00 | $15.00 | 1443ms | 39 |
| Anthropic: Claude Opus 4.8 | $5.00 | $25.00 | 4493ms | 58 |
| Anthropic: Claude Opus 4.6 | $5.00 | $25.00 | 1963ms | 40 |
| Anthropic: Claude Opus 4.7 | $5.00 | $25.00 | — | — |
| Anthropic: Claude Opus 4.5 | $5.00 | $25.00 | — | — |
| Anthropic: Claude Opus 4.8 | $5.00 | $25.00 | 1374ms | 54 |
| Anthropic: Claude Opus 4.7 | $5.00 | $25.00 | 2078ms | 59 |
| Anthropic: Claude Opus 4.5 | $5.00 | $25.00 | 1506ms | 42 |
| Anthropic: Claude 3.5 Sonnet | $6.00 | $30.00 | — | — |
| Anthropic: Claude Fable 5 | $10.00 | $50.00 | — | — |
| Anthropic: Claude Fable 5 | $10.00 | $50.00 | — | — |
| Anthropic: Claude Opus 4.1 | $15.00 | $75.00 | 2991ms | 8 |
Community Reviews
4.5★★★★★(2 reviews)
clouduser42
★★★★★2025-06-15
Reliable service, great API documentation.
mlresearcher
★★★★☆2025-06-10
Good performance but support could be faster.