I
Infermatic
AGGREGATEDINFERENCE
N/A
Uptime
N/A
Rating
30-Day Uptime
96.7%2026-05-222026-06-20
Inference Latency
TheDrummer: Rocinante 12B290ms TTFT · 85 TPS
Sao10K: Llama 3.1 70B Hanami x16608ms TTFT · 8 TPS
Inference Models
| Model | Input $/M | Output $/M | TTFT | TPS |
|---|---|---|---|---|
| TheDrummer: Rocinante 12B | $0.25 | $0.50 | 290ms | 85 |
| Sao10K: Llama 3.1 70B Hanami x1 | $3.00 | $3.00 | 6608ms | 8 |
| SorcererLM 8x22B | $4.50 | $4.50 | — | — |
Community Reviews
4.5★★★★★(2 reviews)
clouduser42
★★★★★2025-06-15
Reliable service, great API documentation.
mlresearcher
★★★★☆2025-06-10
Good performance but support could be faster.