TOMOULoperational

(INT4-AWQ)

gpt-oss-20b (INT4-AWQ): open-weights chat model. Apache-2.0, int4, 16,384-token context.

Overview API Playground Benchmarks Deploy

Quickstart

# OpenAI-compatible chat completion
curl https://api.tomoul.ai/v1/chat/completions \
  -H "Authorization: Bearer $TOMOUL_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "tomoul/gpt-oss-20b",
    "messages": [
      { "role": "user", "content": "Habari za asubuhi" }
    ]
  }'

Specs

16,384

context

int4

quant

Apache-2.0

license

chat

task

Try it

Chat playground

eu-helsinki1

Habari za asubuhi. Karibu Tomoul.

[ 0] -0.0142 0.0314 -0.0271 0.0083 0.0455 …

[ 1] 0.0271 -0.0145 0.0388 0.0017 -0.0223 …

[ 2] -0.0033 0.0198 0.0066 -0.0455 0.0301 …

[ 3] 0.0145 -0.0223 -0.0388 0.0271 -0.0017 …

… 1020 more dimensions

5 tokens · 178ms · $0.0000000600

Benchmarks

Latency · eu-helsinki1 (p95)

batch=1

42ms

batch=8

78ms

batch=32

128ms

batch=128

356ms

Use it

Deployed as serverless inference in your account by default. Drop the OpenAI SDK base URL to https://api.tomoul.ai/v1, and you're running on Tomoul.