TOMOULoperational

Phi-4 14B (INT4-AWQ)

Microsoft Phi-4 14B (INT4-AWQ): open-weights chat model. MIT, int4, 16,384-token context.

Quickstart

# OpenAI-compatible chat completion
curl https://api.tomoul.ai/v1/chat/completions \
  -H "Authorization: Bearer $TOMOUL_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "tomoul/phi-4",
    "messages": [
      { "role": "user", "content": "Habari za asubuhi" }
    ]
  }'

Specs

16,384
context
int4
quant
MIT
license
chat
task

Try it

Chat playground

eu-helsinki1
Habari za asubuhi. Karibu Tomoul.
[ 0] -0.0142 0.0314 -0.0271 0.0083 0.0455 …
[ 1] 0.0271 -0.0145 0.0388 0.0017 -0.0223 …
[ 2] -0.0033 0.0198 0.0066 -0.0455 0.0301 …
[ 3] 0.0145 -0.0223 -0.0388 0.0271 -0.0017 …
… 1020 more dimensions
5 tokens · 178ms · $0.0000000600

Benchmarks

Latency · eu-helsinki1 (p95)

batch=1
42ms
batch=8
78ms
batch=32
128ms
batch=128
356ms

Use it

Deployed as serverless inference in your account by default. Drop the OpenAI SDK base URL to https://api.tomoul.ai/v1, and you're running on Tomoul.