2026-10-12 18:52 UTC

OpenAI's new Ultrafast service tier β€” generally available for GPT-6 Astra and in preview for GPT-5.6 Sol β€” claims the fastest serving in its API for speed-justifies-cost workloads, and whether latency-sensitive long-running agent workloads adopt it at scale resolves whether it becomes the standard low-latency serving option.

state: corroboratedheat: mediumuncertainty: mediumconvergesscott: highopenai inference-economics model-servingOpenAI
Surfaced 2026-10-05T14:31:58Z β€” "Ultrafast mode is the fastest service tier in the OpenAI API. It is broadly available for GPT-6 Astra, with preview access for GPT-5.6 Sol. β€” The Oct 4 announcement burst has fully decayed (0.83 pts/h vs 51 peak, 0 comments/h, cooling; engagement flat within Β±1–2 pts) with only sarcastic price-skeptic comment churn β€” confirming the velocity spike was single-post announcement engagement, not spread. The magnitude-valve flag is discounted: just one Reddit post is top-decile and plateaued (169/18), HN sits at 4 points, and the periphery is not expanding β€” no new outlets, communities, implementations or adoption signals β€” so heat returns to low while the case holds at corroborated as a quiet watch.

What is this?

Ultrafast is OpenAI's premium low-latency API service tier, previewed August 13, 2026 for GPT-5.6 Sol at a vendor-claimed up to 14x standard speed (~750 output tok/s) on Cerebras wafer-scale hardware β€” the flagship product of a ~$10B/750MW low-latency compute partnership announced in January 2026 β€” and made generally available for flagship GPT-6 Astra on September 29, 2026, open to all API users at low default rate limits with higher limits via account team. It is priced at roughly 6x the standard tier for up to 8x speed (Astra base $10/$50 per M in/out); measured against the existing Fast mode (2x price, up to 2.5x speed) the money-to-speed trade is roughly linear rather than a superlinear premium, and third-party comparisons against much cheaper models with comparable token rates have driven price-skeptical reception ('who is this for?'). OpenAI targets latency-critical workloads (incident response, financial research, security), strongly recommends persistent WebSockets for tool-call-heavy agentic use because per-request network overhead can erase the speed gains, and restricts the tier to US data residency with global processing. Caveats: the 14x/750 tok/s figures are OpenAI-reported with no independent timing published, Sol remains in preview, GPT-6.1 Sol support is 'coming later' per OpenAI's own models page (a single-source Reddit echo said 'coming soon'; timing unverified), third-party accounts of Sol's base price conflict ($4/$20 promotional vs $5/$30), and the dedicated Ultrafast per-token pricing table and SLA terms remain uncaptured.

Why it matters to Scott

OpenAI has productized the position Scott's own stack already encodes β€” his LiteLLM gateway's cost-tiered routing treats speed-vs-cost as a first-class dimension β€” and now sells it back to him at ~6x price for ~8x speed, with adverse comparisons (70 tok/s at $300/M vs GLM at ~$4 and Opus 5.5 at $20–40) giving dated receipts for his latency-accuracy-asymmetry claim that long-running agents should renegotiate or remove the clock rather than buy per-call speed, predicting against the tier's own adoption resolution condition. It also bears on active surfaces: a routing decision for the gateway (does an ultrafast alias earn its slot), the docs' WebSocket guidance validating his persistent-connection tool-loop work, and the uncaptured per-token pricing table/SLA as a concrete capture target for the LLM Report pricing tracker; lineage continues the radar's Cerebras Ultrafast Sol-preview episode into Astra GA and a GPT-6.1 extension.
dev:technology.litellmdev:concept.cost-tiered-llm-routingip:concept.latency-accuracy-asymmetryip:framework.fast-slow-splitdev:project.llmreportwork:technology.openai-apiradar:openai-cerebras-ultrafast-inferenceradar:concept.inference-servingradar:concept.cerebrasradar:concept.inference-latencyradar:concept.model-pricingradar:concept.llm-servingradar:concept.inference-economicsradar:openai-gpt56-sol-api-price-cut
queries asked of Scott's wikis
  • speed-cost routing tier LiteLLM gateway
  • inference economics price per million tokens
  • latency-sensitive agent harness streaming tool calls
  • Cerebras wafer-scale low-latency inference
  • LLM pricing table tracker report
  • persistent websocket connection tool calling

Measured heat

now 0 pts/hpeak 75 pts/hcomments 0/hpeers p50momentum: steady3 platformsage 313h
points/hour across evidence Β· reading as of 2026-10-13 05:35:48.225472+11:00 Β· deterministic, not a model opinion

How the heat travelled

09-29 18:07 (minted)⭐ origin echo-reconstructed"Ultrafast mode is the fastest service tier in the OpenAI API. It is broadly available for GPT-6 Astra, with preview access for GPT-5.6 Sol.
OpenAI on blog (echo) Β· attributed from hn.story.49896907 Β· published time unknown
β€”
09-29 17:23first on hacker news Β· published Β· lag ?GPT-6 UltraFast
prodigycorp
β€”
09-29 17:25first on r/OpenAI Β· published Β· lag ?OpenAI announces ULTRAFAST mode (8x speed, 6x the price)
ethotopia
β€”
09-29 17:23amplified on hacker newshn.story.49896907
prodigycorp
peak 4 Β· 2 comments Β· 2% of case engagement
09-29 17:25amplified on r/OpenAIreddit.post.1wtgbyb
ethotopia
peak 20 Β· 39 comments Β· 12% of case engagement
10-01 07:22amplified on r/OpenAIreddit.post.1wut0bf
NandaVegg
peak 58 Β· 19 comments Β· 16% of case engagement
10-04 01:41amplified on r/OpenAI πŸ‘‘reddit.post.1wx3l41
ryanmerket
peak 189 Β· 18 comments Β· 43% of case engagement
10-08 18:49amplified on r/OpenAIreddit.post.1x0z8o1
jeppa35
peak 24 Β· 29 comments Β· 11% of case engagement
10-09 06:33amplified on hacker newshn.story.50016787
willmarch
peak 3 Β· 0 comments Β· 1% of case engagement
1 more amplifiers in ainews.case_chain
09-29 17:24our radar first saw it Β· lag ?discovery anchor: hn.story.49896907β€”
10-04 23:40reached heat=high Β· lag ? Β· via ledgerβ€”β€”
pace: p79 vs 1188 stories at the 168h mark (now 313h old) β€” ahead of oracle-new-mexico-force-majeure (1.0x), behind openai-chatgpt-ad-rollout (1.0x)

Evidence (8) β€” ⭐ canonical anchor

sourceobjectauthorscorecomments
🟧 hnGPT-6 UltraFast
Retrieved article excerpt

Open article Β· Retrieved 2026-09-29T17:42:06.906732+00:00

Ultrafast mode is the fastest service tier in the OpenAI API. It is broadly available for GPT-6 Astra, with [preview access](https://openai.com/index/previewing-ultrafast/) for GPT-5.6 Sol. Use it when speed justifies the higher cost.

We strongly recommend [WebSockets](https://developers.openai.com/api/docs/guides/websocket-mode), especially for agentic applications that make many tool calls in quick succession. Without a persistent connection, network overhead can reduce the latency gains.

Ultrafast mode for GPT-6 Astra is currently available to all API users at [low
rate limits](https://developers.openai.com/api/docs/guides/ultrafast-mode#availability). If your organization works with an OpenAI account
team, contact them to request higher rate limits or preview access for GPT-5.6
Sol.

## Configure your request

Set `model` to `gpt-6-astra` and `service_tier` to `ultrafast` in each `response.create` event.

Use Ultrafast across turns on one WebSocket

Python

```
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51// Install: npm install openai ws
// Set OPENAI_API_KEY in your environment.

import OpenAI from "openai";
import { ResponsesWS } from "openai/resources/responses/ws";

const client = new OpenAI();
const ws = new ResponsesWS(client);
let previousResponseId = null;

try {
  for (const input of [
    "Explain why the sky is blue in one sentence.",
    "Now explain why sunsets look red.",
  ]) {
    let completed = false;
    const events = ws.stream();
    ws.send({
      type: "response.create",
      model: "gpt-6-astra",
      service_tier: "ultrafast",
      previous_response_id: previousResponseId,
      input,
    });

    for await (const event of events) {
      if (event.type === "error") throw event.error;
      if (event.type !== "message") continue;
      const message = event.message;
      if (message.type === "response.output_text.delta") {
        process.stdout.write(message.delta);
      } else if (message.type === "response.completed") {
        previousResponseId = message.response.id;
        completed = true;
        console.log();
        break;
      } else if (
        message.type === "response.failed" ||
        message.type === "response.incomplete"
      ) {
        throw new Error(JSON.stringify(message));
      }
    }

    if (!completed) {
      throw new Error("Connection closed before the response finished.");
    }
  }
} finally {
  ws.close();
}
```

```
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31# Install: pip install --upgrade "openai[realtime]"
# Set OPENAI_API_KEY in your environment.

from openai import OpenAI

client = OpenAI()
previous_response_id: str | None = None
prompts = [
    "Explain why the sky is blue in one sentence.",
    "Now explain why sunsets look red.",
]

with client.responses.connect() as connection:
    for prompt in prompts:
        connection.response.create(
            model="gpt-6-astra",
            service_tier="ultrafast",
            previous_response_id=previous_response_id,
            input=prompt,
        )
        for event in connection:
            if event.type == "response.output_text.delta":
                print(event.delta, end="", flush=True)
            elif event.type == "response.completed":
                previous_response_id = event.response.id
                print()
                break
            elif event.type in {"response.failed", "response.incomplete", "error"}:
                raise RuntimeError(event.to_json())
        else:
            raise RuntimeError("Connection closed before the response finished.")
```

The example streams two responses over the same connection. The second request sends the new prompt and passes the first response’s ID as `previous_response_id`. Reuse the connection for later turns and tool results. See [Continue with incremental inputs](https://developers.openai.com/api/docs/guides/websocket-mode#continue-with-incremental-inputs).

## HTTP alternative

Ultrafast also supports HTTP requests through the SDK. For agentic applications with frequent tool calls, use a persistent WebSocket connection to reduce overhead between requests.

Create an Ultrafast response over HTTP

Python

```
1
2
3
4
5
6
7
8
9
10import OpenAI from "openai";

const client = new OpenAI();
const response = await client.responses.create({
  model: "gpt-6-astra",
  service_tier: "ultrafast",
  input: "Explain why the sky is blue in one sentence.",
});

console.log(response.output_text);
```

```
1
2
3
4
5
6
7
8
9
10
11from openai import OpenAI

client = OpenAI()

response = client.responses.create(
    model="gpt-6-astra",
    input="Explain why the sky is blue in one sentence.",
    service_tier="ultrafast",
)

print(response.output_text)
```

```
1
2
3
4
5
6
7
8
9
10client := openai.NewClient()
response, err := client.Responses.New(context.Background(), responses.ResponseNewParams{
	Model:       "gpt-6-astra",
	ServiceTier: responses.ResponseNewParamsServiceTierUltrafast,
	Input:       responses.ResponseNewParamsInputUnion{OfString: openai.String("Explain why the sky is blue in one sentence.")},
})
if err != nil {
	panic(err)
}
fmt.Println(response.OutputText())
```

```
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16import com.openai.client.OpenAIClient;
import com.openai.client.okhttp.OpenAIOkHttpClient;
import com.openai.models.responses.ResponseCreateParams;

ResponseCreateParams params =
    ResponseCreateParams.builder()
        .model("gpt-6-astra")
        .input("Explain why the sky is blue in one sentence.")
        .serviceTier(ResponseCreateParams.ServiceTier.ULTRAFAST)
        .build();

client.responses().create(params).output().stream()
    .flatMap(item -> item.message().stream())
    .flatMap(message -> message.content().stream())
    .flatMap(content -> content.outputText().stream())
    .forEach(text -> System.out.println(text.text()));
```

```
1
2
3
4
5
6
7
8
9
10
11require "openai"

client = OpenAI::Client.new

response = client.responses.create(
  model: "gpt-6-astra",
  service_tier: :ultrafast,
  input: "Explain why the sky is blue in one sentence."
)

puts(response.output_text)
```

```
1
2
3
4
5
6
7
8curl https://api.openai.com/v1/responses \
  -H "Authorization: Bearer $OPENAI_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "gpt-6-astra",
    "input": "Explain why the sky is blue in one sentence.",
    "service_tier": "ultrafast"
  }'
```

This example waits for the complete response. To display output as it arrives, enable [streaming](https://developers.openai.com/api/docs/guides/streaming-responses?api-mode=responses).

## Availability

GPT-6 Astra has the following default Ultrafast token rate limits:

| API usage tier | Tokens per minute (TPM) |
| --- | --- |
| Tiers 1–3 | 500,000 |
| Tier 4 | 1,000,000 |
| Tier 5 | 5,000,000 |

See the [Ultrafast pricing table](https://developers.openai.com/api/docs/pricing?latest-pricing=ultrafast) for input, cached input, cache write, and output prices.

Ultrafast supports US data residency and global processing only. It does not support EU or other non-US regional processing endpoints.
prodigycorp42
🟧 echo.blog ⭐"Ultrafast mode is the fastest service tier in the OpenAI API. It is broadly available for GPT-6 Astra, with preview access for GPT-5.6 Sol.OpenAIβ€”β€”
🟠 redditOpenAI announces ULTRAFAST mode (8x speed, 6x the price)
OpenAI
ethotopia2039
🟠 reddit"Ultrafast" mode for Astra 6 is 70tps for $300/m output
OpenAI
NandaVegg5818
🟠 redditNOW: OpenAI says GPT-6.1 Sol Ultrafast is coming soon
OpenAI
ryanmerket18918
🟠 redditUltrafast rolling out!
OpenAI
jeppa352129
🟧 hnOpenAI Rolls Out Ultrafast Mode for GPT-6.1 Sol at Up to 8x Speedwillmarch30
🟠 redditUltrafast, after "almost doubling the speed" and "50% faster" announcements
OpenAI
NandaVegg6211

Interpretation history

Decision trace