Guides  /  Cost and scale

Why do agent costs rise faster than agent traffic?

Answer

One agent request crosses eight separately metered services, and each of them prices a different unit of that request. Doubling traffic doubles every one of those meters at once, along with the egress charged for moving data between them.

Akka runs agents, orchestration, memory, streaming, endpoints, guardrails, evaluations, training, and inference on shared compute. One request is one unit of consumption, and the invoice is billed on platform tier and service cores.

The mechanism

A single request is metered by every service it crosses.

An agent request does not stop at the model. Orchestration, memory reads and writes, streaming, the gateway, telemetry and the safety check all happen on the way. On a stack assembled from separate cloud services, each of those steps belongs to a service with its own price list.

one requestPER-SERVICE STACKtokenstepqueryunitcallGBcallGBinference · orchestration · memory · streaming · gateway · observability · safety · egressbilled eight timesONE RUNTIMEshared computeagents · memory · streaming · endpointsbilled once
The billing units

Each service prices a different unit of the same request.

Model inferencePriced per token, so a longer conversation costs more on the same question.
Agent orchestrationPriced per execution step or per invocation. An agent that takes more steps costs more to run.
Memory and statePriced per query plus storage, at 150 to 200ms a round trip. A multi-step turn pays on every read and every write.
Event streamingPriced per throughput unit. Capacity is provisioned ahead of the traffic and bought before it is used.
API gatewayPriced per call, on every request that enters and every callback that returns.
ObservabilityPriced per gigabyte ingested. Agent traces are large, and volume rises with the steps each run takes.
Content safetyPriced per call and billed separately from inference, so a guarded response carries two charges.
Inter-service egressPriced per gigabyte moved between the services above. The charge exists because the services are separate.
What compounds

Headroom is provisioned separately for every service.

Each service in that stack is sized on its own, and each carries headroom so it does not become the constraint. Headroom is provisioned eight times over, and the amount held grows with the deployed base.

Shared compute removes the separate meters. Memory, streaming, observability and governance are properties of the Akka runtime, so none of them carries a line of its own. No data moves between services that would charge for the move. The infrastructure cost reduction reaches 90%. Fox shrank its AI personalization engine from 150,000 cores to 22,000 after porting to Akka.

Questions

Related questions.

Does an Enterprise Agreement or a volume tier fix this?

An Enterprise Agreement and a volume tier both lower the rate charged by each service. The number of services a request crosses stays the same, so the bill still grows on eight meters at once.

Which charge grows at the highest rate?

Growth follows the shape of the agent. A multi-step agent adds orchestration steps and memory queries faster than it adds tokens. A long-conversation agent adds tokens faster than it adds steps, because the whole history is re-sent on every call.

Does moving to open-weight models remove this?

Open-weight models change the token line. Orchestration, memory, streaming, the gateway, observability, safety and egress are billed by the services that provide them, and none of those charges depends on which model was called.

Where does the 90% reduction come from?

The reduction comes from shared compute, sub-10ms memory native to the runtime, scale-to-zero, the removal of inter-service egress, and evaluation, guardrails, observability and governance built into the platform.

On Akka. Shared compute and the billing model are described on the efficiency page. Billing units. Taken from the published pricing pages for AWS Bedrock and AgentCore, Azure AI Foundry, and Google Vertex AI, read 2026. Customer figures. Fox results are reported by the customer.