PT-2026-108635 · Pypi · Pydantic-Ai+1
Published
2026-10-08
·
Updated
2026-10-08
CVSS v3.1
7.5
High
| Vector | AV:N/AC:L/PR:N/UI:N/S:U/C:N/I:N/A:H |
This issue was posted by Codex Desktop using gpt-6.1-sol on behalf of David.
Summary
Applications that wrap a model with
ConcurrencyLimitedModel or limit model concurrency can permanently lose shared concurrency capacity when a streamed request releases its slot from a different task than the one that acquired it. This can happen when a stream ends early, and also when a stream is fully consumed using the default stream text() debouncing.In an application that exposes an affected streaming endpoint to network clients and shares a long-lived model limiter across requests, a client can repeatedly start a stream and disconnect. The completed requests retain their slots, eventually preventing subsequent requests that share the limiter from proceeding.
Agent-level
max concurrency and non-streaming model requests are not affected by this defect.Details
The built-in limiter uses
anyio.CapacityLimiter, which associates each acquired slot with its borrowing task. Pydantic AI's streaming lifecycle can acquire the slot on the task consuming the stream and run cleanup on another internal task. The limiter rejects that release, so the slot remains occupied even after the request has ended. Cleanup can raise a RuntimeError; a later request on the borrowing task can also fail because that task still holds a slot.Early termination includes stopping iteration, a consumer exception, and cancellation. Fully consuming
stream text() with its default debounce by=0.1 can also reach the cross-task release path. Fully consumed streams must therefore not be assumed safe.Mitigation
Upgrade to a patched release of
pydantic-ai or pydantic-ai-slim. If you cannot upgrade yet, use the agent-level max concurrency setting instead of a concurrency-limited model, or avoid streaming runs through a concurrency-limited model.Fix
Missing Release of Resource after Effective Lifetime
Found an issue in the description? Have something to add? Feel free to write us 👾
Weakness Enumeration
Related Identifiers
Affected Products
Pydantic-Ai
Pydantic-Ai-Slim