Files
tracy/profiler
Bartosz Taudul afe249b6d3 Do not disconnect active connections.
The timeout option stops the connection if it has now finished after the
specified time, even if data transfer is underway. Switch to using a low
speed timeout instead, which stops the connection only if no data is being
transferred.

A typical case where this was hit was a slow-responding LLM generating
a large amount of text.

The high timeout value is still needed to account for long prefill times.
2026-07-21 23:53:01 +02:00
..
2026-07-21 16:42:33 +02:00
2026-07-21 23:53:01 +02:00
2024-09-26 16:21:16 +02:00
2024-03-21 23:04:38 +01:00
2026-07-21 16:42:33 +02:00