AI glossary

What is Streaming?

Sending a model's response in small pieces as it's generated, usually via Server-Sent Events, so users see text immediately.

Streaming improves perceived latency. Your code must assemble the deltas, track the stop reason, and handle dropped connections.

Related terms