Sending the response token by token as it's generated instead of waiting for the whole thing.
Why it mattersSame total time, far better experience. Users watch progress rather than a spinner.
Streaming
Sending the response token by token as it's generated instead of waiting for the whole thing.
Explore more AI terms
Browse the full glossary for plain-English definitions across models, agents, data, and safety.
Back to all terms