Back to the Glossary

Inference & RAG

Streaming

A way of showing a model's answer word by word as it is being generated, instead of waiting for the full response.

More in the same category

Inference RAG (Retrieval-Augmented Generation)Vector Database Semantic Search Chain of Thought Prompt Engineering

Browse the full glossary