Running a trained model to get an answer. The everyday act of using AI.
Why it mattersTraining is a one-off cost. Inference is the bill that arrives every month.
See also Latency, Pre-training
Inference
Running a trained model to get an answer. The everyday act of using AI.
Explore more AI terms
Browse the full glossary for plain-English definitions across models, agents, data, and safety.
Back to all terms