Browse all
inference
712
#1·3h ago
Running a trained AI model to produce output. Training teaches the model; inference is every time you use it. Inference is what costs money per token.
"Our inference bill doubled after we shipped the AI search."
Comments (0)
No comments yet — say something.
Have a better definition?
Add your own interpretation of "inference".