This demonstration shows the next five generations formed after a user input. The probabilities of output tokens indicate the likelihood of each token occurring in the sequence given the context. A high probability suggests a higher likelihood of the token in that context. This allows users to gauge the model's confidence in its output or explore alternative responses the model considered.
Input - Enter the start of a sentence or use one of the examples below and click Generate
Examples:
Output - Click the down arrow to view the probability each word was chosen, select a different word from the list to change the generation.
Reference
This application utilizes insights and code examples from the:
Model
OpenAI gpt-3.5-turbo