Capital de TokensA 93.1% score on an enrollment: what did OpenAI actually measure?
Watch on YouTube According to NeuralBrew, OpenAI introduced an internal evaluation called LifeVal on November 2 and says it has been using it for a year to track and improve its models. And what do we know about the enrollment result? OpenAI shows a score of 93.1 percent. It is one of the selected figures reported in the arti
According to NeuralBrew, OpenAI introduced an internal evaluation called LifeVal on November 2 and says it has been using it for a year to track and improve its models. And what do we know about the enrollment result? OpenAI shows a score of 93.1 percent. It is one of the selected figures reported in the article, but we do not know how that task was graded or what steps the model followed. What is the difference between evaluating an assistant’s answer and evaluating an entire task? Let’s consider the question LifeVal poses. A chatbot could respond with advice about enrollment. The evaluation tries to go beyond that answer and measure an action carried through to completion. In this case, the outcome specified by the task is to enroll the child in the appropriate preschool after moving. Yes. That is the description we have. The article does not allow us to reconstruct how the specific test was conducted.
Full episode: https://youtu.be/bdmh-NfiHh0
🤖 AI-generated content: the script, voices, and images in this episode were produced using artificial intelligence tools.
#Shorts