Abstract
By a News Reporter-Staff News Editor at Robotics & Machine Learning Daily News Daily News – According to Jose Hernandez Orallo, a researcher at the Valencian Institute for Research in Artificial Intelligence (V RAIN) of the UPV and ValgrAI, one of the main concerns about the reliability of language models is that their performance does not match the human perception of task difficulty. In other words, there is a mismatch between expectations that the models will fail based on human perception of task difficulty and the tasks on which the models fail. ‘Models can solve certain complex tasks in line with h uman abilities, but at the same time, they fail on simple tasks in the same doma in. For example, they can solve several PhD-level mathematical problems. Still, they can get a simple addition wrong,’ notes Hernandez-Orallo.
NETL
NSTL