Research shows natural language benchmarks don’t measure AI models’ general knowledge well - Earth News Report
Transform 2020 Watch every session from our flagship AI event On Demand Watch Now Open-domain question-answering models — models theoretically capable of responding to novel questions with novel answers — often simply memorize answers found in the data on which they’re trained, depending on the data set. That’s the assertion of a team of researchers
