Physion: Evaluating Physical Prediction from Vision in Humans and Machines

picture 1

People excel at understanding their physical environment. How do they compare to state-of-the-art neural networks? To test this, we developed a large dataset of physical interactions and used it to compare human and AI physical scene understanding: Physion.