Sony Patents Machine Learning Frame Extrapolation Technique (Frame Generation with Minimal Additional Lag)

A Sony patent describes an auto encoder model that takes previous frames, motion vectors and user input to generate the next frame before a new one is rendered. This resembles frame generation, but frame generation requires the next frame to already be rendered, which creates inevitable lag. Frame extrapolation is much harder to get right and is not available even on PC as of now.