New frame rate up-conversion based on foreground/background segmentation

Frame rate up-conversion (FRUC) increases the quality of a video by increasing its temporal frequency. Motion compensated and non-motion compensated frame rate up conversion techniques make up the two main classes of techniques used in this area. Halo artifacts and jaggy edges cause the quality of video to be reduced both subjectively and objectively in these techniques. In this paper, we introduce a new method of motion compensated FRUC that uses foreground background segmentation to address these problems. In typical motion compensated FRUC, motion vectors of existent frames are scaled to define the motion vectors of interpolated frames. In the proposed method, those pixels of an interpolated frame with no unidirectionally assigned motion vectors are assigned motion vectors by interpolation based on known motion vectors of their neighbors and their foreground or background identity. The proposed method significantly improves the video quality and yields better PSNR results than the methods of [1] and [2].