Ram Maheshwari Logo Image
Chunbo Li

Video Prediction Algorithm Design Based on Neural Networks

number of the team,12/2022-12/2023

Project Image

Project Overview

This picture is my final poster

Designed a survey, investigated the need to repair old videos or home movies, and clarified the technical development direction. Analyzed existing video frame interpolation technologies, simulated the similarity between adjacent frames using deep learning algorithms, predicted missing frames, combined traditional video interpolation algorithms with Generative Adversarial Networks (GANs), and incorporated diffusion model inference to reduce unnatural distortions.

Analyzed existing video frame interpolation technologies, simulated the similarity between adjacent frames using deep learning algorithms, predicted missing frames, combined traditional video interpolation algorithms with Generative Adversarial Networks (GANs), and incorporated diffusion model inference to reduce unnatural distortions.

Introduced diffusion inference blocks to enhance the semantic integrity of video frame generation, guided the network convergence using Lpips loss, performed ablation studies, and validated the effectiveness of each component.

Completed the algorithm design, wrote a report, won an award for the BJUT 2023 Spark Fund Excellent Project (24th Edition), and obtained a software copyright.

Achievement

Project Image \Project Image

Tools Used

Diffusion Models
pytorch
Transformer Blocks
Lpips Loss
Vimeo90K
UCF101