Reproject lecture slides onto a screen in a low resolution lecture video as a superresolution tactic
- Use MiVOS (CVPR 2021) to interactively define as many parts as needed to capture all speaker silhouette/shadow segments in the LR video
- Use SIFT (OpenCV/Kornia) for registration of known HR slide images
- Use Blender to reproject (as in this example)
- Instead of reprojecting video, possible to play the video under a masked image somehow?
- Since the slides are unchanging, do not create a video sequence (expensive), instead overlay them where unobscured using a mask (e.g. SVG surely has such a feature?)
- Do not want to end up converting PDF to HTML
- For higher quality videos it'll be preferable to upsample to HD video rather than have an experimental SVG overlay interface (simpler to upload to YouTube than manage) although if this worked well it would no longer require YouTube and permit self-host