Git Product home page Git Product logo

paol-original's Introduction

PAOL: Presentations Automatically Organized from Lectures

Overview

Presentations Automatically Organized from Lectures (PAOL) is a lecture recording system that automatically and transparently captures all material presented. For years the University of Massachusetts Amherst recorded lectures and turned them into indexed presentations that include a video of the lecturer, a table of contents linked to different parts of the lecture, and an enlargement of whatever appeared on the computer screen or white board. The recordings were part of the Multimedia Asynchronous Networked Individualized Courseware (MANIC) project in the Research in Presentation Production for Learning Electronically (RIPPLES) laboratory. These presentations were always hand generated from videos captured by human operators because no method had been created that could automatically store the material presented and determine significant points that would make up the table of contents. PAOL was created to do just that. PAOL uses a device to capture the output of a lecturer's computer as it is sent to a projector. Computer vision techniques are then used to determine when significant changes occur and store an image of the material as well as the time when the change occurred. This capture technique works far better, identifying fewer insignificant changes than the best commercial system. Unlike many computer capture systems, PAOL uses image processing techniques to determine significance and is able to determine significant events and generate content from any application displayed on screen.

High-resolution cameras face the front of the lecture room and capture the entire white board space at 15 frames per second. Simple vision techniques are used to locate the lecturer in these frames and to extract a window that centers on the lecturer. These smaller frames are used to create a video of the lecturer. Vision techniques are also used on the images of the front of the room to remove the instructor from the scene in order to better capture material written on the white board. These images are processed to heighten the contrast and sharpness of what is written or drawn on the board. The board images are then analyzed to determine when material has been added, and selected images and the times they appear are saved. Though some similar work has been done with constrained aspect ratio white boards, none has attempted content capture over such large surfaces and with such varied lighting.

This material, with a soundtrack of the lecture, is sufficient to create an indexed presentation from the lecture that is similar to those previously produced by hand. No other system can capture and index material presented on both computer and white board. Also, no white board capture system has been shown to be as robust in accommodating poor lighting, changes in lighting conditions, and other variables.

paol-original's People

Contributors

timdrichards avatar

Stargazers

 avatar  avatar

Watchers

 avatar Stefan Valentin avatar Ryan Szeto avatar Simon avatar  avatar  avatar  avatar

paol-original's Issues

Add front splash page to Lecture-Viewer

Add a front splash page to lecture viewer. The splash page should describe the system a little bit (we can collectively come up with the description), a logo for UMass and UMass School of Computer Science, and a list of the available semesters. The semesters should be clickable links that will bring up a list of available course numbers & titles. Hovering over a course should bring up the course description. The courses should be clickable links to the main interface. This issue is assigned to @khalilravanna, but the others involved are @genericapplesauce and @ColinDiederich. This may be slightly dependent on getting the previously captured data in the right place on http://present.cs.umass.edu - this is the responsibility of @timdrichards.

Install scripts

Ensure that install scripts are working correctly - that is, they are installing the correct software on latest ubuntu.

Scripts for recording/capturing on cap14x

Create scripts for recording/capturing on cap14x. They will need to also create the right directory structure that is required by the processing component. Look at the previous semesters directory layout to know what this looks like. I believe @pauled also may have created part of these scripts already.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.