Git Product home page Git Product logo

pycon2015-steve-example's Introduction

pycon2015-steve-example

This repo has the contents of the directory where I did work to push pycon2015 videos to the pyvideo pycon2015 category.

Currently steve uses vidscraper to scrape youtube, and that doesn't work with channels or playlists. We've not had time to change steve to rework it yet, and in the meantime I have some one-off youtube script that I use to grab json data. Once I have that, I use parts of steve to save the data to json files so that I can finish the process by using steve's command line interface.

For this example,

  • I used the pyvideo.org admin to add a new category, PyCon US 2015. (this is not in the API)
  • I tweaked things to massage the title, description, and speaker data from the PyCon2015 channel
  • I used steve-cmd webedit to change a few titles (I found that I forgot about Lightning talks)
  • and then I used steve-cmd push to push things to pyvideo.
  • At the admin, I toggled everything from draft to live.
  • I still had some names and titles to edit in pyvideo.org, when I noticed some dedups and some titles that could be improved -- I usually notice these when I'm watching some videos. For example, I corrected Titus Brown to C. Titus Brown, lvh to his full name, Vanderplas to VanderPlas, etc.
  • When I watch videos and see find useful links that relate to the talks, I add those by hand. (this is not in the API)

Observations

When Carl has done events, adding the videos happens a lot quicker and we get more metadata because he has scripts and a webapp that links up the schedule data from a conference with the location of the videos on youtube (or vimeo, etc.) along with downloadable files (because he also pushes them to Rackspace cloudfiles and/or archive.org).

I'd like for people who upload videos to a location to give me data like that because it's neat to include the longer descriptions -- I've managed to hack it up by hand in the past when I'm more deeply involved in a conference. For example for US SciPy 2014 I wrote some scripts to mesh together descriptions from the schedule with the scraped youtube data because I was able to add a json api to the conference site to extract the schedule data in a machine readable format. That was cool because the speakers had written really nice and detailed abstracts with graphs and images. I was also able to do something similar for EuroPycon once because I got similar data from their system (frab.xml from the conference system), and they had also followed a convention in linking up uploaded files with the schedule data so that I could include download links for the conference.

Re-scraping a channel when videos are added later is still painful. there is no graceful way to handle that.

pycon2015-steve-example's People

Contributors

codersquid avatar

Stargazers

 avatar  avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.