Git Product home page Git Product logo

backup_data's Introduction

Backup Data

Backup data from websites such as Facebook or Google Takeout. This can be extremely useful if you have a data cap from your ISP, but still wish to backup your data.

Easy/Automatic (using Terraform)

  1. Wait for Google Takeout or Facebook Downloads to finish processing
  2. ** Create your GPG public key
  3. Get the download link for each file you wish to download
  4. Create the required json file. Save the json in tf/data/data.json
  5. Follow the steps in the terraform doc

** Skip this step and leave the gpg_email value blank when running the script to avoid encryption before uploading

Hard/Manual

Steps to use:

  1. Wait for Google Takeout or Facebook Downloads to finish processing
  2. * Create the aws instance
  3. * Initialize the hard drive
  4. ** Create and import your GPG public key into the new ec2 virtual machine
  5. Get the download link for each file you wish to download
  6. Using the links found in the previous step, create the required json file
  7. Run the script
  8. Destroy or shut down the instance

* Can be skipped if starting from a previously shutdown ec3 instance

** Skip this step and leave the gpg_email value blank when running the script to avoid encryption before uploading

That's it! The script will go through all links and download the file to your Deep Archive S3 bucket

Taken and edited from https://gunargessner.com/takeout

backup_data's People

Contributors

jacobfrericks avatar

Stargazers

Kasper Zutterman avatar Gunar Gessner avatar

Watchers

James Cloos avatar  avatar Gunar Gessner avatar Kostas Georgiou avatar

backup_data's Issues

Links time out before they can be used

Specifically seen in Google takeout's links. They expire if not used in ~5 min. This is a problem if you have several files that need to be fixed.

Suggested using threading to download multiple links at once.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.