Seesaw script for Archive Team's Xanga grab: http://www.archiveteam.org/index.php?title=Xanga
The dashboard for this grab is http://tracker.archiveteam.org/xanga/
If you are not familiar with Archive Team grabs: this program repeatedly grabs a user from the tracker, downloads them via HTTP, then uploads the compressed archive to a collection server.
The IRC channel for this grab is #jenga on efnet.
To run this outside the warrior:
(Ubuntu / Debian 7)
sudo apt-get update
sudo apt-get install -y build-essential lua5.1 liblua5.1-0-dev python python-setuptools python-dev git-core openssl libssl-dev python-pip rsync gcc make git screen
pip install --user seesaw
git clone https://github.com/ArchiveTeam/xanga-grab
cd xanga-grab
./get-wget-lua.sh
# Start downloading with:
screen ~/.local/bin/run-pipeline --disable-web-server --concurrent 3 pipeline.py YOURNICKNAME
(Debian 6)
sudo apt-get update
sudo apt-get install -y build-essential lua5.1 liblua5.1-0-dev python python-setuptools python-dev git-core openssl libssl-dev python-pip rsync gcc make git screen
wget --no-check-certificate https://pypi.python.org/packages/source/p/pip/pip-1.3.1.tar.gz
tar -xzvf pip-1.3.1.tar.gz
cd pip-1.3.1
python setup.py install --user
cd ..
~/.local/bin/pip install --user seesaw
git clone https://github.com/ArchiveTeam/xanga-grab
cd xanga-grab
./get-wget-lua.sh
# Start downloading with:
screen ~/.local/bin/run-pipeline --disable-web-server --concurrent 3 pipeline.py YOURNICKNAME
(CentOS / RHEL / Amazon Linux)
sudo yum install lua lua-devel python-devel python-distribute git openssl-devel rsync gcc make screen
wget --no-check-certificate https://pypi.python.org/packages/source/p/pip/pip-1.3.1.tar.gz
tar -xzvf pip-1.3.1.tar.gz
cd pip-1.3.1
python setup.py install --user
cd ..
~/.local/bin/pip install --user seesaw
git clone https://github.com/ArchiveTeam/xanga-grab
cd xanga-grab
./get-wget-lua.sh
# Start downloading with:
screen ~/.local/bin/run-pipeline --disable-web-server --concurrent 3 pipeline.py YOURNICKNAME
For more options, run:
~/.local/bin/run-pipeline --help
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent