update filterlist about adblock2privoxy HOT 4 CLOSED

Those files are over 20 MB each, and the css directory structure is hundreds of MB. Every update and commit multiplies the size of the repo by that much.

GitHub repos are not a great way of hosting these filter lists.

I’m open to suggestions, but the simplest thing to do is just build and run adblock2privoxy locally.

from adblock2privoxy.

use ipfs https://github.com/ipfs/ipfs#readme

from adblock2privoxy.

ipfs still needs a server infrastructure to host files.

The filter files depend on user preferences for the easylist/adblock filters chosen.

This is a repo for software to convert easylist to adblock files, not update them or host select rule sets. That would be a great project for someone to take up, though.

from adblock2privoxy.

I figured out how to do this efficiently using git rebase. Latest files are in
461f265.

It's also worthwhile to update these example files to reflect the recent parsing fixes in adblock2privoxy.

Notes for the next time someone asks for updated files:

Delete the commit with the old files

1. Find the commit hash to be deleted:

git log --graph --oneline
It’s 1abcb29.

2. Confirm the first hash to be kept:

git log --oneline --reverse --ancestry-path 1abcb291^..master

3. Use rebase to delete the commit:

git rebase -i 1abcb291^

4. Comment out commit(s) to ignore with # at the line beginning.
5. Sanity check the the local repo has all the latest content by comparing it against the remote.
6. Force push to GitHub:

git push origin +master

Add a commit with the updated files

mkdir easylist privoxy css
( cd easylist ; echo "https://easylist.to/easylist/easyprivacy.txt  \
  https://easylist.to/easylist/easylist.txt  \
  https://easylist.to/easylist/fanboy-annoyance.txt  \
  https://easylist.to/easylist/fanboy-social.txt  \
  https://easylist-downloads.adblockplus.org/antiadblockfilters.txt  \
  https://easylist-downloads.adblockplus.org/malwaredomains_full.txt  \
  https://raw.githubusercontent.com/ryanbr/fanboy-adblock/master/fanboy-antifacebook.txt \
  https://raw.githubusercontent.com/Dawsey21/Lists/master/adblock-list.txt" | xargs -n 1 curl -O )
adblock2privoxy -p ./privoxy -w ./css -d 127.0.0.1:8119 ./easylist/*.txt
git add easylist privoxy css
git commit -am 'Update easylist, privoxy, and css rule files and directories'
git push origin master

I'm going to keep this issue open because these examples will be perennially out of date.

from adblock2privoxy.