Comments (9)
Welcome Peter!
There used to be such an option, but I've decided against it for a few reasons.
- If I commit large files directly to the repository, the repo's history grows exponentially, making it tedious for people to clone and contribute on slower connections. This is why I've opted to have releases, unlike other repositories. I'm also aiming to respect GitHub's resources and resource consumption.
- This list will get bigger before it gets smaller, and as it grows figuring out distribution becomes more complicated. This is why I've opted to just release archives of each type instead of specializing them to a specific platform. The specialization is rather trivial for an end-user and just gets more complicated for me.
- You can easily set up a bash script to download the archives w/ your choice utility and extract the archive: https://linuxize.com/post/how-to-create-and-extract-archives-using-the-tar-command-in-linux/#extracting-tar-archive
The links you see in the README release table are permanent, so you won't need to update them.
from black-mirror.
One thing I can do is make a build artifact that's a text file with all my sources on one line. This is a feature I didn't know about previously: https://discourse.pi-hole.net/t/how-to-add-blocklists-v5-and-later/32127
However, if I'm understanding correctly, finding duplicates may be a pain. It also hasn't been personally tested. Would this be something you're interested in?
from black-mirror.
Yes.
from black-mirror.
Hi,
Yes please this would be very helpful. I can check each list and see if they are all in hosts format and use the ones that are. Obviously as you say it would not be as efficient as yours without duplicates and if some are in other formats would not be possible to use but as a workaround would help especially if most work its better than nothing :)
Pete
from black-mirror.
Also not sure how you get the ipv4 blocklist but I also actually maintain one at https://github.com/pallebone/StrictBlockPAllebone if that srt of thing is of any interest to you and you wanted to take a look to see if it was of any interest. Sorry if thats not of interest just thought I would mention it in case :)
Pete
from black-mirror.
Adding the Spamhaus sources is on my TODO list since tracking them down required working around their paywall. Once those are in I suppose you can just use this project over yours and have it be updated daily. I'll add an issue detailing the build artifact and reference this issue.
from black-mirror.
@pallebone Enjoy your text release 😉
from black-mirror.
Ah thanks. Am I using this link here?
https://github.com/T145/the-blacklist/releases/latest/download/black_domain.txt
from black-mirror.
Just loaded it now, the list stats are:
[i] Target: https://github.com/T145/the-blacklist/releases/latest/download/black_domain.txt
[✓] Status: Retrieval successful
[i] Analyzed 9027498 domains
from black-mirror.
Related Issues (20)
- [feature]: Convert ATS to a Lychee GitHub task
- [feature]: Improve CIDR processing
- [feature]: Have a separate "corporate" designation for some list content
- [feature]: sources.adguard seems to be missing? HOT 2
- [bug]: Herrbischoff lists are not downloading during CI HOT 7
- [feature]: Back up lists to the Internet Archive HOT 3
- [feature]: Whitelist all list provider hosts
- [feature]: Source Suggestion: Jarelllama's Scam Blocklist HOT 3
- [bug]: Minor Awk regex bug when processsing schakal HOT 2
- [bug]: Youtube is blocked HOT 1
- [bug]: Wget refuses to log data
- [feature]: Use AGTree and custom code over Hostlist Compiler
- [feature]: Put IPv4 addresses embedded in IPv6 addresses into the IPv4 lists
- [feature]: Ensure any minimum allocation CIDR blocks get placed into a respective IP list
- [feature]: Move the list method to filters, so both methods can be used on the same list.
- [bug]: Fix Abuse.ch FeodoTracker and SSLBL IP lists
- [feature]: Block Blogspot & Tubmlr TLDs and ignore all subdomains to debloat the list.
- [bug]: GitHub messed up CI, so we'll just wait on a fix for now
- [bug]: Windscribe downloads are being blocked HOT 1
- [feature]: Categorize the domain list into unique topics for V2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from black-mirror.