Git Product home page Git Product logo

pihole-stuff's Introduction

pihole-stuff

An ever-evolving blocklist of ads, analytics, tracker, and other domains. Artisinally crafted - attempting to find and include "new" domains that have yet to be added in the default Ublock Origin list(s) or in other popular hosted blocklists.

Add the following link to your pi-hole adlists management config or other blocklist setup: https://raw.githubusercontent.com/RooneyMcNibNug/pihole-stuff/master/SNAFU.txt

If you run into a problem loading critical elements of a page due to a domain being included within this blocklist, please submit an issue and I will tend to it as soon as possible.

One of the more painful illustrations conveying just how massive the user-targeting industry has become. At least it helps with discovering new domains to enumerate for the blocklist.

A compilation of lists I use within different environments, sorted by "type".

A few poorly cobbled together .py scripts to find possible URLs to add to the blocklist.

A quick configuration for a recursive Unbound DNS server running on the same machine as pi-hole. As noted, Unbound creates a more comprehensively private alternative to relying on trusting third-party authorities, and pairs very well with pi-hole ad/tracker blocking.

A Terraform and Ansible-powered deployment of a Wirehole VPN (equipped with Pi-Hole blocking) for DigitalOcean.

Buy Me A Coffee

pihole-stuff's People

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

pihole-stuff's Issues

Invalid domains

Hello
The following have invalid/illegal characters in them and should be cleaned up

upload.zoined.com<
rubikloud.com<>www.rubikloud.com
my.ciradar.com<>www.my.ciradar.com
offers.ciradar.com<>www.offers.ciradar.com
learn.smartly.io<>www.learn.smartly.io
beta.narvar.com<>www.beta.narvar.com
storehippo.com<>www.storehippo.com

typos

could you please fix the following two typos/non valid domain in your list?

[-] Total Unique Subdomains Found: 77
wealthfidelitylimited,cin

centinelapi.cardinalcommerce.com

centinelapi.cardinalcommerce.com

This appears to be used for 3DS2 secure to verify card payments. Was unable to progress with a card payment on Asda's website due to this.

Unsure what else it may be used for but being able to verify 3DS2 payments seems fairly integral to being able to browse.

False Positive - Podcast URL

For some podcast apps appear to use traffic.megaphone.fm to provide content delivery. If this URL is blocked then some podcasts will fail to play or load.

There are two other URL's that are very similar but do not look to break any functionality those being www.traffic.megaphone.fm and u002ftraffic.megaphone.fm. So those do NOT need to be removed.

It can be replicated on the podcast app 'sodes on iOS and the podcast Darknet Diaries. There are other podcasts that use that URL and others that do not. That is just one I know uses it.

This is on the SNAFU.txt list.

sephora.narvar.com

sephora.narvar.com is on this list inherited from tracking.narvar.com.

Possible analytical tracking(?), Narvar is a shipping/delivery platform for business to consumer. Curious to see if this intended, or if there's tracking behind the scenes from this provider?

affinity.serif.com

This is a graphic design software website blocked by the SNAFU list. I can understand the email subdomain being blocked but I'm not sure why their main website is.

carto.com

Hi

I noticed I had to selectively allow dhhs.carto.com and gusc.ep.carto.com which are similar to Google Maps.
Is it a false positive or is it expected ?

Thanks

sockjs.pusher.com

I saw sockjs.pusher.com in my blocked query logs, and I was wondering whether this is a FP or not. It looks like a service used for push notifications, chat, etc. (see https://pusher.com), but I'm unsure whether it is blocked for being a tracking domain/some other reason.

target.scene7.com

Blocking this breaks the Target store's iOS app, none of the images will load.

rogers.lithium.com

This site is required for communityforums.rogers.com , a forum for Rogers ISP subscribers.
Thanks!

Sidenote: yours seems to be the only blocklist out of the 450 I am using blocking these lithium sites. Where did you get these domains from?

SNAFU: Please Remove the following URLs from the list

Hi,

Whilst trying to make bank payments today I was thwarted several times because the following domains are used by banks in the UK (possbily globally) to authenticate card payments online. I;ve whitelisted these domains in my PiHole setup, but for all theother out there it may be prudent to remove these domains from the SNAFU.txt block list:

  • authentication.cardinalcommerce.com
  • geoissuer.cardinalcommerce.com
  • geo.cardinalcommerce.com
  • writer.cardinalcommerce.com
  • centinalapi.cardinalcommerce.com

Thanks,

telephonyspamprotect-pa.googleapis.com

Hi,
This domain is needed for Android's telephone spam protect feature
While this domain is blocked, I recieved SMS spam texts that I did not get while it wasn;t blocked

Incorrect lines

Please check the line that holds
platform.twitter.com

This is what it looks like
api-glb-sjc.smoot.apple.comapi.acompli.netapi.mixpanel.comapi.segment.ioapi.twitch.tvapi.twitter.comapiservices.krxd.netapps.itunes.comas.jivox.com
as.jivox.comas.jivox.com
apple-finance.query.yahoo.comas.jivox.com
evs.jivox.comevs.jivox.com
playercdn.jivox.complayercdn.jivox.com
platform.twitter.complayercdn.jivox.com
pxl.jivox.compxl.jivox.com
creativescdn.jivox.com

There are several lines that have no breaks. And playercdn.jivox.com is listed multiple times.

Also I believe that platform.twitter.com should not be in this list. I had to whitelist it to avoid errors on mobile devices.

checkoutshopper-live.adyen.com required for steam-store purchase

I've not had any issues buying games from the steam client before, but today when I tried, it errored out (claimed I had no internet connection) and when I checked my pihole logs the domain 'checkoutshopper-live.adyen.com' had been blocked.

Tried adding it to my whitelist, and then the purchase went through fine.

Having issues with google domain

Since the last few days I've been having issues watching Youtube videos on my phone.

I tracked it down to this blocklist, and the semanticlocation-pa.googleapis.com domaine.

Is that something that will get updated/fix, or that I need to disable from now on ?

similarly, with all variations of:
rX---sn-XXXXXXX.googlevideo.com , from a different blocklist.

Just trying to figure out what I should whitelist,
Thanks.

rtc-v2-ms1.bitrix24.com

Hello! If this domain is blocked then online chats based on Bitrix24 services don't work. Found out that while trying to consult in online shop website.

cdn.ravenjs.com

Can't access the login portal for my energy provider to pay and view my bills when cdn.ravenjs.com is blocked. Energy provider is https://www.reampedenergy.com.au/

Odd whitespace in entry

db6777d introduced the spurious line 2 script.crazyegg.com. I assumed this was illegal but Iโ€™m not an expert. Is it meant this way?

False Positive: prod-live-chat.sprinklr.com

prod-live-chat.sprinklr.com is used on sites such as samsung.com in order to open an online chat with product support. Suspect this service is used on the other sites too.

There are other sprinklr.com entries in the list, some of which may be non-tracking, however just the above needed allowing to enable the chat window to open.

kaymo75663.lithium.com

Hi Rooney
Thanks for the great list
Just reporting kaymo75663.lithium.com as a false positive
It is needed for community.teamviewer.com
It is not in any other blocklists but yours

Thanks !

pubnub.com

This is a real-time API to build engaging remote experiences using in-app chat, push notifications, etc
pubsub-rc.pubnub.com is a CNAME for ringcentral.pubnubapi.com which is RingCentral, a teleconferencing system
I dont believe blocking an API is a good idea. Rather, we should block malicious apps that may leverage an API.

image

api.usercentrics.eu

Hi there,

thank you for your work!

api.usercentrics.eu is needed so that the Andoid App "Flaschenpost" is working. Please have a look at it. :)

portal.fb.com

Hi,
I believe this is a domain for Facebook's Portal smart hub.
Yours seems to be the only blocklist in my adlist that is blocking this!
Are you sure its malicious?
Thanks!

False positive: dyncdn.me

Hi there,

I'm not quite sure if this was intentionally blocked, but the dyncdn.me is a cdn exclusive to the RARBG website and is used to load images and other site content.

dyncdn.me
www.dyncdn.me

Added in: 8132cf4#diff-782bcd5749cc4dfa54a652ad072dcf25R18989-R18992

You can verify this by visiting any of the RARBG mirrors:

  • rarbgproxy.org
  • rarbg.to
  • rarbgmirror.com

Note: RARBG is a popular and safe torrenting website.

If the dyncdn.me domain should not intentionally be blocked (as it does not classify under ads nor trackers), I'd like to ask to remove it from your list.

SNAFU invalid entries

Hello, thank you for your SNAFU list. I have found a few invalid entries that you might not be aware of:

Space in domain name:

  • profile- eu.exe.bid
  • http win.staticstuff.net
  • ipb0c .voluumtrk3.com
  • wood. www.ispot.tv
  • pearsonn rpush.cogocast.net
  • m e.maillist-manage.com

Leading -

According to rfc3696

If the hyphen is used, it is not permitted to appear at
either the beginning or end of a label.

  • -x3.vindicosuite.com

Leading .

You might have these entries in here on purpose. If so, please ignore.

  • .yieldoptimizer.com
  • .nemosys.ws.markmonitor.com
  • .pagefair.net
  • .qa2.la.razorfish.com

False positive -dns.msftncsi.com

dns.msftncsi.com is used by Microsoft Windows as part of it's Network Connectivity Status Indicator tests.

It is also used by some router manufactures.

Blocking of HPE content

The domain static.cloud.coveo.com serves content to Hewlett Packard Enterprise Support Center pages. If the URL is blocked only a white page is shown. Once whitelisted the rest of the game loads.

This URL is on the SNAFU list.

DL380p Gen8 Server Page To Test.

Please Remove Duplicate Lines

First, I am a human not a bot. A bot will not have the interest to send such a pull request.

The duplicates are easy to spot. Please copy all content starting from the Line 17 of SNAFU.txt to any online tool or offline editor.

I use https://www.somacon.com/p568.php

The result is here

https://pastebin.com/a2APKWaS

I cannot just past it here because Github reminds me of the issue 'There was an error creating your Issue: body is too long (maximum is 65536 characters). '.

track*.channelsight.com

Hi,
Regarding track*.channelsight.com
The above domain is invalid (assuming the SNAFU.txt file was not meant to use wildcards)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.