stevie-ray / referrer-spam-blocker Goto Github PK
View Code? Open in Web Editor NEWApache, Nginx, IIS, uWSGI, Caddy & Varnish blacklist + Google Analytics segments to prevent referrer spam traffic 🤖
License: MIT License
Apache, Nginx, IIS, uWSGI, Caddy & Varnish blacklist + Google Analytics segments to prevent referrer spam traffic 🤖
License: MIT License
Hi, Stevie-Ray.
Please, review a new candidate: santasgift.ml
Dear developers,
my question is about the upgrade from Apache 2.2 to Apache 2.4.
The code:
<IfModule mod_setenvif.c>
SetEnvIfNoCase Referer yougetsignal.com spambot=yes
....
Order allow,deny
Allow from all
Deny from env=spambo
</IfModule>
cause an error in apache2ctl configtest
:
AH00526: Syntax error on line XXX of /etc/apache2/sites-enabled/XXXX.conf:
Invalid command 'Order', perhaps misspelled or defined by a module not included in the server configuration
Action 'configtest' failed.
The Apache error log may have more information.
According to the official page, the directives must be updated.
http://httpd.apache.org/docs/2.4/upgrading.html
How can I adapt the directive to Apache 2.4 sintax?
This rule https://github.com/Stevie-Ray/htaccess-referral-spam-blacklist-block/blob/master/referer-spam.conf#L4 actually prevents access from **any site except them spammers" one
Hello!
Thanks a lot for sharing this.
I have just added a new entry noticed in my GA:
copyrightclaims.org
It seems env=spambot is not set and the deny rules do nothing? There are jut the rewrite condtitions but no rewrite rule which sets the variable.
se2-ptk
traffic2cash.xyz
Just had this one appear in Google Analytics:
Hi guys, please add this one: black-friday.ga
Hi,
azlex.uz
pozdrawleniya.ru
pornophoto.xyz
zdesoboi.com
sad-torg.com.ua
office-windows.ru
vykupavto-krasnodar.ru
It seems like the regular expression of video-production.com ist wrong. I have resolved this issue on my server by removing this line, but perhaps you like to fix it in your own code.
This is from my apache-log:
[Mon Aug 17 11:26:05 2015] [alert] [client xx.xx.xx.xx] /var/www/vhosts/....../httpdocs/.htaccess: RewriteCond: cannot compile regular expression '^http(s)?://(www.)?.video--\production.com.$'
I think it should be like this (look at backslashes):
^http(s)?://(www.)?._video\-\-production.com._$
I have these domains in GA list:
share-buttons.xyz
traffic2cash.xyz
с.новым.годом.рф
website-stealer-warning.hdmoviecamera.net
website-stealer.nufaq.com
build-a-better-business.2your.site
topseoservices.co
Are they spam ? Ublock block me to visit all these sites.
I had a potential client from Fiverr visiting my website and getting blocked thanks to your config 👎
It should not be blocking referrs from fiverr.com
It blocks visitors from fiverr.com
Offending line: should be removed:
` "~*fiverr.com" 1;
Send link to your website where this configuration is enabled from within Fiverr.com private conversation.
Hi!
They are a syntax error in line 94:_burger-imperia.com
"
must be
"~_burger-imperia.com" 1;
porodasobak.net
replicaclub.ru
dimkino.ru
flooringinstallation-edmonton.com
sad-torg.com.ua
pornoklad.net
e-collantes.com
keywords-monitoring-success.com
zvetki.ru
solitaire-game.ru
woman-orgasm.ru
euronis-free.com
sygraem.com
zaim-pod-zalog-krasnodar.ru
vesnatehno.com
iqoption-bin.com
pornoblood.com
ideibiznesa2015.ru
fix-website-errors.com
biznesluxe.ru
Hi,
I have a 500 server error with yout mod_rewrite list :-(
rankings-analytics.com
siteevaluation.com s
mir-betting
salutmonreal.com
xn----7sbho2agebbhlivy.xn--p1ai
burger-impria.com
clicksor
referral from snip.to
success-seo.com
videos-for-your-business.com
fcp.intermesh.net
pizza-tycoon.com
blackle.com
jwss.cc
nate.com
traffic2money.com
Hi guys, please, add alibestsale.com
to the list. Thank you!
videochat.tv.br
mylida.org
video-chat.in
laudit.ru
buy-cheap-pills-order-online.com
biznesschat.net
Another four to add to the list:
Would be nice if you could generate also a varnish version of the blacklist.
Here is my gist:
https://gist.github.com/jithujose/402565c82cbc75e94f005f50fd03c674
As a Mac OSX user it's too much to do manually, can somebody please run the generator and do a pull request..
see commit: c95e18f
Thanks, Stevie
Hi,
I'm trying to use your htaccess to block referral spam.
I have the following problem
If I add to my htaccess the below part of the code I get a 500 internal server error. The rest works fine
Can you help?
SetEnvIfNoCase Referer 4webmasters.org spambot=yes
SetEnvIfNoCase Referer 7makemoneyonline.com spambot=yes
SetEnvIfNoCase Referer acunetix-referrer.com spambot=yes
SetEnvIfNoCase Referer adcash.com spambot=yes
SetEnvIfNoCase Referer advokateg.com spambot=yes
SetEnvIfNoCase Referer advokateg.ru spambot=yes
SetEnvIfNoCase Referer baixar-musicas-gratis.com spambot=yes
SetEnvIfNoCase Referer best-seo-offer.com spambot=yes
SetEnvIfNoCase Referer best-seo-solution.com spambot=yes
SetEnvIfNoCase Referer bestwebsitesawards.com spambot=yes
SetEnvIfNoCase Referer blackhatworth.com spambot=yes
SetEnvIfNoCase Referer buttons-for-website.com spambot=yes
SetEnvIfNoCase Referer buttons-for-your-website.com spambot=yes
SetEnvIfNoCase Referer buy-cheap-online.info spambot=yes
SetEnvIfNoCase Referer cenokos.ru spambot=yes
SetEnvIfNoCase Referer cenoval.ru spambot=yes
SetEnvIfNoCase Referer cityadspix.com spambot=yes
SetEnvIfNoCase Referer darodar.com spambot=yes
SetEnvIfNoCase Referer descargar-musicas-gratis.com spambot=yes
SetEnvIfNoCase Referer econom.co spambot=yes
SetEnvIfNoCase Referer edakgfvwql.ru spambot=yes
SetEnvIfNoCase Referer event-tracking.com spambot=yes
SetEnvIfNoCase Referer fbdownloader.com spambot=yes
SetEnvIfNoCase Referer forum20.smailik.org spambot=yes
SetEnvIfNoCase Referer free-share-buttons.com spambot=yes
SetEnvIfNoCase Referer free-social-buttons.com spambot=yes
SetEnvIfNoCase Referer googlsucks.com spambot=yes
SetEnvIfNoCase Referer gobongo.info spambot=yes
SetEnvIfNoCase Referer guardlink.org spambot=yes
SetEnvIfNoCase Referer hulfingtonpost.com spambot=yes
SetEnvIfNoCase Referer humanorightswatch.org spambot=yes
SetEnvIfNoCase Referer iedit.ilovevitaly.com spambot=yes
SetEnvIfNoCase Referer ilovevitaly.com spambot=yes
SetEnvIfNoCase Referer ilovevitaly.co spambot=yes
SetEnvIfNoCase Referer ilovevitaly.info spambot=yes
SetEnvIfNoCase Referer ilovevitaly.org spambot=yes
SetEnvIfNoCase Referer ilovevitaly.ru spambot=yes
SetEnvIfNoCase Referer iskalko.ru spambot=yes
SetEnvIfNoCase Referer lomb.co spambot=yes
SetEnvIfNoCase Referer luxup.ru spambot=yes
SetEnvIfNoCase Referer make-money-online.7makemoneyonline.com spambot=yes
SetEnvIfNoCase Referer maps.ilovevitaly.com spambot=yes
SetEnvIfNoCase Referer myftpupload.com spambot=yes
SetEnvIfNoCase Referer net.hts.ru spambot=yes
SetEnvIfNoCase Referer offers.bycontext.com spambot=yes
SetEnvIfNoCase Referer o-o-6-o-o.ru spambot=yes
SetEnvIfNoCase Referer o-o-6-o-o.com spambot=yes
SetEnvIfNoCase Referer o-o-8-o-o.ru spambot=yes
SetEnvIfNoCase Referer priceg.com spambot=yes
SetEnvIfNoCase Referer resellerclub.com spambot=yes
SetEnvIfNoCase Referer responsinator.com spambot=yes
SetEnvIfNoCase Referer ?????.?? spambot=yes
SetEnvIfNoCase Referer savetubevideo.com spambot=yes
SetEnvIfNoCase Referer screentoolkit.com spambot=yes
SetEnvIfNoCase Referer semalt.com spambot=yes
SetEnvIfNoCase Referer seoexperimenty.ru spambot=yes
SetEnvIfNoCase Referer shopping.ilovevitaly.ru spambot=yes
SetEnvIfNoCase Referer simple-share-buttons.com spambot=yes
SetEnvIfNoCase Referer slftsdybbg.ru spambot=yes
SetEnvIfNoCase Referer socialseet.ru spambot=yes
SetEnvIfNoCase Referer social-buttons.com spambot=yes
SetEnvIfNoCase Referer srecorder.com spambot=yes
SetEnvIfNoCase Referer st3.cwl.yahoo.com spambot=yes
SetEnvIfNoCase Referer superiends.org spambot=yes
SetEnvIfNoCase Referer theguardlan.com spambot=yes
SetEnvIfNoCase Referer vodkoved.ru spambot=yes
SetEnvIfNoCase Referer websocial.me spambot=yes
SetEnvIfNoCase Referer www1.social-buttons.com spambot=yes
SetEnvIfNoCase Referer www.Get-Free-Traffic-Now.com spambot=yes
SetEnvIfNoCase Referer ykecwqlixx.ru spambot=yes
SetEnvIfNoCase Referer yougetsignal.com spambot=yes
Hi all,
this is hitting my e-commerce site
site8441136.snip.tw
it is spam?
Few more for the list:
Hi all,
it seems that from Russia in the recent days are making party spam .... ;)
I had new hits from
istock-mebel.ru
ifirestarter.ru
avtocredit-legko.ru
woman-h.ru
forum.tvmir.org
foxinsocks.ru
vykup-avto-krasnodar.ru
creditmoney.com.ua
fm-upgrade.ru
money-every-day.com
runovschool.ua
gsmtlf.ru
KR
Boris
I am not a mod_rewrite specialist, but is it normal that the zverokruh line does not contain an OR condition?
RewriteCond %{HTTP_REFERER} ^http(s)?://(www.)?._zazagames.org._$ [NC,OR]
RewriteCond %{HTTP_REFERER} ^http(s)?://(www.)?._zverokruh-shop.cz._$ [NC]
RewriteCond %{HTTP_REFERER} ^http(s)?://(www1?.)?.social-buttons.com.$ [NC,OR]
New
https-legalrc.biz
ordernorxx.com
biznesluxe.ru
mrwhite.biz
linerdrilling.com
fix-website-errors.com
finteks.ru
styro.ru
woman-orgasm.ru
iqoption-bin.com
flooringinstallation-edmonton.com
ideibiznesa2015.ru
pravoholding.ru
vashsvet.com
shopvilleroyboch.com.ua
mmog-play.ru
vgoloveboli.net
kupit-adenu.ru
pravoholding.ru
linerdrilling.com
pron.pro
shopvilleroyboch.com.ua
dnepr-avtospar.com.ua
saitevpatorii.com
vesnatehno.ru
alveris.ru
wedding-salon.net
wallpapersdesk.info
letolove.ru
muz-baza.net
positive2b.ru
zajm-pod-zalog-nedvizhimosti.ru
djonwatch.ru
hd720kino.ru
kinobaks.com
itbc.kiev.ua
remontgruzovik.ru
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai
abiente.ru
xboxster.ru
most-kerch.org
videochat.mx
rumamba.com
kw21.org
I copied the regex spam rewrites from your .htaccess file to mine hosted on my Apache server, replacing the far more limited list I had already in my .htaccess file. However, now I get an internal server error when I upload the updated .htaccess file to my server. When I remove the added spam rewrites, I can access again.
Server error says: "The server encountered an internal error or misconfiguration and was unable to complete your request" Any ideas?
Hi,
social-widget.xyz
net-profits.xyz
are new spam?
B.
Hi all,
it seems that the below links are in someway spamming.....
vilingstore.net
znaniyapolza.ru
womensplay.net
den-noch24.ru
runstocks.com
lego4x4.ru
carsnumber.com
vpnhowto.info
runstocks.com
all4invest.ru
the above sites are mainly from Russia and don't have any relationship with the one I have up. I have a mean value of 10 hits/day from each one.
Thank you
B.
Another one for the list:
Hi, Just tried the latest version (180+) and received a 500 error
Anything I should be looking for?
sorry
Hello everyone!
Today I noticed a new kind of referral spam in my Google Analytics account. It uses the parameter Landing Screen and provides a spammer's URL in it.
Has anyone else already encountered this?
P.S. I hope, I use the correct function to share my message. I am new to github, so please let me know, if creating an issue was wrong.
Hi I found many hits from
keywords-monitoring-your-success.com
can be the case to add it? I suppose a crawl spam type
KR
Boris
You can also add the following:
keywords-monitoring-your-success.com
free-video-tool.com
Thanks
It might be nice to include the latest date or a version number as a comment at the top of the lists. It will make keeping track of updates/changes quite a bit easier when updating the list on multiple hosts.
I.E. # Updated 2015-10-05
Thoughts?
kw21.org
zahvat.ru
betonka.pro
videochat.mx
regionshop.biz
wedding-salon.net
video-chat.in
td-33.ru
mylida.org
alveris.ru
xn----7sbaphztdjeboffeiof6c.xn--p1ai
obuv-kupit.ru
ustion.ru
mmog-play.ru
firma-legion.ru
remontgruzovik.ru
itbc.kiev.ua
djonwatch.ru
biznesschat.net
velobikestock.com
video-chat.in
betonka.pro
currently generator works only on windows, i can't make it work on other OSes.
But i could write a php script that would work on all OSes, windows, mac, linux, but you would have to have a php installed to run it.
Or we could set up a travis CI to run the php script on incoming change that would generate those files zip them and put them into release.
Hi,
new in town.....
sexsaoy.com
inzn.ru
voloomoney.com
zastenchivosti.net
zdesoboi.com
homelygarden.com
KR
B.
I have a list of the top 50 spam that's being sent to one of our sites. I already have your script running on our client servers yet these guys make it through. I don't have a Windows machine to generate it myself. Could you add these to your list?
Seeing referrals from:
A quick Google suggests the number (topic) varies.
top1-seo-service.com/try.php
from semalt
Great job!
Is experiencing an error with the domain that uses special characters.
Syntax error on line 111 of /etc/apache2/httpd.conf:
RewriteCond: cannot compile regular expression '^http(s)?://(www\\.)?r????.??\\.*$'
Action 'configtest' failed.
The Apache error log may have more information.
I suggest removing this domain
https://github.com/Stevie-Ray/htaccess-referral-spam-blacklist-block/blob/master/.htaccess#L87
You can validate the file here: http://www.lyxx.com/freestuff/002.html
I suppose it is new spam
get-your-social-buttons.info
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.