websnifferhq / websniffer Goto Github PK

web sniffer should support internationalized domain names (IDNs) in queries, e.g. for domains like:

• 英伟达.** ("xn--cpq367j69h.xn--fiqs8s" in encoded form)
• fußball.de (fussball.de)
• президент.рф ("xn--d1abbgf6aiiy.xn--p1ai" in encoded form)

tags: IDN, IDNA, Punycode

introduce a similar functionality like wheregoes dot com

e.g. nic.io

this might be the reason of the problem:

I strongly recommend, that you use

header($_SERVER["SERVER_PROTOCOL"]." 404 Not Found");

instead of

header("HTTP/1.1 404 Not Found");

I had big troubles with an Apache/2.0.59 (Unix) answering in HTTP/1.0 while I (accidentially) added a "HTTP/1.1 200 Ok" - Header.

Most of the pages were displayed correct, but on some of them apache added weird content to it:

A 4-digits HexCode on top of the page (before any output of my php script), seems to be some kind of checksum, because it changes from page to page and browser to browser. (same code for same page and browser)

"0" at the bottom of the page (after the complete output of my php script)

It took me quite a while to find out about the wrong protocol in the HTTP-header.

from: https://www.php.net/manual/en/function.header.php

add a Domain Age Checker tool with its own landing page. E.g. example.com/domain-age ?

when doing a dns lookup check at https://websniffer.cc/domain of tuv.com it throws "ERROR: No valid registrable domain name submitted."

Need to investigate why it happens.

currently a lookup of the domain physio-graessler.de from the front page returns a HTTP ERROR 500

to mention it in the description (https://bit.ly/bla-bla-bla)

@karentamrazyan
There is nothing in the repo.
can you please the actual code to the repo?

need to add support for gzip requests