m8sec / subscraper Goto Github PK

hi, noticed in your code, CRT module was not being used "efficiently", i was not getting certain domains in my org that i knew existed. Modded the code a bit (well pretty much just added a new argument via the copy paste method 😅 )

elif args.crt and 'crt' in class_obj.method:
                    Thread(target=class_obj.execute, args=(), daemon=True).start()
                    
#added this on subscraper/__init__.py

was recommending maybe add this to the next iterations of the tool, if you are still working on it.

PS: I like your work :)

Simple problem. I want to search javascript files from URLs that are in the file javascript_files.txt, but the script complains about input file not found

I am using subscraper on Parrot OS, it runs well and also says that subdomains written to output.txt, the file gets created but its always empty. any solution? I ve tried using sudo too

There are like 10 various subdomain enumerators. Please port your ideas into one of them.
The incomplete list is here:
pentoo/pentoo-overlay#273

Hello I downloaded and installed the sub scraper and tried to run it on my Kali computer
Distributor ID: Kali
Description: Kali GNU/Linux Rolling
Release: 2021.2
Codename: kali-rolling

however when I try to run the program for any domain it returns:

**_[Source] Subdomain
[Error-01] No module named 'censys.certificates'

[] Identified None subdomain(s) in 0:00:00.354822
[] Subdomains written to ./subscraper_report.txt_**

and the .txt file is empty.
I'm not sure why it's not working on my machine

Hello:
I have upgraded Kali to latest version and now not working
I am receiving these errors:

raceback (most recent call last):
File "/usr/lib/python3.11/importlib/metadata/init.py", line 563, in from_name
return next(cls.discover(name=name))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/local/bin/subscraper", line 33, in
sys.exit(load_entry_point('SubScraper==3.0.2', 'console_scripts', 'subscraper')())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/bin/subscraper", line 22, in importlib_load_entry_point
for entry_point in distribution(dist_name).entry_points
^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/importlib/metadata/init.py", line 981, in distribution
return Distribution.from_name(distribution_name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/importlib/metadata/init.py", line 565, in from_name
raise PackageNotFoundError(name)
importlib.metadata.PackageNotFoundError: No package metadata was found for SubScraper

Python 3.11.2

I suggest adding a Dockerfile with instructions to build and run from a Docker image with all proper dependencies installed. Similar to other popular projects like wpscan, droopescan and testssl.sh.