bgpview / backend-api Goto Github PK

So we have all the DBs for some RIRs layed out real nice, would be more ideal to use those to regenerate whois data instead of doing the whois queries. This also means we will need to construct our raw whois

APNIC: ftp://ftp.apnic.net/public/apnic/whois/
RIPE: ftp://ftp.ripe.net/ripe/dbase/split/

Afrinic: http://ftp.afrinic.net/dbase/ <-- This has all emails, names and addresses removed though can still use it to updated NETNAMES and DESC and routes etc

• We need to crape and store the whois information for all allocated prefixes (not just BGP)
• Need to look through ASNS in BGP table and also scrape those (not only allocation lists)
• Look through IX members also and get the ASN whois from there

Currently we simply skip any ASN that is not in any RIR record, we need to make a record for this so we dont scrape them daily

There is the option of perhaps to install a local resolver with cache (dnsmasq) and then in the whois.php script pointing all queries to go to the local resolver instead of using the default PHP function that seeks the resolution directly with every query

Need to double check that the prefix data (name and descriptions are setting correclty in the database import)

Currently speaking we are not dealing with maxmind returning a not found in DB exception, we need to be able to make sure that we replace where ever ipUtils->geoip() is called it can handle null result

Currently doing IX memebers and entries (~160k entries) takes far too long for it should.

In theory we should do some non model mass inserting like we do with the BGP table

Hello, how to install this product?
I execute composer install and php artisan key:generate.
When i try to access page there are infinite redirect to API_DOCS_URL.
Need assist.

So the allocation list for all RIRs gets updated daily and some prefixes get removed. currently we are not remove those we are simply adding new ones.

• create the temp tables using DB tools with mass insert and swap them when job done

so IPs like 91.234.142.0 are PI space which means not in the allocation list, need to figure out a way to determine a suitable whois server for the PI server

Need to get the list of private ASN from http://www.iana.org/assignments/as-numbers/as-numbers.xhtml
and add to the ASN whois command a way to ignore and skip over any Private ASN as there will be no point doing a whois query on it.

Example dont query AS asns that are marked as PRIVATE

Also can certainly expand on the API information returned using the IANA info (such as date allocated to RIR or its LEGACY status)

All IANA info already in DB

As title