Git Product home page Git Product logo

cashnodes's Introduction

The project has migrated over to GitLab.com

CASHNODES Crawler

Cashnodes is currently being developed to estimate the size of the Bitcoin network by finding all the reachable nodes in the network. The current methodology involves sending getaddr messages recursively to find all the reachable nodes in the network, starting from a set of seed nodes. Cashodes uses Bitcoin protocol version 70015 (i.e. >= Bitcoin ABC, Bitcoin XT and BUcash). Since Bitcoin Cash network use a different set of network magic bits we are certain to avoid inclusion of Bitcoin legacy nodes in the collected data.

Currently set of API and is currently providing

GET /snapshots
GET /snapshots/:timestamp

To deploy an instance of the crawler please have a look at the step necessary to set up a machine to run the backend code: Provisioning Bitcoin Network Crawler. The Redis Data contains the list of keys and their associated values that are written by the scripts in this project.

Both aforementioned documentations are tailored for bitnodes.earn.com code base, we are going to provide a Cash version of those wiki pages as soon as things settled.

If you wish to access the data, e.g. list of network snapshots, collected using this project, see the initial set of APIs we are currently developing.

How to start the crawler

cd; wget --no-check-certificate https://github.com/BitcoinUnlimited/cashnodes/archive/master.zip
unzip master.zip
virtualenv ~/.virtualenvs/cashnodes
source ~/.virtualenvs/cashnodes/bin/activate
cd cashnodes
pip install -r requirements.txt
bash geoip/update.sh
bash start.sh
cd data/pcap/e3e1f3e8
sudo rm *.pcap
sudo tcpdump -i [INTERFACE] -w %s.[INTERFACE.pcap -v -n -G 2 -B 65536 -Z [USERNAME] 'tcp and not src host [IP_ADDRESS] and not src host [IPV6_ADDRESS]' > [INTERFACE] 2>&1 &
sudo tcpdump -i lo -w %s.lo.pcap -v -n -G 2 -B 65536 -Z [USERNAME] 'tcp and port 9050' > lo 2>&1 &

cashnodes's People

Contributors

ayeowch avatar sickpig avatar torusjkl avatar

Stargazers

 avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

cashnodes's Issues

Number of Nodes discovered

I have been trying to run cashnodes for a few days now. Unfortunately, even after a few days of continuous running, I the crawler only finds 700-800 Bitcoin Cash nodes, according to log/export.e3e1f3e8.log. This is not even half the number shown on the cashnodes website.

I am also running bitnodes, and the number of BTC nodes it finds is about 8400, much closer to the number on their website.

Is there anything special you are doing to get these numbers, like changes that are not in this repo? Or does the website show something like a 24 hour aggregate of nodes?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.