Git Product home page Git Product logo

gekko-datasets's Introduction

What is it?

Powered by Gekko-BacktestTool Perl HitCount GA
Donate with Bitcoin
Donate with Ethereum
Ready to use Gekko trading bot SQLite dump files with history use to do backtests. Just copy downloaded file to the Gekko's history directory and you get for example: full history of Binance BTC pairs.

The data is systematized in two ways: in order to improve Gekko's performance, full history data is divided into separate files sorted by exchange and currency pairs. Each database file contains all possible assets from a given exchange-currency.
Second option: data for the last days (7, 14, 30, 60) have all possible currencies and assets from a given exchange in one db file.

The files are updated every day with new data after 23:15 GMT.

Currently available datasets

  • Binance - BTC, BNB, ETH, USDT (full history)
  • Bitfinex - BTC, ETH, USD, EUR, GBP, JPY (full history)
  • Poloniex - BTC, ETH, XMR (full history), USDT (from 2017-07-01)
  • GDAX - USD, BTC, EUR, GBP (full history)
  • Kraken - XBT, ETH, USD, EUR, CAD, GBP, JPY (full history)

Available soon / currently import

  • Poloniex - USDT (full history)
  • BitX (aka Luno) - MYR, NGN, ZAR (full history)

Haven't more free space

I do not have more space on Google Drive - full 15 GB and datasets do not fit. That is why some of the files can not be found there ... if someone wants to support the project, he can give up his drive or set up a new one (you need a phone number to verify - I do not have any more). Then create the API key according to this tutorial.

Download

Dumps are compressed by zip and stored on Google Drive, detailed information about candles are in .info files.

Last 7, 14, 30, 60 days: drive.google.com
Full history: drive.google.com

The current size of all uncompressed full period databases is about 21 GB.

Install

  1. Go to Google Drive here or here
  2. Select the dataset that interests you, click with the right mouse button and select Download
    Download
  3. Go to Your gekko's main directory
  4. Create a history folder in the main folder gekko if it does not exist
    History folder
  5. Uncompress downloaded file, and copy db file (for eg binance_0.1.db) to history folder
  6. Restart Gekko

Local datasets update

BacktestTool logo
I recommend Gekko-BacktestTool app for self-updating via exchange API import. With one command you can import all new candles. For example, for dataset binance-usdt, use the command: ./backtest.pl -i -p binance:USDT:ALL -f last -t now The rest is done automatically.

Do you want to make a mirror?

Feel free if you want to process / modify the data contained in this repository. For those interested, I provide scripts whose task is to update datasets from last value to current time and share dumps on Google Drive. The datasets.sh (main script) and datasets_info.pl (generating detailed information about candles) files are located in the /root/gekko directory, and my separate copies for each datasets in the following subdirectories: binance-usdt, binance-btc, binance-bnb, binance-eth, poloniex-usdt, poloniex-xmr. Add the datasets.sh file to cron, and the rest happens by itself. Scripts require: Gekko, Gekko-BacktestTool and Gdrive.

See also

gekko-datasets's People

Contributors

xfffff avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

gekko-datasets's Issues

Is it possible to have 2 full-history datasets for two assets?

I wanted to download 2 history datasets, one for binance:usdt:all and one for binance:bnb:all. After unpacking, it turns out that both filenames are the same (binance0_1.db). Is there a way to place both files in the history folder, so that both USDT as well as BNB pairs can be backtested, using one single backtest-config.pl file (and without "swapping" the two files in between)?

Missing bitfinex-usd snapshot

Hey there,

It seems that bitfinex-usd database is missing. I found in google drive only bitfinex-usd.info file. Am I missing something?

Btw, thanks for the great job on providing these databases.

Poloniex ETH data

Where is poloniex-eth.zip actually? I see many .info files but not data itself.
Thank for dump files of other pairs anyway )

Contact

I'd like to discuss supporting more storage as I need a full backtest data set for GDAX, however there's no contact info in the project. Can you please shoot me an email at [email protected]?

binance-btc.zip

unfortunately the binance-btc.zip is missing
at the fullhistory dataset

Missing data in binance-USDT full dataset

binance-usdt.info says:

candles_USDT_BCC
start: 2017-11-11 08:28:00
end: 2018-06-27 03:22:00
candles: 328015
avarage price: 1369.26465959588
lowest price: 578
highest price: 5389.35
trades: 5695574
volume: 3136941.10220005

But when performing a backtest in Gekko on binance-usdt.zip, the data for USDT-BCC seems to ending at 2018-06-15 03:29.

File is downloaded from drive.google.com at 2018-06-27 19:50 UTC.

Google Drive

Hey there,

I might be mistaken but... as far as I can see there are some files missing in the full history folder. For example there is no...

binance-btc.zip
bitfinex-usd.zip

Am I missing something?

Thanks in advance.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.