A spider for access to China's open-end fund data

Type the following code in the console to download or update data.

python spider.py

The first run takes a long time, then the update will be much faster. After the operation, you may get the fund data from "./data/fund-data.db", which is a sqlite file. The following code describes the database table design.

CREATE TABLE fundValue (
    code int NOT NULL, 
    name varchar(50) NOT NULL, 
    trade_date date NOT NULL, 
    net_val decimal, 
    acc_net decimal, 
    day_growth_percent decimal
);

CREATE INDEX idx_fund ON fundValue (code, trade_date);

You need Python3, BeautifulSoup4, pandas, requests, numpy to run this module. Anaconda is recommanded.