根据慕课上scrapy打造搜索引擎完成的项目
根据慕课上scrapy打造搜索引擎完成的项目
数据用scrapy抓取存入elasticsearch中
elasticsearch坑非常多版本必须都一致否则容易出现bug,存elasticsearch先运行爬虫项目的models文件里面写好了逻辑分词库自己单独下载放到es中
如果想增量爬取用scrapy-redis做定时任务还可以去重
后台为django按照网上教程配置就可以热门搜索用了redis有序集合点击次数当做分值数据内容自行扩展
可以放到nginx服务器上配置uwsgi
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.
