PyQt5界面，Scrapy+Selenium将爬取的信息保存到Excel文件
PyQt5界面，Scrapy+Selenium将爬取的信息保存到Excel文件
一、部署虚拟环境，有虚拟环境的可忽略
这个项目的虚拟环境采用pipenv
安装
pip install -i https://pypi.douban.com/simple pipenv
创建环境
cd D:\(所在文件夹)\ExcelCrawl
pipenv install
进入虚拟环境
pipenv shell
二、安装所需要的库、包
cd D:\(所在文件夹)\ExcelCrawl
pip install -i https://pypi.doubanio.com/simple/ -r requirements.txt
三、运行项目
运行里面的main.py文件即可
例子：这里我给大家留了一个text.xlsx用来测试
导入文件
运行，稍等片刻（这里用的是selenium，可加载js渲染的网站适合大多数网站，同时防止访问频繁而被禁IP，看个人需求，静态页面的可不用这种设置）
如果需要修改、添加其他新闻，或想爬更多信息可在以下修改：
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.