Git Product home page Git Product logo

intern's Introduction

软微实习小助手(微信公众号)

##软件介绍:
实习小助手专注于爬取北大未名、清华水木的高端实习信息,可以按类查询并提供推送功能,确保您第一时间获悉最新的实习信息

##系统部署:

  解决依赖:
  python 2.7 + node 4.x:  
  sudo apt-get install python2.7 python2.7-dev python-pip  
  sudo apt-get install libxml2-dev libxml2 libxslt1.1 libxslt1-dev zlib1g-dev zlib1g phantomjs
  pip install w3lib lxml cssselect twisted selenium bs4 pymongo  
  pip install pydispatch pydispacher  
  pip install scrapy  
  
  node依赖:
  cd wxserver && npm install
  
  启动爬虫:
  cd intern 
  scrapy crawl bdwm (北大未名bbs Intern区爬取指令)
  scrapy crawl sm (清华水木社区 Intern区爬取指令)
  
  启动服务器:
  cd wxserver && node weixin.js
  服务器中内置自动爬取任务管理

注意:phantomjs在ubuntu下直接使用apt安装,会导致功能不全,需要去官网下载安装

##使用帮助:

进入自行搭建的公众号或扫描上图即可使用


分开发、算法、金融三类查看

查看职位列表效果


查看具体职位

可跳转至原始链接

##开发人员信息: 陈俊文 applenob
李今晖 jinhuiLee

intern's People

Contributors

applenob avatar jinhuilee avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.