strategist922 Goto Github PK

scnn-prototxt-generator

Script for generating Spatial CNN caffe prototxt file.

scoot

scopus2histcite

scout-client

Scout is an easy-to-use hosted server monitoring service. The scout Ruby gem reports metrics to our service. The agent runs plugins, configured via the Scout web interface, to monitor a server.

scout_scout

Scout your data out of Scout

scrapinghub-stack-portia

Software stack used to run Portia spiders in Scrapinghub cloud

scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

scrapy-autoextract

Scrapinghub AutoExtract API integration for Scrapy

scrapy-bench

A CLI for benchmarking Scrapy.

scrapy-bigml

Scrapy pipeline for writing items to BigML datasets

scrapy-cdr

Item definition and utils for storing items in CDR format for scrapy

scrapy-chromedebugproto

Example of how to integrate Scrapy with Chrome Debugging Protocol [very alpha stage]

scrapy-crawl-once

Scrapy middleware which allows to crawl only new content

scrapy-crawlera

Crawlera middleware for Scrapy

scrapy-deltafetch

Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls

scrapy-feedstock

A conda-smithy repository for scrapy.

scrapy-hcf

Scrapy spider middleware to use Scrapinghub's Hub Crawl Frontier as a backend for URLs

scrapy-kafka-export

Scrapy extension which writes crawled items to Kafka

scrapy-mongodb

MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the items to MongoDB as soon as your spider finds data to extract.

scrapy-puppeteer

Scrapy + Puppeteer

scrapy-rabbitmq

A RabbitMQ Scheduler for Scrapy

scrapy-random-useragent

Scrapy Middleware to set a random User-Agent for every Request.

scrapy-redis

Redis-based components for Scrapy.

scrapy-rotating-proxies

use multiple proxies with Scrapy

scrapy-selenium

Scrapy middleware to handle javascript pages using selenium

scrapyd

A service daemon to run Scrapy spiders

scrapydweb

Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO :point_right:

scribe

Scribe is a server for aggregating log data streamed in real time from a large number of servers. It is designed to be scalable, extensible without client-side modification, and robust to failure of the network or any specific machine.

scriptsbots

ScriptBots is an Open Source Evolutionary Artificial Life Simulation of Predator-Prey dynamics, written by Andrej Karpathy.

scrutineer

Compares a source of truth sorted stream with another to find mismatches. Designed for verifying indexes such as ElasticSearch & Solr are synchronized with their source of data (usually a DB)