Comments (1)
It's sort of hard to see but the —-config
has an invalid dash, it should be --config
. This was also the case for some examples in the README, now fixed.
The command should be:
docker run -v $PWD/crawl-1.yaml:/app/crawl-1.yaml -v $PWD/crawls:/crawls/ webrecorder/browsertrix-crawler crawl --config /app/crawl-1.yaml
With the invalid dash, it should just exit (as no config is specified). The missing required argument is from previous versions, so It looks like you may also have an older version of the image, so would recommend either running docker-compose build
to build the latest, or pulling it again via docker pull webrecorder/browsertrix-crawler
from browsertrix-crawler.
Related Issues (20)
- DRM support possible?
- Config payload Digest sha1 base32 HOT 2
- --rolloverSize Default seems not to apply on warc.gz
- replay of streaming services GUI HOT 2
- Remove invalid Brave update URLs
- Filter out non-HTML pages from QA testing
- Always explicitly set mime type for pages
- Docker Exit Code 11 for time and size Limit HOT 6
- Add documentation for QA!
- `.warc` output, always write the warcinfo record ? HOT 2
- `.warc` strict conforming output ? HOT 5
- Port 9222 can't be used for Screencast HOT 2
- pages.jsonl missing required ts timestamp field HOT 2
- Parameter --failOnFailedSeed exits Docker with ExitCode 0 HOT 8
- Crawl error: missing context with id
- Unable to resume crawl: not valid JSON HOT 2
- Cannot convert argument to a ByteString HOT 4
- WARC record HTTP status code is 0 instead of 200 HOT 1
- What exactly is '--blockRules' blocking? Entire URLs where an element like an iframe matches a regex, or only the matching part of a page? HOT 2
- Combine Parameters --failOnFailedLimit with --failOnInvalidStatus HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from browsertrix-crawler.