Git Product home page Git Product logo

carbon-internet / linkchecker Goto Github PK

View Code? Open in Web Editor NEW

This project forked from linkchecker/linkchecker

0.0 1.0 0.0 65.73 MB

check links in web documents or full websites

Home Page: https://linkcheck.github.io/linkchecker/

License: GNU General Public License v2.0

Dockerfile 0.06% Makefile 0.73% Python 70.79% JavaScript 0.05% HTML 0.35% CSS 0.03% Shell 0.14% Awk 0.02% C 22.20% Lex 2.33% Yacc 2.75% PHP 0.02% Batchfile 0.54%

linkchecker's Introduction

LinkChecker

Build Status License

Check for broken links in web sites.

Features

  • recursive and multithreaded checking and site crawling
  • output in colored or normal text, HTML, SQL, CSV, XML or a sitemap graph in different formats
  • HTTP/1.1, HTTPS, FTP, mailto:, news:, nntp:, Telnet and local file links support
  • restrict link checking with regular expression filters for URLs
  • proxy support
  • username/password authorization for HTTP, FTP and Telnet
  • honors robots.txt exclusion protocol
  • Cookie support
  • HTML5 support
  • a command line and web interface
  • various check plugins available, eg. HTML syntax and antivirus checks.

Installation

See doc/install.txt in the source code archive for general information. Except the given information there, please take note of the following:

Python 2.7.2 or later is needed. It doesn't work with Python 3 yet, see #40 for details.

The version in the pip repository is old. Instead, use the current git master version via pip install git+https://github.com/linkchecker/linkchecker.git. See #4.

Windows builds are seriously lagging behind the Linux releases, see #53 for details. For now, the only two options are to install from source or use Docker for Windows.

Usage

Execute linkchecker http://www.example.com. For other options see linkchecker --help.

Docker usage

If you do not want to install any additional libraries/dependencies you can use the Docker image.

Example for external web site check: ` docker run --rm -it -u $(id -u):$(id -g) linkchecker/linkchecker --verbose https://google.com `

Local HTML file check: ` docker run --rm -it -u $(id -u):$(id -g) -v "$PWD":/mnt linkchecker/linkchecker --verbose index.html `

linkchecker's People

Contributors

wummel avatar anarcat avatar mgedmin avatar petrdlouhy avatar reinholdfuereder avatar yarikoptic avatar regexaurus avatar cmelchior avatar cicku avatar ruzickap avatar sitsofe avatar zawataki avatar gerdneuman avatar fd0 avatar alperkokmen avatar arlol avatar bluebird75 avatar jaremko avatar florianjacob avatar harry-wood avatar tyrannosaurusjames avatar screenack avatar mstock avatar mgoodhand avatar mark-hetherington avatar nicf82 avatar peterdavehello avatar pmhahn avatar nottrobin avatar astrofrog avatar

Watchers

James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.