Git Product home page Git Product logo

musicscraper's Introduction

musicScraper

CLI tool for scraping information from musical website (Rateyourmusic, Metal Archives), with nice album ASCII art.

Features

  • Search for your favorite artists on Metallum and RateYourMusic (so far)

  • Show discography and album tracklist

  • Show album credits

  • Show user reviews.

  • RYM feature: Login and rate an album.

  • Metallum feature: Check similar artists.

Usage

Clone the repo and build the package with go build, with Go version >= 1.21. Put the binary file in ~/.local/bin.

Optionally, create a config.json file in ~/.config/musicScraper and write:

{
    "request_delay": 1,
    "authenticate": true,
    "save_cookies": true
}
  • request_delay allows you to slow down the web scraper, by setting the random delay interval (in seconds) between calls. It is highly recommended to set it between 1 and 5, since RateYourMusic may block your IP address if the calls are too fast. However, you can set it at 0 to disable it.

  • autheticate at true will make the app ask you for RYM username and password, you will be able to see and set your album ratings.

  • save_cookies will save a copy of your RYM cookies in the ~/.cache/musicScraper folder. If disabled, the app will always ask for username and password each time authenticate is true.

IMPORTANT: Cloudflare in Metal Archives

Since Metal Archives has implemented Cloudflare protection, you must export MetalArchives cookies in a ~/.cache/musicScraper/metallumCookie.json file. You have many options to export your cookies, one of them might be Cookie-Editor

musicScraper [OPTIONS] "name_of_artist"

-credits
        Display RYM credits
-expand
        Expand RYM albums (Equivalent of pressing "show all")
-website string
        Desired Website ('metallum' or 'rym')

Credits

Made with Colly and Bubbletea.

Screenshots

1

2

musicscraper's People

Contributors

mbaratta96 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.