Puppeteer2 is a Node.js server that uses Puppeteer to provide a web scraping API. It allows users to send POST requests with JSON payloads to interact with web pages and retrieve data in various formats.

• Accepts POST requests with application/json content type.
• Supports navigation to URLs with optional custom HTTP methods, post data, content type, and headers.
• Returns data in different formats based on the responseType specified: text, html, links, images, text+links, text+images, links+images, text+links+images, text+links-inline, text+images-inline, text+links+images-inline.

Send a POST request to http://<server-ip>:5469 with a JSON payload containing the url property and optional parameters. The server will process the request and return the extracted data from the web page.

Example request using curl:

curl -X POST http://<server-ip>:5469 -H "Content-Type: application/json" -d '{"url": "https://example.com", "responseType": "text"}'

Clone the repository and navigate to the puppeteer2 directory. Run npm install to install dependencies. Set up the puppeteer2.service file in /etc/systemd/system/ to run the server as a service.

The server runs under the puppeteer user with limited privileges for security. It uses a headless Chromium browser to minimize exposure.

Contributions are welcome. Please submit pull requests to the master branch.

Puppeteer2 is open-source software licensed under the MIT license.