CloudQuery
Turn any website to serverless API (with SPA support!)
Try online: https://2uvlp0y13b.execute-api.us-west-2.amazonaws.com/staging/
API
Query params:
- url: url of the webpage you want to fetch
- selectors: css selectors describing the elements interests you
Returns:
- innerText: element innerText
- href: element href
Run locally
npm i
npm start
How to deploy your own CloudQuery to AWS lambda
1. Configuration
- update
profile
(AWS Credential Profiles) inup.json
to use your own aws account - update
rateLimit
inconfig.json
to set your own rate limit (Default: 5 request/hour)
2. Deploy
npm install
- install
up
- Input
up
in terminal and hit enter :) up url
to see the API baseURL of your CloudQuery
Contribute
Backend
vim app.js
Frontend
cd frontend
# develop
npm start
# build
npm run build
Thanks
- up for deploying serverless API to AWS with ease
- serverless-chrome for running chrome on AWS lambda
- finder for making it easy to select elements on webpage