`post_connection_check': hostname "www.jamapi.xyz" does not match the server certificate (OpenSSL::SSL::SSLError)

If I'm reading this right, there is an issue with the SSL certificate for jamapi.xyz?

This was after running just the demo code for ruby provided on the main page

require 'httparty'
require 'json'
response = HTTParty.post("https://www.jamapi.xyz/",
{ 
  :body => [ { "url" => "http://www.radcircle.com", "json_data" => "{'title': 'title'}"} ].to_json,
  :headers => { 'Content-Type' => 'application/json', 'Accept' => 'application/json'}
})  
puts JSON.parse(response)

This is a very cool project, and simple enough to make scraping old HTML sites a breeze.

One thing I've noticed is that if you select an element in the target page that contains line breaks around the content inside the tags, they are also returned, e.g:

{
"title": "\nMax Glenister - Front-end developer from Oxford, UK\n"
}

It would be nice if http://www.jamapi.xyz/ could also be served with https.

My personal suggestion (and how i did it on my own server):

• Have apache
• Get free https://letsencrypt.org/ certificate
• Setup apache proxypass to the http instance of http://www.jamapi.xyz/ on localhost
• Done 👍

(I'll be here if you have questions/need help doing it 🆘)

Hi, your ssl certificate has expired.

The example of targeting the URL "http://www.producthunt.com/jobs"

with

{
"title": "title",
"companies": [{"elem": "ul.jobs li.job a", "link": "href", "name": "text"}],
"company_descriptions": [{"elem": "ul.jobs li.job .description", "name": "text"}]
}

Has valid JSON, but no longer populates companies or companies_descriptions

So we can return child values inside of it's parent. Basically turn:

"paragraphs": [
        {
            "index": 0,
            "value": {
                "value": "Porter Robinson – Sad Machine (Cosmo’s Midnight Remix)"
            }
        }
],
"links": [
        {
            "index": 0,
            "value": {
                "location": "http://radcircle.com/2016/03/porter-robinson-sad-machine-cosmos-midnight-remix/"
            }
        }
]

into

"paragraphs": [
    {
      "index": 0,
      "value": {
        "value": "Porter Robinson – Sad Machine (Cosmo’s Midnight Remix)",
        "location": "http://radcircle.com/2016/03/porter-robinson-sad-machine-cosmos-midnight-remix/"

      }
    }
]

There should be some sanity checks, especially on the public facing API. Running it with something like http://speedtest.newark.linode.com/100MB-newark.bin (obviously not an HTML file) will easily eat tons of memory and possibly crash it.

Would it be possible to select by other tag attributes? I am currently looking at parsing sites that have a lot of unique itemprop attributes like: <td itemprop="description">IC MCU 8BIT 32KB FLASH 44TQFP</td> from this site but hardly any ids or classes. I think these are ASP sites.

https://github.com/fizx/parsley does almost the same thing

I am struggling to do a more complex implementation of this... for example given the following HTML (and having multiples on the page)

<div class="card">
  <div class="card-title">Title</div>
  <div class="card-desc">Description text here</div>
  <a href="#link" class="card-link">More info</a>
</div>

How would you format your JSON request to get those cards? This is what I assume it would be but lack of docs has me guessing...

{
    "title": "title",
    "news": [{
        "elem": ".card",
        "cardTitle": ".card .card-title",
        "cardDesc": ".card .card-desc"
    }]
}

Also the example on jamapi.xyz should be like something above, and not rely on website that can change like it does.

It looks dead...

Hi,

What license are you releasing this under?

Thank you

Hi,
Was wonder how I can use this within my c# application.

Hopefully there is an option..

Hi there !

This idea looks pretty cool for micro scraping services.
But today, as I read, it works server side.

It could be more usefull to create a client side version of Jam to make possible to create many and many github pages who scrap the web.

For exemple, I am looking for a way to turn my city transportation service website into an api without hosting cost (thanks to github pages).

Cheers,

Just noticed this and thought I'll let you know.

Hello, I cannot find the correct syntax, I have tried this:

import requests
r = requests.post('http://www.jamapi.xyz', 'url = "http://www.radcircle.com"', 'json_data = {"title": "title"}')
print r.text

and get the error message:
{
"statusCode": 400,
"error": "Bad Request",
"message": "Invalid request payload JSON format"
}

If I change it to this:

r = requests.post('http://www.jamapi.xyz', 'url = "http://www.radcircle.com"', json_data = '{"title": "title"}')

I get this:
TypeError: request() got an unexpected keyword argument 'json_data'

When I try to visit https://www.jamapi.xyz/ I get NET::ERR_CERT_DATE_INVALID - of course, this means I also cannot do api calls.

Hi ! is there any code example available to implement in typescript!? I am hardly getting internal server(500) error!

so far i have tried.. and trying! any help would be appreciated

import { Http ,Headers, URLSearchParams,RequestOptions} from '@angular/http';
import { Observable } from 'rxjs/Rx';

getData():Observable {
let headers = new Headers({ 'Content-Type': 'application/json' , 'Accept': 'application/json'});
let options = new RequestOptions({
headers: headers
});
let body = JSON.stringify({form: {url: 'http://www.gavin.codes/', json_data: {'title': 'title'}}});
return this.http.post('https://www.jamapi.xyz/',body,options).
map(res => res.json())
.catch((error: any) => {
return Observable.throw(new Error(error.status));
});
}