ValueError: Unicode strings with encoding declaration are not supported about python-goose HOT 6 CLOSED

Is it possible to change the configuration of html_parser for unicode encoding by means of goose

from python-goose.

@PriyeshV I don't get your last comment. Goose only deals with unicode. It seems to be an error in lxml html parser because the soup parser works.

That said. Goose in not suitable for extracting this kind of web page. It's build to extract article. Your page doesn't have any article.

from python-goose.

Thanks grangier. I too figured it out that the error was with lxml html parser. I wanted to know whether there is any possibility of passing arguments to lxml html parser when invoking goose.

from python-goose.

@PriyeshV no. Use raw_html extraction if you want to preprocess content

from python-goose.

Thanks again @grangier

from python-goose.

Hello! Sorry to drag this up again, but I'm a little less confident than PriyeshV that I know how to handle raw_html preprocessing... I'm having the exact same exception, and I was wondering what I'm supposed to do about it?

(Love Goose, by the way. Thanks so much!)

Do I need to convert the html to an encoding that won't bother lxml? You say it works with the soup parser, is there a way to use that instead? I guess I'm just a little unsure of how to proceed. Thanks so much!

--- Edit -----

Oh, the page I'm trying to extract article text from is here: http://arxiv.org/abs/1401.4454
I was hoping to end up with just the abstract extracted.

Thanks.

from python-goose.