Comments (3)
migurski
commented on June 20, 2024
“Q” is another tag that gets dropped in the HTML cleaning process, which should be kept.
from python-goose.
psilva261
commented on June 20, 2024
@migurski Right, all tags get dropped. So the only formatters that stay are '\n'.
Another option would be some attribute cleaned_html that only contains basic html.
from python-goose.
migurski
commented on June 20, 2024
It’s not just the tags, it’s also the content. In the example above, the content of the lists is not included in the cleaned text or in the top_node. It’s still in the raw_doc but not unambiguously findable based on xpath or whatever.
from python-goose.
Related Issues (20)
- li tags in html not extracted HOT 2
- ModuleNotFoundError: No module named 'urlparse' HOT 2
- Not working with ABC News and The Hill articles
- [extractors/title.py] None value for `site_name` in line 40
- encoding error : input conversion failed due to input error, bytes 0xEC 0xD8 0xFD 0xFF
- Failed extraction from blogger post HOT 12
- ImportError: dynamic module does not define init function (init_imaging)
- python-goose/goose/utils/encoding.py
- PLEASE SUBMIT ISSUES TO GOOSE3
- Not parsing following articles. HOT 1
- Japanease functionality
- lots of temporary files in /tmp/goose HOT 1
- Goose is not extracting article whole text
- what's python's version HOT 1
- no result return and waiting HOT 3
- any paper or algorithm description about text extraction?
- Add support for HTTP and HTTPS proxies
- Installation error HOT 2
- Unable to use goose with Python 3 HOT 1
- Unable to execute the install script
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from python-goose.