Comments (2)
That one was tricky:
wget -O - https://www.dailytelegraph.com.au/feed
outputs the expected feed.
But when looking at all the redirects:
--2021-06-15 00:12:20-- https://www.dailytelegraph.com.au/feed/
Loaded CA certificate '/etc/ssl/certs/ca-certificates.crt'
Resolving www.dailytelegraph.com.au (www.dailytelegraph.com.au)... 23.3.64.134
Connecting to www.dailytelegraph.com.au (www.dailytelegraph.com.au)|23.3.64.134|:443... connected.
HTTP request sent, awaiting response... 302 Moved Temporarily
Location: https://www.dailytelegraph.com.au/remote/check_cookie.html?url=https%3a%2f%2fwww.dailytelegraph.com.au%2ffeed%2f [following]
--2021-06-15 00:12:20-- https://www.dailytelegraph.com.au/remote/check_cookie.html?url=https%3a%2f%2fwww.dailytelegraph.com.au%2ffeed%2f
Reusing existing connection to www.dailytelegraph.com.au:443.
HTTP request sent, awaiting response... 302 Moved Temporarily
Location: https://www.dailytelegraph.com.au/feed/ [following]
one gets the idea: Cookies.
And thus:
wget --no-cookies -O - https://www.dailytelegraph.com.au/feed/
returns an HTML site that states that cookies need to be enabled.
Alternatives:
- As cookies and RSS in combination make no sense, one should contact the Daily Telegraph and make them correct their broken implementation
- Make gofeed support cookies: In
parser.go#ParseURLWithContext
:
if client.Jar, err = cookiejar.New(nil); err != nil {
return
}
- Use your own
http.Client
and callparse.Parse
with the result.
@mmcdole: How do you feel about this?
from gofeed.
I agree @Necoro -- this is probably outside of what I'd consider normal. For this, I'd do as you suggested and have them create their own http.Client with this behavior.
from gofeed.
Related Issues (20)
- Undetect Json array HOT 2
- Multiple 'enclosure' elements not being picked up... HOT 2
- build failed on go 1.18
- GoFeed parses the CoinDesk feed but the Link fields are empty HOT 4
- no parse content HOT 2
- Thanks for the hat tip! HOT 1
- Support for comments tag in feed Item HOT 3
- Limit the maximum number of feed items when parsing HOT 5
- Support URI field for Author in Atom Feed HOT 3
- corrupted / mangled nested custom XML HOT 1
- Enhance custom element handling HOT 5
- Make illegal character sanitization more robust HOT 1
- These links cannot be resolved HOT 3
- ITunes Summary should be store in the Description field of the feed if Description is empty
- Unit tests are failing HOT 8
- The RSS 2.0 comments fields appears to be missing HOT 1
- Ignore RSS "enclosure" child tags
- feeds.mashable.com: unexpected EOF in CDATA section HOT 1
- infoworld feeds: failed to detect feed type HOT 1
- Atom <logo> is cropped into a squared icon even if it should be 2:1 landscape according to specs HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gofeed.