Lot of programs have missing serie and episode about tvgrabpyapi HOT 17 OPEN

You have fast enabled so you aren't grabbing any details that would include the episode numbers. In tv_grab_nl3_py.conf change the line that says "fast = True" to "fast = False"

from tvgrabpyapi.

Sorry, the inserted xml was formatted, so here is it again hopefully not formatted:
<programme start="20200322090500 +0100" stop="20200322100000 +0100" channel="0-1"> <title lang="nl">Floortje terug naar het einde van de wereld</title> <desc lang="nl">In 2014 bezocht Floortje de Engelse dierarts Joe Hollins op het prachtige en extreem geïsoleerde eiland Sint-Helena. Het eiland is inmiddels een stuk minder geïsoleerd.</desc> <category lang="nl">Overige</category> <previously-shown/>

from tvgrabpyapi.

Please have a look at: #48

from tvgrabpyapi.

• The html pages from tvgids.nl are unusable as to slow.
• The json feed from tvgids.nl only very recently as had episode info added, it will take some time to seep through or run tv_grab_nl3.py --clear_source 3 to remove all data from tvgids.nl from your database.
• The rtl feed is off-line since January 28th. Unknown when back on-line

from tvgrabpyapi.

After following all suggestions in #48, I still dont see episode and serie info.

from tvgrabpyapi.

Can you post your tv_grab_nl3_py.set, tv_grab_nl3_py.log and tv_grab_nl3_py.conf files?

For that specific show it should have fetched the episode numbers from the tvgids.nl detail fetch and it should have gotten the episode title from Horizon or VPRO or via the detail fetch from NPO.nl or humo.

This is what my file has for that show:

  <programme  start="20200322080500 +0000" stop="20200322090000 +0000" channel="1.tvgids.nl">
    <title  lang="nl">Floortje terug naar het einde van de wereld</title>
    <sub-title  lang="nl">Sint-Helena</sub-title>
    <desc  lang="nl">(BNNVARA) In 2014 bezocht Floortje de Engelse dierarts Joe Hollins die op het prachtige en extreem geïsoleerde eiland Sint-Helena woont. Een plek die je alleen kon bereiken met een boottocht van vijf dagen. Inmiddels is er veel veranderd op het eiland en is het een stuk minder geïsoleerd doordat in 2017 een directe verbinding met de bewoonde wereld werd gerealiseerd. Wat heeft deze grote verandering voor impact op het leven daar?</desc>
    <date>2020</date>
    <category>Unknown</category>
    <keyword  lang="nl"/>
    <country>NL</country>
    <episode-num system="xmltv_ns">0 . 4/6 . </episode-num>
    <previously-shown/>
    <rating  system="kijkwijzer">
      <value>AL</value>
      <icon  src="http://tvgidsassets.nl/img/kijkwijzer/al_transp.png"/>
    </rating>
  </programme>

from tvgrabpyapi.

Please find attached files from yesterdays and todays run.
tvgrab.zip

from tvgrabpyapi.

That did indeed get the details back, but then I have been running with the setting for over 2 years so something, probably in the sources, has changed which made it disappear.

from tvgrabpyapi.

Humo's new API now only has the episode numbers in the detail fetches. The old API included everything in the base fetches.

from tvgrabpyapi.

More and more sources put the more detailed data on separate detail pages, where the base page only supplies title and start-time. So the --fast setting is mostly useful to get an update on start-times. I run a full fetch at night that takes some 20 min or more and then at 17:00 I run a quick --fast scan for just that day to get any last minute changes in the timings like recently with all the corona related stuff. That last one then only takes a little over 2 min.
There are also some settings to limit the detail and ttvdb fetches.

from tvgrabpyapi.

I'm also having issues with getting detail info for certain episodes where at least one of the detail sources has this info.
For example 'Blaze en de monsterwielen' doesn't get season/episode info, while when looking at humo.be/tvgids (https://www.humo.be/tv-gids/nickelodeon-spike/uitzending/aflevering/34ef56b2-b2f2-4c47-94f5-fed86fc4526e), tvgids.nl (https://www.tvgids.nl/tv/blaze-and-the-monster-machines/86461921) or tvgids.tv (https://www.tvgids.tv/tv/blaze-en-de-monsterwielen/24181184) it has this information available somewhere there.
And my config file has fast=False configured.
I've already tried to disabled a few sources, but to no avail.
tv_grab_nl3_py.conf.txt

Anyone that can help me out?

from tvgrabpyapi.

In case someone is still looking into this, For me it's mainly the Nickelodeon/Spike channel that is missing it's season/episode info. As far as I understand the source system (it's not quite trivial to wrap my head around), Humo.be is the prime source for this channel, which is also a details source, for some reason the season info is not retrieved from the details, while the description is.

from tvgrabpyapi.

Still seeing missing season and episode, mainly NPOx, despite following all recommendations.

from tvgrabpyapi.

It seems some of the detail pages get some of the details added in at a later stage. I'm thinking and working on scenarios to solve this, but that will take some time.

from tvgrabpyapi.

Nickelodeon Nederland and the Nickelodeon / Spike (virtual) channel for KPN Digitenne is not the same as Nickelodeon/Spike Vlaanderen. At one point in the late 00s they were simulcasts with different reclame blocks and Nederland switching to Comedy Central overnight and Vlaams swithching to MTV overnight, but they have since drifted apart and now have completely different schedules:
https://www.nickelodeon.nl/tv-gids/nickelodeon-nl
https://www.nickelodeon.nl/tv-gids/nickelodeon-be

Those tvgids.nl and tvgids.tv pages are for Nickelodeon NL, not Nickelodeon BE, so the 8-nickelodeon channel does not grab details from them, it only gets details from humo. We used to get it from Primo, but the magazine was purchased by Humo's owners a few years ago and their online gids were discontinued. Humo does occasionally have a server issue where some detail fetches initially fail, so you might have to run tv_grab_nl3.py a second time and it should try to fetch those missing detail pages again.

from tvgrabpyapi.

For me, details of some shows are still missing after multiple fetches. Some have details, others don't, while when looking at the Humo guide, they seem to have the same detail structure. Not sure why this happens. If you need the config file or maybe the cache file to investigate, just let me know.

from tvgrabpyapi.

@kyl416 , any logs, config, cache ... files needed for this?

from tvgrabpyapi.