Half the posters are missing

An evolving, supported alternative to Rovi
Forum rules
★ Download the latest EPG123 here: http://epg123.garyan2.net <> Setup guide here: http://epg123.garyan2.net/downloads/epg123_Guide.pdf
User avatar
garyan2

Posts: 6609
Joined: Fri Nov 27, 2015 7:23 pm
Location:

HTPC Specs: Show details

#21

Post by garyan2 » Fri Mar 04, 2022 2:47 am

When EPG123 refreshes your token, the limit flag is reset to False. As soon as something requests an image from the service, the service will reach out to SD and will get the limit exceeded response. The service will then set the limit flag back to True. This still has to do with SD denying you authorization to download images.

Question: are you on a trial membership right now?
- Gary
Keeping WMC alive beyond January 2020. https://garyan2.github.io

User avatar
MKANET

Posts: 53
Joined: Mon Mar 12, 2012 9:40 pm
Location:

HTPC Specs: Show details

#22

Post by MKANET » Fri Mar 04, 2022 2:58 am

Thanks for explaining. I've been a paying customer to SD for nearly 2 years. I used to use guide2go for my HDHomeRun.. however, recently, as soon as I realized that EPG123 can download posters for the rest of my IPTV channels, I started using EPG123.

One thing that puzzles me is that when I first set up EPG123, it was providing my poster images very nicely (at least 60% or so).

However, when I tried to redo things from scratch just recently to get all posters to show up.. now I can't get any posters at all. Something happened after I deleted all the cache and started from scratch. Or, it's possible all the time I had 60% posters, I was just looking at old cached images.. and, EPG123 might have only downloaded 1 time only?

Space

Posts: 2539
Joined: Sun Jun 02, 2013 9:44 pm
Location:

HTPC Specs: Show details

#23

Post by Space » Fri Mar 04, 2022 3:27 am

The limit is not with the download of the URLs of the images during the guide update, it is a limit of the number of images that can be downloaded from the SD server. The limit has nothing to do with anything EPG123 does during the guide download. It has to do with you downloading the actual images from SD either directly or using the EPG123 HTTP proxy server.

I don't know the details of how the SD server limits downloads, but I am aware of how this type of limiting generally works:

When you download images from SD, you need to provide a token that identifies your account. Every image you download increments a counter associated with your account.

When you download your first image, the counter increments to 1 and the 24 hour timer starts, you now can download a maximum of X images within that 24 hour period, if you exceed X, then you can no longer download images until the 24 hour timer expires. When that timer expires, you can again download images, the first image you download after the timer expires will set the counter to 1, and the 24 hour timer starts over again.

User avatar
MKANET

Posts: 53
Joined: Mon Mar 12, 2012 9:40 pm
Location:

HTPC Specs: Show details

#24

Post by MKANET » Fri Mar 04, 2022 3:36 am

I'm downloading v1.7.1.3 right now. Thanks!

BTW: My SchedulesDirect account shows that I have 4 lineups under the "account" section.

However, when I submitted a ticket to SD in the link below, I also have 4 additional "SD-JSON" lineups (see screenshot below).
www.schedulesdirect.org/lineupsupport

Is that going to cause the issue I have? I don't even have the ability to delete the SD-JSON lineups. EPG123 is using the top 4.
https://api.onedrive.com/v1.0/shares/u! ... ot/content
No need to reply if it's supposed to be like that. I just thought that was odd.

User avatar
MKANET

Posts: 53
Joined: Mon Mar 12, 2012 9:40 pm
Location:

HTPC Specs: Show details

#25

Post by MKANET » Fri Mar 04, 2022 3:54 am

Space wrote:
Fri Mar 04, 2022 3:27 am
The limit is not with the download of the URLs of the images during the guide update, it is a limit of the number of images that can be downloaded from the SD server. The limit has nothing to do with anything EPG123 does during the guide download. It has to do with you downloading the actual images from SD either directly or using the EPG123 HTTP proxy server.

I don't know the details of how the SD server limits downloads, but I am aware of how this type of limiting generally works:

When you download images from SD, you need to provide a token that identifies your account. Every image you download increments a counter associated with your account.

When you download your first image, the counter increments to 1 and the 24 hour timer starts, you now can download a maximum of X images within that 24 hour period, if you exceed X, then you can no longer download images until the 24 hour timer expires. When that timer expires, you can again download images, the first image you download after the timer expires will set the counter to 1, and the 24 hour timer starts over again.
Thanks for explaining. I didn't realize that image downloads are instigated directly from the XMLTV clients. I thought that EPG123 pre-emptively downloads ALL poster images from my lineups at the time the Guide is downloaded. ...in anticipation that the clients would use them.

User avatar
MKANET

Posts: 53
Joined: Mon Mar 12, 2012 9:40 pm
Location:

HTPC Specs: Show details

#26

Post by MKANET » Sat Mar 05, 2022 3:08 am

Gary, how do I enable debug logging for EPG123's Service mode? It should be be pretty easy to tell whats going wrong if we can to see actual proxied http request/response messages from xmltv clients. I searched the online manual,. but didn't see anything about how to enable debug logging.

User avatar
garyan2

Posts: 6609
Joined: Fri Nov 27, 2015 7:23 pm
Location:

HTPC Specs: Show details

#27

Post by garyan2 » Sat Mar 05, 2022 3:36 am

What you see in the service log is the debug logging. I don't log all the http traffic. If want to see what is going on for yourself, just open a browser, press function key F12 and view the Network tab. Then take one of the links out of the xmltv file, change http://HTPC:9009/ to https://json.schedulesdirect.org/20141201/, put it in the address bar and try to get the image. You will see SD respond with a json file saying you have exceeded your limit.
- Gary
Keeping WMC alive beyond January 2020. https://garyan2.github.io

User avatar
MKANET

Posts: 53
Joined: Mon Mar 12, 2012 9:40 pm
Location:

HTPC Specs: Show details

#28

Post by MKANET » Sat Mar 05, 2022 6:55 pm

garyan2 wrote:
Fri Mar 04, 2022 2:47 am
When EPG123 refreshes your token, the limit flag is reset to False. As soon as something requests an image from the service, the service will reach out to SD and will get the limit exceeded response. The service will then set the limit flag back to True. This still has to do with SD denying you authorization to download images.

Question: are you on a trial membership right now?
UPDATE: I think I may have found out a huge clue! This morning I went to look at the server.log. I noticed that it repetitively showed the following message over and over again for every image request. I don't remember seeing this message before.

Code: Select all

[3/4/2022 8:51:02 PM] /image/248085ec6d669c3978b61c8996f79552014b391c1fd8c3e946de120fd443cec3.jpg: 200 OK
{"response":"MAX_IMAGE_DOWNLOADS_TRIAL","code":5003,"serverID":"20141201.web","message":"Maximum image downloads for trial user reached. Counter resets every 24h. Post message to http:\/\/forums.schedulesdirect.org\/viewforum.php?f=6","datetime":"2022-03-05T04:51:02Z"}
[3/4/2022 8:51:02 PM] /image/510eeb314de58299964aa4862b5f3fddd96888fe82c517a1e3bebef092f01b49.jpg: 200 OK
{"response":"MAX_IMAGE_DOWNLOADS_TRIAL","code":5003,"serverID":"20141201.web","message":"Maximum image downloads for trial user reached. Counter resets every 24h. Post message to http:\/\/forums.schedulesdirect.org\/viewforum.php?f=6","datetime":"2022-03-05T04:51:02Z"}
[3/4/2022 8:51:02 PM] /image/036c2e95f8d2e06f72bb2753233ac513f4e019c8c0f74d54ae7e476e6e7d4ab5.jpg: 200 OK
{"response":"MAX_IMAGE_DOWNLOADS_TRIAL","code":5003,"serverID":"20141201.web","message":"Maximum image downloads for trial user reached. Counter resets every 24h. Post message to http:\/\/forums.schedulesdirect.org\/viewforum.php?f=6","datetime":"2022-03-05T04:51:02Z"}
[3/4/2022 8:51:02 PM] /image/3abf7ab3f8e0e5935c8d96c069ed033828b71c5294910439f74633a66c51c0a5.jpg: 200 OK
When I went to look at my actual SD account on the SD webpage. I realized that there are actually 2 types of memberships:
"Schedules Direct offers two data services. With the newer SD-JSON service, lineups are managed within the application. The legacy SD-DD (XML) service requires you add a lineup below.

In EPG123, I think I selected the lineups I had previously created under the below URL (as opposed to creating new the lineups via EPG123 GUI"
https://www.schedulesdirect.org/account

Gary, is it possible that the whole issue is because I've been using the legacy SD-DD (XML) service lineups I created in the SD webpage for EPG123? Do I need to delete the lineup ups I created in the above SD URL... and, use the lineups that EPG123 created specifically?

User avatar
garyan2

Posts: 6609
Joined: Fri Nov 27, 2015 7:23 pm
Location:

HTPC Specs: Show details

#29

Post by garyan2 » Sat Mar 05, 2022 7:06 pm

No. The SD-DD and SD-JSON services are completely different; EPG123 only uses the JSON service. There is no cross-functionality between the 2 even though your single account gives you access to both.

I thought you said you were not on a trial? If you truly are not, then a key to the issue may be that SD thinks you are. In which case, I'm not sure the 5000/day download limit is the same. It may be 5000 images total during the trial which would explain why your limit doesn't seem to get reset.

NOTE: I wish you had shown me this about an hour ago. I could have added the 5003 MAX_IMAGE_DOWNLOADS_TRIAL code to the service and responded with a proper 429 HTTP status code.
- Gary
Keeping WMC alive beyond January 2020. https://garyan2.github.io

User avatar
MKANET

Posts: 53
Joined: Mon Mar 12, 2012 9:40 pm
Location:

HTPC Specs: Show details

#30

Post by MKANET » Sat Mar 05, 2022 8:05 pm

Prior to this morning, the only thing that would ever show up in my server.log file is just one line:

Code: Select all

[3/2/2022 12:11:29 AM] version 1.7.1.0 : token=731f16b7c...............00911 , autoRefreshToken=True , cacheImages=True , cacheRetention=30
This morning was the first time I saw the message in server.log that I'm on a trial membership. I'm not sure what changed that my server.log started reporting that I'm on a trial membership.

The only thing I can find on the SD website that shows my membership status under:
https://www.schedulesdirect.org/account
Status: Active
Expires: Tuesday, June 07, 2022


If the server.log message that I'm on a trial account is correct.. I guess I'll have to wait for SD support to manually change my membership from trial to a paid membership.
Last edited by MKANET on Sat Mar 05, 2022 8:38 pm, edited 1 time in total.

User avatar
garyan2

Posts: 6609
Joined: Fri Nov 27, 2015 7:23 pm
Location:

HTPC Specs: Show details

#31

Post by garyan2 » Sat Mar 05, 2022 8:28 pm

Currently, the service will not log the 5002 MAX_IMAGE_DOWNLOADS in the text but will increment the 429 Too Many Requests and set the limit flag. If I had known about the 5003 MAX_IMAGE_DOWNLOADS_TRIAL, then that would not have been logged either. I will change that to only logging the very first instance on a given token, but I am not going to log all of them... that would be crazy.

I'm thinking SD is working on your account right now trying to figure it out. Your webstats showed '429' responses meaning you were getting the 5002 code for a non-trail membership, it is just now that you are getting the 5003 code which would fall into "Other (see log)" responses.
- Gary
Keeping WMC alive beyond January 2020. https://garyan2.github.io

User avatar
MKANET

Posts: 53
Joined: Mon Mar 12, 2012 9:40 pm
Location:

HTPC Specs: Show details

#32

Post by MKANET » Sat Mar 05, 2022 8:54 pm

garyan2 wrote:
Sat Mar 05, 2022 8:28 pm
Currently, the service will not log the 5002 MAX_IMAGE_DOWNLOADS in the text but will increment the 429 Too Many Requests and set the limit flag. If I had known about the 5003 MAX_IMAGE_DOWNLOADS_TRIAL, then that would not have been logged either. I will change that to only logging the very first instance on a given token, but I am not going to log all of them... that would be crazy.

I'm thinking SD is working on your account right now trying to figure it out. Your webstats showed '429' responses meaning you were getting the 5002 code for a non-trail membership, it is just now that you are getting the 5003 code which would fall into "Other (see log)" responses.
I hope you're right that SD is working on my account right now. I haven't heard from them since I initially opened a lineup support request. BTW: I used my Chrome browser's developer tools to see if I could get any more information. The only relevant thing I could find was a "429" response in the header.

One last thing... this may not be relevant. I just edited my SD account details under:
https://www.schedulesdirect.org/account/edit

In that section, I noticed that I didn't have EPG123 selected under "Software I use". The only thing I had checked was "Tvheadend"; which I didn't end up using. I just updated my account details to include EPG123... and, removed "Tvheadend". Other than that, it seems like I've correctly configured everything both on my SD account and EPG123.

User avatar
MKANET

Posts: 53
Joined: Mon Mar 12, 2012 9:40 pm
Location:

HTPC Specs: Show details

#33

Post by MKANET » Thu Mar 10, 2022 11:45 pm

garyan2 wrote:
Sat Mar 05, 2022 8:28 pm
Currently, the service will not log the 5002 MAX_IMAGE_DOWNLOADS in the text but will increment the 429 Too Many Requests and set the limit flag. If I had known about the 5003 MAX_IMAGE_DOWNLOADS_TRIAL, then that would not have been logged either. I will change that to only logging the very first instance on a given token, but I am not going to log all of them... that would be crazy.

I'm thinking SD is working on your account right now trying to figure it out. Your webstats showed '429' responses meaning you were getting the 5002 code for a non-trail membership, it is just now that you are getting the 5003 code which would fall into "Other (see log)" responses.
Hi Gary, it's been a week since I opened the ticket with SD. I still haven't heard much from them. I just sent a 3rd follow-up email. Did they contact you by chance?

User avatar
garyan2

Posts: 6609
Joined: Fri Nov 27, 2015 7:23 pm
Location:

HTPC Specs: Show details

#34

Post by garyan2 » Fri Mar 11, 2022 3:35 am

They didn't contact me, but I sent them a message on the 3rd.

Sent from my SM-G965U using Tapatalk

- Gary
Keeping WMC alive beyond January 2020. https://garyan2.github.io

User avatar
MKANET

Posts: 53
Joined: Mon Mar 12, 2012 9:40 pm
Location:

HTPC Specs: Show details

#35

Post by MKANET » Sat May 21, 2022 9:25 pm

Hi Gary, I finally received a comment on the SchedulesDirect forum about everything working, except the poster image downloads. If I understand correctly, he is saying this issue is most likely caused by not using an active token or possibly an issue with the token not working correctly on my setup. Could you please check the response I got on their forum? Is there a possibility something is going wrong with the active token when downloading these images on my machine? Maybe there's a way to debug this issue to find what's causing the active token to not work correctly on my PC; even after a clean reinstall.

https://forums.schedulesdirect.org/view ... 558#p10558

User avatar
garyan2

Posts: 6609
Joined: Fri Nov 27, 2015 7:23 pm
Location:

HTPC Specs: Show details

#36

Post by garyan2 » Sat May 21, 2022 10:06 pm

I posted a comment on the SD forum. The token isn't the issue. I had figured this was resolved a long time ago since I hadn't heard anything since March.
- Gary
Keeping WMC alive beyond January 2020. https://garyan2.github.io

User avatar
MKANET

Posts: 53
Joined: Mon Mar 12, 2012 9:40 pm
Location:

HTPC Specs: Show details

#37

Post by MKANET » Sat May 21, 2022 10:36 pm

Thank.you Gary. I didn't want to take up anymore of your time. Unfortunately, I don't have enough expertise/experience to debug where/why it's failing on my setup;.other than getting generic 5002 MAX_IMAGE_DOWNLOADS  message as a response from SchedulesDirect. It doesn't look like they think there's anything wrong with their service and you don't seem to think there's anything that could go wrong on my end. All I know for sure is both can't be true.

Post Reply