Page 2 of 2

Re: EPG Yesterday

Posted: Fri Apr 23, 2021 5:24 pm
by garyan2
You could run an update with epg123 without the nogc parameter and see any errors it spits out, but you would still be where you are right now. I think it is obvious that the garbage collector is failing. The [Rebuild WMC Database] would be the way to go to correct it. You will lose your recording histories, but it will be a nice fresh database and the GC will complete in considerably less time.

Re: EPG Yesterday

Posted: Sat Apr 24, 2021 12:19 am
by Space
I'll try these two things tonight.

I assume you haven't seen this problem in your systems. I hope this is just a one-off issue that only I am having and will be fixed by at least rebuilding the DB. Rebuilding should clear out all the old data, but I'll also have to make sure it is allowing garbage collection to work again.

Has anyone else noticed that garbage collection is taking longer than usual? If you use something like Remote Potato to view the TV listings, can you go back in time more than 5 or 6 days and still see full listings?

Re: EPG Yesterday

Posted: Sat Apr 24, 2021 5:06 am
by Space
Letting EPG123 do garbage collection did nothing different, and no log messages, so I rebuilt the DB.

This resulted in the mcepg2-0.db file going from about 1.3 GB to 224 MB.

I also noticed that there is a file in the mcepg2-0 folder called Blocks.mem, and it's size went from 104 MB to 1.7 MB. Not sure if this is significant.

I also noticed a periodic message in the Event Log:
Source: srv
Description: The server was unable to allocate from the system nonpaged pool because the server reached the configured limit for nonpaged pool allocations.

Not sure if this may be related to the problem.

I'll wait 5 or 6 days for the garbage collection to run again and see if it is working. But right now the TV listings only go back to April 22 at 8pm, as expected, before that there is nothing...

Re: EPG Yesterday

Posted: Sat Apr 24, 2021 2:20 pm
by StinkyImp
Space wrote: Sat Apr 24, 2021 12:19 am Has anyone else noticed that garbage collection is taking longer than usual?
I look at these times occasionally and it appears that mine runs an average of around 10 minutes. It's been pretty consistent since June 2020.

These are my times for this year...

Code: Select all

EPG123 Log Parser (and Report Generator) - v 1.7.6 (64 bit)
Report Created on 04/24/2021 at 07:14:45
================================================================
[1/3/2021 12:15:22 AM] Entering PerformGarbageCleanup().
[1/3/2021 12:26:24 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[1/8/2021 12:15:24 AM] Entering PerformGarbageCleanup().
[1/8/2021 12:26:43 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[1/13/2021 12:15:24 AM] Entering PerformGarbageCleanup().
[1/13/2021 12:27:06 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[1/18/2021 12:15:22 AM] Entering PerformGarbageCleanup().
[1/18/2021 12:25:25 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[1/23/2021 12:15:29 AM] Entering PerformGarbageCleanup().
[1/23/2021 12:24:55 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[1/28/2021 12:15:26 AM] Entering PerformGarbageCleanup().
[1/28/2021 12:24:16 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[2/2/2021 12:15:27 AM] Entering PerformGarbageCleanup().
[2/2/2021 12:24:32 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[2/7/2021 12:15:25 AM] Entering PerformGarbageCleanup().
[2/7/2021 12:25:57 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[2/12/2021 12:15:26 AM] Entering PerformGarbageCleanup().
[2/12/2021 12:28:11 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[2/17/2021 12:15:28 AM] Entering PerformGarbageCleanup().
[2/17/2021 12:29:29 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[2/22/2021 12:15:26 AM] Entering PerformGarbageCleanup().
[2/22/2021 12:30:50 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[2/27/2021 12:15:27 AM] Entering PerformGarbageCleanup().
[2/27/2021 12:25:57 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[3/4/2021 12:15:27 AM] Entering PerformGarbageCleanup().
[3/4/2021 12:24:44 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[3/9/2021 12:15:26 AM] Entering PerformGarbageCleanup().
[3/9/2021 12:24:46 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[3/14/2021 12:16:34 AM] Entering PerformGarbageCleanup().
[3/14/2021 12:26:14 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[3/19/2021 12:15:13 AM] Entering PerformGarbageCleanup().
[3/19/2021 12:23:19 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[3/24/2021 12:45:30 AM] Entering PerformGarbageCleanup().
[3/24/2021 12:56:22 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[3/29/2021 12:45:28 AM] Entering PerformGarbageCleanup().
[3/29/2021 12:56:14 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[4/3/2021 12:45:26 AM] Entering PerformGarbageCleanup().
[4/3/2021 12:56:49 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[4/8/2021 12:45:27 AM] Entering PerformGarbageCleanup().
[4/8/2021 12:58:32 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[4/13/2021 12:45:25 AM] Entering PerformGarbageCleanup().
[4/13/2021 12:59:13 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[4/18/2021 12:45:27 AM] Entering PerformGarbageCleanup().
[4/18/2021 1:00:13 AM] Exiting PerformGarbageCleanup(). SUCCESS.
[4/23/2021 12:45:26 AM] Entering PerformGarbageCleanup().
[4/23/2021 12:55:21 AM] Exiting PerformGarbageCleanup(). SUCCESS.

===== QUERY INFORMATION (Predefined) ===========================
Logs used:		trace.log ONLY
Search String:		PerformGarbageCleanup
Date Range:		01/01/2021 thru 04/24/2021 (114 days)
Total results found:	46
Query time:		07 seconds

===== GENERAL INFORMATION ======================================
Log Path:		C:\epg123\
Logfile timespan:	1/1/2021 thru 4/24/2021 (114 days)
Total lines processed:	8481

Re: EPG Yesterday

Posted: Wed Apr 28, 2021 2:47 am
by Space
Garbage collection ran on it's own yesterday and I checked the guide before and after and there was no change, I still have guide data going back to April 22nd at 8pm (ET). I wonder what might be preventing it from purging the old guide data?

I might try stopping the Remote Potato server before running GC again, but I've been running that for years and as far as I know it's been fine.

Any other ideas?

Re: EPG Yesterday

Posted: Wed May 19, 2021 9:47 am
by Space
I still have guide data going all the way back to April 22nd in my WMC DB according to Remote Potato.

Nobody else is having this issue?

My garbage collection (GC) "system maintenance" task has gone from taking over 2 hours to complete to under 1 hour (like it used to be), so "Rebuild WMC database" did clear out old data that was probably causing the GC to take longer.

Now I'm not sure if GC is even doing anything on my system... I know it is not purging old guide data (although there does seem to be gaps here and there, but for the most part the entire guide is present all the way back to April 22nd), but I don't know if it is working to purge any other old data.

I assume the time to run the GC process will continue to grow and I will have to rebuild the WMC database again to get it below an hour again.

I'm guessing that the GC process IS doing something, because I have not had any problems (other than GC taking a long time to run) and I know if you do not do GC for a long time it will eventually cause issues.

If anyone else can run Remote Potato and see how far back you can go in the "TV Guide" and still have guide data, I would appreciate it. I want to be sure that it is only me that is having this issue and it is not a more widespread problem. I can't understand why it would only be me, since a rebuild of the DB should rule out any DB corruption issues, although maybe there is something in the backups that when reloaded in to the new DB causes this issue.

Re: EPG Yesterday

Posted: Wed May 19, 2021 2:53 pm
by StinkyImp
Space wrote: Wed May 19, 2021 9:47 amIf anyone else can run Remote Potato and see how far back you can go in the "TV Guide" and still have guide data, I would appreciate it.
I don't use Remote Potato but I do use Kodi. This is purely anecdotal but the guide in Kodi (using ServerWMC) currently goes back to March 18th at 7:30AM or around 24 hours into the past.

My GC is consistent with my prior post.

Re: EPG Yesterday

Posted: Thu May 20, 2021 1:40 am
by garyan2
How does one make Remote Potato show prior guide listings? I am only able to see a few hours before the current time. I've never used it before, but I am not seeing how to get it show past guide listings.

Re: EPG Yesterday

Posted: Thu May 20, 2021 6:16 am
by Space
For me, it is a simple matter of (in the Silverlight interface) going to "TV Guide" and then besides the current date in upper middle of the screen there is a right-arrow that allows you to go forward to the next day and a left-arrow to go back to the previous day. I can press that left facing arrow all they way back to April 22nd.

I tried doing this in the HTML interface for Remote Potato, and it looks like it is not possible, so you have to use the Silverlight version (meaning you have to have Silverlight installed in a browser that supports Silverlight, I am using IE11 for Win 10, I don't think it works on current versions of Chrome or Firefox).

Silverlight will be discontinued in October, so I'll have to see what that means for my use of Remote Potato...

Re: EPG Yesterday

Posted: Fri May 21, 2021 4:51 pm
by StinkyImp
I know these replies are in reference to Remote Potato but I presume that ServerWMC pulls from the same source to provide the guide to Kodi. The underlying question is whether anyone else is showing a "past" date going back a month or more.

My previous post inferred that I could only go back 24 hours but then I found a setting that allowed me to choose how far back to go, so I set it for 30 days. Even then it only went back approximately a day.

Note: It was previously set to go back for one day.

Image

Edit: It also appears that ServerWMC pulls the entire "raw" WMC database for processing. :think:

Image

Re: EPG Yesterday

Posted: Sat May 22, 2021 12:30 am
by Space
I'm not sure how ServerWMC works, but I would think that the way the WMC database works is that it keep updating with new guide data daily and when the garbage cleanup runs (which is typically every 5 days) it would remove all the days from the past. At least this seems like the way it should work.

This means that the most number of guide data days you should have in the past is about 5 or 6 days.

Re: EPG Yesterday

Posted: Sat May 22, 2021 5:10 am
by garyan2
Okay, finally had time to install Remote Potato on my laptop and see what I can see. My last garbage cleanup run was on 5/19 and Remote Potato would show nothing prior to 5/18 which makes sense. Not sure why yours would be any different unless GC fails to work if RP is running for some reason. But you said you never had a problem like this before, so....

Re: EPG Yesterday

Posted: Sat May 22, 2021 12:07 pm
by Space
Yeah, never had a problem with it before, as far as I know, at least. I mean the only real side affect of it happening that I've noticed is the longer time it takes to run GC and the fact that you can go way back in the guide in Remote Potato.

I didn't notice either of those before, but I never really looked, although I would assume I would have noticed the GC taking longer prior to now.

I'm trying to think or anything that might have changed, but I've been using Remote Potato for years, so I doubt it is that, although I'll try shutting it down and run a GC when I have some extra time.

I'll also make note of the size of the DB file to see if it changes after GC (although I'm not sure if a GC should cause it to reduce in size).