ReIndex Took 3 Hours?

An evolving, supported alternative to Rovi
Forum rules
★ Download the latest EPG123 here: http://epg123.garyan2.net <> Setup guide here: http://epg123.garyan2.net/downloads/epg123_Guide.pdf
Post Reply
Sammy2

Posts: 1665
Joined: Fri Aug 24, 2012 7:35 pm
Location:

HTPC Specs: Show details

ReIndex Took 3 Hours?

#1

Post by Sammy2 » Thu Mar 31, 2016 1:54 pm

Here's a log of last nights run on v0.9.2. All went well and there's no longer reporting of time slot mismatches but the ReIndex took 3 hours! Hmm.

Code: Select all

[3/31/2016 12:00:03 AM] ===============================================================================
[3/31/2016 12:00:03 AM]  Beginning epg123 update execution.
[3/31/2016 12:00:03 AM] ===============================================================================
[3/31/2016 12:00:05 AM] [ INFO] epg123 version 0.9.2 , DaysToDownload: 30 , PrefixEpisodeTitle: True , AutoImport: True , TMDbCoverArt: True , LogoOverride: True , Automatch: False
[3/31/2016 12:00:09 AM] [ INFO] Successfully retrieved TMDb configurations.
[3/31/2016 12:00:10 AM] [ INFO] Token request successful. serverID: 20141201.web.1
[3/31/2016 12:00:10 AM] [ERROR] epg123 is not recognized as an approved app from Schedules Direct. code: 1005 , message: Did not recognize the submitted client. , datetime: 2016-03-31T07:00:10Z
[3/31/2016 12:00:10 AM] [ INFO] Successfully requested listing of client lineups from Schedules Direct.
[3/31/2016 12:00:11 AM] [ INFO] Successfully retrieved the station mapping for lineup USA-CA04768-X.
[3/31/2016 12:00:11 AM] Entering getAllScheduleEntryMd5s() for 30 days on 642 stations.
[3/31/2016 12:00:29 AM] [ INFO] Successfully retrieved Md5s for 642 station's daily schedules.
[3/31/2016 12:00:39 AM] [ INFO] Successfully retrieved 490 station's daily schedules.
[3/31/2016 12:02:11 AM] Exiting getAllScheduleEntryMd5s(). SUCCESS.
[3/31/2016 12:02:11 AM] Entering buildAllProgramEntries() for 51048 programs.
[3/31/2016 12:04:19 AM] [ INFO] Successfully retrieved 930 programs metadata.
[3/31/2016 12:04:22 AM] Exiting buildAllProgramEntries(). SUCCESS.
[3/31/2016 12:04:22 AM] Entering buildAllGenericSeriesInfoDescriptions() for 9824 series.
[3/31/2016 12:05:08 AM] [ INFO] Successfully retrieved 82 programs generic description metadata.
[3/31/2016 12:05:09 AM] Exiting buildAllGenericSeriesInfoDescriptions(). SUCCESS.
[3/31/2016 12:05:09 AM] Entering getAllMoviePosters() for 5860 movies.
[3/31/2016 12:05:10 AM] [ INFO] Successfully retrieved artwork info for 19 programs.
[3/31/2016 12:05:11 AM] [ INFO] TMDb catalog search for "Los Pobres Van al Cielo" from 1951 found 1 results.
[3/31/2016 12:05:11 AM] [ INFO] TMDb catalog search for "Acuérdate de Vivir" from 1953 found 1 results.
[3/31/2016 12:05:11 AM] [ INFO] TMDb catalog search for "Escenas de un Matrimonio" from 1973 found 0 results.
[3/31/2016 12:05:11 AM] [ INFO] TMDb catalog search for "Escenas de un Matrimonio" from 1974 found 0 results.
[3/31/2016 12:05:11 AM] [ INFO] TMDb catalog search for "Escenas de un Matrimonio" from 1972 found 0 results.
[3/31/2016 12:05:11 AM] [ INFO] TMDb catalog search for "Cada Loco Con Su Tema" from 1939 found 1 results.
[3/31/2016 12:05:11 AM] [ INFO] TMDb catalog search for "Secreto Eterno" from 1942 found 0 results.
[3/31/2016 12:05:11 AM] [ INFO] TMDb catalog search for "Secreto Eterno" from 1943 found 0 results.
[3/31/2016 12:05:12 AM] [ INFO] TMDb catalog search for "Secreto Eterno" from 1941 found 0 results.
[3/31/2016 12:05:12 AM] Exiting getAllMoviePosters(). SUCCESS.
[3/31/2016 12:05:12 AM] Entering getAllSportsImages() for 909 sports showings.
[3/31/2016 12:05:12 AM] [ INFO] Successfully retrieved artwork info for 43 programs.
[3/31/2016 12:05:12 AM] Exiting getAllSportsImages(). SUCCESS.
[3/31/2016 12:05:12 AM] Entering getAllSeriesImages() for 9824 series.
[3/31/2016 12:05:13 AM] [ INFO] Successfully retrieved artwork info for 500 programs.
[3/31/2016 12:05:14 AM] [ INFO] Successfully retrieved artwork info for 91 programs.
[3/31/2016 12:05:15 AM] Exiting getAllSeriesImages(). SUCCESS.
[3/31/2016 12:05:15 AM] Entering writeImageArchive().
[3/31/2016 12:05:15 AM] Exiting writeImageArchive(). SUCCESS.
[3/31/2016 12:05:15 AM] Entering writeMxf().
[3/31/2016 12:05:17 AM] Exiting writeMxf(). SUCCESS.
[3/31/2016 12:05:17 AM] [STATS] Generated .mxf file contains 642 services, 9824 series, 51048 programs, and 65325 people with 14156 image links.
[3/31/2016 12:08:47 AM] [ INFO] Successfully imported .mxf file into Media Center. Exit code: 0
[3/31/2016 12:08:47 AM] Beginning AutoMatch feature.
[3/31/2016 12:08:49 AM] Completed AutoMatch feature.
[3/31/2016 12:08:49 AM] [ INFO] Starting ehPrivJob.exe /DoReindexSearchRoot to index guide data.
[3/31/2016 3:07:10 AM] [ INFO] Successfully completed the ReindexSearchRoot task. Exit code: 0
[3/31/2016 3:07:10 AM] [ INFO] Beginning cache cleanup routine.
[3/31/2016 3:07:28 AM] [ INFO] 2261 files deleted from the cache directory during cleanup.
[3/31/2016 3:07:28 AM] [STATS] epg123 execution time was 03:07:22.4421089.

User avatar
garyan2

Posts: 3470
Joined: Fri Nov 27, 2015 7:23 pm
Location:

HTPC Specs: Show details

#2

Post by garyan2 » Fri Apr 01, 2016 2:20 am

Sammy2 wrote:Here's a log of last nights run on v0.9.2. All went well and there's no longer reporting of time slot mismatches but the ReIndex took 3 hours! Hmm.

Code: Select all

[3/31/2016 12:00:03 AM] ===============================================================================
[3/31/2016 12:00:03 AM]  Beginning epg123 update execution.
[3/31/2016 12:00:03 AM] ===============================================================================
[3/31/2016 12:00:05 AM] [ INFO] epg123 version 0.9.2 , DaysToDownload: 30 , PrefixEpisodeTitle: True , AutoImport: True , TMDbCoverArt: True , LogoOverride: True , Automatch: False
[3/31/2016 12:00:09 AM] [ INFO] Successfully retrieved TMDb configurations.
[3/31/2016 12:00:10 AM] [ INFO] Token request successful. serverID: 20141201.web.1
[3/31/2016 12:00:10 AM] [ERROR] epg123 is not recognized as an approved app from Schedules Direct. code: 1005 , message: Did not recognize the submitted client. , datetime: 2016-03-31T07:00:10Z
[3/31/2016 12:00:10 AM] [ INFO] Successfully requested listing of client lineups from Schedules Direct.
[3/31/2016 12:00:11 AM] [ INFO] Successfully retrieved the station mapping for lineup USA-CA04768-X.
[3/31/2016 12:00:11 AM] Entering getAllScheduleEntryMd5s() for 30 days on 642 stations.
[3/31/2016 12:00:29 AM] [ INFO] Successfully retrieved Md5s for 642 station's daily schedules.
[3/31/2016 12:00:39 AM] [ INFO] Successfully retrieved 490 station's daily schedules.
[3/31/2016 12:02:11 AM] Exiting getAllScheduleEntryMd5s(). SUCCESS.
[3/31/2016 12:02:11 AM] Entering buildAllProgramEntries() for 51048 programs.
[3/31/2016 12:04:19 AM] [ INFO] Successfully retrieved 930 programs metadata.
[3/31/2016 12:04:22 AM] Exiting buildAllProgramEntries(). SUCCESS.
[3/31/2016 12:04:22 AM] Entering buildAllGenericSeriesInfoDescriptions() for 9824 series.
[3/31/2016 12:05:08 AM] [ INFO] Successfully retrieved 82 programs generic description metadata.
[3/31/2016 12:05:09 AM] Exiting buildAllGenericSeriesInfoDescriptions(). SUCCESS.
[3/31/2016 12:05:09 AM] Entering getAllMoviePosters() for 5860 movies.
[3/31/2016 12:05:10 AM] [ INFO] Successfully retrieved artwork info for 19 programs.
[3/31/2016 12:05:11 AM] [ INFO] TMDb catalog search for "Los Pobres Van al Cielo" from 1951 found 1 results.
[3/31/2016 12:05:11 AM] [ INFO] TMDb catalog search for "Acuérdate de Vivir" from 1953 found 1 results.
[3/31/2016 12:05:11 AM] [ INFO] TMDb catalog search for "Escenas de un Matrimonio" from 1973 found 0 results.
[3/31/2016 12:05:11 AM] [ INFO] TMDb catalog search for "Escenas de un Matrimonio" from 1974 found 0 results.
[3/31/2016 12:05:11 AM] [ INFO] TMDb catalog search for "Escenas de un Matrimonio" from 1972 found 0 results.
[3/31/2016 12:05:11 AM] [ INFO] TMDb catalog search for "Cada Loco Con Su Tema" from 1939 found 1 results.
[3/31/2016 12:05:11 AM] [ INFO] TMDb catalog search for "Secreto Eterno" from 1942 found 0 results.
[3/31/2016 12:05:11 AM] [ INFO] TMDb catalog search for "Secreto Eterno" from 1943 found 0 results.
[3/31/2016 12:05:12 AM] [ INFO] TMDb catalog search for "Secreto Eterno" from 1941 found 0 results.
[3/31/2016 12:05:12 AM] Exiting getAllMoviePosters(). SUCCESS.
[3/31/2016 12:05:12 AM] Entering getAllSportsImages() for 909 sports showings.
[3/31/2016 12:05:12 AM] [ INFO] Successfully retrieved artwork info for 43 programs.
[3/31/2016 12:05:12 AM] Exiting getAllSportsImages(). SUCCESS.
[3/31/2016 12:05:12 AM] Entering getAllSeriesImages() for 9824 series.
[3/31/2016 12:05:13 AM] [ INFO] Successfully retrieved artwork info for 500 programs.
[3/31/2016 12:05:14 AM] [ INFO] Successfully retrieved artwork info for 91 programs.
[3/31/2016 12:05:15 AM] Exiting getAllSeriesImages(). SUCCESS.
[3/31/2016 12:05:15 AM] Entering writeImageArchive().
[3/31/2016 12:05:15 AM] Exiting writeImageArchive(). SUCCESS.
[3/31/2016 12:05:15 AM] Entering writeMxf().
[3/31/2016 12:05:17 AM] Exiting writeMxf(). SUCCESS.
[3/31/2016 12:05:17 AM] [STATS] Generated .mxf file contains 642 services, 9824 series, 51048 programs, and 65325 people with 14156 image links.
[3/31/2016 12:08:47 AM] [ INFO] Successfully imported .mxf file into Media Center. Exit code: 0
[3/31/2016 12:08:47 AM] Beginning AutoMatch feature.
[3/31/2016 12:08:49 AM] Completed AutoMatch feature.
[3/31/2016 12:08:49 AM] [ INFO] Starting ehPrivJob.exe /DoReindexSearchRoot to index guide data.
[3/31/2016 3:07:10 AM] [ INFO] Successfully completed the ReindexSearchRoot task. Exit code: 0
[3/31/2016 3:07:10 AM] [ INFO] Beginning cache cleanup routine.
[3/31/2016 3:07:28 AM] [ INFO] 2261 files deleted from the cache directory during cleanup.
[3/31/2016 3:07:28 AM] [STATS] epg123 execution time was 03:07:22.4421089.
I suspect this will be a task priority issue. Before, when using the task scheduler to kick off the reindex, epg123 didn't wait for completion of the task, it would just wait for it to start. Now with 0.9.x, I am monitoring the entire execution of the reindex and if it runs with too low a priority will evidently last a very long time. You could edit the task in task scheduler to up the priority to see if that makes a difference ... a 5 is normal.
- Gary
Stomping out the Rovi disease, one media center at a time. http://epg123.garyan2.net

Sammy2

Posts: 1665
Joined: Fri Aug 24, 2012 7:35 pm
Location:

HTPC Specs: Show details

#3

Post by Sammy2 » Fri Apr 01, 2016 1:58 pm

So for some it doesn't run at all but for me it takes three hours.

So this task is in task manager and I need to change the priority to 5?

glorp

Posts: 334
Joined: Sun Sep 23, 2012 2:54 pm
Location:

HTPC Specs: Show details

#4

Post by glorp » Fri Apr 01, 2016 3:23 pm

You have to export the existing task in TM, edit the xml that the export produces (there's a tag in the full definition called, IIRC, <Priority>) then delete the old task and import the new from xml in TM. Not exactly user friendly as it's not something that can be set from Windows TM GUI. Priorities can range from 0-7. 7 is lowest. 4, 5, 6 are "Normal" meaning it will compete equally with other desktop activities which also are in that range. I use "4" for all of mine since I am scheduling them when no one is using the MC. They all tend to take fairly consistent times now but I do run the reindex asynchronously so I have no idea how long that really takes.

User avatar
garyan2

Posts: 3470
Joined: Fri Nov 27, 2015 7:23 pm
Location:

HTPC Specs: Show details

#5

Post by garyan2 » Fri Apr 01, 2016 4:14 pm

Version 0.7.6 created the task with priority 7 ... 0.9.x creates it with priority 6. If you current task was created with 0.7.x then you could delete the task and recreate it with x0.9.x to boost the priority. Don't know how much boost it will be.
- Gary
Stomping out the Rovi disease, one media center at a time. http://epg123.garyan2.net

Sammy2

Posts: 1665
Joined: Fri Aug 24, 2012 7:35 pm
Location:

HTPC Specs: Show details

#6

Post by Sammy2 » Fri Apr 01, 2016 10:05 pm

Last night's run was 3 minutes.

It turns out that I was recording a 3 hour movie at midnight the night before. That is a priority so I think I'll leave the task priority as is because it did finish, it just took a while..

User avatar
garyan2

Posts: 3470
Joined: Fri Nov 27, 2015 7:23 pm
Location:

HTPC Specs: Show details

#7

Post by garyan2 » Fri Apr 01, 2016 10:15 pm

Sammy2 wrote:Last night's run was 3 minutes.

It turns out that I was recording a 3 hour movie at midnight the night before. That is a priority so I think I'll leave the task priority as is because it did finish, it just took a while..
I would agree ... do you know if the task was created with 0.7.6 (priority 7) or 0.9.x (priority 6)?
- Gary
Stomping out the Rovi disease, one media center at a time. http://epg123.garyan2.net

Sammy2

Posts: 1665
Joined: Fri Aug 24, 2012 7:35 pm
Location:

HTPC Specs: Show details

#8

Post by Sammy2 » Sun Apr 03, 2016 5:18 pm

garyan2 wrote:
Sammy2 wrote:Last night's run was 3 minutes.

It turns out that I was recording a 3 hour movie at midnight the night before. That is a priority so I think I'll leave the task priority as is because it did finish, it just took a while..
I would agree ... do you know if the task was created with 0.7.6 (priority 7) or 0.9.x (priority 6)?
I was using v0.9.2. I'm good. It worked perfectly to prevent issues with recording.

Post Reply