dcbarry
06-29-2010, 08:18 PM
All:
I was out of town for awhile, and came home to find my Tivo HD in a reboot loop. The machine has a hacked PROM, and the CCI patch applied. My initial thought was that an update had come down, and I was not prepared. It had been rebooting for at least a week.
However, turns out that was not the case. I've taken a virgin image from a never booted TivoHD with 9.4 software using WinMFS. However, despite multiple attempts, the machine continues to reboot, during Stage F.
I've attached the same (re-applied) virgin image on the same HD to another HD box that is also PROM hacked. The only difference is the "bad box" is a Fusion Revision 4 box, the "good box" is Fusion Revision 5 or later. This rev5 box box boots normally, and proceeds to the User startup pages. So, we can eliminate bad hard drive as the hardware.
There is no "obvious" failure in the logs. EDIT: See post 3 ... with 11g software, there is an error to review... and it sounds ugly. I am attatching the full logs ("good boot" and "bad boot"). Within this message, just for quick persusal, I'm attaching the segments for the logs that show where the "bad boot" dies by using the good boot. (In other words, other than the time stamp, minor timing differences and the service number of the box, I' showing you where the "bad hardware" dies.) Also to note, that the box "dies" at the same point reliably and consistantly.
Again, full logs are attached.....
(EDIT: need to split over two messages due to length)
kernel:
Jun 29 07:16:51 (none) kernel: Drive bandwidth seems acceptable
Jun 29 07:16:51 (none) kernel: Performing basic S.M.A.R.T. checks
Jun 29 07:16:51 (none) kernel: This can cause DriveStatusError messages in some cases... don't worry.
Jun 29 07:16:51 (none) kernel: Checking /dev/hda
Jun 29 07:16:51 (none) kernel: S.M.A.R.T. pass on /dev/hda
Jun 29 07:16:51 (none) kernel: No forensic selected
Jun 29 07:16:51 (none) kernel: Scanning for phase3 repair scripts
Jun 29 07:16:51 (none) kernel: Running boot Stage F_ApplicationLaunch scripts
Jun 29 07:16:51 (none) kernel: Starting Services.
>>>>>>>> "BAD BOOT" ENDS WITH THIS LINE <<<<<<<<<<<
Jun 29 07:18:52 (none) kernel: [TV_BCMDISPLAY_SET_VIDEO_OUTPUT_MODE] mode=1
Jun 29 07:18:52 (none) kernel: FIRMWARE: Got standby mode update. Standby: NO
Jun 29 07:19:02 (none) kernel: Video feed not attached or on during construction
Jun 29 07:19:02 (none) kernel: [TV_BCMDISPLAY_SET_VIDEO_OUTPUT_MODE] mode=1
Jun 29 07:19:03 (none)
Jun 29 07:19:03 (none) kernel: [TV_BCMDISPLAY_SET_VIDEO_OUTPUT_MODE] mode=1
Jun 29 07:19:07 (none) kernel: Tuner lock acquired
TVLOG:
Jun 29 07:17:11 (none) dbcache[314]: Creating dbcache in program myworld, size = 200
Jun 29 07:17:13 (none) TmkInit[314]: 2.081 seconds: start DbBillboardUtil
Jun 29 07:17:17 (none) TmkInit[314]: 3.831 seconds: start TvSettingsCommonService
Jun 29 07:17:17 (none) TmkActivityManager[314]: Activity High Water Mark: 10
Jun 29 07:17:17 (none) TmkActivityManager[314]: Activity High Water Mark: 20
Jun 29 07:17:17 (none) DbQueryCacheManager[314]: Creating DbQueryCacheManager in program myworld
Jun 29 07:17:17 (none) DbStationDayCache[329]: Directory scan took 0 seconds err = 0x0
Jun 29 07:17:17 (none) DbStationDayCache[329]: Allocated:0 Size:0
Jun 29 07:17:17 (none) DbNowShowingBucketList.C[314]: (130) Create
Jun 29 07:17:17 (none) DbNowShowingBucketList.C[314]: (148) CreateNoRetry strDir=/Recording/NowShowingByBucketTitle
Jun 29 07:17:17 (none) DbFilteredNowShowingBucketList.C[314]: (87) Create
Jun 29 07:17:17 (none) DbFilteredNowShowingBucketList.C[314]: (105) CreateNoRetry strDir=/Recording/NowShowingByFlatTitle
Jun 29 07:17:18 (none) TvSetupSignalSourceQueryServer[314]: TvSetupSignalSourceQueryServer started.
Jun 29 07:17:18 (none) TmkActivityManager[314]: Activity High Water Mark: 30
Jun 29 07:17:23 (none) DbRecordingList.C[329]: (496) Expand nAllocatedM=0 -> nToAllocate=25, freeK =4493
Jun 29 07:17:23 (none) TmkMempool[329]: STAT myworld: blocks=2552 bytes=96856 bytesMax=96920 unusedBytes=4600976 chunks=4 chunkBytes=3584 freeChunks=0 freeChunkBytes=0 maxFreeChunk=4591344
Jun 29 07:17:23 (none) DbRecordingList.C[329]: (539) Expand End, freeK =4491
Jun 29 07:17:23 (none) TmkMempool[329]: STAT myworld: blocks=2553 bytes=98360 bytesMax=98392 unusedBytes=4599464 chunks=4 chunkBytes=3584 freeChunks=0 freeChunkBytes=0 maxFreeChunk=4589832
Jun 29 07:17:23 (none) DbNowShowingBucketList.C[329]: (1010) Dump this=0x5eca6bb0 items=5 Nodes=2 pDirM=/Recording/NowShowingByBucketTitle
Jun 29 07:17:23 (none) DbFilteredNowShowingBucketList.C[329]: (246) DbFilteredNowShowingBucketList::PreLoadDirectory
Jun 29 07:17:23 (none) DbFilteredNowShowingBucketList.C[329]: (489) DbFilteredNowShowingBucketList::PostLoadDirectory
Jun 29 07:17:23 (none) DbFilteredNowShowingBucketList.C[329]: (558) Dump this=0x5eca6cd8 items=1 pDirM=/Recording/NowShowingByFlatTitle
Jun 29 07:17:28 (none) DbFilteredNowShowingBucketList.C[329]: (246) DbFilteredNowShowingBucketList::PreLoadDirectory
Jun 29 07:17:28 (none) DbFilteredNowShowingBucketList.C[329]: (489) DbFilteredNowShowingBucketList::PostLoadDirectory
Jun 29 07:17:28 (none) DbFilteredNowShowingBucketList.C[329]: (558) Dump this=0x5eca6cd8 items=1 pDirM=/Recording/NowShowingByFlatTitle
>>>>>>>> "BAD BOOT" ENDS WITH THIS LINE <<<<<<<<<<<
Jun 29 07:18:51 (none) TmkInit[314]: 93.801 seconds: start TvCryptoManager
Jun 29 07:18:52 (none) mediamgr[314]: Create mom mempool os size 9011200 (0x5e0c0000)
Jun 29 07:18:52 (none) mediamgr[314]: Creating a secure mempool for MOM os size 163840
Jun 29 07:18:52 (none) momglobals.C[314]: Creating 39 buffers of contigmem for encryption
Jun 29 07:18:52 (none) MOMGlobals[314]: TMK_DEBUGGER=not sleep
Jun 29 07:18:52 (none) TvMediaNetworkModule.C[314]: Created
Jun 29 07:18:52 (none) TmkActivityManager[314]: Activity High Water Mark: 40
Jun 29 07:18:52 (none) TvDbGenreMapperTivo[333]: Updating Genre Cache
Jun 29 07:18:52 (none) TvVideoGuts[330]: Setting video policy to TempTogglePolicy
Jun 29 07:18:52 (none) TvVideoGuts[330]: Setting network policy to SharedPolicy
Jun 29 07:18:52 (none) TvVideoClosedCaptionControlServe[330]: VideoClosedCaptionControlServer started.
Jun 29 07:18:52 (none) QeConsole[335]: FIRMWARE: Got standby mode update. Standby: NO
TVERR:
Jun 29 07:16:59 (none) GetListOfKeys[246]: failed to get keys after 10 tries
>>>>>>>> "BAD BOOT" ENDS WITH THIS LINE <<<<<<<<<<<
Jun 29 07:17:04 (none) last message repeated 4 times
Jun 29 07:18:57 (none) GetListOfKeys[335]: failed to get keys after 10 tries
Jun 29 07:19:02 (none) scheduler[380]: Not allowed to schedule this network explicit, refused control: 101
Jun 29 07:19:02 (none) Scheduler[380]: Error 0x2e0069: TvSchedulerSingleNetworkRequestHandler.C line 146
Jun 29 07:21:15 (none) Scheduler[327]: Error 0xffff: HandleDataChangedChore.C line 326
Jun 29 07:21:30 (none) Scheduler[357]: Error 0xffff: HandleDataChangedChore.C line 326
SVCLOG --- is identical except for the time and TIVOID#
CONTINUED ON NEXT POST
I was out of town for awhile, and came home to find my Tivo HD in a reboot loop. The machine has a hacked PROM, and the CCI patch applied. My initial thought was that an update had come down, and I was not prepared. It had been rebooting for at least a week.
However, turns out that was not the case. I've taken a virgin image from a never booted TivoHD with 9.4 software using WinMFS. However, despite multiple attempts, the machine continues to reboot, during Stage F.
I've attached the same (re-applied) virgin image on the same HD to another HD box that is also PROM hacked. The only difference is the "bad box" is a Fusion Revision 4 box, the "good box" is Fusion Revision 5 or later. This rev5 box box boots normally, and proceeds to the User startup pages. So, we can eliminate bad hard drive as the hardware.
There is no "obvious" failure in the logs. EDIT: See post 3 ... with 11g software, there is an error to review... and it sounds ugly. I am attatching the full logs ("good boot" and "bad boot"). Within this message, just for quick persusal, I'm attaching the segments for the logs that show where the "bad boot" dies by using the good boot. (In other words, other than the time stamp, minor timing differences and the service number of the box, I' showing you where the "bad hardware" dies.) Also to note, that the box "dies" at the same point reliably and consistantly.
Again, full logs are attached.....
(EDIT: need to split over two messages due to length)
kernel:
Jun 29 07:16:51 (none) kernel: Drive bandwidth seems acceptable
Jun 29 07:16:51 (none) kernel: Performing basic S.M.A.R.T. checks
Jun 29 07:16:51 (none) kernel: This can cause DriveStatusError messages in some cases... don't worry.
Jun 29 07:16:51 (none) kernel: Checking /dev/hda
Jun 29 07:16:51 (none) kernel: S.M.A.R.T. pass on /dev/hda
Jun 29 07:16:51 (none) kernel: No forensic selected
Jun 29 07:16:51 (none) kernel: Scanning for phase3 repair scripts
Jun 29 07:16:51 (none) kernel: Running boot Stage F_ApplicationLaunch scripts
Jun 29 07:16:51 (none) kernel: Starting Services.
>>>>>>>> "BAD BOOT" ENDS WITH THIS LINE <<<<<<<<<<<
Jun 29 07:18:52 (none) kernel: [TV_BCMDISPLAY_SET_VIDEO_OUTPUT_MODE] mode=1
Jun 29 07:18:52 (none) kernel: FIRMWARE: Got standby mode update. Standby: NO
Jun 29 07:19:02 (none) kernel: Video feed not attached or on during construction
Jun 29 07:19:02 (none) kernel: [TV_BCMDISPLAY_SET_VIDEO_OUTPUT_MODE] mode=1
Jun 29 07:19:03 (none)
Jun 29 07:19:03 (none) kernel: [TV_BCMDISPLAY_SET_VIDEO_OUTPUT_MODE] mode=1
Jun 29 07:19:07 (none) kernel: Tuner lock acquired
TVLOG:
Jun 29 07:17:11 (none) dbcache[314]: Creating dbcache in program myworld, size = 200
Jun 29 07:17:13 (none) TmkInit[314]: 2.081 seconds: start DbBillboardUtil
Jun 29 07:17:17 (none) TmkInit[314]: 3.831 seconds: start TvSettingsCommonService
Jun 29 07:17:17 (none) TmkActivityManager[314]: Activity High Water Mark: 10
Jun 29 07:17:17 (none) TmkActivityManager[314]: Activity High Water Mark: 20
Jun 29 07:17:17 (none) DbQueryCacheManager[314]: Creating DbQueryCacheManager in program myworld
Jun 29 07:17:17 (none) DbStationDayCache[329]: Directory scan took 0 seconds err = 0x0
Jun 29 07:17:17 (none) DbStationDayCache[329]: Allocated:0 Size:0
Jun 29 07:17:17 (none) DbNowShowingBucketList.C[314]: (130) Create
Jun 29 07:17:17 (none) DbNowShowingBucketList.C[314]: (148) CreateNoRetry strDir=/Recording/NowShowingByBucketTitle
Jun 29 07:17:17 (none) DbFilteredNowShowingBucketList.C[314]: (87) Create
Jun 29 07:17:17 (none) DbFilteredNowShowingBucketList.C[314]: (105) CreateNoRetry strDir=/Recording/NowShowingByFlatTitle
Jun 29 07:17:18 (none) TvSetupSignalSourceQueryServer[314]: TvSetupSignalSourceQueryServer started.
Jun 29 07:17:18 (none) TmkActivityManager[314]: Activity High Water Mark: 30
Jun 29 07:17:23 (none) DbRecordingList.C[329]: (496) Expand nAllocatedM=0 -> nToAllocate=25, freeK =4493
Jun 29 07:17:23 (none) TmkMempool[329]: STAT myworld: blocks=2552 bytes=96856 bytesMax=96920 unusedBytes=4600976 chunks=4 chunkBytes=3584 freeChunks=0 freeChunkBytes=0 maxFreeChunk=4591344
Jun 29 07:17:23 (none) DbRecordingList.C[329]: (539) Expand End, freeK =4491
Jun 29 07:17:23 (none) TmkMempool[329]: STAT myworld: blocks=2553 bytes=98360 bytesMax=98392 unusedBytes=4599464 chunks=4 chunkBytes=3584 freeChunks=0 freeChunkBytes=0 maxFreeChunk=4589832
Jun 29 07:17:23 (none) DbNowShowingBucketList.C[329]: (1010) Dump this=0x5eca6bb0 items=5 Nodes=2 pDirM=/Recording/NowShowingByBucketTitle
Jun 29 07:17:23 (none) DbFilteredNowShowingBucketList.C[329]: (246) DbFilteredNowShowingBucketList::PreLoadDirectory
Jun 29 07:17:23 (none) DbFilteredNowShowingBucketList.C[329]: (489) DbFilteredNowShowingBucketList::PostLoadDirectory
Jun 29 07:17:23 (none) DbFilteredNowShowingBucketList.C[329]: (558) Dump this=0x5eca6cd8 items=1 pDirM=/Recording/NowShowingByFlatTitle
Jun 29 07:17:28 (none) DbFilteredNowShowingBucketList.C[329]: (246) DbFilteredNowShowingBucketList::PreLoadDirectory
Jun 29 07:17:28 (none) DbFilteredNowShowingBucketList.C[329]: (489) DbFilteredNowShowingBucketList::PostLoadDirectory
Jun 29 07:17:28 (none) DbFilteredNowShowingBucketList.C[329]: (558) Dump this=0x5eca6cd8 items=1 pDirM=/Recording/NowShowingByFlatTitle
>>>>>>>> "BAD BOOT" ENDS WITH THIS LINE <<<<<<<<<<<
Jun 29 07:18:51 (none) TmkInit[314]: 93.801 seconds: start TvCryptoManager
Jun 29 07:18:52 (none) mediamgr[314]: Create mom mempool os size 9011200 (0x5e0c0000)
Jun 29 07:18:52 (none) mediamgr[314]: Creating a secure mempool for MOM os size 163840
Jun 29 07:18:52 (none) momglobals.C[314]: Creating 39 buffers of contigmem for encryption
Jun 29 07:18:52 (none) MOMGlobals[314]: TMK_DEBUGGER=not sleep
Jun 29 07:18:52 (none) TvMediaNetworkModule.C[314]: Created
Jun 29 07:18:52 (none) TmkActivityManager[314]: Activity High Water Mark: 40
Jun 29 07:18:52 (none) TvDbGenreMapperTivo[333]: Updating Genre Cache
Jun 29 07:18:52 (none) TvVideoGuts[330]: Setting video policy to TempTogglePolicy
Jun 29 07:18:52 (none) TvVideoGuts[330]: Setting network policy to SharedPolicy
Jun 29 07:18:52 (none) TvVideoClosedCaptionControlServe[330]: VideoClosedCaptionControlServer started.
Jun 29 07:18:52 (none) QeConsole[335]: FIRMWARE: Got standby mode update. Standby: NO
TVERR:
Jun 29 07:16:59 (none) GetListOfKeys[246]: failed to get keys after 10 tries
>>>>>>>> "BAD BOOT" ENDS WITH THIS LINE <<<<<<<<<<<
Jun 29 07:17:04 (none) last message repeated 4 times
Jun 29 07:18:57 (none) GetListOfKeys[335]: failed to get keys after 10 tries
Jun 29 07:19:02 (none) scheduler[380]: Not allowed to schedule this network explicit, refused control: 101
Jun 29 07:19:02 (none) Scheduler[380]: Error 0x2e0069: TvSchedulerSingleNetworkRequestHandler.C line 146
Jun 29 07:21:15 (none) Scheduler[327]: Error 0xffff: HandleDataChangedChore.C line 326
Jun 29 07:21:30 (none) Scheduler[357]: Error 0xffff: HandleDataChangedChore.C line 326
SVCLOG --- is identical except for the time and TIVOID#
CONTINUED ON NEXT POST