HR10-250 6.3 in reboot loop

[SpoonsJTD]

My wife and I watched a show from my hr10-250 last night with no issues. I got up this morning and noticed it was in a reboot loop:

CPU revision is: 00005430
FPU revision is: 00005410
Primary instruction cache 32kb, linesize 32 bytes.
Primary data cache 32kb, linesize 32 bytes.
Linux version 2.4.20 (build@buildmaster50) (gcc version 3.3.4) #1 Tue Feb 14 20:
55:02 PST 2006
Determined physical RAM map:
memory: 08000000 @ 00000000 (usable)
On node 0 totalpages: 32768
zone(0): 32768 pages.
zone(1): 0 pages.
zone(2): 0 pages.
Kernel command line: root=/dev/hda7 dsscon=true upgradesoftware=false console=2,
115200
Monotonic time calibrated: 81.01 counts per usec
Calibrating delay loop... 161.79 BogoMIPS
Contiguous region 1: 12582912 bytes @ address 0x80585000
Contiguous region 2: 2097152 bytes @ address 0x81185000
Contiguous region 8: 23068672 bytes @ address 0x81385000
Contiguous region of 37748736 bytes total reserved at 0x80585000.
Memory: 91232k/131072k available (1224k kernel code, 39840k reserved, 68k data,
64k init, 0k highmem)
Dentry cache hash table entries: 16384 (order: 5, 131072 bytes)
Inode cache hash table entries: 8192 (order: 4, 65536 bytes)
Mount-cache hash table entries: 2048 (order: 2, 16384 bytes)
Buffer-cache hash table entries: 8192 (order: 3, 32768 bytes)
Page-cache hash table entries: 32768 (order: 5, 131072 bytes)
Checking for 'wait' instruction... unavailable.
POSIX conformance testing by UNIFIX
PCI: Probing PCI hardware
ttyS00 at iomem 0xb4100100 (irq = 79) is a 16550A
ttyS00 at port 0xbc010000 (irq = 133) is a unknown
ttyS00 at iomem 0xb4100140 (irq = 81) is a 16550A
ttyS00 at iomem 0xb4100120 (irq = 80) is a 16550A
Linux NET4.0 for Linux 2.4
Based upon Swansea University Computer Society NET3.039
Initializing RT netlink socket
Starting kswapd
Serial driver version 5.05c (2001-07-08) with MANY_PORTS SHARE_IRQ SERIAL_PCI en
abled
ttyS00 at 0xb4100100 (irq = 79) is a 16550A
ttyS01 at 0xbc010000 (irq = 133) is a unknown
ttyS02 at 0xb4100140 (irq = 81) is a 16550A
ttyS03 at 0xb4100120 (irq = 80) is a 16550A
Uniform Multi-Platform E-IDE driver Revision: 6.31
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
hda: WDC WD2500BB-55GUA0, ATA DISK drive
ide0 at 0x400-0x407,0x438 on irq 87
hda: 488397168 sectors (250059 MB) w/2048KiB Cache, CHS=30401/255/63
Partition check:
hda: [mac] hda1 hda2 hda3 hda4 hda5 hda6 hda7 hda8 hda9 hda10 hda11[M] hda12 hd
a13[M]
RAMDISK driver initialized: 16 RAM disks of 4096K size 1024 blocksize
PPP generic driver version 2.4.2
PPP Deflate Compression module registered
Kernel Panic Logger registered
NET4: Linux TCP/IP 1.0 for NET4.0
IP Protocols: ICMP, UDP, TCP
IP: routing cache hash table of 1024 buckets, 8Kbytes
TCP: Hash tables configured (established 8192 bind 16384)
ip_conntrack version 2.1 (1024 buckets, 8192 max) - 152 bytes per conntrack
ip_tables: (C) 2000-2002 Netfilter core team
NET4: Unix domain sockets 1.0/SMP for Linux NET4.0.
VFS: Mounted root (ext2 filesystem) readonly.
Freeing unused kernel memory: 64k freed
Starting rc.sysinit
Running boot Stage A_PreKickstart scripts
Scanning for configuration files
/etc/rc.d/rc.sysinit: [global]: command not found
/etc/rc.d/rc.sysinit: interfaces: command not found
/etc/rc.d/rc.sysinit: workgroup: command not found
/etc/rc.d/rc.sysinit: server: command not found
/etc/rc.d/rc.sysinit: netbios: command not found
/etc/rc.d/rc.sysinit: security: command not found
/etc/rc.d/rc.sysinit: guest: command not found
/etc/rc.d/rc.sysinit: hosts: command not found
/etc/rc.d/rc.sysinit: encrypt: command not found
/etc/rc.d/rc.sysinit: [Root]: command not found
/etc/rc.d/rc.sysinit: path: command not found
/etc/rc.d/rc.sysinit: guest: command not found
/etc/rc.d/rc.sysinit: guest: command not found
/etc/rc.d/rc.sysinit: writable: command not found
/etc/rc.d/rc.sysinit: browsable: command not found
Loading tivoconfig.o
Invoking startup scripts for:
platform 'phoenix'
implementation 'Series2'
implementer 'TiVo'
Releasing /initrd and clearing ramdisk, if they exist
umount: /initrd: not mounted
Activating swap partitions
Adding Swap: 131064k swap-space (priority -1)
Loading core system drivers
Loading fpga.o
Parallel modem driver loaded, 1 ports starting at /dev/ttyS1
Loading i2c_Series2.o
Loading ircatch.o
Found rev 'F' Si2433 modem on /dev/cua1
Checking for Kickstart panic signal
Running boot Stage B_PostKickstart scripts
Cleanup /dev/hda9 pass 1
ext2fs_check_if_mount: No such file or directory while determining whether /dev/
hda9 is mounted.
/dev/hda9 was not cleanly unmounted, check forced.
Inode 2070, i_blocks wrong 3254 (counted=3240). Set i_blocks to counted? yes

Inode 2062, i_blocks wrong 10248 (counted=10234). Set i_blocks to counted? yes

Inode 2071, i_blocks wrong 1210 (counted=1198). Set i_blocks to counted? yes

Fix summary information? yes

/dev/hda9: 401/32768 files (2.5% non-contiguous), 17826/131072 blocks
Cleanup /dev/hda9 pass 2
ext2fs_check_if_mount: No such file or directory while determining whether /dev/
hda9 is mounted.
/dev/hda9: clean, 401/32768 files, 17826/131072 blocks
/dev/hda9 is clean after pass 2
Mounting /var
/dev/hda9 on /var type ext2 (rw)
Cleaning up files in /var
Checking space in /var
Mounting initial environment
Starting logging daemons
Found Silicon Labs "Si2433" modem, rev F, skipping modem patch
Scanning for phase1 repair scripts
Running boot Stage C_MediaInitialization scripts
Loading input section drivers
Loading oslink.o
Loading cobra.o
cobra module was successfully installed, LNBPA 0x10 LNBPB 0x12
Loading output section drivers
Loading brcmdrv-rb.o
Linux BCM7020 STB interface: version 510082104
******** versionInfo->major is 2 ********
Using dual-tuner HD client priorities
Changed Broadcom output format to 4800
Broadcom DVI colorspace set to YCbCr
Loading si9190.o
Splash the screen
Bound Hdmi Semaphore to name
PHOENIX GETS MORE CONTIGMEM: height=1349
Running boot Stage D_PreMfs scripts
Remote control is TIVO
MFS partition on /dev/hda10
Loading Phoenix dssapp
Look for debug board
/tvbin/dssappAV: DSS Interface Version 1.24, compiled on Jun 15 2006
Loading Phoenix ATSC tuner daemon (AtscTunerD) ...
Loading Phoenix atscapp
Loading irblast.o
Loading ideturbo.o
/tvbin/atscapp: ATSC (Hpk-Enabled OsServices-Enabled) Interface Version 0.7, com
piled on Jun 15 2006
<InitInputs> Found a total of 2 inputs.
<InitInputs> got 2 ATSC inputs.
Loading fan.o
2004 probe
Loading therm.o
Loading TvBus router
Updating system clock
Time set to: Mon Oct 2 11:38:52 2006
<InitInputVcxoDevice> VcxoDevice for input #1 already opened, fileId = 8
<BroadcomAtscInputResetMuxedInputForDirectv> Set tuner mux pin state to DSS
<BroadcomAtscInputResetMuxedInputForDirectv> Set record type to RecordDirecTV_ES
<InitInputVcxoDevice> VcxoDevice for input #0 already opened, fileId = 9
<BroadcomAtscInputResetMuxedInputForDirectv> Set tuner mux pin state to DSS
<BroadcomAtscInputResetMuxedInputForDirectv> Set record type to RecordDirecTV_ES
Enabling local route
Setting TCP keepalive parameters
Checking for additional disk
Start fan control
First temperature parameters set:
Terminal temp: 71
Critical temp: 62
Logging temp: 60
Target temp: 50
Lowest fan speed: 7
/tvbin/fancontrol is running in the background.
Starting TvLauncher
assert: Tmk Assertion Failure:
assert: OutOfMemoryCrash, line 147 ()
Tmk Fatal Error: Thread TvLauncher <125> strayed!
0x02a7ea98 0x02a6a934 0x02a25f78 0x00718d6c 0x007504c4 0x006b2664 0x0070f504
0x00f443a0 0x02a44518 0x006bcf88 0x02a4a878 0x02a4cc40 0x02a5a9b4 0x00752954
0x006f76d4 0x0074bff8 0x006e0274 0x0201455c
END_OF_BT

Tmk Fatal Error: Thread TvLauncher <125>: assertion failure
flushing ide devices: hda
Restarting system.


Hacked manually. NoCso patch applied. Like I said, it was working fine (and had been since I manually upgraded to 6.3) until I noticed the reboot loop.

I've never seen this before during a boot of any of my hacked DTivo's (and silly me I didn't capture a log before I started having this problem):

/etc/rc.d/rc.sysinit: [global]: command not found
/etc/rc.d/rc.sysinit: interfaces: command not found
/etc/rc.d/rc.sysinit: workgroup: command not found
/etc/rc.d/rc.sysinit: server: command not found
/etc/rc.d/rc.sysinit: netbios: command not found
/etc/rc.d/rc.sysinit: security: command not found
/etc/rc.d/rc.sysinit: guest: command not found
/etc/rc.d/rc.sysinit: hosts: command not found
/etc/rc.d/rc.sysinit: encrypt: command not found
/etc/rc.d/rc.sysinit: [Root]: command not found
/etc/rc.d/rc.sysinit: path: command not found
/etc/rc.d/rc.sysinit: guest: command not found
/etc/rc.d/rc.sysinit: guest: command not found
/etc/rc.d/rc.sysinit: writable: command not found
/etc/rc.d/rc.sysinit: browsable: command not found


Any ideas? HD going bad?

[SpoonsJTD]

Reverting to unpatched tivoapp didn't help.

DD'ing 6,7 to 3,4 and booting to 3,4 didn't help.

[SpoonsJTD]

Could someone post or PM me a log of a successful boot for an hr10-250 running 6.3 or 6.3a?

[Jamie]

...
Running boot Stage A_PreKickstart scripts
Scanning for configuration files
/etc/rc.d/rc.sysinit: [global]: command not found
/etc/rc.d/rc.sysinit: interfaces: command not found
...

If you examine the startup scripts, you'll see that right after printing the "Scanning for configuration files" message, it is trying to source all files of the form /etc/rc.d/*.conf and /test.conf, if they exist:# Read in our testing or feature configuration, if there is any.
echo "Scanning for configuration files"
for ConfFile in /etc/rc.d/*.conf /test.conf ; do
[ ! -f $ConfFile ] || source $ConfFile
doneLooks like somebody dropped a file with a name that matched that pattern somewhere, and it is hosing your startup process. Kind of looks like a samba config file....assert: Tmk Assertion Failure:
assert: OutOfMemoryCrash, line 147 ()You sure you have swap space that is recognized?

[SpoonsJTD]

Looks like somebody dropped a file with a name that matched that pattern somewhere, and it is hosing your startup process. Kind of looks like a samba config file.

Ha, 'somebody' did do that. 'Somebody' then removed the file and now 'somebody' is still getting the same error, minus the bootup messages from it trying to run 'smb.conf' that 'somebody' put in etc/rc.d. Dead on that it was a samba file -- I am impressed. :)

Thanks for that!

You sure you have swap space that is recognized?

Well, this is a clean drive that was hacked,i.e., no mfs tools were used to create it. I assume the swap is recognized, at least, it seems to have been up until last night, if that's the problem. How can I tell? And can I use mkswap in some way to 'reset' it? Is it possible for swap space to get corrupted?

I did a quick and dirty instacake on a small hd and put it in and it booted fine. Just wanted to eliminate a hardware problem.

[Jamie]

...
Well, this is a clean drive that was hacked,i.e., no mfs tools were used to create it. I assume the swap is recognized, at least, it seems to have been up until last night, if that's the problem. How can I tell? And can I use mkswap in some way to 'reset' it? Is it possible for swap space to get corrupted?

I did a quick and dirty instacake on a small hd and put it in and it booted fine. Just wanted to eliminate a hardware problem.It's in the log, I just missed it:
Activating swap partitions
Adding Swap: 131064k swap-space (priority -1)This indicates you have 128MB of swap, which is probably ok.

Next step might be to roll back to a stock (unpatched) tivoapp to see if things improve. If you run anything before the tivo rc.sysinit (e.g. one of the init frameworks), you might want to strip that out. I'd also suggest simplifying your rc.sysinit.author to the bare minimum, but it doesn't look like you are getting that far.

A final posibility might be a corrupt MFS. Forcing a GSOD might cause it to be repaired.

[jayazusa]

I have been experiencing a similar problem, in an effort to force the upgrade I connected to my TiVo thru bash and prompted the upgrade, after modifying the installSw.itcl, although I had a typo as follows

Entered
exec /var/utils/updateroot /dev/hda /install /var/packages $ name >&@ stdout

Correct
exec /var/utils/updateroot /dev/hda /install /var/packages $name >&@ stdout

During the upgrade process it rebooted and has been rebooting ever since. I am trying to save both 400 gb drives so I can extract all of the recordings.

So far I have tried the following
Eliminating my rc.sysinit.author
Reverting the tivoapp to the original
DD the entire /dev/hda7 from a known good system
Then I tried to dd /dev/hda1 - /dev/hda8
Tried booting a single drive

I am unsure what to do at this point anything I missed please let me know. I am currently working fine off a duplicate of my factory drive. I am headed to bestbuy tonight to get an external drive enclosure to try to recover the recordings directly off the drives then will rebuild once the 250gb that is in there upgrades thru the “Real Process”

I am attaching a clean.txt and fail.txt, these were made within minutes of each other Clean.txt is my Duplicate 250gb drive output booting fine, fail.txt is the 2x400gb drives that have the exact code dd /dev/hda1 - /dev/hda8 from the original 250gb drive. The only partitions that I have not touched are the mfs partitions.

Any pointers would be greatly appreciated.

Jay

[SpoonsJTD]

Next step might be to roll back to a stock (unpatched) tivoapp to see if things improve.


Yeah, that was one of the first things I tried. No love.


A final posibility might be a corrupt MFS. Forcing a GSOD might cause it to be repaired.

How do you do that on the HR10-250? I tried the 'hold pause' and '5-8' when the lights came on but it didn't do anything (and serial log showed nothing different).

I never did figure it out and with a full week of tv ahead (not the least of which is the Lost season premiere), I punted. Got a 500GB, instacaked 3.1.5f, manually upgraded via slices, and finally copied my hacks from the original to the new drive. No patches applied to tivoapp yet.

I would still like to try the forced GSOD though to see if I can get back a couple shows I hadn't watched yet.

[cheer]

From a bash prompt, mfsassert -please will force a GSOD.