PDA

View Full Version : Extracted Video from DirecTivo



dopester
09-22-2001, 02:37 AM
I have used ExtractStream to rip video from the DirecTivo. It only works if you save the raw stream.

Upon some simple investigation it appears that the video is stored as 480x480 and stereo sound, etc. (Which as best I can tell is perfect for archiving as SVCD). The only problem is that it appears that there is some extra data in the MPEG to make it not play properly on a PC.

I can extract audio under linux using mpg123 (You get the sound and other random garbage).

You can play the video under windows and linux but you get pixelization, and it appears that the mpeg is corrupted.

Has anyone looked into what needs to be done to fix whatever is needed to make these extracted videos burn right on to an SVCD? I cannot find very good information on the MPEG2 file structure yet, but I will keep looking.

mrblack51
09-22-2001, 04:03 AM
what specific commands were you using, and what setup were you using to get the video off the tivo (smb, nfs, netcat)? i have been trying to pull the macgyver episodes i have recorded off, but all it gives me is errors. any help would be greatly appreciated.

dopester
09-22-2001, 03:39 PM
I extracted the video to an NFS mount. As far as the settings I go I used the second version of ExtractSream (6-13 Does that sound right?) and used the raw stream extraction method.

One thing to note though. ExtractStream seems to only grab the raw stream 1 out of maybe 10 streams on the DirecTivo. When it doesnt work it just fills the screen with a listing of 00's (could be a memory dump thats all zeros) and exits.

What problem are you running into?

mrblack51
09-23-2001, 01:57 PM
I have been trying to use either nfs or netcat. no matter what, when using the newest extractstream from cvs, i get:

Sector FSID passed (0x#####) failed to match the FSID value in the sector (0x#####). Trying next block.

Then nothing seems to come through on the netcat. The video on the unit skips while this is going on as well. here is the command sequence i just tried:

on the pc:
nc -p 1235 -l > e:\program.mpv

on the tivo:
mkfifo /var/tmp/video
nc -p 1235 -n -w 3 192.168.0.2 </var/tmp/video &
ExtractStream 449374 449376 -s > /var/tmp/video

dopester
09-25-2001, 08:13 PM
The exact sequence I used is as follows:

I would obtain the FSID from the NowShowing list with the tcl httpd.

ExtractStream -s FSID1 FSID2 FSID3 > dump.mpeg

This would give me the error about the maping of sectors about 2/3 of the time and return me to the command line. The other times I was able to get good video (well good as a described previously).

hinsdale
09-25-2001, 08:29 PM
Edit: disregard.. had to turn off FTP for server maintainance

Glitched
10-17-2001, 08:58 PM
im going to resurect this thread, because i plan to put some time into figuring out how to do this... anyones else got any ideas/information on why we are getting this pixelation, in our extracted stream??? im going to be honest, im no video extraction wiz, but i plan to start being one now!

Lets make this a reality guys, we can do it!!!

TheDoctor
10-17-2001, 09:30 PM
Could this be the result of the playback software not understanding variable rate encoding?

dopester
10-17-2001, 10:33 PM
No.. Im certain.. I tried a few differnet players.. the one that comes with the MJpeg tools for linux, windvd, and another mpeg2 player for windows that I cannot recall the name now.. All of those programs play VBR SVCDs fine..

Besides if that was all that was wrong we would all be ripping video from our DirecTivos

mrblack51
10-18-2001, 02:44 AM
ok, so i finally got nfs working by using my linux box. btw, warnfsd doesnt work properly on winxp.

ok, so i tried using dopester's method by doing

ExtractStream -s FSID1 FSID2 FSID3 > outfile.mpeg

while i was in the nfs mounted dir. all i get is the same errors as before:

Sector FSID passed (0x7cc31) failed to match the FSID value in sector (0x0).

the sector passed is different depending on what streams i try to extract.

dopester
10-19-2001, 12:52 PM
Thats the exact problem I mentioned earlier.. I was only able to get a few streams to extract.. It seemed to be something on the order of 20% of them worked.. Obviously there needs to be some work done on ExtractStream to fix that, but I have neither the time, nor the knowledge of ExtractStream to do it..

Hopefully the ExtractStream guys can get it fixed.. I guess if they dont I will have to figure it out myslef, but I dont have that kind of time..

mrblack51
10-19-2001, 01:08 PM
dopester: are you running a single drive or a dual drive setup? my t60 is running 40 + 80, so im not sure if that could cause a problem.

mrblack51
10-21-2001, 02:49 AM
ok, i have a little more info. maybe someone can take a look at it.

I tried the version of ExtractStream from http://www.ntworld.com/tivo/, and it gave me a different output which was more informative than the last version I was using. I got the FSID from httpd.tcl, and when I went to extract it, I got the following:



Attempting to locate tyStream with fsid 513401...
Sector FSID passed (7d579) failed to match the FSID value in the sector (3d579).
Sector FSID passed (7d579) failed to match the FSID value in the sector (0).
00 00 00 00 00 00 00 00 00 00 00 1f 00 0a 05 94 ................
00 01 c9 92 00 00 00 00 00 00 00 08 00 00 00 00 ................
00 00 00 00 3b 7a 61 e4 08 02 be ef 91 23 1e bc ....;za......#..
f3 b0 63 e0 40 00 00 00 00 00 00 00 00 00 00 0c ..c.@...........
00 00 00 08 00 20 00 20 00 52 00 00 00 00 00 00 ..... . .R......
00 00 00 0b 00 10 00 10 00 ae 01 37 00 ac 00 69 ...........7...i
00 ac 00 7c 01 60 01 60 00 03 20 00 00 00 00 00 ...|.`.`.. .....
00 00 00 0a 00 01 00 08 00 00 00 01 40 08 00 0e ............@...
41 30 30 30 62 64 61 62 32 00 62 32 00 09 00 08 A000bdab2.b2....
00 00 00 01 80 2e 00 0c 00 04 ee e2 00 00 00 0b ................
40 14 00 0c 45 6e 67 6c 69 73 68 00 40 13 00 51 @...English.@..Q
43 6f 6f 6b 69 6e 67 20 73 65 63 72 65 74 73 3b Cooking secrets;
20 65 78 70 65 6e 73 69 76 65 20 64 72 65 73 73 expensive dress
65 73 3b 20 64 65 63 6f 72 61 74 69 76 65 20 70 es; decorative p
69 6c 6c 6f 77 73 3b 20 62 75 67 6c 65 20 62 65 illows; bugle be
61 64 73 3b 20 66 61 63 69 61 6c 2e 00 31 32 38 ads; facial..128
40 1d 00 32 4e 61 74 68 61 6c 69 65 20 44 75 70 @..2Nathalie Dup
72 65 65 3b 20 50 68 6f 74 6f 20 50 69 6c 6c 6f ree; Photo Pillo
77 73 3b 20 4f 6b 6c 61 68 6f 6d 61 20 42 75 7a ws; Oklahoma Buz

mrblack51
10-21-2001, 02:50 AM
7a 00 3a 30 00 27 00 10 00 00 01 37 00 00 00 69 z.:0.'.....7...i
00 00 00 7c 00 2d 00 08 00 00 00 01 00 31 00 08 ...|.-.......1..
00 00 2c 53 40 32 00 0e 41 30 30 30 61 31 32 33 ..,S@2..A000a123
33 00 3a 30 80 12 00 0c 00 03 b8 55 ff ff ff ff 3.:0.......U....
00 15 00 08 00 00 00 05 40 11 00 11 48 6f 6d 65 ........@...Home
20 4d 61 74 74 65 72 73 00 48 30 31 40 10 00 11 Matters.H01@...
45 50 30 37 39 31 36 35 30 35 36 38 00 08 41 54 EP0791650568..AT
00 30 00 08 00 00 00 03 60 04 00 1c 2f 53 65 72 .0......`.../Ser
76 65 72 2f 41 30 30 30 62 64 61 62 32 3a 33 3a ver/A000bdab2:3:
31 3a 30 00 de ad be ef de ad be ef de ad be ef 1:0.............
de ad be ef de ad be ef de ad be ef de ad be ef ................
de ad be ef de ad be ef de ad be ef de ad be ef ................
de ad be ef de ad be ef de ad be ef de ad be ef ................



It does the same thing for the other two FSIDs that I give it. Now, since I havent ever been able to extract stuff, I'm not sure whether or not the text in this dump is normal, but it has nothing to do with the show that I am trying to extract. It seems as if the FSIDs that are being grabbed are not the ones that it should be grabbing. any ideas? I would like to dump some MacGuyver episodes

j0e
11-07-2001, 11:44 AM
I dont think it will be possible for you to just rip the video off it and store it without doing some kind of conversion to svcd.. This type of hack has been done in europe for a while now and when they rip raw stream files from their satellite box, they have to use an mpeg-2 encoder like tmpegenc or lsx or whatever to convert it to svcd.. Even though the raw source files may be svcd specs and all that they wont work properly until they are reencoded.. The quality should be amazing on the files extracted from the directivo though, ive seen svcd files from someone who does this and lives in europe and theyre always great.. Here is more information on the european equivalent

http://www.dominance.net/


This is probably the main reason why I bought a directivo.. At least I know now its possible.. Has anyone had any further success with this?

Fugg
11-07-2001, 02:41 PM
ok, i'll throw in my 2 cents here...;)

As far as the extracted streams,(when you can get one off:)) there is additional information in the extracted stream that hoses up playback. On my standalone, I get the same symptoms when I try to extract a composite stream.(audio and video in one stream, ie. using the -s switch) Has anyone tried to pull separate m2v and m2a streams off the dtivo? (no -s switch) If you can, check the vid file by itself and see how it plays. That will tell us if it's in the vbr format itself or due to the composite a/v files construction. If you can't, run the composite file thru tmpeg or something to split the audio/video apart and see if the video is any better by itself.

now onto the extraction prob.

I fought with my sa for weeks trying to get it to extract reliably. I finally hosed it up so bad, I just restored from my dd copy and started over. Being anxious to get back into it, I bypassed expansion and loaded tivonet and ExtractStream on a "stock" drive(no extra space, capacity as purchased) and got it to work.

Lo and behold, every extraction was perfect! That sucker worked like a dream! It seems that the tivo system is a little more forgiving in it's manipulation of the data than ExtractStream is. (ok, not EVERY one, but ~29 out of 30 ain't bad!)

ExtractStream works by following physical sectors as laid out by the system using the fsids. It does not care about the quality, it's just looking for valid data on the physical sectors. If it does not find what it thinks is good data, it skips to the next sector. (ie. "Sector FSID passed (7d579) failed to match the FSID value in the sector")

-continued-

Fugg
11-07-2001, 02:42 PM
As the tivo system has the "brains" to figure out what's good video and what's bad, it can be a bit sloppy in it's writes since the system is not gonna use what it thinks is bad video.

Any expansion (other than the old original bless tivo method, I think) can change the pattern of how the data is laid on the disk. This is not a problem with the tivo system, as it's more forgiving. But since ExtractStream looks for physical sectors, any non-standard, out of the ordinary things it finds, it doesn't know how to handle, giving us failed extractions.

Good Luck!!