PDA

View Full Version : HOWTO: Extract Video from the HR20



TimeHorse
10-12-2007, 04:21 PM
This is the place where you will find instructions on extracting video from your HD-20 DirecTV DVR.

This and the following 9 posts will form the basis of this FAQ with unused posts marked as "Intentionally Left Blank" for future expansion.

Special thanks to PlainBill, RonnyThunder and Blender for helping create this FAQ.

Version 1.01

----------------------------------------------------------------

Video Extraction is currently not possible on the HR20.

Indications are that the video data is encrypted on the the HR20's Hard Drive (be it internal or external) and that unlike TiVo there is no software stored on the disk which can be patched. (Like the StarChoice DSR530) indications are that the OS and software for the HR20 are stored in a flash chip. Thus, much like the old days of TiVo, one would have to reflash the unit to apply any hack such as turning off encryption. Even if Encryption could be turned off, it is unknown the file system format the the HR20 uses. That is not to mention that unlike MFS (the file system for TiVo Data Streams), there are no tools for extraction of unencrypted video from the HR20, assuming the HR20 had encrypted storage disabled.

That having been said, none of these problems are unsurmountable, but much depends on the market. If a large hacker community grows around the HR20, it is possible that people will start disassembling the HR20 firmware and use prom flashers to reprogram their units. It may then be possible that people find a way of flashing the unit without desoldering the primary Flash. Then maybe more details will come to light about the file system used by the HR20, perhaps through reverse engineering. Regardless of whether this violates law or license, it may happen.

But remember, DirecTV and NDS (the original manufacturer of the new line of non-TiVo DirecTV receivers) are also working on ways of preventing these things from happening and are not going to sit by and wait for someone to hack their unit. So it may be a game of cat and mouse for years to come. But, like DeCSS, HD DVD, Blu Ray and HDCP, it may only be a matter of time. Only time will tell who will win.

TimeHorse
10-12-2007, 04:21 PM
Intentionally Left Blank 2

TimeHorse
10-12-2007, 04:22 PM
Intentionally Left Blank 3

TimeHorse
10-12-2007, 04:22 PM
Intentionally Left Blank 4

TimeHorse
10-12-2007, 04:23 PM
Intentionally Left Blank 5

TimeHorse
10-12-2007, 04:23 PM
Intentionally Left Blank 6

TimeHorse
10-12-2007, 04:24 PM
Intentionally Left Blank 7

TimeHorse
10-12-2007, 04:24 PM
Intentionally Left Blank 8

TimeHorse
10-12-2007, 04:25 PM
Intentionally Left Blank 9

TimeHorse
10-12-2007, 04:26 PM
Intentionally Left Blank 10

blender
10-15-2007, 11:14 AM
On the other hand, HDCP remains unbroken and that is only a matter of software.

Actually, HDCP was broken even before it went into common use. Rough details here:

http://en.wikipedia.org/wiki/HDCP#Cryptanalysis

Also, you can get pass-through devices that remove the HDCP (often disguised as HDMI to DVI adapters).

-blender

TimeHorse
10-16-2007, 07:15 PM
Well, I suppose it depends on what you mean by broken. Yes, I was aware that Niels Ferguson had postulated an attack that would be able to obtain the master key, but without the master key, HDCP will remain unbroken. However, since Ferguson refused to publish, I hadn't heard anything so it's nice to know someone finally did figure out the master key. Now, with an HDCP decryptor disguised as an HDMI to DVI adapter, the only question I have is when, if ever, will we see PCs that accept even DVI input? :) (Handy though it is being able to display HDCP-encrypted material on a PC monitor).

Anyway, thanks for the update, Blender!

RavenStL
12-22-2007, 01:47 PM
So I see since September that MFSLive says that you can explore your HR20.

http://www.tivocommunity.com/tivo-vb/showthread.php?t=327239

Has anyone done some digging?

I may crack the case, or just add an ESATA drive and then unplug it and start browsing.

I also have the cpabilities to remove and read PROMS.

I just dont see me finding anything quick since Im a software noob. Have to look at the processor, board structure, get a feel for the engineers design.....

Has anyone heard from Directv that all this is taboo and as soon as someone talks about is going to be hounded by the Feds... :)

Hmm, and now a white van is in front of my house :)

jt1134
12-22-2007, 06:54 PM
So I see since September that MFSLive says that you can explore your HR20.

http://www.tivocommunity.com/tivo-vb/showthread.php?t=327239


Interesting. I hadn't even noticed that. Thanks.

VaBeachGuy
03-03-2008, 05:25 PM
Has there been any progress on the extraction front?

jt1134
03-05-2008, 08:24 PM
Has there been any progress on the extraction front?

Doubtful (at least publicly anyways). Extraction would be the easy part. Decryption and multiplexing would be the challenging part.

vertigo235
05-07-2008, 10:57 PM
Is this not promising?

http://www.dbstalk.com/showthread.php?t=127649

PlainBill
05-08-2008, 01:08 PM
Very promising. I haven't read the full thread yet, so I'm not up on the latest info. Even if it's limited to transfers at 'real time' speed, that's pretty good.

PlainBill

blackhill
11-27-2008, 09:23 PM
Any luck with extracting files from the HR20 DVR receiver from DirecTV?

blackhill
11-27-2008, 09:24 PM
I managed to break the warranty seal and replace the default HDD with a Terabyte drive, works nice since the HR20 formats it with the correct partitions upon reboot if it doesn't detect it's own filesystem structure immediately.

stevel
11-28-2008, 09:57 AM
I have not seen anything to suggest that "extraction" has been accomplished for the HR2x series. Live streaming to an application that honors the copy protection works.

vurbano
11-28-2008, 04:49 PM
I have not seen anything to suggest that "extraction" has been accomplished for the HR2x series. Live streaming to an application that honors the copy protection works.

You know, all D* would have to do is come up with some software to place on your networked NAS server and I think many wouldnt even think about hacking. Just let me store vast amounts of programming that I have paid for intelligently for playback through the DVR. Scramble it.. whatever. Just don't make me play musical external hard drives with no way to even organize the files :rolleyes:

PlainBill
11-28-2008, 05:58 PM
You know, all D* would have to do is come up with some software to place on your networked NAS server and I think many wouldnt even think about hacking. Just let me store vast amounts of programming that I have paid for intelligently for playback through the DVR. Scramble it.. whatever. Just don't make me play musical external hard drives with no way to even organize the files :rolleyes:

:rolleyes::rolleyes::rolleyes:

Amazing!!! Many of us who own an HR20 are aware that this can easily be done by running TVersity. It handles pictures, music, and videos. And it's a snap to set up.

PlainBill

vurbano
11-28-2008, 06:19 PM
:rolleyes::rolleyes::rolleyes:

Amazing!!! Many of us who own an HR20 are aware that this can easily be done by running TVersity. It handles pictures, music, and videos. And it's a snap to set up.

PlainBill
You can move D* HD recordings from the HR20 DVR to an NAS server and manage them? I have an HR20 and an HR21 and didnt know that. Of course you can use media share to play back material you already have on an NAS or a computer etc. I think everyone knows that. The only way I know of to not have a D* recording located on the HR20's internal HD is to use an external ESATA drive. Of course if you wanted any sort of structure you would need seven of them, one for each day of the week to have all episodes of say "24" in the same folder and on the same disk. Its an absolutely mickey mouse way to store material. Some sort of copy protection software from D* could allow Raid NAS servers to be used over an ethernet network putting an end to this nonsense.

jsmmd
03-02-2009, 01:05 PM
Doubtful (at least publicly anyways). Extraction would be the easy part. Decryption and multiplexing would be the challenging part.

Last week I installed DIRECTV2PC (http://www.directv.com/DTVAPP/global/contentPageNR.jsp?assetId=P4920044). Sadly, I had to decommission one of my 2 DirecTV TiVos and succumb to HD. I have a DirecTV HR23 DVR.

While running the DIRECTV2PC application, I fired up Wireshark (aka Ethereal)

The paradigm is similar to the web server on S2 and S3 TiVo units, minus the user-friendly front end.

http://{your_DVR_IP}:49152/virtual/description.xml

gives some interesting content about the DVR, in general

http://{your_DVR_IP}:49152/virtual/ContentDirectorySCPD.xml

gives you the mapping to the SOAP calls used to 'extract' shows


The Cyberlink application, DIRECTV2PC merely is a web-service front end, performing and rendering the SOAP calls to the DVR.

Shows can be 'extracted' by:

http://{your_DVR_IP}:9000/playback?id=avmedia-0x0a0aa0a00a0a0a00

(I replaced all numbers and letters with 0 or a intentionally.)


The resulting files seems to be a complete video. I've tried to use applications like GSpot or VideoInspector to "peek" inside. Both can't process the video files or identify codecs.

I found these urls via looking at the traffic in the results via Wireshark. Each show has its own id. I'll be working to formulate the correct SOAP calls to view the various shows. I can supply the SOAP request if you are interested.

A little about the Cyberlink DIRECTV2PC application:

C:\Program Files\DirecTV\DirecTV\Kernel\DMP has what appears to be the codecs.

I've tried opening Media Player Classic. In External Filters, I've added the Cyberlink items listed and am not able to play.

I'm by no means an expert here, just tripping around. I don't know if my filter order matters, if I'm missing a codec to be correctly installed into MPC.

Another interesting item to note, the below code seems to describe the video in the SOAP calls.


http-get:*:video/isdb:DLNA.ORG_PN=MPEG_TS_HD_NA;DLNA.ORG_OP=01;DHTOOLS.ORG_PN=MPEG_TS_HD_NA



My real goal here is to backup kids shows onto my NAS for playback via MediaShare. I don't want to pirate any of the programming which could be more easily found elsewhere online I'm sure.


Anyone willing to share some more thoughts or tips.

dengland
03-02-2009, 10:22 PM
Anyone willing to share some more thoughts or tips.

Wish I had something to add.

I am really hating life with respect to no extraction on the DTV boxes. All of my TVs are now HD. The HDVR2 was working great to get video onto the iPhone for plane trips. I used that to get caught up with whatever series I was behind on. I basically have to keep an extra box subscribed and record everything I might want to watch. I would be happy with some sort of TIVO TO GO thing on the HR20-xx.

PlainBill
03-04-2009, 11:29 AM
I'm glad to see you were able to capture the data stream. That is one step. I think you are missing one part of the puzzle. If you recall, when you first ran DIRECTV2PC it had to acquire a key. I suspect learning how that key is used to convert the data will make extraction possible.

PlainBill

stevel
03-07-2009, 09:52 PM
DIRECTV2PC is using DLNA protocols with an extra layer of encryption. You may want to study DLNA to save some effort in understanding what the application is doing.

vurbano
03-10-2009, 04:37 PM
My real goal here is to backup kids shows onto my NAS for playback via MediaShare. I don't want to pirate any of the programming which could be more easily found elsewhere online I'm sure.



Exactly what I would like to do with it too.

jsmmd
03-16-2009, 09:49 PM
I'm glad to see you were able to capture the data stream. That is one step. I think you are missing one part of the puzzle. If you recall, when you first ran DIRECTV2PC it had to acquire a key. I suspect learning how that key is used to convert the data will make extraction possible.

PlainBill



DIRECTV2PC is using DLNA protocols with an extra layer of encryption. You may want to study DLNA to save some effort in understanding what the application is doing.


Well, I've tried to work some more on this, I've hit a wall trying to read through the http traffic. I'm at the end of my skillset.

I'd really like to hear if anyone else has had any luck with the information I've supplied, any suggestions? I just need a little boost.


"Why do I hate DLNA protocol so much ?" (http://gxben.wordpress.com/2008/08/24/why-do-i-hate-dlna-protocol-so-much/)



You’ll find below the only supported stream characteristics:

* Image Codecs: JPEG, PNG
* Audio Codecs: AC3, AMR, ATRAC3, LPCM, MP3, MPEG4, WMA
* Video Codecs: MPEG 1, MPEG 2, MPEG 4 Part 2 (a.k.a DivX), MPEG 4 Part 10 (a.k.a H.264), WMV9.
* Containers: MPEG PS/TS, MP4, ASF for video files …



Well, I know what in general the package is, I just suck at breaking encryption.

eahkee
07-07-2009, 02:26 PM
So I see since September that MFSLive says that you can explore your HR20.

http://www.tivocommunity.com/tivo-vb/showthread.php?t=327239

Has anyone done some digging?

I may crack the case, or just add an ESATA drive and then unplug it and start browsing.

I also have the cpabilities to remove and read PROMS.

I just dont see me finding anything quick since Im a software noob. Have to look at the processor, board structure, get a feel for the engineers design.....

Has anyone heard from Directv that all this is taboo and as soon as someone talks about is going to be hounded by the Feds... :)

Hmm, and now a white van is in front of my house :)

I can browse my DirectTV DVR from suse Linux however the files are encypted.

wild123
12-31-2009, 03:25 PM
are there any developments on extracting and decoding or even streaming it through a media server like WDTV Live?

I missed the old Tivo where I can use TyTools. DirectV2PC sreaming works on my PC but it's ideal through a mediaserver.

stevel
01-01-2010, 08:35 PM
Not that I'm aware of.

Raketemensch
06-06-2010, 07:26 PM
Still no luck, eh? I'm mainly interested in this because DirecTV2PC is a Windows-only thing. I've tried VMWare and Parallels on Linux and Mac with no joy.

I'm sick to death of the whole user experience with my HR20, and am just trying to get the videos off to watch on one of my media center machines.

dengland
06-06-2010, 08:38 PM
I still holding out slim hope for Tivo ToGo when the Tivo I/F comes to the HR2X boxes.

PlainBill
06-07-2010, 11:19 AM
Still no luck, eh? I'm mainly interested in this because DirecTV2PC is a Windows-only thing. I've tried VMWare and Parallels on Linux and Mac with no joy.

I'm sick to death of the whole user experience with my HR20, and am just trying to get the videos off to watch on one of my media center machines.

This makes me wonder what you are doing wrong. I've had an HR20-700 for more than three years and it has been extremely reliable. To put it bluntly, the learning curve after using the TiVo UI for several years was very short. Notable deficiencies have been resolved. Features well beyond those available on a hacked HD DirecTiVo are now standard.

At this point the only thing it won't do is allow extraction. While I agree it would be a nice feature, I do understand DirecTV's position on that.

PlainBill

PlainBill
06-07-2010, 11:21 AM
I still holding out slim hope for Tivo ToGo when the Tivo I/F comes to the HR2X boxes.

I'm not so sure I would look forward to a TiVo UI. At this point that would require massive upgrades to standard TiVo features or it would represent a downgrade from the DirecTV software.

PlainBill

dengland
06-07-2010, 07:32 PM
I'm not so sure I would look forward to a TiVo UI. At this point that would require massive upgrades to standard TiVo features or it would represent a downgrade from the DirecTV software.
PlainBill

My main TV is 95% of the time serviced by the HR10-250. I use the HR20 for NFL ticket and any other MPEG4 only HD signal. The other TVs in the house have the HR20s. I feel that I am well versed in both GUIs. The HR20 is a fully capable machine, but I am not sure what would be a step backwards from it. (Maybe I am making an assumption that the Tivo boxes would get the media player stuff and MRV and you aren't making that same assumption.)

(I need to update my signature to add another HR22 and get rid of an HR10)

PlainBill
06-08-2010, 12:02 PM
My main TV is 95% of the time serviced by the HR10-250. I use the HR20 for NFL ticket and any other MPEG4 only HD signal. The other TVs in the house have the HR20s. I feel that I am well versed in both GUIs. The HR20 is a fully capable machine, but I am not sure what would be a step backwards from it. (Maybe I am making an assumption that the Tivo boxes would get the media player stuff and MRV and you aren't making that same assumption.)

(I need to update my signature to add another HR22 and get rid of an HR10)

I looked at the development of the Series 2 DirecTiVos. It took what - 3 years? for TiVo to add folders to the OS, and actually get decent speed out of the UI. Other features - caller ID, 'Gas guage', media sharing, MRV were never added. Without a major push from DirecTV I see no reason to believe those features would ever be added to the existing boxes.

The kindest thing that can be said about the response speed on the HR22 is that is works. The HR20 was 'tolerable'. The HR24 has been reported to be very fast.

PlainBill

geordi
07-27-2010, 04:05 PM
I just upgraded from an HR22 to the HR24. I'm back here posting b/c I'm looking for ways to get back to the extraction game and hoping that the smart people have figured a way to make it work with the WMP functions of DirecTV2PC.

Yes, the HR24 is a screaming demon on the menus, fast like a twitch game. As fast as you can push buttons, it reacts. Me like.

stevel
07-29-2010, 07:27 PM
Not that I've heard of.

gkoth
12-29-2011, 10:05 PM
This makes me wonder what you are doing wrong. I've had an HR20-700 for more than three years and it has been extremely reliable. To put it bluntly, the learning curve after using the TiVo UI for several years was very short. Notable deficiencies have been resolved. Features well beyond those available on a hacked HD DirecTiVo are now standard.

At this point the only thing it won't do is allow extraction. While I agree it would be a nice feature, I do understand DirecTV's position on that.

PlainBill


I am still using the DirecTiVo hacked. Had to replace a unit that was failing. Transfered wanted shows to second box, went in with TiVoWebPlus and copied all the season passes from both machines (over 130 each) and pasted them into an Excel spreadsheet. Transfered the hard drive, cleared and deleted all, plugged it in and activated and after a few days when the guide got built reinstalled all the Season Passes very easily from the list and got rid of some duplicates we had because of the failing uint and recording on both to be sure we got a clean copy. After getting all the season passes back on the machine I went into TiVoWebPlus and prioritized all the season passes. Much easier than using the remote and moving passes one at a time one slot at a button press. Just determine the order you want and put that number in the list. TiVoWebPlus addresses the DirecTiVo and reorders the season pass list. As I understand it, none of the above are possible with the DirecTV Rupert boxes, with the exception of a cleaned off hard drive swap.

No transfer, no extraction of season passes (series links) no reordering of passes in a nice orderly fashion on the computer, and certainly not more than 50 Season Passes (Series Links). How it that better?

dengland
12-29-2011, 10:39 PM
Thanks for posting today. I had sort of forgot about this thread.

HR10-250 is the only Tivo box I have left. I still do majority of the TV watching from that one using OTA.

Like you, I find tivoweb a better interface than the remote if I want to do anything complicated.

I guess we got the answer to the burning question the thread asked.... It is called Nomad. I will probably break down and buy one. Anything I want to take with me on my iPad, comes via a tuner card in my PC right now. Works pretty well. That is what finally made me deactivate my last HDVR2 last December. I am currently SOL if the content comes from SHO, AMC, etc without the Nomad.

I guess we also know that I was wrong back in post #38. No TivoToGo and no MRV for the new Tivo box.... Just old HW. I cannot see myself getting one of those now. I might be tempted if it was on the HR24 HW, but it still would be missing some of the neat things that D has done (e.g. iPad app). When the HR10 dies, I may just get the HR34....

gkoth
12-30-2011, 01:36 AM
That Nomad looks interesting. Will have to study up on it.

Callindril
01-08-2012, 12:29 PM
What is this nomad device you speak of?

dengland
01-08-2012, 12:42 PM
What is this nomad device you speak of?

Look here: http://www.dbstalk.com/showthread.php?t=197694

PlainBill
01-08-2012, 01:25 PM
What is this nomad device you speak of?

http://www.directv.com/DTVAPP/content/technology/nomad

PlainBill

OvitivO
09-22-2013, 08:53 PM
Hey all, I wanted to share a tiny bit of information that I've discovered while poking around the Nomad/GenieGo app.

On the Android version, when you download a local copy of the video, it is stored in the following location:


/storage/emulated/0/Android/data/com.directv.application.android.go.production/files/QewVideos/<hash>.mp4

There is also a second (32 byte) file for each video stored in the following location:


/storage/emulated/0/Android/data/com.directv.application.android.go.production/files/QewVideos/<hash>.mp4.kfe

I know...nothing earth shattering in this discovery, but I'm curious if anyone has poked around with the files generated by the GenieGo application yet.


Cheers