DTivo Extractor [Archive] - DealDatabase Forum - Deals, Freebies, and TiVo & DirecTivo Hacking

dburckh

01-27-2007, 11:33 PM

TySuiteJ

I wrote this set of tools to extract video from my Series 2 DTivo. There are 4 major tools.
1. The Graphical User Interface (GUI) - Similar to TyTool
2. The Web Server
3. The CLI (Command Line Interface)
4. The Standalone Media Center server.

In a nut shell, this tool will extract and remux TY streams into mpg streams on the fly. They have a couple advantages over existing tools:
1. All tools allow you to convert from the Ty format to .mpg on the fly.
2. The converter handles HD properly. Nothing else out there can extract and mux HD properly on the fly.
3. The .mpg converter is extremely robust and will handle streams with severe drop out problems.
4. All tools will run on any platform that supports Java SE. That's pretty much everything but your phone. Well, maybe some phones. :)
5. You can programaticly extract list and extract NowShowing, Ty streams and .mpg files from the command line. Nice for the unix guys.

Note: Version 1.3 will only officially supports DTivo Series 2. Check out the 2.0 beta at the end of the thread for other models

Unzip and check out the readme.txt

Version 1.3/2.0a_beta
---------------------
Fixed the imfamous audio dropout problems!
Fixed issue with reserved chars in filename
Refactored Sequence logic to it's own class to support the new version
Reset video buffer size back to 1000ms
2.0a-Now support other tivos version! Please give feedback if it doesn't.

See TODO.txt for known issues

Note: You only need one of the attachments. TySuiteJ_13 is the newest. The old one is out there in case you need to fall back.

kemac

01-28-2007, 12:28 AM

Very nice work! Just started playing around and I like what I see so far, thank you for sharing your talent. Thank your wife as well...

I look forward to what's ahead.

dburckh

01-28-2007, 08:53 PM

Here's the latest. I'm calling the first version .5, so this .6

What's new:
Fixes:

Refactored SCR clock protection to allow big jumps forward in the SCR (to account for lost signal)
Changed code to dump dead audio that is before the SCR.
Changed in memory queue time to 3/4 second
Added video packet cleaning

Enhancements:

Made Abort button function in near real time
Added convert.cmd
Added analyze.cmd

Could somebody try thing against a Series 2 other than DTivo? I don't think it will work as is on Series 1.

Thanks.

dburckh

01-29-2007, 10:38 PM

version .7
----------
Fixes:
Log scrolls to end on add
GenericWebServer was looking at MyHomeServer tivo entry
TyServlet converted to use TyStreamHelper
Updated patch.cmd to use the .jar file

Enhancements:
Added Convert button to UI
Multiple hosts now supported for generic web server. Property file entry changed!

This has everything I have up to date. Haven't heard much from anybody. Any change requests?

Future development plans:
Change code to sync SCR on audio PTS instead of video PTS to resolve issues where video may drop.
Full implementation of Link Theater server
Fix video patch functionality to insert a new sequence instead of just hacking the existing one.

av8rdude

01-30-2007, 12:51 AM

Hi,
First off...great application. I love the idea so far. But I'm unable to play the ty files that I extract with this.

Ty shows I extract with this will not play on my windows PC. I can extract the same shows with TyTool or mfs_ftp and they will play using wmp 11 (tyshow codec installed).

What info can I provide you for troubleshooting?
Thanks,
Scott

dburckh

01-30-2007, 01:25 AM

I'm just saving the raw .ty file from mfs_uberexport. If you are extracting HD and trying to play the .ty file via TyShow, VLC, or MPlayer problems are likely to occur. Problems with these players are part of these reason I wrote this tool set. I can't get TyShow, VLC or mplayer to play an HD .ty file reliably.

Does the file play if you extract it with TyTool? If so, then I'll try that and see if I can see the difference. The focus of this project is to convert .ty files to standard .mpg.

Try extracting the file as .mpg or converting it to .mpg with v.06+. I don't have any control over TyShow, VLC or mplayer. They don't seem to handle HD .ty files correctly.

Hope that helps. Thanks for your input!

dburckh

01-30-2007, 11:28 AM

cheer

01-30-2007, 12:03 PM

version .8
----------
Fixed problem where I would dump the first video Sequence
Updated the buffer size for patch.cmd to 64k to deal with files that start with audio
Updated readme.txt

Did an apples to apples comparision of convert to tytompg. Sadly (but not unexpectedly) bcc beat me by 23%. I'm going to change to New I/O to try to narrow this gap. Hopefully I can get it down to 10%. I can still grab streams straight form the Tivo (a little sour grapes there).

Please don't take this the wrong way -- anything that makes these tools better for all of us ought to be applauded.

I'm just not getting the focus of this tool -- is this designed to do something that tytompg does not, or just meant as a little healthy competition?

dburckh

01-30-2007, 02:15 PM

No offense taken. Hopefully none given. I have tremendous respect for what bcc and others have done. I'm just trying to measure up. :)

This is tool is really more of a suite of tools. convert.cmd is one tool that is pretty much the same as tytompg. I don't actually use it that much, it just allows apples to apples comparisons on extracts.

Couple of things that I don't think are out there that this toolset provides:

1. Neither TyTools, mplayer nor TyShow seem to properly render HD files. Or at least I can't get it work with my Tivo. Does this work for others?
2. The web.cmd web server serves up .mpg files that are extracted and converted from the Tivo on the fly. This allows you to stream files through VLC without TyShow and without extracting the file to your HDD. In theory any player should be able to open these streams (TODO: WMP doesn't seem to work).
3. It's java so it should run anywhere. Including the UI! I haven't provided .sh files, but it should be pretty easy to make them.
4. A tool to view NowShowing, extract and convert titles from the command line (cli.cmd).
5. Most of the tools allow you to connect to multiple tivos in a consolidated view (Web and UI).
6. A bridge between the Tivo and Link Theater (still in progress).

My primary motivation for this whole thing was to understand MPG streams and get the Link Theater Bridge going so I can watch my stuff on remote Tivos. The last thing I want to do is tee somebody off.

All the source and the project is in the .jar file (they are glorified zips), so help yourself. Ideally, I'd like to make this thing open source so others could contribute and improve it.

cheer

01-30-2007, 03:05 PM

Ah OK, I get you. So the intent was not to craft a muxer per se, but to create a suite of tools aimed at streaming/etc. mpg files out of the tystreams, and a muxer was a required piece so that you could serve up the mpegs without having to convert them first locally. I get it.

Interesting stuff. I've not done much with streaming so I didn't "get" where you were going at first, but it makes sense now. And yes, there is definitely a problem with HD files and TyShow/TyTool. (Can't speak to mplayer.)

And I don't think you have to worry about teeing someone off. My question originated from a much more selfish place -- in other words, I was trying to figure out what this could do for me. :)

snoots

01-30-2007, 04:48 PM

I'm hoping this will stream to a linkplayer2 similar to the tivobridge app that another user developed that was abandonded. I have not downloaded it and tried it out as I'm at work at the moment.

dburckh

01-31-2007, 01:18 AM

I looked briefly at linkplayer2 and it appears to be MyIHome based as well. Hopefully it uses the same video chipset as well. If all that is true, it "should" work.

With what's in version .08, you should be able to view Now Showing and play a title. FFWD and RWD will screw everything up. Pause works in short bursts. You should be able to view SD programs with out issues. HD titles are a little more tricky. They require a fast network connection. OTA channels are very high bitrate and I have problems keeping them stable.

The main problem I have is that FFWD, RWD and long pauses cause the player to jump around in the stream. The .mpg stream I create and the source .ty stream are not 1:1 from a byte index standpoint, although they are pretty close. With RWD and pause I could (not done) build a MPG/TY byte count xref, but FFWD is a little more tricky.

It will probably be the weekend before I get anyfuther with MyIHome. It's not something I can slap together in a short hurry.

snoots

01-31-2007, 02:43 PM

I gave it a quick try and of course the myihome web stuff is hardcoded to the Linktheater WWW files. I installed the linktheatre server pages and associated images but I now get a connection rejected or denied in the dos prompt server window. Also the gui refreshes both TIVO's but nothing shows up in the display window. I have verified the pathes to NowShowing and mfsuberexport to be correct as set in the preferences. I turned on the telnet log but can't find the log file to see whats happening. where does the log get written to? Thanks !

bcc

01-31-2007, 03:14 PM

1. Neither TyTools, mplayer nor TyShow seem to properly render HD files. Or at least I can't get it work with my Tivo. Does this work for others?Yes, I posted a patch here to mplayer a few years ago that fixed audio playback for cases such as ATSC recordings. With my patch, mplayer works for all HD files I've tried. Sometimes I have to use '-demuxer 33' to get it to not misidentify the stream however.

dburckh

01-31-2007, 03:19 PM

The log is only written to the console. If you run the UI by clicking the jar, you don't see the console. Try running ui.cmd.

Yeah. It is hard coded to link theater. I was trying to keep the same motif. I think it only uses the background file. In the next release, I'll get rid of the hardcoding.

If the UI doesn't work, it's likely that the bridge won't work either. I think you are doing the right things though!

You can also try the cli.cmd <tivo_IP>. That should also dump NowShowing.

My Telnet emulator assumes a couple of things:
1. No login
2. A single line command prompt on login. Nothing else.

Try telneting into the box directly. Verify the above.
Paste in whatever you have in application.properties for NowShowing.executable.
That should dump NowShowing in an XML like format.

It that doesn't work, PM your setup (Tivo model, software version, hack type...) with the following file with telnet logging on:

cli.cmd <tivo_IP> > log.out

I had some problems with really slow tivos in the past, but I thought it was corrected. You may want to try restarting the tivo.

snoots

01-31-2007, 07:11 PM

I have 2 HD Tivos 6.3b tserver, vserver, twp all working. Extractions using tytool then tytompg works fine. Below is telnet example and tivo side directory structure. Also CLI output

bash-2.02#
bash-2.02# pwd
/tivo-bin
bash-2.02# ls -al NowShowing.tcl
-rwxrwxrwx 1 0 0 13604 Dec 16 21:01 NowShowing.tcl
bash-2.02# ls -al mfs_uberexport
-rwxrwxrwx 1 0 0 122360 Dec 16 21:00 mfs_uberexport
bash-2.02#

_____________________________________________________________

PC Side

C:\Program Files\DtivoExtract>cli 192.168.1.201
FSID Size Title
------ ----- ------------------------------------------------------------
Total MB: 0

C:\Program Files\DtivoExtract>

dburckh

01-31-2007, 08:55 PM

Ok. I think I see the problem.

Your setup is different than mine. If you look in the readme.txt, in the setup section it tells you how to configure. It looks like you are using "NowShowing.tcl". Please use "NowShowing". I haven't tested with "NowShowing.tcl" (and I can't find it), so "NowShowing" is prefered. There is a link in the readme.txt to sourceforge. You want the mips version.

Please make these changes to application.properties. Make sure you don't have double entries.

NowShowing.executable=NowShowing
TyStreamHelper.executable=mfs_uberexport -n 512

Telnet.logConnection=true

snoots

01-31-2007, 09:27 PM

My problem was an old NowShowing file. I now get the lists of files. Thanks

snoots

01-31-2007, 09:35 PM

One more quick question. I verified my firewall is not restricting access but I get the below error in the webserver window when connecting with a browser.

Tivo Server open for tBusiness on http://localhost:8280/
Request: GET / HTTP/1.1
ServerConnection
java.net.ConnectException: Connection refused: connect

dburckh

01-31-2007, 10:53 PM

If you are not getting links on the NowShowing WebPage, verify that the hosts are set in the application.properties files. Yours should be:

GenericWebServer.hosts=192.168.1.201

For the MyIHomeServer (linktheater) you should set this as well:
MyIHomeWebServer.tivo=192.168.1.201

Otherwise, you can ignore it.

snoots

01-31-2007, 11:34 PM

Ok, got it all working. Thanks !! The myIhome works on my linkplayer2. SD plays back great. HD video stops and starts along with audio. Thanks for writing this app. So far looks good, are there any tuning options that might help my HD playback ? Thanks again, great work !!

dburckh

02-01-2007, 01:31 AM

Congratulations :) If your linkplayer is wireless, you may want to plug into the ethernet to see if that's the problem.
Next step is to extract a file with the UI and see if it will play it through the normal media center. My old D-Link couldn't process an HD stream even wired and preconverted.

Finally, you can play with these settings. preload is the number of packets the server reads before it starts streaming. Increasing this delays the start, but allows the server to handle hiccups better. readAhead is how far it will read ahead the stream. These are 128K packets. I have some extra logging for this that I'll re-enable in the next version. I didn't think anybody would actually use this feature. :)

ThreadedTyPacketReader.preloadPackets=6
ThreadedTyPacketReader.readAheadPackets=8

You can fire up the web server and see what kind of speeds you are getting off the Tivo downloading files off the tivo. If it's less than 2,000KBps you are going to have issues with HD. Reboot if you haven't done it recently. Tune to blank channels. Check the forums for the fastest adapter. I have a USB200M v2. It works ok and I've seen some tweak to make it better.

code10

02-01-2007, 07:10 PM

Does a nice job of extracting hd ty off my HR10-250. Simple to setup easy to use gui and I like on the fly muxing ty to mpg. All of my hd downloads are error free ready for vrd editing. Thank's again and thank your wife for letting you spend the time on DTivo Extractor. :)

snoots

02-01-2007, 07:16 PM

I have to apologize again, the choppy HD was due to my running your program on Vista Ultimate RC2. I dual booted to MCE2005 and can now stream HD to the linkplayer2 with solid audio and video. I am very happy !!! Thanks again. Now to figure out my Vista network slowness :(
I am using the airlink GIGE adapters with Jamies backport drivers and get great download speeds under MCE. Vista has been more of a problem. Under MCE my NIC switch and hdtivos run jumbo frames. I suspect that it is my Vista issue as I can't get it to allow jumbo frames. I think all the nodes must support jumbo frames or they fragment which slows the whole network down.

daleykd

02-02-2007, 01:38 AM

I have to give you some credit. I love the look and feel and ease of this. I've always had a hard time grasping the concept of watching my shows using other methods, but I haven't had the time I would like to research.

I have tried to get a file using both the .jar and the cli.cmd. I get a NowShowing list successfully. The following is the error I keep getting.
C:\DTiVoExtract>cli 192.168.3.97 508416 "C:\Tivo\BSG.mpg"
java.net.SocketTimeoutException: Accept timed out
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(Unknown Source)
at java.net.ServerSocket.implAccept(Unknown Source)
at java.net.ServerSocket.accept(Unknown Source)
at common.TyStreamHelper.getTyStreamSocket(TyStreamHelper.java:39)
at common.FileTransferrer.getMpgFile(FileTransferrer.java:28)
at cli.TivoCli.main(TivoCli.java:54)

Any help would be appreciated.

dburckh

02-02-2007, 11:00 AM

The program is timing out waiting for a connection from the Tivo. Looks like your firewall is blocking the Tivo. Either turn it off, or make an exception for your Tivo's IP address.

daleykd

02-02-2007, 10:38 PM

Feeling kinda dumb...

The only software firewall I have is Windows Firewall, and there's no way to allow a particular IP, only ports and programs. It prompts me to unblock the Java(TM) 2 Platform Standard Edition binary, which I unblock.

Sorry to be a pain.

snoots

02-02-2007, 10:58 PM

dburckh

I posted a link to your thread over at AVS forums on the Linkplayer2 forum, hope you don't mind.

Snoots

dburckh

02-02-2007, 11:48 PM

daleykd,

So are you up now, or still having problems? In the next release I'm including a setup test utility.

I have Windows Firewall disabled and I'm working. I've also tested with Panda.

dburckh

02-02-2007, 11:49 PM

snoots,

Not a problem. I'm working on some updates for the MyIHome server. I have serving multiple Tivos working. I also removed the hard coding to LinkTheater. I'm trying to get a file system backed caching mechanism working. This will fix the RWD and Pause problems and make FFWD more likely to work. The down side is that it will write the .mpg file while viewing. These can get pretty big with HD (3 hours~=15GB).

daleykd

02-03-2007, 02:01 AM

daleykd,

So are you up now, or still having problems? In the next release I'm including a setup test utility.

I have Windows Firewall disabled and I'm working. I've also tested with Panda.

Unfortunately, I'm still having problems. I can't disable Windows Firewall because this is a work laptop with the firewall set by group policy. TyTool actually is successful in connecting/extracting, which makes this even quirkier. Being that I haven't coded in Java in a few years, I don't know if there's a firewall difference between the two apps.

Sorry to be a pain in the butt. (I love the interface, though!)

Kyle

snoots

02-03-2007, 10:22 AM

Sounds good, can't wait to take it for a spin !!

dburckh

02-03-2007, 12:23 PM

The new version is posted at the top of the Thread

Kyle, run testSetup and see what happens.

dburckh

02-03-2007, 12:27 PM

Mods or other senior people. I changed the name of my first post to better reflect what the tool does, but the thread name didn't change. Is there a way to do that?

Thanks in advance,

Dustin

snoots

02-03-2007, 03:22 PM

New version working, had to replace your background as my two cats objected to it :)

daleykd

02-03-2007, 05:13 PM

dburckh

02-03-2007, 08:28 PM

Kyle,

See below

dburckh

02-03-2007, 08:31 PM

Kyle,

Could be two things. 1. You are firewalled. 2. If you have a wireless bridge/router that only allows you to go one way. I had this happen with my ViewSonic bridge. Either way, you are DOA. You can extract with TyTool and convert with this tool if you need HD. I'm working on a version to get around the problem. Unfortunately, it requires writing code that resides on the Tivo. I've never written TCL before so it might be a while.

ihristov

02-04-2007, 04:24 AM

Excellent work dburckh

I am happy to report that I had no problems at all using it from my Linux laptop.

I can see in the utils folder there is a utility "util.VideoSizePatcher" (patch.cmd) ? Does this allow you to crop the image? I have sometimes an annoying white noice on the top.

Can this be done at the same time as downloading?

If the sources are available somewhere I might try to fiddle with this to try to make it work.

Thanks.

dburckh

02-04-2007, 01:15 PM

patch, MAY allow you to remove the out of band data in the top or bottom, but I think it is unlikely to work. It really depends on the player. What this util does is tell the decoder that the first frame is a different size. Usually, I use it to make the decoder think the video is larger than it is. I've never tried smaller. It can be done while decoding, but it patches to standard SD and HD picture sizes, which I don't think you want.

Your best bet is to have the player strip a couple of pixels off the border of the image.

It's pretty simple to use and I personally think it's kind of cool. :)

This will tell you the current size of the first sequence
patch "file.mpg"

This will change it.
patch "file.mpg" width height

teobar

02-06-2007, 11:59 PM

Testing connection from: 192.168.3.102

Testing UI Connections
----------------------
Checking Host: 192.168.3.97
Checking: Tivo can see you
It has been sitting there for at least 10 minutes, and I've got another host listed in the application.properties file.

I have exactly the same problem when I tried this. My firewall is disabled and I can run the ping -c 1 <localhost> from another telnet prompt and get a response. My TIVO is wired so it can't be a wireless bridge issue. Any other situations that could cause this behavior?

I'm not sure if it is the telnet.ExecuteFunction that doesn't return or if it is something else.

/Teo

dburckh

02-07-2007, 01:50 AM

I found a bug in the telnet emulator that may be causing it. If there is zero lag between commands and responses, I can miss some replies.

Either way it's soon to be a mute point. I'm really close to releasing version 1.0. It has a server component that improves performance and removes the requirement for the Tivo to connect back to the pc.

dburckh

02-07-2007, 12:06 PM

Version 1.0 is out there. A lot has changed, please check the readme.txt.

tlphipps

02-07-2007, 01:44 PM

I downloaded version 1.0 and I'm getting a blank NowShowing list. I moved the .tcl script into place and I've verified all the paths to the various apps on the TiVo. Everything looks correct, but when the GUI says "refresh completed" the list is just blank.

I can run the previous version (.9) with no problems.

I turned on the telnet logging and it says it connects fine. Is there any other log info I can look at?

dburckh

02-07-2007, 04:21 PM

Did you run setupTest.cmd? This should detect 90% of the problems.

Couple of things that are different. In v.9, you could specify a path for NowShowing and mfs_uberexport. In this version they have to be in the search path on the Tivo. If you specifiy a path in this version, it will mess setupTest.cmd up. You also have to have dserver.tcl in the path. You can type "echo $PATH" from telnet to see what the path is. You should be able to do a "which NowShowing", "which mfs_uberexport", "which dserver.tcl" if you have busybox installed.

Did you ftp dserver.tcl over as binary (image), or text? If you did it as text you'll have to redo it as binary, or run dos2unix on it. You can tell if it was a text transfer in vi if it has ^M on the end of the lines.

Hope this helps.

av8rdude

02-07-2007, 05:39 PM

Works great for me now, also! I can now download .ty files locally with the ui and remotely with the webserver that play perfectly.

This is a great addition to the tools here at DDB. I really like the ability to see all three of my DTivo shows in one interface for downloading.

Thanks for all the hard work,
Scott

tlphipps

02-07-2007, 05:41 PM

The path was the issue. I didn't realize that had changed. I saw reference to that in the readme.txt, but didn't realize it wouldn't work the old way.

Fixing the path got things going. Thanks!

dburckh

02-07-2007, 06:55 PM

Cool guys. Glad it's working now!

dserver.tcl now calls NowShowing and mfs_uberexport directly from inside the Tivo. The entries in the application.properties file are pretty much dead. I did leave the old I/O subsystem out there, but I really think the new one is superior. They'll probably go away in the next release.

We have company in town, so I probably won't do any development on it until next weekend. I'm going to work on supporting Series 1, a new UI and supporting external files for the Media Center. If I get some time, I may write an FTP server. Any other ideas?

av8rdude

02-07-2007, 10:57 PM

Thanks again for the great app....
I have a few ideas for the dream sheet:

1) Would it be possible to add more detail to the web server view? Like date/time of recording, channel, etc. Info similar to the tivoweb nowshowing list?

2) How about password protecting the web server?

I did find that when using the web server to download .ty files via the link. The default "save as" was an .mpg instead of .ty. I tried downloading via the .ty link and leaving the format as .mpg and then changed it to .ty. Both files played perfectly.

Cheers,
Scott

dburckh

02-08-2007, 12:10 AM

I can pretty easily add the extra info to the web page. I've been thinking about a sort order as well. I believe it is sorted by most recent by default.

Security is a little harder, but I believe it would be possible. I think a single user/password would be reasonably easy to implement.

I use FireFox and the .ty and .mpg links work perfectly. I just checked IE and I can duplicate the problem. I think I can fix it in IE so .ty files save properly. You must have TyShow installed to play the .ty files. I don't believe you will be able to play HD .ty files properly, so I would stick to the default .mpg.

ibooyaka

02-08-2007, 12:26 AM

Thanks for a great app, its a big time saver!

When I try to convert shows "on the fly" by pressing the "MPG" button, the resulting video has some audio drop-outs. In the cmd window it says "Dropping dead audio: X" where x is a number 1-3 usually. I am using the latest version of your TySuiteJ. Thanks

dburckh

02-08-2007, 01:43 AM

ibooyaka

02-08-2007, 01:56 AM

I can increase and/or expose the SCR offset and that may allow you to fix it. This can also be a sign of a bad signal. If it were a bad signal, this would show up on the tivo too. Any problems there?

Couple of questions. What tivo hardware and software revision are you using? Is the video SD or HD? Is it OTA, or DTV? If OTA, what network (CBS, etc)? Are you getting any "Tried to move the SCR backwards" errors?

Thanks for the quick reply dburckh,

The dropouts do not show up on the tivo, they play smooth on the tivo.

I tried it with both a SD TiVo (Phillips DSR704 running 6.2) and a HD TiVo (HR10-250 running 6.3b). They are DTV recordings. I was tested a Prison Break (FOX) episode in HD and a childrens show in SD (on the phillips dsr704). Both had major drop out problems. Did not see any "Tried to move SCR backwards" errors. Thanks again

dburckh

02-08-2007, 11:30 AM

ibooyaka

02-08-2007, 01:20 PM

Thanks, I will check that Dolby Digital setting when I get home from work. Before finding your app, I was using TyTool and the tytompg command line utility to get my shows to .mpg, none of those ever had any dropouts. Does Dolby Digital also affect shows extracted by TyTool? Thanks again for the replies.

dburckh

02-08-2007, 02:17 PM

The Dolby Digital affects how the program is stored on the Tivo, not the extaction. I have a very similar setup and don't have any problems. I was just looking for a reason for your issues. I usually use OTA for HD locals, so I haven't tried the DTV local channels.

Because you are not getting "No Picture in video packet" or "Huge jump in PTS errors", I assume your stream is clean. If I can't duplicate it, you'll have to send me a chunk of the .ty file.

ibooyaka

02-09-2007, 12:14 AM

Here's a test release with fixes for the .ty file type problem, the audio dropouts, and web UI. Extract this file over your 1.0 release.

You'll need to add "GOPTyRecordParser.videoBufferTimeMillis=1000" to your application.properties. If you are still getting "Dropping dead audio: xxx", try bumping it up in 250 increments. Stop when you hit 2000. The bigger this number, the more memory the application takes. If this doesn't resolve it, I have one more thing to try.

I had another thought, do you have Dolby Digital turned on, or are you using the default? That may explain the reason you are having problems and others aren't.

Thanks for the file, it looks like it is working! I would usually get that "Dropping dead audio: xxx" error right away, so far there are no dropouts in the short test files I have done. The audio is very clear, with no errors. I will download the whole file tonight and see how it works. Thanks again!

bwperez

02-10-2007, 11:57 AM

Here's a test release with fixes for the .ty file type problem, the audio dropouts, and web UI. Extract this file over your 1.0 release.

This fixed the issue for me as well.

I'm using a LinkPlayer to playback the mpg and I am running into the same issues others have mentioned regarding the video beings squashed. So far I've been manually running your patch utility and have had success getting the videos to start in the correct screen mode. I have noticed there is a Patch First Sequence: false entry in the cmd window. I understand how to enable this for the web interface, however how can I enable it form the ui?

Anyone else with a LinkPlayer that is using WizXP? I've found that if you stop a show and restart it sometimes you get a blank screen and others you get the video squashed? I've never seen this behavior with any other files I've viewed.

Brian

dburckh

02-10-2007, 03:08 PM

The patch isn't available in the UI yet. It's pretty easy to add. I'm using the MyIHome server for my LinkTheatre, so I don't have the problem. I'll add it to the next release with the new value for the videoBufferSize

The squashed video is actually a problem with LinkTheater and the DTV stream. DTV sends the video squashed and the Tivo unsquashes it. Widescreen DVDs do the same thing. Unfortunately, LinkTheater ignores the aspect ratio information in the MPEG sequence. If you play the file on anything else it displays properly. The patch is actually nonstandard and screws some programs up.

panman9999

02-10-2007, 03:40 PM

Hi dburckh , will this run on a series 1 tivo (UK version)?

I am hoping to be able to install this on my Tivo and then be able to stream to my Pinnacle ShowCenter 200 from my Tivo.

Any thoughts?

Thanks

dburckh

02-10-2007, 04:42 PM

You can give it a try. :) I don't have high hopes with the current ty to mpg converter on series 1 streams. Try the UI first to see if it will convert Series 1 ty streams/files. You should be able to at least retrieve the NowShowing and a ty stream. MPG is questionable.

I don't think anyone has tried ShowCenter. See if you can attach to the myihome server. You should at least be able to see NowShowing. If the step above works, then it may work.

I know there are problems with an older .ty file I tried to convert. If you can hang on for a couple of weeks, I'm planning on working on a ty/mpg converter to handle it. I think PAL video should work.

If you can convert the Series 1 .ty files, please tell me! To support the older ty format is a major P.I.T.A. I would prefer not to do it!

bwperez

02-10-2007, 08:45 PM

I'm using the MyIHome server for my LinkTheatre, so I don't have the problem.

I guess it is time to try out the MyIHome server. Thanks for the feedback and the intention to add to the next release.

The patch is actually nonstandard and screws some programs up.

I guess I can use the Zoom button on the linkplayer remote. It "unsquashes" the image and really isn't that much of an inconvience.

I want to again think you for such a great tool. I had used TyTool for years and must say that this one is even easier for what I use it for. With the LinkPlayer I quit burning DVD's almost two years ago.

Brian

dburckh

02-11-2007, 01:31 AM

New version! I think this has all the requests and fixes since the last release. Fixed a problem with dimension (sequence) patching introduced in 1.0(?).

I hope the next release will have folders in MyIHome and be able to stream video off the file system.

signwatcher

02-11-2007, 03:39 AM

Excellent work, makes extraction very painless and simple.

In the GUI, could you possibly make ui.downloads Dynamic so changing destination can be done without exiting and editing application.properties?

Also a nice touch would be a job queue so one could queue up all the desired extractions and let it rip to appropriate subfolders overnight.

I'm not necessarily being lazy, I could do this myself, but it's in early development and this would go along way to making it a more intuitive tool for those of us with centralized mass storage.

I can also confirm that this will save correctly to a network drive (samba share) though it needs the format \\\\server\\share\\path\\subpath
and obviously must have logged in already if it is protected.

bwperez

02-11-2007, 09:39 AM

I like the idea of a job queue. I'm currently looking through the log to see where things are in the process. This work, however it takes a little time if you kick of a bunch of dowloads.

Another suggestion would be to add a line in the cmd output log that states what file is being worked on. I queued up about 15 HD shows and have a few "dead audio" messages. Figuring out which show had the issue has been tricky.

Again thanks for the wonderful tool!

bwperez

02-11-2007, 09:41 AM

I also started using the MyIhome server and the LinkPlayer and it works like a champ!

dburckh

02-11-2007, 11:46 AM

I've wanted to make the properties file reader dynamic for a while. I'll put that on the list. Some of the values are stored in static and instance variables, so I'll have to change that as well.

We are still getting "Dropping dead audio", even in 1.1? I can bump the video buffer to 1250ms. I might even try 1500. I'll have to see how it affects memory usage. The properties file option isn't active in the 1.1 release, it's set in code to 1000ms

kemac

02-11-2007, 12:45 PM

Everything is working well for me as well including using my LinkPlayer. Thanks again!

I had a few UI requests.

1. Adding a total number of shows - broken down by host if possible
2. Total Space used for all shows - broken down by host if possible
3. Total space of selected shows
4. Space indicator(s) might be cool..

The reason I am interested in the total space information is because I have over 1T of MFS space on my HDTivos, which isn't reported properly by TWP or the Tivo software for that matter (Indicates 1 hr of recording space). So the only way I have today, to tell how much recording space I am using, is to fire up an MFS_FTP session and have my ftp client give me the total space used by all my shows.

dburckh

02-11-2007, 01:16 PM

kemac,

If you use the CLI, it calcuates this information now. cli.cmd <host>. This will dump the NowShowing and give you the total MB used at the end.

kemac

02-11-2007, 01:38 PM

kemac,

If you use the CLI, it calcuates this information now. cli.cmd <host>. This will dump the NowShowing and give you the total MB used at the end.

Ahhhh, the one tool I hadn't used yet the cli... works great, thanks!

tlphipps

02-11-2007, 04:07 PM

Since today seems to be the day for feature requests, here's mine:

1. TMF file support. I have several TMF files that I've downloaded that I'd love to be able to convert to MPG files without having to first convert the TMF to TY.

bwperez

02-11-2007, 04:20 PM

We are still getting "Dropping dead audio", even in 1.1?

I was still using 1.0fp1. I'll try out 1.1

Update:

I tried downloading with 1.1 and I am still getting the Dropping dead audio message.

Brian

dburckh

02-13-2007, 01:23 PM

I finally reproduced "Dropping dead audio" problem in 1.1. I set the video buffer to 1250ms (only works in 10_fp1) and that finally eliminated it for me. This only occurred at the beginning of the stream. If it's only at in the beginning and you don't have audio drop outs, it probably not going to hurt anything. Each frame is like 1/20th of a second. The number you see is the frame count being dropped.

Anywho, it will be bumped up to 1250ms in 1.2. 1.2 will be probably be out Thursday.

dishdude

02-14-2007, 11:52 AM

Ok been pulling my hair out.. Got a zippered S2 Tivo trying to get this to work. Getting this..

Testing connection from: 192.168.0.100

Testing UI Connections
----------------------
Checking Host: 192.168.0.50
Checking: NowShowing
Passed: NowShowing
Checking: mfs_uberexport
Passed: mfs_uberexport
Checking: dserver.tcl
Starting dserver.tcl
getting NowShowing
Exception in thread "main" java.lang.IndexOutOfBoundsException: Index: 1, Size:
0
at java.util.ArrayList.RangeCheck(Unknown Source)
at java.util.ArrayList.get(Unknown Source)
at util.SetupTest.testTivo(SetupTest.java:169)
at util.SetupTest.testTivos(SetupTest.java:89)
at util.SetupTest.test(SetupTest.java:59)
at util.SetupTest.main(SetupTest.java:44)

MS_ftp is working fine as well as Tytools..

dburckh

02-14-2007, 12:39 PM

NowShowing is either the wrong version, or not in the Tivo path. There is a link to the correct version in the readme.txt. Type "which NowShowing" from telnet should verify it's in the path. It should be and will be hard coded in testSetup in the next release. I'll also fix the setupTest problem. Make sure this is the entry for NowShowing in applications.properties. No path.

NowShowing.executable=NowShowing

It is also possible that NowShowing is hanging, but that is unlikely.

1.2 will have vastly improved logging. If we still can't get it, we can crank up the logging to ludicrous levels.

dishdude

02-14-2007, 01:20 PM

dburckh

02-14-2007, 02:33 PM

Hmmm. Sounds like it didn't like the .ty stream. If you didn't do this already, start the ui from ui.cmd. That will have the console. Run it again and see if you get errors. If there are errors, what hardware and Tivo software version are you using? Is the HD or SD? Does the title play on the Tivo without error?

I may want to get the .ty file. You may have hit something new.

dishdude

02-15-2007, 08:44 AM

dishdude

02-15-2007, 09:12 AM

Well picked a different show and it worked fine. Lemme try the same one again and monitor the outcome.. I'll let u know what happens.

Appears to be a problem with that particular series. It's Junk Brothers on HGTV. Grabbed something else and no problem. It appears to be working but the file stops at 1.5MB to around 2 but the inferface shows it still coming in but doesn't write anymore. One thing to note is this is pulling down as an MPG, works fine coming in as a TY.

dburckh

02-15-2007, 11:05 AM

New Version! Lots of improvements/fixes in Media Center. Better logging through out.

snoots

02-15-2007, 03:10 PM

02/15/2007 19:07:02 INFO [ui.TivoUI] Refreshing from 192.168.1.201...
02/15/2007 19:07:04 INFO [ui.TivoUI] Refreshing from 192.168.1.202...
02/15/2007 19:07:05 INFO [ui.TivoUI] Refresh Complete
02/15/2007 19:07:59 INFO [ui.TivoUI] Queued D:\Tyfiles\Fight Science.mpg
02/15/2007 19:07:59 INFO [ui.TivoUI] Started D:\Tyfiles\Fight Science.mpg
Exception in thread "Thread-2" java.lang.NumberFormatException: null
at java.lang.Integer.parseInt(Unknown Source)
at java.lang.Integer.parseInt(Unknown Source)
at common.PropertiesReader.getIntProperty(PropertiesReader.java:69)
at parser.GOPTyRecordParser.<init>(GOPTyRecordParser.java:95)
at io.FileTransferrer.convertTyStream(FileTransferrer.java:107)
at io.FileTransferrer.getMpgFile(FileTransferrer.java:40)
at ui.TransferDaemon.run(TransferDaemon.java:44)
at java.lang.Thread.run(Unknown Source)

dburckh

02-15-2007, 03:15 PM

Doah! My bad. Uncomment this line in application.properties for now. I'll have it patched shortly.

#GOPTyRecordParser.maxPacketSize=32768

e.g.

GOPTyRecordParser.maxPacketSize=32768

snoots

02-15-2007, 03:34 PM

That got it goin'

snoots

02-15-2007, 03:42 PM

2/15/2007 19:33:36 INFO [ui.TivoUI] Started D:\Tyfiles\Good Eats - Bowl O'
you.mpg
2/15/2007 19:34:46 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:34:51 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:34:51 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:34:51 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:34:51 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:34:52 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:34:53 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:34:53 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:35:00 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:35:00 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:35:01 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:35:02 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:36:04 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:36:04 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:36:12 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:36:17 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:36:17 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:36:18 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:37:40 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:37:41 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:37:42 WARN [parser.GOPTyRecordParser] Dropping dead audio: 1
2/15/2007 19:38:18 INFO [ui.TivoUI] Completed D:\Tyfiles\Good Eats - Bowl O'
you.mpg

Thanks !

dburckh

02-15-2007, 03:59 PM

Man. Bad day. :)

It won't screw up the stream, but you may hear it. Each of those packets is about 50ms. I've been fighting with this for a while. My box works fine. Others have this issues. With the logging re-write this is now showing up in the UI, but it was probably always happening on certain files. I'll release 1.2a tonight after work and bump up the stream buffer up even further.

snoots

02-15-2007, 04:05 PM

Thanks a lot, I really like this program, I mostly use it with my LinkPlayer2. And of course it makes downloading to the pc real easy !

dburckh

02-15-2007, 05:14 PM

Have you checked out the Folders and local/network file content? I'm really digging that. Finally, all my video accessible from a single point. Nerdvana.

mixelpix

02-15-2007, 05:55 PM

Great job on this suite of apps. I've never been able to so easily stream/download content from my beloved Tivos.

Is there a way to make sure the file names are compliant to the receiving OS.
I'm trying to download the HD version of 24 and I get:
ui.TivoUI] Queued G:\TivoDL\24 - Day 6: 6:00AM -7:00AM\7:00AM - 8:00AM.mpg
ui.TivoUI] Failed G:\TivoDL\24 - Day 6: 6:00AM -7:00AM\7:00AM - 8:00AM.mpg

Other files work just fine so apprently the "/" in the title is preventing the download.
It also truncates the file at the ":" on other single hour episodes.
24 - Day 6: 8:00AM - 9:00AM ends up being "24 - Day 6"

snoots

02-15-2007, 06:54 PM

Ok trying to get myihome running again. I have replaced your background image ( see earlier post about my cats complaint ). It starts up slowly on the linkplayer2 shows the background but no files displayed from tivos or folder on PC. I do see what looks like activity on my tivo network adapter but that may be random traffic. See below from cmd window. Sorry to be a pest

02/15/2007 22:49:20 INFO [web.myihome.MyIHomeWebServer] Tivo Server open for t-
Business on http://localhost:5000/
java.lang.NullPointerException
at util.TypeFileFilter.<init>(TypeFileFilter.java:10)
at web.myihome.NowShowingServlet.retrieveFileNowShowing(NowShowingServle
t.java:123)
at web.myihome.NowShowingServlet.refresh(NowShowingServlet.java:205)
at web.myihome.FolderNowShowingServlet.refresh(FolderNowShowingServlet.j
ava:32)
at web.myihome.NowShowingServlet.getNowShowing(NowShowingServlet.java:10
2)
at web.myihome.FolderNowShowingServlet.getNowShowing(FolderNowShowingSer
vlet.java:24)
at web.myihome.NowShowingServlet.doPost(NowShowingServlet.java:58)
at web.myihome.NowShowingServlet.doGet(NowShowingServlet.java:38)
at web.ServerConnection.run(ServerConnection.java:24)
at common.ThreadPool$WorkerThread.run(ThreadPool.java:24)

dburckh

02-15-2007, 07:25 PM

Looks like you have to set somethings in application.properties

Maybe this, or whatever is appropriate. Check the readme.txt

MyIHomeWebServer.dirs=C:\\
MyIHomeWebServer.fileTypes=.mpg

snoots

02-15-2007, 07:42 PM

Missed the new display file types requirement. Working great now.

If you are taking requests ( off topic since it's not tivo ) would it be possible to playback dvr-ms files from a media center pc? I think it is just mpg with some meta data wrapped in.

dburckh

02-15-2007, 08:50 PM

That's a can of worms. Before I released the TySuite, I spent 2 months working on the ty to mpg converter. I banged the initial UI out in about 4 hours, if that gives you a frame of reference. :)

There's got to be a command line tool that converts dvr-ms to MPG out there already. If there's one for Java, that's a bonus. If so, I could probably integrate it in with out too much hassle. I could use the same code to give people the option to use BCC's tytompg instead of my Java converter.

snoots

02-15-2007, 08:59 PM

I actually added ms-dvr to the file types in the myihome and got video playback on the linkplayer2 but no audio and the video was choppy. The actual quaility resolution wise was full HD just jumped and stopped and started frequently. This is also what happens when I use any other pc based syabas compatable server to try streaming the files. Maybe it's a "microsoft" thing . Videoredo can convert but if your excellent tool would let me watch stuff I don't need to archive. If archiving I can convert with videoredo. Anyway thanks again and keep up the great work.

dburckh

02-15-2007, 09:54 PM

I justed added 1.2a which should address the issues snoots found. I figured I would have to EBF something soon or later, but this the best testing I've done in a while. :)

dburckh

02-15-2007, 10:03 PM

snoots,

This looks like the deal:

h++p://babgvant.com/files/folders/dvrmstoolbox/entry1113.aspx

It's got something called DVRMStoMPEG.exe which should do what you need.

Anywho, I'm going to work on support other Tivos first. Then, I'm on vacation. :)

snoots

02-15-2007, 11:07 PM

Thanks, agin, and I hope you have a great vacation.

dburckh

02-15-2007, 11:11 PM

Is there a way to make sure the file names are compliant to the receiving OS.
I'm trying to download the HD version of 24 and I get:
ui.TivoUI] Queued G:\TivoDL\24 - Day 6: 6:00AM -7:00AM\7:00AM - 8:00AM.mpg
ui.TivoUI] Failed G:\TivoDL\24 - Day 6: 6:00AM -7:00AM\7:00AM - 8:00AM.mpg

Other files work just fine so apprently the "/" in the title is preventing the download.
It also truncates the file at the ":" on other single hour episodes.
24 - Day 6: 8:00AM - 9:00AM ends up being "24 - Day 6"

Ah yes, I suspect that anything with a / or \ will have problems. I'll replace them with _. I am kind of curious about the : problem, it should at least behave consistently.

mixelpix

02-16-2007, 02:48 AM

Ah yes, I suspect that anything with a / or \ will have problems. I'll replace them with _. I am kind of curious about the : problem, it should at least behave consistently.

If you pop in the code to replace the / \ with _ I'll do further testing on the on the : to see if it behaves more predictably.

Thanks for the quick response.

dburckh

02-16-2007, 03:47 AM

Well, this is getting really close to what I would call non-beta. It should fix most of the ty problems.

With a little help, I got a couple other .ty samples. (Thanks snoots and Wander98!). It seems to be converting those properly now. 20c is what you want. 20b is out there in case I pouched something. See the release notes.txt for changes.

dburckh

02-16-2007, 11:37 AM

snoots

02-16-2007, 02:12 PM

With the last couple of versions on my Linkplayer2 I can't seem to get things to playback that were working before. For example on one machine i have a bunch of "24" episodes. It shows up as one entry for 24. When selecting it I then see the items in the folder as individual shows with the date. However selecting any of the shows they don't playback, the screen goes black and then comes back to the menu. I will post the cmd window below. I noticed that some of the shows are duplicates that were recorded on more than one of the tivos. Perhaps that confuses things. I am going to try delete 2 of the 3 tivos from the perferences and try it. Will post results. By the way I am trying this on 2 hdtivos at 6.3b and one S1 Dtivo at the last updated version it it running if it helps.

2/16/2007 18:02:53 INFO [web.myihome.MyIHomeWebServer] Tivo Server open for t-usiness on http://localhost:5000/
xception in thread "Thread-3" java.lang.ExceptionInInitializerError
at web.myihome.BackgroundPerformServlet.doPost(BackgroundPerformServlet.
ava:29)
at web.myihome.BackgroundPerformServlet.doGet(BackgroundPerformServlet.j
va:15)
at web.ServerConnection.run(ServerConnection.java:24)
at common.ThreadPool$WorkerThread.run(ThreadPool.java:24)
aused by: java.lang.NullPointerException
at java.io.File.<init>(Unknown Source)
at web.myihome.BackgroundFileConverter.<clinit>(BackgroundFileConverter.
ava:33)
... 4 more
xception in thread "Thread-2" java.lang.NoClassDefFoundError
at web.myihome.BackgroundPerformServlet.doPost(BackgroundPerformServlet.
ava:29)
at web.myihome.BackgroundPerformServlet.doGet(BackgroundPerformServlet.j
va:15)
at web.ServerConnection.run(ServerConnection.java:24)
at common.ThreadPool$WorkerThread.run(ThreadPool.java:24)

dburckh

02-16-2007, 02:27 PM

It looks like you don't have this entry specified.

BackgroundFileConverter.cacheDir=.

snoots

02-16-2007, 02:56 PM

Somehow that line got commented out in my preferences. I don't think I commented it out. My cache was being written in the install directory originally. Now I can stream the S1 tivo files and get good clean video but no audio at all. This is on my sony S1 Dtivo

02/16/2007 18:55:50 WARN [parser.RestreamingTyRecordParser] Dropping dead audio
. Last SCR: 0:09:54.193 current SCR: 0:09:54.226 Audio [0:07:46.28, ]
02/16/2007 18:55:50 WARN [parser.RestreamingTyRecordParser] Dropping dead audio
. Last SCR: 0:09:56.195 current SCR: 0:09:56.228 Audio [0:07:46.28, ]
02/16/2007 18:55:51 WARN [parser.RestreamingTyRecordParser] Dropping dead audio
. Last SCR: 0:09:57.363 current SCR: 0:09:57.396 Audio [0:07:46.28, ]
02/16/2007 18:55:51 WARN [parser.RestreamingTyRecordParser] Dropping dead audio
. Last SCR: 0:09:59.331 current SCR: 0:09:59.365 Audio [0:07:46.28, ]
02/16/2007 18:55:52 WARN [parser.RestreamingTyRecordParser] Dropping dead audio
. Last SCR: 0:10:00.332 current SCR: 0:10:00.366 Audio [0:07:46.28, ]
02/16/2007 18:55:53 WARN [parser.RestreamingTyRecordParser] Dropping dead audio
. Last SCR: 0:10:01.901 current SCR: 0:10:01.934 Audio [0:07:46.28, ]
02/16/2007 18:55:54 WARN [parser.RestreamingTyRecordParser] Dropping dead audio
. Last SCR: 0:10:03.569 current SCR: 0:10:03.602 Audio [0:07:46.28, ]

robn77

02-16-2007, 03:05 PM

I just downloaded the 13 and then the 20a beta and with both I get errors when downloading a show.

The error is:

14:02:55 Aborting record due to large timestamp delta: 2018 | 0:00:12.679 | 0:00:10.660
14:02:55 Warning: Illegal size for packet type: -32: 9868

I searched through this thread and did not see anyone else having this problem.

This is a series 2 DTivo and the show is a SD show

I was able to download the ty file and mux it through tytools fine.

Thanks!

dburckh

02-16-2007, 04:00 PM

Snoots,

Wow, that audio is really is really late (over 2 mins). This may be due to bad data that seems to accompany the end of a .ty block or a massive PTS jump. I'd like to get the ty file.

I'll work on getting an upload website this weekend. I'll PM you the URL.

dburckh

02-16-2007, 04:02 PM

robn77,

I'm at work, so I'll have to wait until I get home to find out where that error is coming from.

robn77

02-16-2007, 04:22 PM

robn77,

I'm at work, so I'll have to wait until I get home to find out where that error is coming from.

No Problem.

I seem to be able to download & convert shows from my HR10-250. It got farther in the process than the SD Tivo without any of the errors. I will know in about 80 minutes how the download did.

dburckh

02-16-2007, 04:43 PM

robn77,

I know that HR10-250s work. I haven't seen that error before and I don't recognize the error. It has something to do with a video packet. It might be that the length does not match what I calculated it to be. I haven't actually seen a video packet with a length on it, usually only audio packets have this set.

robn77

02-16-2007, 04:51 PM

Another item to think about.

SD Program recorded on DirecTV local channel

HD Program recorded on OTA local channel

I might test out recording both local channels on the HR10 and see if the same error comes up.

dburckh

02-16-2007, 06:20 PM

wander98

02-17-2007, 05:57 AM

Had a huge 24 hours. 3 releases in 24 hours (4 if you count the EBF release).

Wrote code to support other Tivo versions and believe I have fixed the audio drop problems that everyone was seeing. Thanks for the tip wander98.

New versions of 1.x and 2.0 beta are posted with these changes.

Thanks,
Still having problems with some ty's. It converts several seconds of the stream and then stops putting data into the mpg file. Each stream always stop at the same spot so guessing some goofy data in there. Other show's I have convert with out any issue.

Wander98

robn77

02-17-2007, 10:31 AM

I have a set of test files that I usually try to run through before I make a release.

They are:
HD DTV
SD Non-network
HD OTA

I'll Tivo something off a DTV local and add it to my testing process. Fox seems to be the most problematic. Sometimes I do skimp on this if I haven't modified the converter. :)

The only file type that I seem to have errors with is Local Channels on the SD Tivo. This is not usually a problem but I will download from these channels to watch on my laptop on a plane because the file sizes are smaller.

HR10-250:
OTA Locals OK
SD Locals OK
SD Non-Network OK
HD DTV OK

Phillips-704
SD Locals NO
SD Non-Network OK

mixelpix

02-18-2007, 09:51 PM

dburckh

02-18-2007, 11:08 PM

2.0b is out. Fixes for series 1 and a few fixes/enhancements for Media Center. The web server now has an icon! Ooooooo. :)

http://www.dealdatabase.com/forum/showpost.php?p=275977&postcount=99

If you have any .ty files you can't convert, please post or PM me and I'll see what I can do.

wander98

02-19-2007, 01:50 AM

I want to echo Mix's comments.

The package has been one of the quickest and easiest overall from install to shows playable/streamable on a PC.

Thanks for helping those of us support our habit of hacking our tivo's.

Wander98

dburckh

02-19-2007, 02:53 AM

Thanks guys! I'm actually having a lot of fun with this project. Glad to see others are using it.

snoots

02-19-2007, 08:53 PM

I can confirm my T60's S1 stream now plays with audio using the new version. Thanks !!!!

dburckh

02-20-2007, 02:02 AM

I just added 2.0c. A couple of really nice UI improvements (See readme.txt) and some improvements to the 2.0 ty stream processor.

http://www.dealdatabase.com/forum/showpost.php?p=275977&postcount=99

av8rdude

02-20-2007, 08:04 PM

Hi,
I have been using this since the first version. Great tool!!! But since version 2.0A I have had this error when trying to run the webserver:

C:\Documents and Settings\Scott\Desktop\TySuiteJ_20c_beta>web.cmd
Exception in thread "main" java.lang.NullPointerException
at java.io.File.<init>(Unknown Source)
at web.UploadServlet.<init>(UploadServlet.java:18)
at web.generic.GenericWebServer.<init>(GenericWebServer.java:17)
at web.generic.GenericWebServer.main(GenericWebServer.java:28)

Thanks,
Scott

dburckh

02-20-2007, 08:34 PM

Ooops. That isn't supposed to be there. Try this:

UploadServlet.uploads=C:\BOGUS

There is an upload servlet that I was using for other reasons. I thought it would be disabled by removing the entry. I was partially right. ;) Make sure the directory doesn't exists or the upload servlet will be functional.

robn77

02-20-2007, 11:42 PM

2.0c Looks good!!!

Now I can convert all files.

Great utility!

ghasi

02-22-2007, 01:59 AM

wander98

02-22-2007, 02:07 AM

Hi dburckh,

I am not expert with linux... I am just nubie.. I have recently upgraded my directivo DVR to 6.2 kernel, using PTVupgrades instacake and PTVNet CD's... I want to install your application to extract video from directivo... in instructions you mentioned that Java need to be install, is it on TIVO or on my desktop?

if it is on Tivo, please let me know how can I install Java on directivo..

Thanks,
G

From the readme.txt
3. Java 1.4.2 or better (http://java.sun.com/j2se/1.5.0/index.jsp)

The only things that you need to install on your tivo are NowShowing, mfs_uberexport(http://sourceforge.net/projects/mfs-utils/), and dserver.tcl(Included in tysuite) are on the Tivo, up to date and in the path.

Wander98

ghasi

02-22-2007, 02:57 AM

wander98,

Thanks for quick response... it worked...

dburckh,
Excellent application...

Thanks,
G

wahooj

02-22-2007, 03:23 AM

First I would like to say this tool works great! I do have a small problem that I can't quite figure out though. It works fine from my Windows XP box using java version 1.5.0_10. However, on the MythTV box I'm building, when I run the ui.cmd, it reboots the Tivo, partway through populating the Now Showing list. The only difference on the boxes I can see other than the OS is the java version on my MythTV box is 1.6.0-b105. I haven't yet tried upgrading Java on my XP box, or downgrading on the MythTV box. Any help is appreciated, and I am absolutely willing to help troubleshoot, debug, etc.

dburckh

02-22-2007, 11:19 AM

I've seen this occur if the telnet session dies unexpectedly. This has a tendancy to crash dserver.tcl and reboot the box. Try this:

Before starting the ui, open a telnet session to the tivo. Execute the following two commands:

dserver.tcl &
exit

Now start the UI.

This will allow the UI to connect to the box without telnet-ing to it first. You'll have to do this each time you restart the tivo.

I'm going on vacation really soon and I'll do some testing with Java 6 when I get back.

wahooj

02-22-2007, 12:30 PM

Thank you. I will try that. Last night I tried Java 1.5.0_11 on the MythTV box with the same results. Maybe its a difference in the networking. Have a great vacation!

dburckh

02-22-2007, 02:17 PM

I should be releasing version 2.0d tonight or tomorrow. I put in some minor changes in the telnet emulation shutdown. It might fix it.

wahooj

02-22-2007, 10:02 PM

Update: running 'dserver.tcl 56178 &' on the tivo before running the UI worked like a charm.

dburckh

02-22-2007, 10:15 PM

Update: running 'dserver.tcl 56178 &' on the tivo before running the UI worked like a charm.

Awesome! I made some improvements in the next release that MAY resolve it.

dburckh

02-22-2007, 11:02 PM

I'm calling this release 2.1 Release Candidate 3.

The suite has evolved quite a bit and I don't think "DTivo extactor" is an accurate description any more. My plan is to start a new thread called "TySuiteJ - UI, Extraction, Multiplexing, and much much more". I'm taking suggestions for thread titles as well.

Hopefully this fixes the Tivo reboots. I didn't feel comfortable with that "feature"

Version 2.1_rc3
---------------
Added easy to use streaming video! Click "view" from web server
Improved telnet emulation. May lock, but shouldn't reboot tivos (hopefully)
Fixed convert.cmd
Added .tmf support to convert.cmd
Updated the readme.txt for convert.cmd and view. Updated a couple other things a well.

mbklein

02-23-2007, 03:20 PM

Holy Friggin' Cow, I can't wait for my USB adapter to show up from Amazon so I can try this out. I finally got around to hacking my DTivo last night (another story of pain and perseverance, given that I had to do it all start to finish with a Mac laptop and USB drive enclosures), and I was not looking forward to having to deal with trying to get tystudio working reliably on an Intel mac.

So I'm going to salute your hard work now, before I even get a chance to try the thing. I'm sure I'll be even more effusive when I've started converting stuff.

Offhand (and I may have missed an earlier post about this), what kind of transfer/transcode times can I expect per hour of SD video? My TiVo will be wired, but my iMac is 802.11g.

Thanks!
Michael

dburckh

02-23-2007, 04:21 PM

You are only really limited by your transfer rates. I average 2.2MB/s, so that means I get a half an hour of SD in about 3.5 minutes. HD is considerably larger and slower. The wireless is probably going to be your limiting factor. I think with my 54g, I could only get 2.7MB even with MIMO.

The nice thing is that the UI always you to queue extractions, so you can start a bunch of stuff before bed time. Probably want to do a test run first. :)

drez

02-23-2007, 05:07 PM

With Jamie's custom kernel and both tuners set on dead channels (0 and 1), I get 4.1MB/s sustained from mfs_ftp. With the both tuners active, I get ~3MB/s.... the custom kernel seems to really help. This is on a 6.2, wired, 100mbit. (yup, regular old 100mbit...)

Before I start mfs_ftp from telnet, I enter: setpri fifo 10 $$
which gives mfs_ftp the highest priority on the box.

I get ~3.1MB/s (2.9MB/s sustained) from my Tivo connected to a 54g bridge in the other room.

dburckh: Great program :) If you'd like, when you come back from vacation, I can help you setup a monte if you'd like to try the custom kernel.

dburckh

02-23-2007, 05:20 PM

If the "setpri fifo 10 $$" works for mfs_ftp, it should help with dserver.tcl. We use very similar transfer mechanisms. (I pretty much copied that line).

I was reading about custom kernel's and monte last night. Is it going to work with my HR10-250? They all talked about 6.2 versions, which I've only heard of 3.1.x and 6.3 on my unit.

drez

02-23-2007, 06:09 PM

Yeah, a custom kernel will work with a HR10. A while back I setup a HR10 (3.1.5f) for a family member and I remember getting ~3.1MB/s with a custom kernel and tuners on 0&1.

"setpri fifo 10 $$" should help a bit but the real gains come with a custom kernel. The best I could get without a custom kernel was ~3.2MB/s. (vs. 4.1MB/s with the kernel)

"setpri fifo 10 $$" will make the UI unresponsive (video will still play but remote presses may take a while to register) during a transfer, so if you plan to use it, make it optional and add a warning.

rjhinton

02-23-2007, 07:31 PM

I've been trying to get Tysuitej 2.0 rc1 Web Server to server up a recording from my HR10-250 6.3c DVR to myplayer. The following is reported by the Web Server console.

02/24/2007 06:31:05 INFO [web.generic.GenericWebServer] Tivo Server open for t-
Business on http://localhost:8280/
02/24/2007 06:31:15 DEBUG [web.MinimalServletRequest] Request: GET /title/Cars.m
pg?host=192.168.0.6 HTTP/1.0
02/24/2007 06:31:15 TRACE [web.MinimalServletRequest] Host: localhost:8280
02/24/2007 06:31:15 TRACE [web.MinimalServletRequest] User-Agent: MPlayer/1.0rc1
-3.4.2
02/24/2007 06:31:15 TRACE [web.MinimalServletRequest] Icy-MetaData: 1
02/24/2007 06:31:15 TRACE [web.MinimalServletRequest] Connection: close
java.lang.NullPointerException
at io.DServerTyStreamHelper.getSocket(DServerTyStreamHelper.java:96)
at io.DServerTyStreamHelper.getTyStreamSocket(DServerTyStreamHelper.java
:89)
at web.generic.TitleMinimalServlet.doPost(TitleMinimalServlet.java:41)
at web.generic.TitleMinimalServlet.doGet(TitleMinimalServlet.java:23)
at web.ServerConnection.run(ServerConnection.java:24)
at common.ThreadPool$WorkerThread.run(ThreadPool.java:24)

Please help me resolve this issue.

mbklein

02-24-2007, 12:39 AM

I got everything installed, and it acts like it's working -- it took 15 minutes to copy an hour-long show from my TiVo to my laptop, which seemed fine. But when it was done, I quite the UI and browsed to the MPG file, and it was only 4K in size. It has a create time of 10:52 PM and a last modified time of 11:07 PM, so clearly it was being written to over time, but it somehow got truncated.

I'm on a Mac, which I hope doesn't have anything to do with it. I still have the 4K MPG if you think it might tell you anything.

(Edit - Additional Info): I just tried transferring the .ty, which worked fine, but when I went to convert it to MPG, it created another 4K file.

(Edit 2 - The Additional Info Strikes Back): When I try to extract to MPG using either the web server or UI, I get a line reading "WARN [parser.TyRecordServer] Invalid Record Size Returned: 0 : -98". Pulling down the TY gives me no such error.

(Edit 3 - Return of the Additional Info): Never mind. I was inadvertently trying to stream/extract/transcode encrypted shows from before I superpatched tivoapp.

End result: DTivo Extractor totally rocks.

dburckh

02-24-2007, 10:40 AM

rjhinton,

The fsid is missing from the get URL. Are you sure you copied the entire url? It should have some like h++p://192.168.0.6:8280/title/Cars.mpg?host=192.168.0.6&fsid=12345

dburckh (from Miami)

rjhinton

02-25-2007, 10:29 PM

dburckh,

Looks like I negelected to surround the shortcut I pasted into the command with quotes.

rjhinton

mbklein

02-26-2007, 11:56 PM

Nitpicky question: I've got .ty and .mpg extraction working through the UI, and the web server is working as well. If I copy an MPG or TY url from the web browser screen and paste it into VLC's "Open Network..." dialog, it'll buffer a little, then start playing, but I have trouble trick playing -- apparently VLC isn't buffering the way I'd expect. When I paste the URL into QuickTime Player's "Open URL..." dialog (I have the MPEG-2 codec for QuickTime installed), I get an immediate response that the URL isn't valid and the web server console looks like this:02/26/2007 22:51:36 INFO [web.generic.GenericWebServer] Tivo Server open for t-Business on http://localhost:8280/
02/26/2007 22:51:44 INFO [parser.RestreamingTyRecordParser] Offsetting PTS/DTS by:0:04:27.750
java.net.SocketException: Broken pipe
I know very little about streaming formats, but is it possible to wrap the MPEG-2 data in some kind of streaming container that will allow QuickTime to understand what it's receiving, instead of it looking like a truncated, incomplete MPEG file?

Thanks,
Michael

dburckh

03-02-2007, 02:13 AM

Nitpicky question: I've got .ty and .mpg extraction working through the UI, and the web server is working as well. If I copy an MPG or TY url from the web browser screen and paste it into VLC's "Open Network..." dialog, it'll buffer a little, then start playing, but I have trouble trick playing -- apparently VLC isn't buffering the way I'd expect.

By trick playing, I assume you mean FFWD, RWD, etc. The output is a stream and most players only hold a short period piece of it in their buffer. If you want trick play, you can start downloading the file and then opening it in VLC. VLC is one of the few players that will allow you to open a file that is being saved.

There is a protocol called RTSP that would be possible to support. Unfortuately, it's very complicated to do all the jumping around required to support trick play.

When I paste the URL into QuickTime Player's "Open URL..." dialog (I have the MPEG-2 codec for QuickTime installed), I get an immediate response that the URL isn't valid and the web server console looks like this:
I know very little about streaming formats, but is it possible to wrap the MPEG-2 data in some kind of streaming container that will allow QuickTime to understand what it's receiving, instead of it looking like a truncated, incomplete MPEG file?

I haven't been able to get QT to play any MPG files (mine or others), but I haven't tried their MPEG plugin. Will it play the ones that are completely extracted?

dburckh

03-02-2007, 08:16 PM

New release! This should now have all the requests addresed and has some performance increases. I'm calling this the "final" release.

http://www.dealdatabase.com/forum/showpost.php?p=276579&postcount=131

Any feed back on the new thread/title? I'm going to do that tomorrow.

mbklein

03-03-2007, 06:09 PM

I haven't been able to get QT to play any MPG files (mine or others), but I haven't tried their MPEG plugin. Will it play the ones that are completely extracted?

There's a $20 add-on (http://www.apple.com/quicktime/mpeg2/) for QT to play MPEG-2 files. Completely extracted files play fine. Partially extracted files play file up to the point that they were written before QT opened them, but QT never sees the rest of the file (like VLC does) unless you close and reopen after some more buffering time.

The new release looks great. :up: QT no longer gives an error, and it shows a window as if it's going to play the file, but it never actually gets around to playing it. I'll stick with VLC for the time being; I'd be happy to work on RTSP support if you give me some idea of how it would have to interface with your code.

Michael

dburckh

03-03-2007, 07:03 PM

I'm not sure RTSP is going to do the trick either. There just isn't much support out there for streaming MPG video.

I've been considering UPNP, which should work. A lot of media players and Vista support this out of the box.

tlphipps

03-03-2007, 11:04 PM

UPNP would be awesome! I've had limited success streaming TY files to my xbox with ccxstream, but with UPNP it should be a piece of cake!

lenoxb

03-04-2007, 05:31 AM

I can run mfs_ftp without trouble, but I reboot the Tivo whenever I try to do anything with TySuiteJ_21_rc2.

The stuff from http://sourceforge.net/projects/mfs-utils/ is in my path.

/var/tmp# md5sum $(which dserver.tcl NowShowing mfs_uberexport)
966d4f8ce5a2f1e309871a1d7edadf7d /var/mybin/dserver.tcl
75b225fef425c46fc8423ced0450b35e /var/mybin/mfs-utils/bin.mips/NowShowing
cd29d8ca504662dbbd706e2fde3a737c /var/mybin/mfs-utils/bin.mips/mfs_uberexport
This is the output I get from testSetup.cmd just before it reboots:

C:\Documents and Settings\lenoxb\TS>testSetup.cmd
java version "1.5.0_02"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_02-b09)
Java HotSpot(TM) Client VM (build 1.5.0_02-b09, mixed mode)
Testing connection from: 192.168.1.129

Testing UI Connections
----------------------
Checking Host: 192.168.1.99
Checking: NowShowing
Passed: NowShowing
Checking: mfs_uberexport
Passed: mfs_uberexport
Checking: dserver.tcl
Starting dserver.tcl
getting NowShowing

(I also reboot the Tivo with “cli 192.168.1.99”)

Any ideas what might be going wrong?

dburckh

03-04-2007, 12:11 PM

It appears to be blowing up running NowShowing. It's kind of a head scratcher as it appears to be finding it.

Are you running on a ppc or mips box? I get the following on my mips box.

966d4f8ce5a2f1e309871a1d7edadf7d /ptvupgrade/bin/dserver.tcl
0c1edd7bb93b5e9666538dd9165244e9 /ptvupgrade/bin/NowShowing
5fac7c242b6fc2e3b70e9e232ae42629 /ptvupgrade/bin/mfs_uberexport

Thanks for the cool snippet. I'll keep it around.

Try to run NowShowing from telnet. See if it reboots.

You probably want to update your Java as well. The DST change is going to screw that version up (assuming you are in the US or another country observing the new DST rules).

Finally, you can try the following.

1. Telnet to the tivo before running anything from TySuiteJ
2. execute "dserver.tcl 56178 &"
3. exit
4. Proceed normally.

lenoxb

03-04-2007, 02:42 PM

It appears to be blowing up running NowShowing. It's kind of a head scratcher as it appears to be finding it.

Agreed. And I already had run NowShowing from bash as a sanity check. It worked fine.

Are you running on a ppc or mips box? I get the following on my mips box.

mips--it's an HR10-250. At any rate, it's not rebooting anymore now that I have run "dserver.tcl 56178 &" first.

I'll press on and see what happens later today. Thanks for the help.

dburckh

03-04-2007, 04:06 PM

That's my setup and I have no issues. I'm guess you are running, "mfs-utils 20060503-experimental-snapshot". Where as I'm running, "mfs-utils 20050604"

That may be the issue. It seems more likely that it's a telnet emulation problem because running dserver.tcl directly fixed it.

lenoxb

03-04-2007, 10:05 PM

I am now away from home (and Tivo), but I have some ty files on my laptop. I just tried to convert one using util\convert.cmd. No luck. I did upgrade Java. Here's what I have.

C:\Documents and Settings\lenoxb\TS>java -version
java version "1.5.0_11"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_11-b03)
Java HotSpot(TM) Client VM (build 1.5.0_11-b03, mixed mode)

C:\Documents and Settings\lenoxb\TS>util\convert.cmd "in.ty" "out.mpg"
Exception in thread "main" java.lang.NoClassDefFoundError: parser/TyRecordServer

This is a ty file which I extracted with mfs_ftp (as a tmf, which I converted to ty by "tar xf" and concatenating pieces with "copy /b"). tytompg converted this file successfully.

I am running from the "root" of the extracted TySuiteJ_21_rc2.zip file, and it contains the application.properties file.

Any ideas how to troubleshoot this?

dburckh

03-04-2007, 11:45 PM

You have to run convert from the util directory. Can't run from the "root".

FYI: You can use the UI and converted right from the .tmf file in rc2. I'm NOT supporting .tmf from convert.cmd yet.

Ooops. I broke convert.cmd.

You can run it like this from the "root"

java -cp tySuiteJ.jar parser.TyRecordServer "file.ty" "file.mpg"

lenoxb

03-05-2007, 12:23 AM

I am running from the "root" of the extracted TySuiteJ_21_rc2.zip file, and it contains the application.properties file.

Answer: don't run convert.cmd from the directory which contains application.properties. The readme file is incorrect about this one.

lenoxb

03-05-2007, 12:36 AM

dburckh

03-05-2007, 01:17 AM

New Version!

http://www.dealdatabase.com/forum/showpost.php?p=276579&postcount=131

Streaming video from within the browser.
Tivo reboots fixed (I hope).

av8rdude

03-05-2007, 09:27 AM

Oops. I really do need to hit "Submit Reply" after I hit "Preview Post."

Anyway, I seem to be converting some files successfully now with your software that tytompeg couldn't cope with. My wife (who is stuck in the hospital far away from Tivo) and I both thank you very kindly for your hard work.

Tonight when I go home, I'll try using the UI to do the extraction and conversion at the same time.

You should just install tyshow on your laptop. Then you just play the ty files directly and save a bunch of effort/time. Here is a link to tyshow: http://sourceforge.net/project/showfiles.php?group_id=89724
Scott

av8rdude

03-05-2007, 09:48 AM

I like the new streaming feature in the web server. But I don't have the audio. The video looks great on my local network. But no audio...
While playing with the video during playback it crashes. If I try to ffwd or rev it will kill the stream.
I don't know how tivowebplus does it. But it works perfectly. I can move to any point of the stream and it will start from the selected location.
Thanks,
Scott

dburckh

03-05-2007, 10:59 AM

You should just install tyshow on your laptop. Then you just play the ty files directly and save a bunch of effort/time.

True with the following limitations:
1. TyShow does not work with with HD content, and I've had problems with normal content from my Tivo.
2. The .ty files will only play on computers with the TyShow filter. The .mpg files will play on any computer or media center.
3. You cannot burn a DVD with a .ty file.

You can extract and convert to .mpg at the same time with the UI. No time difference.

dburckh

03-05-2007, 11:32 AM

I like the new streaming feature in the web server. But I don't have the audio.

Might seen like a stupid question, but can you play .mpg files from WMP straight of the HDD?

FFWD and seek aren't enabled on my box. I'm running XP SP2 Home IE7, WMP 11, PureVideo DirectShow. I tried it on my other box running XP Pro SP2, IE6, WMP9, PureVideo DirectShow, same results.

I did notice that it wouldn't stream from another box to my local. It looked like WMP was trying to download the whole file.

lenoxb

03-05-2007, 07:26 PM

Dustin,

How much do you want to sweat over MPEG incompatibilities?

I extracted an MPEG of a TNT-HD show that seemed to have “seek” busted on WMP 11 on my XP machine, although it plays okay. On two different Vista machines, “seek” works on that MPEG file.

I extracted several HD MPEGs broadcast by our local CBS affiliate that, on one of our Vista machines, plays audio okay but with “all-black” video. (New Zealand rugby fans may find this amusing.) On my XP laptop, it plays okay. On my wife’s Vista laptop, it plays okay.

My wife thinks the “all-black” video represents a video driver problem. Perhaps it does, but other MPEGs from different HD channels can play without a problem. And she cautions me that XP didn’t ship with any OS-supplied MPEG in the box, so there can be a lot of variability in the MPEG playback experience there depending on what codec the OEM might have shipped (likely with some bundled DVD software).

As long as my wife’s laptop can play the files I extract, I’m getting what I need. But I’d be glad to do whatever I can to help you troubleshoot this if it’s important to you.

dburckh

03-05-2007, 08:22 PM

First, I'm impressed that your wife knows that XP doesn't come with MPEG decoders. :)

It's going to be pretty tough for me to remotely diagnose DirectShow problems. That being said, I'm willing to give it a shot.

Have you ever played with graphedit? It a tool for creating DirectShow Graphs. It allows you to see how Windows renders a particular file. To use it, just run it and select File->Render Media file. That will show you how Windows is playing it.

If you want to run it on the machine that works and the machine that doesn't, you can see the differences. The demuxing filter is usually the second one from the left. That usually splits the stream and directs it to the Video and Audio DirectShow filters. If you can tell me the demuxing filter and the video filter, I may be able to duplicate it.

h++p://www.digital-digest.com/software/download.php?sid=82&ssid=0&did=1

lenoxb

03-05-2007, 08:37 PM

I'll be glad to give graphedit a shot when I get home.

av8rdude

03-05-2007, 11:47 PM

Might seen like a stupid question, but can you play .mpg files from WMP straight of the HDD?

FFWD and seek aren't enabled on my box. I'm running XP SP2 Home IE7, WMP 11, PureVideo DirectShow. I tried it on my other box running XP Pro SP2, IE6, WMP9, PureVideo DirectShow, same results.

I did notice that it wouldn't stream from another box to my local. It looked like WMP was trying to download the whole file.

Sorry for the bad acronyms...I should have said that I use tivowebplus to stream .ty files on my network. I play them with wmp11. During playback I can drag the "progress cue" anywhere in the length of stream. And wmp11 will begin to stream from that location. This allows me to jump anywhere in the video and skip commercials or go to the very end of a 2 hour stream in the first few seconds.....

When I try to move the progress cue on the web server even a minute ahead while streaming it will crash and lockup.

Yes I do have an mpeg encoder installed and can play mpegs. But I choose to do everything in .ty format. I have tyshow installed and see no reason to bother converting anything to mpeg. I can travel with all the .ty files I need. I have no use for coasters and more dvds. I want everything on a hard drive or cyberspace :) But, of course, I have not made the HD leap yet...

Cheers,
Scott

dburckh

03-06-2007, 03:25 AM

...I should have said that I use tivowebplus to stream .ty files on my network. I play them with wmp11. During playback I can drag the "progress cue" anywhere in the length of stream. And wmp11 will begin to stream from that location. This allows me to jump anywhere in the video and skip commercials or go to the very end of a 2 hour stream in the first few seconds.....

That's actually pretty cool. I wonder how they are doing that. If it's an http stream, there is no skip (that I'm aware of). I'll have to snoop their stream and see what they are doing. Maybe I can emulate it.

I'm thinking this whole "view" thing might be a big can of worms. It seems to behave inconsistently. Maybe I'll disable by default and put a bunch of ***warnings*** around enabling it.

Sorry if I was a little grumpy on previous posts. You have every right/reason to use TyShow if it works for you. It's hard for me to get behind something that's dev. dead. Maybe I can bust out my long latent C skills and fix up TyShow for HD. yeah...maybe... :rolleyes:

lenoxb

03-06-2007, 04:47 AM

If you want to run it on the machine that works and the machine that doesn't, you can see the differences. The demuxing filter is usually the second one from the left. That usually splits the stream and directs it to the Video and Audio DirectShow filters. If you can tell me the demuxing filter and the video filter, I may be able to duplicate it.

h++p://www.digital-digest.com/software/download.php?sid=82&ssid=0&did=1

Hmm, for a problematic file, a working (XP laptop) and nonworking (Vista desktop) machine each say that the demuxing filter is "MPEG-2 Demultiplexer" and the video filter is "InterVideo Video Decoder." Could there be another difference that this tool isn't picking up?

(FWIW, I did compare a file that worked on both machines, and found that on the XP laptop, it was being demuxed by "Nero splitter," not "MPEG-2 Demultiplexer." On the Vista desktop, the demuxing filter is "MPEG-2 Demultiplexer" and the video is being shown--for that file.)

dburckh

03-06-2007, 10:53 AM

Hmm, for a problematic file, a working (XP laptop) and nonworking (Vista desktop) machine each say that the demuxing filter is "MPEG-2 Demultiplexer" and the video filter is "InterVideo Video Decoder." Could there be another difference that this tool isn't picking up?

You can verify that it's correct by clicking the play button in graphedit. It should behave the same as WMP. Interestingly enough, mine uses "MPEG-2 Splitter" which seems to point to the same .ax file.

MPEG-2 Demultiplexer

The MPEG-2 Demultiplexer ("demux") filter demultiplexes MPEG-2 transport and program streams that are delivered in push-mode. In Microsoft® Windows® XP, this filter also supports program streams in pull mode (file playback). On earlier platforms, use the MPEG-2 Splitter filter for program streams in pull mode. This filter can be used in any type of filter graph, including a BDA digital TV filter graph.

Note The MPEG-2 Demultiplexer does not support frame-accurate seeking.

I'm curious as to why it chose Splitter vs. Demuxer for similar files. Maybe it's the difference between InterVideo and NVIDIA. Anywho, it looks like MS changed the Demultiplexer for Vista or there is a bug in "InterVideo Video Decoder." on Vista. I don't have Vista yet. Further down in the MSDN page it mentions that TS requires PAT/PMT tables. The streams I create are PS, but maybe Vista requires PAT/PMT now. I have the code for that, but nothing was requiring it so I didn't have it turned on. I'll put something special out later today. I can also force the first PES to be video. That may fix it too.

dburckh

03-06-2007, 11:53 PM

Dustin,

I extracted several HD MPEGs broadcast by our local CBS affiliate that, on one of our Vista machines, plays audio okay but with “all-black” video. (New Zealand rugby fans may find this amusing.) On my XP laptop, it plays okay. On my wife’s Vista laptop, it plays okay.

Try this version and see if it cures the "all-black" video. It writes the PAT/PMT at the beginning of the stream.

I found that changing this setting in WMP makes the video stream over the network instead of trying to download the whole file. I still can't make seek work on my machine. :(
Options->Performance
-Network buffering
(o) Buffer [ 5 ] seconds of content.

lenoxb

03-07-2007, 03:54 AM

You can verify that it's correct by clicking the play button in graphedit. It should behave the same as WMP.

A file that was "all-black" in WMP on the Vista desktop machine had non-black video when I hit the play button in graphedit on that same machine.

There did seem to be some interlacing artifacts in the video that I don't think are present on my XP laptop, but it may be that the better monitor on the Vista desktop is letting me see more artifacts. I don't think that's true, but it's possible.

I mentioned before, but it might bear repeating: my wife's Vista laptop is having no trouble with these files. It's likely that it has different video hardware and drivers, but it is Vista.

lenoxb

03-07-2007, 03:58 AM

Try this version and see if it cures the "all-black" video. It writes the PAT/PMT at the beginning of the stream.

Sorry. There's no difference. It plays in graphedit, but is all black in WMP. And I did verify that the files from the different versions have different sizes.

C:\Documents and Settings\lenoxb\TS>dir \\bd1\disk1\delme*.mpg
Volume in drive \\bd1\disk1 is disk1
Volume Serial Number is 006E-0132

Directory of \\bd1\disk1

03/06/2007 11:31 PM 1,129,606,608 delme.mpg
03/06/2007 11:44 PM 1,129,606,640 delme-exp.mpg

(The input to the converter was a part00.ty file extracted from a ~5GB tmf.)

lgkahn

03-07-2007, 10:23 AM

new version working good.. couple of observatoins

mpg is not a streameable format so it doesnt stream in the web vresion ie you cannot fast forward say if you want to go were you left off and watch from there.. how about conversion to .wmv streameable format

as for other formats.. how about templates so you can setup a conversion for say .ipod or creative zen format

thanks

dburckh

03-07-2007, 10:36 AM

Sorry. There's no difference. It plays in graphedit, but is all black in WMP. And I did verify that the files from the different versions have different sizes.

That's is weird. Might be a bug in Vista, WMP or the video driver. Or maybe WMP is overriding the default Graph. Guess you'll have to wait for SP1. You can try ZoomPlayer too, it should use the default graph.

There did seem to be some interlacing artifacts in the video that I don't think are present on my XP laptop, but it may be that the better monitor on the Vista desktop is letting me see more artifacts. I don't think that's true, but it's possible.

I've seen this before. There are quality/extended settings for DirectShow filters. I'm guessing GraphEdit just uses the defaults.

dburckh

03-07-2007, 10:46 AM

mpg is not a streameable format so it doesnt stream in the web vresion ie you cannot fast forward say if you want to go were you left off and watch from there.. how about conversion to .wmv streameable format

I wouldn't say MPG is not streamable. Transport Streams (.ts) files are MPG file designed to be streamed and are what digital OTA broadcasts are. I think the bigger problem is WMP doesn't stream MPG files well, or at least not the ones I create. Further complicated by the fact that I'm just using an HTTP stream. I may need to go to a different protocol or enhance my support.

FYI. You can stream the .MPG in VLC. There are instruction in the readme.txt to do this. I'm also streaming with FFWD, RWD, PAUSE... to my Buffalo LinkTheater.

as for other formats.. how about templates so you can setup a conversion for say .ipod or creative zen format
thanks

Right now, I'm not converting. I'm just remuxing. The MPG video is coming right off the Tivo, I'm just re-wrapping it into a standard format. Conversion is a bigger can of worms. The same problems with seek would still apply.

lgkahn

03-07-2007, 01:56 PM

thanks don't have link player... curretnly using etivo and slingbox for streaming...

aha that is why yours is so fast compared to etivo.. no conversion thanks...

dburckh

03-07-2007, 05:02 PM

The other reason I'm faster is that I stream the data as it comes out. To make HD work, I think eVito requires the entire stream to be extracted first, run through tytompg, then run through mencoder. You might be able to transcode SD directly.

I may be able to wire in mencoder like eTivo does. It would take a decent box to recode SD in realtime and a massive box to recode HD in real time. I'm already going in too many directions, I might look at this next month.

lgkahn

03-07-2007, 08:56 PM

well I could test it .. I have an evga 680i watercooled running x6800 dual core oc to 3.5ghz with 2 gig of memory and 800g serial ata raid 5 but my other machine with scsi 7200 is still faster in disk dept... but the sucker is fast super pi 1m is sub 15 seconds

lenoxb

03-09-2007, 04:33 AM

I tried using RC3 without starting dserver.tcl first, to see if this version would reboot my Tivo. Bad news, it did.

I checked to see if dserver.tcl had changed versus the one I had on my Tivo, and it had not.

dburckh

03-09-2007, 10:16 AM

I tried using RC3 without starting dserver.tcl first, to see if this version would reboot my Tivo. Bad news, it did.

Drat. I'm not have a problem with either tivo. I would appreciate it if you would tolerate one more reboot so I could potentially fix it for yourself/others.

Please add this line to application.properties and try it again.

telnet.TelnetFilterInputStream.logLevel=TRACE
util.Logger.file=tivo.log

It will create a file called tivo.log. Please PM it to me or attach it to a post. It should be small.

Could you answer these questions:
1. What model of Tivo?
2. What version of Java?
3. What OS?
4. What kind of network, (e.g. 100MB ethernet or Wireless 54g)?

I checked to see if dserver.tcl had changed versus the one I had on my Tivo, and it had not.

Confirmed, dserver.tcl hasn't changed.

Thanks for your help.