PDA

View Full Version : TySuiteJ - GUI, Extraction, MPEG Conversion, and much much more


Pages : [1] 2 3 4

dburckh
03-11-2007, 11:23 PM
Version 2.6 - Support for Series 1 & 2

There are 5 major tools:


The Graphical User Interface (GUI) - Similar to TyTool, but with an improved GUI. One click transcoding of Ty files to almost any format, including iPod.
The Web Server - Stream/download/transcode/view* ty/mpg files from your favorite browser and smart phone.
The UPNP and MyIHome Server - A feature rich media servers for audio, video, and photos.
The CLI (Command Line Interface) - Extract and browse your Tivo from the command line.
Automatic Extraction - Extracts and/or transcodes Tivo titles based on rules you define.

The core of this tool is software that will extract, remux and transcode TY streams into mpg streams on the fly. It has a couple advantages over existing tools:

All tools allow you to extract from the Tivo and convert to .mpg on the fly*. No intermediate steps and TyShow is not required.
The converter handles HD properly. Nothing else out there can extract and mux HD properly on the fly.
The .mpg converter is extremely robust and will handle streams with severe drop out problems.
All tools will run on any platform that supports Java*. That's pretty much everything but your phone. Well, maybe some phones.
You can programaticly list NowShowing, extract Ty streams and .mpg files from a remote command line. Nice for the unix guys.

See the new /help/readme.htm for installation instructions and options.

Request List:
http://www.dealdatabase.com/forum/showpost.php?p=280070&postcount=80

Important Notes:

application.properties has been redone in 2.5+. You'll need to update yours. See /help/readme.html for more info.
*Transcoding (conversion to non-ty/mpg formats) requires ffmpeg. It is not platform independent, but has builds for most platforms. See /help/readme.html for more info.

lenoxb
03-12-2007, 11:52 PM
I'll try to work on the all-black problem when I get home tonight.

In the Dept of Tivo Rebooting, I'm sorry to say I rebooted the Tivo last night when I tried to connect UI to it without dserver.tcl running. It read 22 of about 60 shows and then rebooted. I could not repro the rebooting. I was tuned in to HBO HD at the time it rebooted, so it may be that there was not enough CPU available, but I could not repro the rebooting with logging turned on.

I have never had a reboot when dserver.tcl is already running, even with the "experimental" S2 binaries. Unless you think it is a really bad idea, I will probably launch dserver.tcl from rc.sysinit.author. I wonder if it makes sense for your code to even try to do it remotely, since it seems to be so risky (for me, anyway).

dburckh
03-13-2007, 01:59 AM
I'm still confused as to why you are having these problems. We have very similar setups and I don't have it happen.

Running dserver.tcl from rc.sysinit.author is probably the best solution across the board. I have support for tserver too, if you want to try it. It's single threaded, so you can't do things like "refresh" when a transfer is happening. Jamie gave me some instructions on getting around that, but it's a little complex.

lenoxb
03-13-2007, 03:57 AM
Well, if I had been using the same mfs_uberexport and NowShowing as you, it's possible I never would have seen a problem either. That's a potentially important difference in our setups.

And like I say, after the first reboot last night, I couldn't get the problem to recur after I turned on logging. The fact that I had HD programming on one live TV tuner (and who knows what on the other) may be the X factor. I did not try putting an HD program on the second tuner after the reboot when I was trying to repro the reboot.

I think I'd rather start dserver in .author than fiddle with tserver. The last thing I want to do is start making my setup less like yours. And when I've had dserver running ahead of time, the program has been very stable--certainly better behaved for me than mfs_ftp--even with the experimental binaries.

My logic is that if it's happening to me, it will happen to somebody else at some point, so it's worth posting.

drewcurtis
03-15-2007, 01:50 AM
Iv'ed tried changing the dos extensions to get the stream to open in VLC from web server. Installing the latest verison didn't help any either. Is there anyway to include a path to the perfered ap. in the application.properties to open the stream?
Thanks Drew

psunami
03-15-2007, 12:54 PM
Thanks for the great tool. I've used it on some of my newer files without any issue.

I'm running into a few issues using Tytool with some very large HD files. These files were on my drive before it was hacked, so I had to do the S2_unscramble process to be able to pull them off. Unfortunately, Tytool cannot get them because of their large size.

If I was to modify the TySuite to use the tserver_mfs file that I have on my system, do you think it would be able to grab these files?

They're all between 25 and 28 GB.

Thanks for your help.

dburckh
03-15-2007, 04:00 PM
Iv'ed tried changing the dos extensions to get the stream to open in VLC from web server. Installing the latest verison didn't help any either. Is there anyway to include a path to the perfered ap. in the application.properties to open the stream?
Thanks Drew

I haven't had much luck with this either. There are experimental VLC plugs out there you can try. I did some reading and it looks like IE opens them based on MIME type. You may be able to tweak that, but it's pretty complex. The mime type is video/mpeg. The view button in 2.1 ***might*** work for you, but that's WMP.

dburckh
03-15-2007, 04:11 PM
Thanks for the great tool. I've used it on some of my newer files without any issue.

I'm running into a few issues using Tytool with some very large HD files. These files were on my drive before it was hacked, so I had to do the S2_unscramble process to be able to pull them off. Unfortunately, Tytool cannot get them because of their large size.

If I was to modify the TySuite to use the tserver_mfs file that I have on my system, do you think it would be able to grab these files?

They're all between 25 and 28 GB.

Thanks for your help.

I'm not familar with tserver_mfs. It could be that tserver_mfs doesn't properly handle the files too. I do have support for tserver in TySuiteJ. It is beta!!!!

Try this:

1. Start tserver_mfs on the Tivo.

2. Change this setting:
TyStreamHelperFactory.className=io.DServerTyStreamHelper
to:
TyStreamHelperFactory.className=io.TServerTyStreamHelper

3. Run the UI.

If tserver and tserver_mfs use the same port, you should get NowShowing.

Probably want to extract as .ty files first, then convert in case something goes wrong. My guess is that if TyTool doesn't work, the problem is in tserver_mfs. Best of luck.

Jamie
03-15-2007, 04:24 PM
My guess is that if TyTool doesn't work, the problem is in tserver_mfs. Best of luck.I don't think so. I think tytool has a limitation on the number of "parts" in a recording on the PC side.

psunami
03-15-2007, 05:21 PM
Thanks so much for the suggestions.

It doesn't seem to be able to launch NowShowing. It just says Refreshing but never actually gets the data in the Gui. I figured I'd give it a try using your tool as it works so well with my normal recordings since I hacked the system.

Here's what I see when I run tserver_mfs

Waiting for an incoming connection!
SERVER: We got a message! buf = ''
Bogus command... ''
Waiting for an incoming connection!
SERVER: We got a message! buf = 'SHOWING'
Waiting for an incoming connection!

dburckh
03-15-2007, 10:43 PM
Worked better than I thought it would. :) It appears it doesn't understand the NowShowing output.

Do all the previous steps with this release (overlay your existing) and this setting in application.properties.

io.TServerTyStreamHelper.logLevel=DEBUG

I'm trying to get a sample of the NowShowing format.

dburckh
03-15-2007, 10:58 PM
I don't think so. I think tytool has a limitation on the number of "parts" in a recording on the PC side.

Jamie,

Does tserver_mfs it support the normal "TYSTREAM" command? Does this version decrypt? Is it just an old version of tserver?

Thanks.

Jamie
03-16-2007, 12:33 AM
Jamie,

Does tserver_mfs it support the normal "TYSTREAM" command? Does this version decrypt? Is it just an old version of tserver?

Thanks.As far as I know, it's just an old version of tserver hacked to work with the S2 unscramble kernel. I think the protocol is the same, though it probably doesn't have the ability to run under inetd.

psunami
03-16-2007, 12:46 AM
Here's the output of the log.

It looks like it is getting the NowShowing info.

You'll also see that I've got an affinity for hockey... and Little Einsteins.

twosox
03-16-2007, 01:07 AM
Strange things. I can't get my linux box to launch this program -- I get an error:
FAILED: Unknown Host???

Then, I copied the same exact files over to my WinXP box, and voila, it worked.

Any ideas?

dburckh
03-16-2007, 02:35 AM
Strange things. I can't get my linux box to launch this program -- I get an error:
FAILED: Unknown Host???

Then, I copied the same exact files over to my WinXP box, and voila, it worked.

Any ideas?

Did a little research. This is a Java "feature" with linux and DHCP. The attached version should fix it. I only use this code for setupTest, so the apps. should work. Either way, this should fix it. Overlay your existing install.

dburckh
03-16-2007, 02:38 AM
Here's the output of the log.

It looks like it is getting the NowShowing info.

You'll also see that I've got an affinity for hockey... and Little Einsteins.

I'm morally against helping a Badger fan, but try 22_a2 (above). :) I think I have the NowShowing bug fixed. I've had a problem with older versions of NowShowing. This may fix those as well. If Jamie is correct about tserver_mfs, it should just work.

dyeargan
03-16-2007, 08:32 AM
dburckh:

I have been following this and previous threads for over a month and have really enjoyed your package, however, in streaming to wmp, I have no audio. I haven't seen anyone else with this problem. Any thoughts?

twosox
03-16-2007, 10:15 AM
Did a little research. This is a Java "feature" with linux and DHCP. The attached version should fix it. I only use this code for setupTest, so the apps. should work. Either way, this should fix it. Overlay your existing install.

Works like a champ.

Thanks -- this is an excellent application!

dburckh
03-16-2007, 10:46 AM
dburckh:

I have been following this and previous threads for over a month and have really enjoyed your package, however, in streaming to wmp, I have no audio. I haven't seen anyone else with this problem. Any thoughts?

First thought is I should have never tried this. :) WMP is really picky. I'm play with upnp, and it won't even stream HD content to itself.

You can try to installing TivoDesktop. You don't actually use the software and you don't have to start it. TivoDesktop installs a different set of MPEG splitters and decoders that become globally available. Other than that, I don't really have any great ideas.

psunami
03-16-2007, 12:28 PM
I'm morally against helping a Badger fan, but try 22_a2 (above). :) I think I have the NowShowing bug fixed. I've had a problem with older versions of NowShowing. This may fix those as well. If Jamie is correct about tserver_mfs, it should just work.

I knew showing that I had those Badger games on there might hurt development.

I didn't have any luck with a2. It still seems to have the same issue as the last one did.

One thing that I didn't mention was that this does need to use NowShowing.tcl instead of NowShowing.

Not sure how much of a difference that would make.

dburckh
03-16-2007, 01:26 PM
We might be doing this the hard way. If this is a MIPS binary or a .tcl file, just attach it to the post, or show me where you got it. I can run it locally. Because this is HD, I'm assuming it's MIPS.

snoots
03-16-2007, 01:31 PM
I ran into a small problem, I downloaded an episode of Good Eats from one of my HD-Tivos. The resulting MPG plays fine but is missing the end of the show. If I download it as a ty file it goes all the way to the end. If I try to convert it after download the resulting mpg is missing the end again. I also downloaded the file as a ty file using tytool and then tried the convert feature and still the mpg is short. Below is the file sizes, you can see the 2 mpgs have the same shorter length than the 2 ty file attempts. Any suggestions? Thanks !

03/15/2007 06:06 PM 506,391,604 Good Eats - Corn the Beef.mpg
03/15/2007 06:03 PM 509,607,936 Good Eats - Corn the Beef.ty
03/15/2007 06:09 PM 506,391,604 Good Eats-Corn the Beef.mpg
03/15/2007 05:59 PM 509,607,936 Good Eats-Corn the Beef.ty
6 File(s) 4,823,771,339 bytes
2 Dir(s) 338,698,194,944 bytes free

C:\TyFiles>

psunami
03-16-2007, 03:03 PM
It's the one from this post (http://www.dealdatabase.com/forum/showpost.php?p=195327&postcount=1).

It is in mfs-utils_src-20050604.tar.bz2

dburckh
03-16-2007, 04:29 PM
I ran into a small problem, I downloaded an episode of Good Eats from one of my HD-Tivos. The resulting MPG plays fine but is missing the end of the show. If I download it as a ty file it goes all the way to the end. If I try to convert it after download the resulting mpg is missing the end again. I also downloaded the file as a ty file using tytool and then tried the convert feature and still the mpg is short. Below is the file sizes, you can see the 2 mpgs have the same shorter length than the 2 ty file attempts. Any suggestions? Thanks !

03/15/2007 06:06 PM 506,391,604 Good Eats - Corn the Beef.mpg
03/15/2007 06:03 PM 509,607,936 Good Eats - Corn the Beef.ty
03/15/2007 06:09 PM 506,391,604 Good Eats-Corn the Beef.mpg
03/15/2007 05:59 PM 509,607,936 Good Eats-Corn the Beef.ty
6 File(s) 4,823,771,339 bytes
2 Dir(s) 338,698,194,944 bytes free

C:\TyFiles>

The .ty stream should be the same with tytool and TySuiteJ. It's a conversion problem. Try bumping this setting up. Start with 4000, goto 5000, 6000 etc.

TyRecordServer.badTyTimestampThreshold=3000

dburckh
03-16-2007, 04:34 PM
It's the one from this post (http://www.dealdatabase.com/forum/showpost.php?p=195327&postcount=1).

It is in mfs-utils_src-20050604.tar.bz2

I didn't see tserver_mfs in this post. I can try the NowShowing.tcl if that's what you meant.

psunami
03-16-2007, 05:11 PM
Oh, my bad. I thought you were asking how to get to the NowShowing.tcl

Here's (http://www.dealdatabase.com/forum/showpost.php?p=193135&postcount=1) where I got the tserver_mfs. In the s2_unscramble.tar.bz2 file.

Gunnyman
03-16-2007, 05:25 PM
just wanted to say thanks for this project.
It seems tivotool development has stopped. With this and mpegstreamclip I'm able to author dvd's again nicely on my mac.
Is there MPEG4 conversion in there yet? can I add it?

dburckh
03-16-2007, 05:56 PM
just wanted to say thanks for this project.
It seems tivotool development has stopped. With this and mpegstreamclip I'm able to author dvd's again nicely on my mac.
Is there MPEG4 conversion in there yet? can I add it?

I played around with MPEG 4 ASP conversion and mencoder. I don't think it's fast enough to be streamable in real-time even at SD resolutions, but it's pretty easy to implement as a post extraction filter. I may even be able to do it as part of the extraction.

What tool did you plan to use for conversion? I usually use autoGK, it's the fastest and seems to work the best (I believe it's Windows only).

There's some related info on this thread.

http://www.dealdatabase.com/forum/showthread.php?t=53756

Gunnyman
03-16-2007, 06:03 PM
currently I am using ffpgex to convert from ty to ipod mpeg4.

I hate that there isn't an easy solution for us mac folks. Doing the project in Java is an awesome idea.

dburckh
03-16-2007, 06:44 PM
currently I am using ffpgex to convert from ty to ipod mpeg4.

I hate that there isn't an easy solution for us mac folks. Doing the project in Java is an awesome idea.

Did you mean ffmpegx? It looks like it's just a mencoder front end (and maybe other tools???). It also appears there is a mencoder version for OS X. It would be pretty easy to integrate mencoder. Like I said, I don't think real time streaming from that is an option, but a post filter is definitely doable. I'm already doing it for tytompg.

snoots
03-16-2007, 08:13 PM
TyRecordServer.badTyTimestampThreshold=6000

Tried 4,5,6000 no change

dburckh
03-17-2007, 12:09 PM
I knew showing that I had those Badger games on there might hurt development.

I didn't have any luck with a2. It still seems to have the same issue as the last one did.

One thing that I didn't mention was that this does need to use NowShowing.tcl instead of NowShowing.

Not sure how much of a difference that would make.

Ok, NowShowing works in this release. Overlay as before.

I tried to extract a file, but got a lot of errors. Might be because it was unencrypted.

psunami
03-17-2007, 03:59 PM
Ok. I now see NowShowing, but I do get an error when I try to retrieve a file.

13:49:51.468 Received NowShowing
13:49:51.468 Got 26 titles, 143292 MB from 192.168.0.100
13:49:51.468 Refresh Complete
13:50:00.265 Queued C:\TIVO\College Hockey - NCAA Tournament, Final_ Boston College vs. Wisconsin.mpg
13:50:00.281 Requesting ty stream: 694620
13:50:00.296 Started C:\TIVO\College Hockey - NCAA Tournament, Final_ Boston College vs. Wisconsin.mpg
13:50:01.265 Completed C:\TIVO\College Hockey - NCAA Tournament, Final_ Boston College vs. Wisconsin.mpg

Here's what happens in tserver.

Again, thanks for all of the help.

dburckh
03-17-2007, 06:19 PM
Ok. I now see NowShowing, but I do get an error when I try to retrieve a file.

13:49:51.468 Received NowShowing
13:49:51.468 Got 26 titles, 143292 MB from 192.168.0.100
13:49:51.468 Refresh Complete
13:50:00.265 Queued C:\TIVO\College Hockey - NCAA Tournament, Final_ Boston College vs. Wisconsin.mpg
13:50:00.281 Requesting ty stream: 694620
13:50:00.296 Started C:\TIVO\College Hockey - NCAA Tournament, Final_ Boston College vs. Wisconsin.mpg
13:50:01.265 Completed C:\TIVO\College Hockey - NCAA Tournament, Final_ Boston College vs. Wisconsin.mpg

Here's what happens in tserver.

Again, thanks for all of the help.

From this output, it looks like there's an internal problem with tserver_mfs. Not much I can do about that. The tserver protocol is pretty straight forward. I tested with a normal tserver and the tool is working.

My guess is that you need to install the hacked 3.1.5x kernel in post you found and reboot the Tivo. This is not informed advice, it's just what makes sense to me. Before doing this, I suggest you read the thread thoroughly. Someone else may have had this problem.

Good luck!

psunami
03-17-2007, 06:30 PM
I know that I have the hacked kernel, and a working version of tserver_mfs, on there already as TyTool can grab some files on there but it just can't grab really large HD files.

Thanks again for all of the effort that you put in, but I understand if you want to cut your losses on this one as there won't be many people trying to do what I'm doing.

Thanks again.

dburckh
03-17-2007, 07:08 PM
I know that I have the hacked kernel, and a working version of tserver_mfs, on there already as TyTool can grab some files on there but it just can't grab really large HD files.

Thanks again for all of the effort that you put in, but I understand if you want to cut your losses on this one as there won't be many people trying to do what I'm doing.

Thanks again.

I'm sorry you feel like I'm cutting my losses, but there is really nothing more I can do. There is an error occurring inside tserver_mfs. Nothing I can do about that.

Couple things to consider/try:

From the post, it looks like you use the other mfs_* utitlities in the post with mfs_ftp and accomplish the same thing. That would probably be the easiest.

Try extracting the individual parts with TyTool. You can merge them with copy (see below). Make sure you get the order right. :)

copy part1.ty+part2.ty+part3.ty+... whole.ty

Make sure you started tserver_mfs and not tserver.

Omikron
03-17-2007, 07:11 PM
Although it may not matter, make sure you use "copy -b" instead of just "copy" to specify a binary file.

dburckh
03-17-2007, 07:13 PM
Although it may not matter, make sure you use "copy -b" instead of just "copy" to specify a binary file.

You are correct. Thanks, and I believe you mean

copy /B

dburckh
03-17-2007, 07:16 PM
I had another thought. It looks like tserver_mfs offloads the processing to external tools. You might want to make sure you are running the versions of mfs_* from the post unscramble post. Especially mfs_export and mfs_stream. You may have overwrote them with newer versions, which could be causing the problem. I didn't see any sourcecode for tserver_mfs, so this is all a guess.

drez
03-17-2007, 07:21 PM
The source code for tserver_mfs is inside tus2.tar.gz, which is inside s2_unscramble.tar.bz2.

dburckh
03-17-2007, 08:19 PM
The source code for tserver_mfs is inside tus2.tar.gz, which is inside s2_unscramble.tar.bz2.

I found the code, but I can't figure out where the ret = -1 is coming from. It definitely isn't using mfs_export, so you can ignore that comment.

I think I'm back to my previous statement about mfs_ftp. The other difference between my code and TyTool is that I use a single socket. The code looks the same for both, but that's the only difference I can think of.

It looks like there is an mfs_rewrite that will remove the encryption. Once that is done, it's business as usual. That's probably your best alternative.

psunami
03-17-2007, 09:53 PM
I'll give mfs_ftp a look... it looks like I'll be spending a bit of time learning that one.

psunami
03-17-2007, 10:40 PM
Well, I have no idea what in the hell is going on now. I can't even get TyTool to pull off any files at this point.

Great fun.

dburckh
03-17-2007, 10:43 PM
I kind of expected this. It seemed very odd to me that TyTool was working and mine wasn't. Did you loose the unscramble kernel with the 6.3c upgrade?

psunami
03-17-2007, 10:51 PM
Never got around to doing the 6.3c upgrade. I'm still working on getting those three HD files off of this. I don't want to do anything until I can get them off.

I re-copied over all of the s2 files and still am not having any luck. I can use TySuite to pull off all of my unencrypted stuff, without any issues.

I'm hung up on patching MFS_FTP at this moment... so I'm back to working at this again.

Edit: Ok. I have TyTool working again, but using the tserver, not tserver_mfs.

But now I can't get TySuite to use tserver. Fun, fun, fun....

dburckh
03-17-2007, 11:42 PM
Never got around to doing the 6.3c upgrade. I'm still working on getting those three HD files off of this. I don't want to do anything until I can get them off.

I re-copied over all of the s2 files and still am not having any luck. I can use TySuite to pull off all of my unencrypted stuff, without any issues.

I'm hung up on patching MFS_FTP at this moment... so I'm back to working at this again.

Edit: Ok. I have TyTool working again, but using the tserver, not tserver_mfs.

But now I can't get TySuite to use tserver. Fun, fun, fun....

The tserver code is beta. I was testing it out when I wasn't getting the performance I wanted out of dserver.tcl. I abandoned it when I updated dserver.tcl with some code from mfs_ftp

psunami
03-17-2007, 11:52 PM
Good news everyone! (Dr. Farnsworth)

I found a different Nowshowing.tcl and tserver and it doesn't get the error in TySuite anymore... but what it does do when I click on MPG is say this....

21:37:25.187 Queued C:\TIVO\College Hockey - NCAA Tournament, Final_ Boston College vs. Wisconsin.mpg

then nothing

I must just have some setting wrong now.

Thanks again for all of your help.

TerpEE93
03-18-2007, 03:54 PM
Curious, I saw Gunnyman is running on a Mac, but it won't work for me...

I've got an HR10-250, hacked, running 3.1.5f...
I've got a MacBook, Intel, running OSX 10.4.9...

TySuite seems to pull the files down fine, as I get as reasonably sized .mgp as a result (~490MB for a 30min SD). But whenever I try to play in Quicktime or Windoze Media Player, I get file format errors. Am I making a brain dead mistake? Did I miss something in the thread? Ugh...

Gunnyman
03-18-2007, 05:16 PM
I haven't done anything special. I followed the directions to the letter. I do recall seeing something about mencoder not playing nicely with Intel Macs though. I wonder if that's causing your problem?

dburckh
03-18-2007, 05:17 PM
Curious, I saw Gunnyman is running on a Mac, but it won't work for me...

I've got an HR10-250, hacked, running 3.1.5f...
I've got a MacBook, Intel, running OSX 10.4.9...

TySuite seems to pull the files down fine, as I get as reasonably sized .mgp as a result (~490MB for a 30min SD). But whenever I try to play in Quicktime or Windoze Media Player, I get file format errors. Am I making a brain dead mistake? Did I miss something in the thread? Ugh...

I know on Windows XP you need a MPEG DirectShow filter. I know Quicktime doesn't work without one as well. If you install TivoDesktop on the Windows side it may work in WMP (TivoDesktop installs an MPG DirectShow filter).

VLC and mplayer should work out of the box. They have their own internal renderers.

TerpEE93
03-18-2007, 07:51 PM
I know on Windows XP you need a MPEG DirectShow filter. I know Quicktime doesn't work without one as well. If you install TivoDesktop on the Windows side it may work in WMP (TivoDesktop installs an MPG DirectShow filter).

VLC and mplayer should work out of the box. They have their own internal renderers.
Check, mplayer works great. Downloaded the 3ivx DirectShow filter for Mac OSX, installed, rebooted, but no luck with Quicktime. PC worked fine with WMP and a viewer that came with my video card.

Guess I'll stick with mplayer for now. Thanks!

dburckh
03-18-2007, 08:07 PM
Check, mplayer works great. Downloaded the 3ivx DirectShow filter for Mac OSX, installed, rebooted, but no luck with Quicktime. PC worked fine with WMP and a viewer that came with my video card.

Guess I'll stick with mplayer for now. Thanks!

3ivx is MPEG-4, you need MPEG-2. Most DVD players install this.

dburckh
03-27-2007, 11:48 AM
I added limited UPNP support for UPNP Media Players. I know these work:

Buffalo Linktheater
XBOX classic - XBMC v2.x

These support UPNP, but either don't work or are unknown (please advise):

Windows Vista - Discovers media server, but doesn't work. I believe it requires AVTransport.
XBOX 360-??? - If someone donates one, I'll be glad to add support. :D
DLink 320/520 - Should work.
LinkPlayer2 - 99% sure it will work

In this version, FFWD and RWD don't work on UPNP (FFWD works on XMBC). I need to implement AVTransport.

I parallelized NowShowing retrieval across the board, so this should be faster for all tools that hit multiple Tivos.

The media center supports videos from the file system as well. I'll add audio and pictures soon. Look out Twonky. :)

Setup:

The applications.properties entries parallel MyIHomeWebServer. There is an example configuration at the top of the file.

Then just run upnp.cmd. Wait for the "open for t-business" and your UPNP devices should see it automatically.

dburckh
03-29-2007, 01:06 AM
Update on Vista: I thought it wasn't possible, but I got WMP to see the UPNP Media Server and request the content!

Anybody tried a 360? I think they are limited to WMV files, but I don't have one.

snoots
03-29-2007, 07:36 PM
Great work much appreciated !

SteveT
04-03-2007, 09:55 PM
Thanks for this excellent new tool. I've been using it to download the Planet Earth series in HD and it is working great.

If you get bored and want to add even more features, you might consider adding a wild-card scheduler, similar to eTivo. Basically a way to auto-download and process shows when they become available.

Anybody tried a 360? I think they are limited to WMV files, but I don't have one.I have a 360, but I haven't determined how to make it connect to multiple PCs (my Media Center PC is already sharing), so it isn't looking for your upnp server. Maybe I'll just try another PC (and turn off my MPC) and see what happens.

dburckh
04-03-2007, 10:22 PM
I have some updates for Vista. I'm close to being able to server up static content. It also appears to work with PowerDVD. Nero has problems, but that should be easy to fix.

Unfortunately, I'm getting my butt kicked by my real job at the moment. In addition, I just picked up an HD DVD drive. (Sweeeeeeeet)

I've thought about the scheduler idea, and it may be the next thing I work on. I didn't think there would be much interest due to eTivo. Further, I want to integrate it with encoding (ffmpeg/mencoder) software so I can pull things down and recode them.

kmt
04-05-2007, 11:38 AM
Is there any way to pass in the location of the application.properties file on the command line (or environment variable) for the ui?

twosox
04-05-2007, 06:36 PM
I am loving this program -- works great! I was curious to know if there was some way to re-encode the mpegs from the web interface so as to make them streamable over a 3G connection (to my blackjack windows mobile phone). I think it might require some re-encoding and certainly reducing the bitrate on the video file.

dburckh
04-05-2007, 09:03 PM
Is there any way to pass in the location of the application.properties file on the command line (or environment variable) for the ui?

Sorry, no there is not. I know this is annoying. Eventually I want to get rid of the file.

dburckh
04-05-2007, 09:10 PM
I am loving this program -- works great! I was curious to know if there was some way to re-encode the mpegs from the web interface so as to make them streamable over a 3G connection (to my blackjack windows mobile phone). I think it might require some re-encoding and certainly reducing the bitrate on the video file.

It's on the list. I have a treo, and I want to do the same thing. Even MPEG SD is going to be pretty massive from a cell phone standpoint.

It depends on if mencoder (or whatever) can take in a stream. If so it should be possible to do it in real time with a big enough machine at low enough bit rates. Ultimately, it would be possible to recode everything and re-serve them, but I don't know if real-time is possible.

There a lot of good ideas float around and I'm interested in all of them. Unfortunately, I'm swamped with my real job, so it's going to be a month before I can get to any of this.

dageekkid
04-08-2007, 05:03 PM
can someone help me out? running J 21.. I have a series2 DirecTivo... when I run the mpeg the total d/l file size is 1k, what gives?

little more details... ran the test and it passes with flying colors.. download runs completely but the mpg size for any show is always 1k in size...

Here's a bit more... d/l'ed the ty file and ran the tytool10r4 on it and got this...

Ready...
Generating KeyFrame File: d:\DTivo\file.ty
Sorry... Failed to get the first 10 initial chunks...
Have to have at least that many to start the analysis phase...


DiffTime = 0.000000 (0) == 0.000000 Minutes

total = 1310720 (1 MB)



Done

what am I missing?

The Only Druid
04-08-2007, 05:29 PM
can someone help me out? running J 21.. I have a series2 DirecTivo... when I run the mpeg the total d/l file size is 1k, what gives?

little more details... ran the test and it passes with flying colors.. download runs completely but the mpg size for any show is always 1k in size...

Here's a bit more... d/l'ed the ty file and ran the tytool10r4 on it and got this...

Ready...
Generating KeyFrame File: d:\DTivo\file.ty
Sorry... Failed to get the first 10 initial chunks...
Have to have at least that many to start the analysis phase...


DiffTime = 0.000000 (0) == 0.000000 Minutes

total = 1310720 (1 MB)



Done

what am I missing?
Your recordings are still encrypted. You need to disable encryption through the methods discussed on the board (e.g. the appropriate superpatch). You'll also want to look at the techniques on unscrambling your existing, encrypted recordings.

dageekkid
04-08-2007, 05:36 PM
I have used the zipper tools with the PTVupgrade a fresh install on the DirecTivo, I also used the method on the forum here to disable the encrypting... I have NOT found a way to unscramble however... :(

Zipper and PTVupgrade with enhanced hacks all say encryption is off.. how can I tell...?

justDave
04-09-2007, 11:22 AM
Since someone asked on a previous thread, I just wanted to say that the MyIHome module works great on my Showcenter.

Is there a way to view live tv?

dburckh
04-09-2007, 04:07 PM
Is there a way to view live tv?

It's unlikely with this version. You probably hit the end of the show and stop extracting before the show ends recording.

This is at the end of my long and growing list of things to do.

Allistah
04-10-2007, 01:36 AM
Hi there,

I tried to use your TySuiteJ but I get this problem when I run the testSetup.cmd:

D:\Desktop\TySuiteJ>testSetup.cmd
java version "1.5.0_11"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_11-b03)
Java HotSpot(TM) Client VM (build 1.5.0_11-b03, mixed mode)
Testing connection from: 192.168.1.103

Testing UI Connections
----------------------
Checking Host: 192.168.1.122
Checking: NowShowing
Passed: NowShowing
Checking: mfs_uberexport
Passed: mfs_uberexport
Checking: dserver.tcl
Starting dserver.tcl
getting NowShowing
getting Ty Stream
shutting down dserver.tcl
Passed: dserver.tcl
Exception in thread "main" java.lang.NullPointerException
at java.io.File.<init>(Unknown Source)
at util.SetupTest.test(SetupTest.java:61)
at util.SetupTest.main(SetupTest.java:42)

D:\Desktop\TySuiteJ>

Any ideas what I could be doing wrong?

Thanks for the help,

-Allistah

The Only Druid
04-10-2007, 09:43 AM
I have used the zipper tools with the PTVupgrade a fresh install on the DirecTivo, I also used the method on the forum here to disable the encrypting... I have NOT found a way to unscramble however... :(

Zipper and PTVupgrade with enhanced hacks all say encryption is off.. how can I tell...?

Search for ciphercheck.

Allistah
04-10-2007, 10:18 AM
Does this just check to see if you have the encryption still on? I have it off because I'm able to download the shows and watch them on my pc with the TyShow codec. I wasn't able to do this before when it was encrypted.

Btw, my unit is a DSR704 DirecTivo.

Allistah
04-12-2007, 11:19 PM
Anyone have any info on the error I showed up above?

dburckh
04-14-2007, 11:37 AM
Anyone have any info on the error I showed up above?

You didn't specify a download directory. You need something like this in application.properties:

ui.downloads=C:\\Tivo

I'll fix it so it gives a better error. You really only need this if you are using the UI.

Allistah
04-14-2007, 02:47 PM
Hi dburckh,

That fixed the issue. Thanks. First I wanted to thank you for the work that you've done on this. This is going to enable me to easily take my shows on my laptop so I can watch them on the train. 8-) Great job!

Now that I have gone through the process I wanted to let you know what worked for me and what didn't work and what suggestions I have. I'm sorry this is long but I have tested software for the past 15 years so this is kind of a second nature for me to give feedback like this. I have some suggestions on your docs as well that would have helped make the process easier for me to get going. If any of this doesn't make sense, please feel free to ask me so that I can clarify myself.

What worked:
I was able to run the UI and download multiple shows from the UI. I was able to download both .mpg files and .ty files. The Save As worked as well after I learned how it worked. The generic webserver worked and clicking the .ty file downloaded the file and then loaded it up in WMP.

1) When you're telling people to copy over the files in the docs, maybe make it a couple step process and tell them where the files come from. I copied over the two files from the mfs-utils but then couldn't find the dserver.tcl because I was still looking in the mfs-utils dir. Something as simple as "From the mfs-utils archive, copy over the xxx and yyy files to a directory on the Tivo" and then the next one would say something like "From the TySuiteJ archive, copy over the dserver.tcl file to the same directory as in the previous step, etc."

2) I'd recommend putting all these files in a unique directory to keep things clean and separate. It will make upgrading to newer versions easier for people like me who can't remember which files below to which hack. I made a new dir called /var/hack/tysuitej and added it to my path.

3) Have them add this dir in suggestion #2 to the path in rc.sysinit.author.

4) Be more clear on which sections are for what in the application.properties file and also say which are optional. I also wasn't sure which IPs should be pointed at the Tivo and which should be pointed at my local machine. Also maybe add a couple lines of notes on each section to let the user know how it works. For example, I didn't realize that the web server ran on my local machine. I was expecting it to run on the Tivo itself so this confused me a bit.

5) When using the Save As button in the UI, you should prevent people from typing in filenames or selecting individual files. It looks like thats what it is looking for so I typed in test.mpg. Below you can see the cause of the problem:
09:22:12.140 Queued E:\My Shows\test.mpg\How It's Made.mpg
09:22:12.140 Failed E:\My Shows\test.mpg\How It's Made.mpg
Once I went up a level and selected the "My Shows" directory and then clicked Save, it then started to work and put this in the log window:
09:23:28.984 Queued E:\My Shows\How It's Made.mpg
09:23:28.984 Started E:\My Shows\How It's Made.mpg
6) Clicking the Refresh button on the UI doesn't actually refresh the shows. Newly recorded shows won't show up until you quit/restart the UI app.

7) Maybe add another button to the UI that says "Set default save location" and have it remember it for next time.

8) It would be good to have a delete button on the UI so that I could delete all of the currently selected shows. You should also have a confirmation window to confirm the delete in case the button was clicked on accident.

9) When I use the web interface clicking the "View" link on shows results in this error below. Any idea what is wrong here?

04/14/2007 10:26:19.843 INFO [web.generic.GenericWebServer] Tivo Server open for t-Business on http://localhost:8280/
04/14/2007 10:26:27.921 INFO [common.ContentHelper] Refreshing from 192.168.1.122
04/14/2007 10:26:32.171 INFO [common.ContentHelper] Got 5 titles, 208 MB from 192.168.1.122
04/14/2007 10:26:38.656 INFO [web.generic.StreamMinimalServlet] java.net.Socket
Exception: Connection reset by peer: socket write errorServerConnection
java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at web.MinimalServletRequest.readLine(MinimalServletRequest.java:43)
at web.MinimalServletRequest.parse(MinimalServletRequest.java:55)
at web.ServerConnection.run(ServerConnection.java:19)
at common.ThreadPool$WorkerThread.run(ThreadPool.java:24)

10) Maybe have a .mpg link as well as the .ty link on the web interface.

11) Maybe add some transfer speed information when it is downloading files from the server so we can see how fast things are moving along.

12) Is there any way to get this web server on the Tivo itself? :-)

That is all for now.. :-) I'll start to use it now and see what else I can see. So far I like this one a lot better than the competition because it converts the files to .mpg files on the fly which is excellent for me. :-)

-Allistah

dburckh
04-14-2007, 04:09 PM
Wow, this is a lot. I'll do my best. I'm not going to repeat the questions, so you'll have follow along

1) Good point, dserver.tcl location isn't there.

2&3) I think this is a matter of opinion. The mfs_* files are common utils. I use the path for these and they are shared by other programs such as mfs_ftp. I see your point with dserver.tcl

4) If you look at the readme.html, there are two sections. Although the first doesn't say required, the second says optional. I can make the first say required.

5) I had a hard time with the "Save As..." from a UI metaphor standpoint. It's meant to be an advanced feature to avoid having a ton of buttons.

6) This is a bug. It should refresh. Some of the code has a 5 minute delay.

7) At some point there will be a UI configuration util. This will be a part of it.

8) Delete requires an update to dserver.tcl. As that is on the Tivo side, I avoid updating it for support reasons. That being said, 2.2 will have a new dserver.tcl. I'll add delete if it isn't too complicated.

9) You client (WMP?) disconnected. It didn't like my server. This is somewhat normal. This honestly doesn't work well. Try VLC or mplayer.

10) The main link is the .mpg link. Some browsers (like IE) tie .mpg files to a specific program. If I created a .mpg you would get the same behavior as the main link. Right click->Save As... seems to work for IE.

11) Web download status: This is possible, but tricky. All I need to do is set the content-length. This seems simple, but it's a real mess. First, the .mpg translation is done on the fly, so I don't know what the exact size is. If I set it too short, the browser will cut off the file. To irritate the matter, neither IE nor FireFox can accept a length > 4GB (max size of a UI32 for the geeks out there) Some version can't go beyond 2GB (I32)

12) If somebody creates a Tivo version of Java, it's done! Otherwise would have to be ported to C (major painful). Might want to look at WebTivoPlus. It does quite a bit.

Allistah
04-14-2007, 04:29 PM
Thanks for the quick reply. When I clicked the view link, Windows Media Player popped up and then apparently choked.

It also might be good to include the version number of dserver.tcl in the beginning of the file so we can know which version we have. Thats where I would check if a newer one came out, I'd check which version I currently had.

Thanks for listening on the other points. :-)

Allistah
04-14-2007, 05:43 PM
I noticed that if I start recording a show for 5-20 seconds and then stop the recording, if I try and download that small clip, the transfer will hang with this error below. It should probably be more graceful with errors like this and reset. You can't get anything else until you quit/restart because the transer is hung.

Clicking abort does nothing. The progress bar freezes and stops with however many seconds were remaining.

13:36:51.171 Queued E:\downloads\Deadliest Catch Special_ Best of Season 2.mpg
13:36:51.187 Started E:\downloads\Deadliest Catch Special_ Best of Season 2.mpg
13:37:25.546 Dropping dead audio. Last SCR: 0:02:42.244 current SCR: 0:02:42.278 Audio [0:02:01.625, 0:02:01.649, 0:02:01.673, 0:02:01.697, 0:02:01.721, ]
13:37:25.562 Dropping dead audio. Last SCR: 0:02:42.378 current SCR: 0:02:42.411 Audio [0:02:01.745, 0:02:01.769, 0:02:01.793, 0:02:01.817, ]

Allistah
04-14-2007, 05:44 PM
Sorry for all the posts - I have a lot coming to mind.

Another suggestion would be to delete any partial files that get downloaded from the Tivo. So if you're downloading someone that abort the transfer, you should delete the partial file on the PC that was downloaded.

Oh, heres another one.. When you download files have the metadata on the file filled out for Episode Name, Program Description, etc. Whatever info is available on the Tivo, add that to the meta data on each file because you can add those columns in Windows and it's nice to see that info if you have it. If this wasn't clear, let me know.

Allistah
04-14-2007, 09:44 PM
OMG, I just noticed that I can't seek around in the mpg files that I get downloaded from TySuiteJ. This is -really- bad for me. I'm on the go all the time and I have to start/stop things every now and again. Not being able to pick up where I left off would pretty much kill this whole feature for me. :'-(

Is there anything I can do to fix this?

I noticed that I can seek around in the .ty files so I guess I could use those until the mpg files get fixed.

dburckh
04-14-2007, 11:00 PM
OMG, I just noticed that I can't seek around in the mpg files that I get downloaded from TySuiteJ. This is -really- bad for me. I'm on the go all the time and I have to start/stop things every now and again. Not being able to pick up where I left off would pretty much kill this whole feature for me. :'-(

Is there anything I can do to fix this?

I noticed that I can seek around in the .ty files so I guess I could use those until the mpg files get fixed.

I don't have the seek problem, but others have reported this. Assuming your are talking about WMP, the seek feature in WMP is pretty flaky. I read somewhere that it has to do with your demuxer. I would recommend VLC. IMHO, it's the best thing out there.

You might also try installing Tivo Desktop. It installs a different demuxer. (You don't actually use the Tivo Desktop software).

dburckh
04-14-2007, 11:17 PM
People have been requesting a lot of features. I agree with and like most of them but at the moment my free time is very limited. I'm going to use this post to track requests or they'll get lost. I'll update this as I get time to work on them

In the works:

Coming Soon:

New tags like description and duration
showing.xml extraction
Transcoding non-supported media for UPNP (PS3)
Vista UPNP Support

On the list:

Real time streaming (streaming while recording)
UI Configurator
OS relative storage of application.properties (e.g. use the Windows registry)
TMF Insertion

Allistah
04-14-2007, 11:25 PM
I don't have the seek problem, but others have reported this. Assuming your are talking about WMP, the seek feature in WMP is pretty flaky. I read somewhere that it has to do with your demuxer. I would recommend VLC. IMHO, it's the best thing out there.

You might also try installing Tivo Desktop. It installs a different demuxer. (You don't actually use the Tivo Desktop software).

I'll look that one up and give it a try. Yeah, I'm using WMP. Whats interesting though is that the .ty files seek perfectly. :-/ I'll let you know how the Tivo Desktop does.

UPDATE: I just tried MPC and I don't have the seek problems I did with WMP11.

Allistah
04-16-2007, 03:17 PM
Hey there..

I noticed that some of the mpgs that I download with TySuiteJ are interlaced and some are not. Is there anything that could cause this with some and not others? Is the content originally interlaced and it's getting deinterlaced on the fly when it's made into an mpg file?

dburckh
04-17-2007, 03:49 PM
Hey there..

I noticed that some of the mpgs that I download with TySuiteJ are interlaced and some are not. Is there anything that could cause this with some and not others? Is the content originally interlaced and it's getting deinterlaced on the fly when it's made into an mpg file?

I don't muck with the video or audio stream. It is how the Tivo is encoding (or DTV is sending) it. DTV seems to mix progressive with interlaced in the same showing. Most players support some sort of deinterlacing. You may have to turn it on or increase the level.

Allistah
04-17-2007, 04:08 PM
Yeah, I noticed that it was the same in the .ty file as it was in the .mpg file. How do you turn this deinterlacing on in the player?

You know how when it starts recording a show that it might catch a few seconds of the previous show? It did this and on that previous show, there was no interlacing artifacts. Then as soon as Desparate Housewives came on it appeared.

GriffinW
04-21-2007, 06:53 AM
just wanted to say thanks for this project.
It seems tivotool development has stopped. With this and mpegstreamclip I'm able to author dvd's again nicely on my mac.
Is there MPEG4 conversion in there yet? can I add it?
Sorry for my newbie question. I pop into this forum every few months, trying to figure this out, I get to a certain point, realize that what I want to do can't be done, and I go away again. Problem is, in between, I forget all the details I learned the last time, and I have to start over again from the beginning.

So, here is what I want to do: I have a Mac (10.4.9) and a hacked, networked DTivo S2 (6.2), and I want to burn Tivo shows to a DVD. That's it, plain and simple. I have all of the utilities, like mpegstreamclip, etc. I am very familiar with telnet, FTP, etc., and I have Toast (7.0.2 and 7.1) for DVD burning. But every DVD I have ever burned is either a coaster, or the video quality is worse than an old VHS tape, or the audio is out of sync, etc. I forget all of the details at this point, other than i have spent dozens, if not hundreds, of hours trying to accomplish this over the last couple of years.

I got TyStudioJ installed and working. (Thank you dburckh!)

When you say, Gunnyman, that you can "author dvd's again nicely on my mac" could you please just give me an overall snapshot of how you do that, and what utilities are needed?

I bought Toast 7 specifically to burn Tivo shows to DVD, as that seemed at the time to be a necessary component, but it never really worked. (I use it for creating CDs and data DVDs, though.) I know there is a later version of Toast now, but, I don't want to buy that until I know that it will do something for me that version 7 won't. It seems that one of the problems i remember is that Toast would re-encode whatever i would get off of my Tivo (most recently with TivoTool), which would take hours, and would render very poor quality video. I'm willing to spend a few bucks on this, but I would like to know that what I buy will work. If I need to buy the latest version of Toast (or some other utility) to do that, I'm willing to do that. I bought the MPEG2 Quicktime decoder from Apple also.

Somehow, I got a full version of The Daily Show from last summer onto my Treo, and it plays very well (impresses my geek friends!), although I can't remember exactly the steps I took to accomplish that, but I used TivoTool, and a lot of experimentation, and possibly another utility in between (mpegstreamclip?). (I use TCPMP as the player on my Treo, in case anybody's interested.) Seems that if that can be done, it should be possible to burn a show to DVD using my Mac. I can save a show to a data DVD for playing on a PC or Mac (using TivoTool 0.5.7 as MPG-4, I think, but I'm not sure, as it has been awhile), but not to play (well) in a stand alone DVD player, and it doesn't always play on all PCs either.

So, that's it - Tivo to Mac to DVD as easily as possible. It sounds like TyStudioJ is an important link in that, and I have that working, and can save ty files to my Mac, no problem. But I don't really want to spend hours and hours again, only to find out that any DVD I create I'm embarrassed to show to my family and friends! (I have several shows on my Tivo which feature a couple of different friends, and I keep promising to them that I will figure out a way to get that on a playable DVD for them. They keep saying "well, put it on a tape" but I just can't seem to bring myself to give them something using technology from last century! And besides, I have it in such perfect, digital Satelite quality video and audio - it would be painful to give them a VHS tape!)

So, what are the next steps?

Gunnyman, or anybody who can help with this, thanks in advance for your time.

Griffin

dburckh
04-25-2007, 01:16 AM
Griffin,

No simple answers here. I'm a Windows guy until Mac Mini's support HDCP. Then I may make the jump. :)

You definitely have to convert to MPG. I've burned a couple DVDs without sync problems using Nero. I know that doesn't help much.

There are a couple of problems burning DTivo video to DVD. First, DTV sends video down as 480x480 and stretches it to 640x480. DVD requires 640x480. Further most DTV streams use MP3 audio, which isn't technically supported by DVD (although most do).

I'm not familiar with Toast, but you may be able to relax some of the compliance settings. I have a friend with a Mac at work. I'll see if he has Toast.

dburckh

GriffinW
04-25-2007, 08:48 PM
Thanks for the response. There is an option in Toast (7) to 'Re-encode: Never' but when I select that, it still re-encodes the video, with poor results. I don't know if Toast 8 fixes that bug or not, so I was hoping somebody would have tried it before I spent money on the upgrade.

I've attached a screenshot from the custom encoding screen. I have tried a lot of different settings. The defaults are quite a bit different from this, so I must have changed them during my experimentation. I really don't understand the significance of most of these settings, so it's a shot in the dark for me. Like I said, selecting 'Re-encoding: Never' doesn't seem to make a difference, it still goes through the long re-encoding phase.

If anybody understands which of these options might make a difference, I could give it another try, when I get some time. I haven't tried burning a DVD from a file downloaded with TyStudioJ, so it's possible that the problem was in the format of the files I was downloading with TivoTool, so I suppose I should give it a try, but I was hoping somebody would have already done this, and could point the way!

Anyway thanks for the help, and I'll keep plugging away at it, just not sure when I'll have the time.

Griffin

GriffinW
04-26-2007, 08:43 PM
Okay, so I spent all last evening doing a bunch of tests, and the results are below. I am using a G4 Power Mac with a 1.3 Ghz processor, 1GB of Memory, OS 10.4.9. I had no other software running during any of the tests. No errors were generated during any of the testing. No speed issues either - no buffer over or under runs, etc. I used DVD-R media. I have been testing the DVDs I created by playing them on my Mac, using the built-in DVD player (not a burner) and Apple's DVD player software. I have burned them using an external Lite-on Firewire DVD R/RW burner. Max burn speed is 16X, but I have burned them all at 8x, to make sure I don't get any buffer problems. The DVD Burner is less than a year old. (I bought it after I thought that my last round of testing failures might be because my DVD burner was not up to snuff.)

I downloaded a 2.5 minute clip from my DTivo version 6.2 using TySuiteJ as an MPG file. (I just realized I was referring to it as TyStudioJ previously. Sorry.) Then I burned a DVD using Toast 7.0.2 and 7.1.2.

The video clip (mpg) plays fine on my Mac, using VLC, MPEGStreamclip and Quicktime player. No sync issues at all. None of the DVDs burned would play on my Windows XP Pro computer, nor would the downloaded mpg clip but then neither will standard DVDs, as Windows does not have a DVD player built in, and I haven't installed DVD player software, and apparently the DVD burning software that came with the DVD burner on my Windows PC will not play DVD movies. So, my Windows PC is useless when it comes to movies. (Windows Media Player gives me an error that the proper decoder is not installed, and I really do not want to load up my Windows PC with a ton of drivers. I use my Windows PC for work, and I don't want to make it any more unstable than it already is.)

But, none of the DVDs burned would play on my 5-6 year old RCA stand alone DVD player, either, which I use to play pre-recorded DVDs all the time. I know this is an old DVD player, but I want to make sure that any DVD I create will play in any DVD player, so I am concerned about this also.

In all cases, I started by selecting the automatic settings and Best quality in the Toast Settings.

Here are the results:

Using Toast 7.0.2 left on automatic, best quality: Toast re-encoded the file, which took about 7.5 minutes. This would mean that a one hour show would take about three hours to re-encode. Video seemed fine, but audio was out of sync. Same result with Toast 7.1.2

Turning off re-encoding: With all other settings left the same, I set the option: "Re-Encoding" to "Never." Toast did NOT re-encoded, just went through a quick multiplexing pass (about 5 seconds). So, the burning went through very quickly. But, I had the same Audio out of sync problem. This was the same with both 7.0.2 and 7.1.2 version of Toast. (Previous downloads using TivoTool would always be re-encoded by Toast, even with the re-encode option off, so there must be something about the format that TySuiteJ uses that is different than TivoTool.)

PCM Audio Option: The only audio setting I could change in Toast was Dolby Digital (the default) and PCM Audio. I switched the Audio settings to PCM and burned again (re-encoding off). Again, the audio was out of sync, using both 7.0.2 and 7.1.2 of Toast.

So, that's the end of my testing. Another evening of testing multiple combinations of settings, and still nothing that works. I would really appreciate hearing from anybody who has ever successfully transfered a show from their Tivo to a Mac to a DVD. Maybe Toast 8 fixes the sound sync issues, or maybe there is another DVD burning utility for Mac that works better, but I would like to know if anybody has done this, before I spend more money on this.

I have attached a screenshot from my final Toast settings, so if anybody has any suggestions for changes to them, I would be willing to give those a try.

Thanks for reading all this, and for any help.

Griffin

dburckh
04-26-2007, 09:09 PM
It looks like there is a problem with Toast and audio sync upon recoding. I think recoding has to happen unless there is an audio option for MPA/mp3. As I stated before, this isn't officially supported by DVD, but most do. You probably want to try another DVD tool if any are available.

As a last effort, you can set this flag in applications.properties:
ui.patchFirstVideoSequence=true

It may fool Toast into not recoding the video, but usually it just screws things up.

lsmod
04-30-2007, 04:08 AM
First off, I'm happily running TySuite on a Mac to fetch .tys!

FWIW, I then run them through tytompeg, then VideoReDo and MF6 under windows to make HVDVD_TS folders, which I then burn with Disco for my HD-A2... life is good. Complicated, but good.

A small feature request:

It appears that if there are two shows with the same name, TySuite will overwrite them when doing a multiple extract.

Could you add a sequence number if the file already exists? Failing that, adding the date and time to the filename will solve the problem.

(actually, giving us a set of variables and control of the filename in application.properties would be fantastic, and easier than providing a UI for customizing filenames.)

Thanks again, this is a great piece of software, and I know I'm only using a small corner of it.

dburckh
05-01-2007, 10:56 AM
First off, I'm happily running TySuite on a Mac to fetch .tys!

FWIW, I then run them through tytompeg, then VideoReDo and MF6 under windows to make HVDVD_TS folders, which I then burn with Disco for my HD-A2... life is good. Complicated, but good.

A small feature request:

It appears that if there are two shows with the same name, TySuite will overwrite them when doing a multiple extract.

Could you add a sequence number if the file already exists? Failing that, adding the date and time to the filename will solve the problem.

(actually, giving us a set of variables and control of the filename in application.properties would be fantastic, and easier than providing a UI for customizing filenames.)

Thanks again, this is a great piece of software, and I know I'm only using a small corner of it.

Shouldn't be a big deal to set the file name. I'll add it to the list. Hopefully I'll have some time to do some development again in the 2nd week of May.

If you are already using TySuite, there really isn't a reason to go through tytompeg, just extract them as .mpg. If you are still dead set on using tytompeg, it can be setup to run as an external processor. Should make your life a little easier.

dburckh
05-16-2007, 12:01 AM
Well, my release (real job) went live Monday and there has been an eerie silence since then. I took advantage of the few breaks I had to bang out another release. It's mostly requests.

I've updated the first post with the release.
WARNING: This release requires a new version of dserver.tcl, so be warned.

Fixed UI Refresh
Added Delete Title
Added TMF Extract
Added file name formatter
Added Video Info to log window
Updated Help file
***NEW VERSION OF dServer.tcl

UPNP is included in the release, but it hasn't changed since the last beta and is still incomplete. I'm putting it on the back burner to do scheduled extraction, conversion and phone streaming.

snoots
05-16-2007, 07:14 PM
Looking forward to trying it out !! Thanks again, I love this suite of apps !

snoots
05-26-2007, 02:37 PM
The PS3 is now DNLA compliant meaning I can stream video and audio from DNLA servers. I know that you have UPNP working and my Linkplayer2 syabas player is good to go. Is there any chance you might be able to support DNLA so my PS3 could access the TIVO media similar to the syabas stuff you did? This would be AWSOME ! I know it might be too much work but thought I would float the idea. There is a lot of activity on PS3 boards looking for servers to supply content and yours looks like it would fill the TIVO niche perfectly. Thanks again,

Snoots

SteveT
05-26-2007, 08:09 PM
...
Fixed UI Refresh
Added Delete Title
Added TMF Extract
Added file name formatter
Added Video Info to log window
Updated Help file
***NEW VERSION OF dServer.tcl
...These are great! Thanks for your continued work on a great tool.

One small item I noticed is that the Save As dialog has a selection input called "File Name", but it's treating it as a "Directory Name". The behavior is correct, but you might want to change the label to avoid confusion.

Another feature I'd like added to the to-do list would be the ability to save as .TY+ files (just like the .TY, but append the xml onto the end). This format allows me to view the show from my PC using TyShow, and provides full show details for use with Tivoserver. Just tossing that out there....

dburckh
05-27-2007, 11:27 AM
The PS3 is now DNLA compliant meaning I can stream video and audio from DNLA servers. I know that you have UPNP working and my Linkplayer2 syabas player is good to go. Is there any chance you might be able to support DNLA so my PS3 could access the TIVO media similar to the syabas stuff you did? This would be AWSOME ! I know it might be too much work but thought I would float the idea. There is a lot of activity on PS3 boards looking for servers to supply content and yours looks like it would fill the TIVO niche perfectly. Thanks again,

Snoots

The UPNP server uses DNLA XML for the meta content information. I believe DNLA just certifies UPNP devices (thus DNLA certified). That being said, TySuiteJ should just work in UPNP mode. At a minimum, the PS3 should see the TySuiteJ UPNP server.

The UPNP server is working. The issue I'm having is that some clients (like Vista) request the end of the file. This would require the entire file to be extracted or me to come up with something clever. So of this will be resolved by the scheduled extraction stuff I'm working on. I don't know if PS3 supports Mpeg2 via UPNP. I know the 360 only support WMV (I doubt Sony supports that).

snoots
05-27-2007, 01:16 PM
I have not been able to see the upnp server from the ps3. Is there a way to tell it is running, when I run the upnp bat file I get the quick dos box then nothing else appears to be happening.

dburckh
05-28-2007, 12:59 PM
I have not been able to see the upnp server from the ps3. Is there a way to tell it is running, when I run the upnp bat file I get the quick dos box then nothing else appears to be happening.

You should get a "refreshed xxx from yyy" and an "open for t-business message" Make sure you've set the following properly.

UpnpMediaServer.hosts=192.168.2.202
UpnpMediaServer.port=8380
#UpnpMediaServer.dirs=C:\\video
UpnpMediaServer.fileTypes=.avi,.mpg

You should be able to see the server from your LinkPlayer. I can see it from Vista, XBOX, Nero ShowTime, and my LinkTheater.

dburckh
05-28-2007, 01:04 PM
These are great! Thanks for your continued work on a great tool.

One small item I noticed is that the Save As dialog has a selection input called "File Name", but it's treating it as a "Directory Name". The behavior is correct, but you might want to change the label to avoid confusion.

Another feature I'd like added to the to-do list would be the ability to save as .TY+ files (just like the .TY, but append the xml onto the end). This format allows me to view the show from my PC using TyShow, and provides full show details for use with Tivoserver. Just tossing that out there....

Added to "the list"

Couldn't figure out how to easily change from "File Name:" to "Directory Name:", but the I did manage to get ty+ working. Will be in next release.

snoots
05-28-2007, 02:52 PM
I don't get the refreshing message or the t-business message like i do if i run the myihome bat file, below is my upnp settings

UpnpMediaServer.hosts=192.168.1.201,192.168.1.202
UpnpMediaServer.patchFirstVideoSequence=false
UpnpMediaServer.port=8380
UpnpMediaServer.dirs=C:\\tyfiles
UpnpMediaServer.fileTypes=.avi,.mpg,.ms-dvr

dburckh
05-28-2007, 04:36 PM
That's odd. It should at least try to do the refresh. The UPNP stuff requires Java 1.5. I'm using 1.5.0_11. If that's all good, try turning your logLevel up to DEBUG

snoots
05-28-2007, 05:08 PM
Updated to 1.5.0.11 still same problem, set loglevel to DEBUG, where is the log file stored

snoots
05-28-2007, 05:24 PM
can you verify the correct syntax of the upnp.bat file?

dburckh
05-28-2007, 05:38 PM
If you specify something as "util.Logger.file=XXX", it will go there. Otherwise it should go to the console.

You should be able to use the UPNP.cmd file that was part of the 2.2 zip. There are no parameters.

snoots
05-28-2007, 05:46 PM
the ui command generates the logfile I selected but the upnp does not generate a log output

snoots
05-28-2007, 05:50 PM
In order to get my system back to "normal". If I extract the 2.2zip to a new folder and then extract the latest jar file to the same place would that get me up to everything new?

snoots
05-28-2007, 06:43 PM
Reinstalling restored the upnp server. From the linkplayer I can select the tivo server, but I get the no files when I click on the folder. The PS3 shows up the tivo server but also displays no content found.

dburckh
05-28-2007, 07:05 PM
Hmmm... I don't know the state of the UPNP code in 2.2. I think I was working with Vista last. Might want to try one of the 21bX builds that I said was working with my LinkTheater or XBOX. I'll check it out tonight.

hbpate
05-29-2007, 05:17 PM
I just loaded TySuiteJ this weekend. This is an EXCELLENT TiVo Tool ! Works perfectly on DTiVo.

Thank You

dburckh
05-30-2007, 01:41 AM
I just loaded TySuiteJ this weekend. This is an EXCELLENT TiVo Tool ! Works perfectly on DTiVo.

Thanks. Glad to hear it's helping you out.

dburckh
05-30-2007, 01:55 AM
This release has TY+ extraction and UPNP working again/better. You'll need to update your dserver.tcl with this release.

UPNP notes:

1. FFWD/RWD seem to be working on my LinkTheater via UPNP
2. Added & verified UPNP support for PowerDVD 7.2 and Nero ShowTime 3 (aka Nero 7)
3. MS Authorization Services for Vista UPNP support disabled (but it might still work).
4. Audio/Pictures folders don't work and may crash TySuiteJ. Just use the Video!

Snoots, point your PS3 at this and give it a shot.

snoots
05-30-2007, 11:21 AM
Thanks, will try it as soon as I get home from work.

Kreed
05-30-2007, 08:33 PM
Amazing tool, love the webserver. I am using this with my HR10-250 and once I figured out that I had to put the path to java in all the .cmd files it works great!

Thanks!

snoots
05-30-2007, 09:06 PM
Well, tried the new test version, linkplayer sees it and plays back video from TIVO. PS3 sees the tysuite server but when I select the TIVO server icon I get a server disconnect error followed by "there are no titles" there is not a audio/video/music/picture folder tree displayed. Is there any log info I could send that might assist you? I am really psyched up about possibly playing TIVO files through the PS3.

dburckh
05-30-2007, 09:17 PM
Change/set these in application.properties and restart.

util.Logger.logLevel=TRACE
util.Logger.file=ps3.log

It'll get big fast. Zip it up and I'll have a look at it.

snoots
05-30-2007, 09:35 PM
Here it is

snoots
05-30-2007, 09:38 PM
Ok, now that I figured out how to attach the file.

dburckh
05-31-2007, 12:10 AM
Doah! I'm not using the logging framework for the DNLA XML. It does look like the PS3 is communicating with the server, but I can't see the detail.

Remove or comment out the following line:
util.Logger.file=ps3.log

Start the server like this:
upnp.cmd > ps3.txt 2>&1

Attempt to access from the PS3. Send me the ps3.txt file.

From the log, it appears that you have Nero Home running as well. Can the PS3 see their UPNP server?

FYI: You should be able to see the server from ShowTime. Right click, "Select Source->Media Files..." It will show up under "Media Home Network"

Kreed
05-31-2007, 02:45 AM
Trying to connect to the UPNP server with XBMC it gets a list of shows on my tivo but when it goes to open one for some reason XBMC thinks the stream is coming from my desktop's IP address 192.168.20.20:8380. I have the "application.properties" file configured for my tivo's IP address 192.168.20.100 in all sections.

I also got this error when I tried typing
upnp.cmd > xbmc.txt
Although the server still seemed to be running.

Exception in thread "Thread-9" java.lang.ExceptionInInitializerError
at upnp.server.ContentMinimalServlet.streamTivo(ContentMinimalServlet.java:56)
at upnp.server.ContentMinimalServlet.service(ContentMinimalServlet.java:45)
at web.ServerConnection.run(ServerConnection.java:32)
at common.ThreadPool$WorkerThread.run(ThreadPool.java:24)
Caused by: java.lang.NullPointerException
at io.BackgroundFileConverter.<clinit>(BackgroundFileConverter.java:39)
... 4 more
Exception in thread "Thread-8" java.lang.NoClassDefFoundError: Could not initialize class
io.BackgroundFileConverter
at upnp.server.ContentMinimalServlet.streamTivo(ContentMinimalServlet.java:56)
at upnp.server.ContentMinimalServlet.service(ContentMinimalServlet.java:45)
at web.ServerConnection.run(ServerConnection.java:32)
at common.ThreadPool$WorkerThread.run(ThreadPool.java:24)
^CC:\Program Files\Java\jre1.6.0_01\bin\java.exe was unexpected at this time.


I'll attach the xmbc.txt

dburckh
05-31-2007, 11:46 AM
Kreed, the stream actually is coming from your desktop. TySuiteJ pulls the Ty stream from the Tivo, converts it to standard MPG and then re-streams it to the client.

The problem you are having appears to be related to this entry in application.properties:

BackgroundFileConverter.cacheDir=.

If you changed it something else that's fine, but remember to double up the \. e.g. C:\\Temp. Also, I haven't tested with Java 6. I've been using 1.5.0_11.

I noticed that my capture wasn't grabbing stderr. This should fix it.

upnp.cmd > ps3.txt 2>&1

snoots
05-31-2007, 07:16 PM
Yes nero was also running and the ps3 likes it for most items. It won't playback some of the HD tivo mpgs that I had converted before however.
Here is the output from the new .txt file

dburckh
05-31-2007, 08:19 PM
Yes nero was also running and the ps3 likes it for most items. It won't playback some of the HD tivo mpgs that I had converted before however.
Here is the output from the new .txt file

Ok, I see at least some of the problem. They are using UPNP features I don't support (yet). It might take a couple of days to sort out...

I have seen posts on various forums about HD mpeg compatibility and the PS3. In addition, it appears they are only supporting H263 SP at the moment as well. I may consider buying one as a media center if they start supporting H263 ASP and fix the MPEG issues. Until then, LONG LIVE WII & HD DVD!!!

snoots
05-31-2007, 08:58 PM
The PS3 seems to be unforgiving or at least inconsistent in it's playback of mpgs. I can stream for example an HDnet concert that looks and sounds outstanding but other HD tivo videos that I downloaded using TysuiteJ of Serinity show as either corrupted data or playback a few seconds and then give an error. I am hoping they provide some improvements as time goes by. I am however hooked on MotorStorm and BluRay discs look super.

SteveT
05-31-2007, 09:31 PM
This release has TY+ extraction....I tried out the new .TY+ feature and it works great! Thanks a bunch!

dburckh
05-31-2007, 10:17 PM
The problem that I thought was going to be the hardest turned out to be the easiest.

Anyway, totally coding blind for the PS3 functionality that nothing else uses. This may work and it may blow up horribly. I also opened up the "Search" functionality that isn't implemented properly.

If it blows chunks, repeat the logging process.

snoots
05-31-2007, 11:29 PM
Sorry same results at least from the PS3 side of things.

dburckh
06-01-2007, 01:02 AM
Ok, I found a tool to test the functionality I couldn't duplicate. So here it is. Hopefully this works. After this, the only thing I have left to try is netcap.

snoots
06-01-2007, 11:56 AM
Thank you for making the effort to add this function to your great tool

snoots
06-01-2007, 08:38 PM
Ok, now we're talkin. Browses both my hdtivos, playsback some SD videos with audio. Playsback some videos both SD and HD but with no audio. Zipped up log file attached.

dburckh
06-01-2007, 09:21 PM
Excellent. Now the problem is with the PS3's MPG playback engine. First off, we have to drop back on the logging.

util.Logger.logLevel=INFO

Now lets give the PS3 a little more breathing room on the audio side

RestreamingTyRecordParser.minScrLeadFrames=6
RestreamingTyRecordParser.audioPacketLeadFrames=4

You can try bumping these up to 7,5 and 8,6. If that doesn't work, back them off to 4,2. Finally, try 7,3. If that doesn't work, send Sony a nasty e-mail.

snoots
06-01-2007, 09:44 PM
Will do, thanks for going the extra mile on this for me/us !!!

dburckh
06-01-2007, 09:51 PM
Had another thought as well. A couple of things you should COMMENT/REMOVE.

UpnpMediaServer.patchFirstVideoSequence
RestreamingTyRecordParser.maxPacketSize

snoots
06-01-2007, 10:34 PM
All of the sd directv streams playback fine with audio. HD shows on Directv like TNT the closer work fine video and audio. Looks like the shows recorded in HD OTA local fox, nbc etc have good video but no sound. After further checking it looks like ALL DirecTV stuff is good, ALL OTA local has problems. Some OTA HD shows like 24 playback video with no audio. SD OTA gives an error "data type is not supported" and lock up the PS3.

dburckh
06-01-2007, 10:58 PM
Interesting. Well that's a start. I can play with some HD OTA and see if I can see any problems with it. It's at a higher FPS and bitrate than DTV.

Try 8,6 setting above or even 9,4. The audio might be coming too fast for the PS3 to render it properly.

I haven't tried SD OTA. Are you getting that off an analogue signal or is it digial (does it have a "-" in the channel number)?

snoots
06-01-2007, 11:18 PM
ALL the OTA stuff is digital not analog. I know there is at least one sd directv stream that crashes but all most all of the directv stuff is solid and that includes the TNTHD stuff.

snoots
06-01-2007, 11:41 PM
9,4 allows some of the OTA SD fox shows to play a few minutes but also noticed it seems to cause some of the directv sd shows to flash frames out of sync or something, picture looks normal then you see like a subliminal frame of either ahead or behind the current position. I will try to get organized keep some notes on the different file types, etc etc and get that to you. Since I have quite a few shows on the boxes and there is no way from the PS3 gui to tell what or where the shows are coming from it may take me a bit to sort out. Also noticed that the tivocache file mpgs in the tysuitej directory are not being deleted. Is that normal?

Thanks, Snoots

dburckh
06-02-2007, 08:04 AM
Snoots,

There are two options to make the OTA stuff playable. The first is to mess with the muxer. I'm really reluctant to do that as it's complicated and the core of the system. The second is to hope a firmware update from Sony fixes it. I've seen several posts about others having issues with mpg, so they may fix it in a future release.

Try running an extracted HD and SD OTA mpg through VideoRedo (they have a free trial). Just open it and do a Save As... It will ask you if you just want to re-mux. Say yes. If this makes it playable on the PS3, I can trying messing with the muxer, otherwise we have to wait for Sony. You should be able to serve up a static directory with these settings:

UpnpMediaServer.dirs=C:\\video
UpnpMediaServer.fileTypes=.avi,.mpg

Also noticed that the tivocache file mpgs in the tysuitej directory are not being deleted. Is that normal?

It shouldn't be doing that. I had kind of abandoned the UPNP code as I couldn't get a "main stream" player to work, so there are a lot of loose ends.

snoots
06-02-2007, 01:43 PM
Sounds like a plan, I'll keep tweaking and we'll see what develops with PS3 firmware updates, they have been doing a pretty decent job of fixing things. Just the fact that I can play at least some of the files from both my HD-Tivo's via your app is a plus. I have videoredo and I'll give a try to the quick stream fix/save as and see if the defaults work. Thanks again !!!!

didjit
06-02-2007, 05:20 PM
Sweet tool. Finally I can "easily" extract and stream vidio using Linux. Wish more tools were written in Java.

Thank you for your efforts!

Question, any way to stream the 2 live channels (using web.cmd)?

Tx

Didjit

dburckh
06-02-2007, 05:57 PM
Question, any way to stream the 2 live channels (using web.cmd)?


Not at the moment, but it's on "the list"

dburckh
06-07-2007, 12:45 AM
This beta release adds all the PS3 UPNP changes + transcoding (converting from Ty/MPG to something else). The end goal of this release is to get video streaming on to my Treo. This is the first step. Eventually, I will support transcoding via the web, for now it's in the UI. The sample profiles use ffmpeg. I did some exhaustive research and this seems have the best balance of speed and usability. Windows builds can be obtained here: http://arrozcru.no-ip.org/ffmpeg_builds/

There's a bunch of new application.properties settings for transcoding and you'll have to set the path to ffmpeg. You should be able to use mencoder or any command line tool that takes in an mpg stream via stdin. I've added high quality SD, HD and mobile profiles for the XviD codec.

You access the transcoding profiles via the Save As... button. You can add new ones (e.g. H264) via the applications.properties file.

Enjoy

snoots
06-07-2007, 07:18 PM
I tried out the new changes, now most content will not play on my PS3 even those that were playing. Some play for just a few seconds then quit. I am getting a lot of the "connection to the media serrver could not be established, check your permissions" even when the video and audio plays. I enclosed a logout.

snoots
06-07-2007, 07:19 PM
Also included my properties file

snoots
06-07-2007, 07:22 PM
Access to the media server has been denied. Check the settings for the media server is the primary error message, not the one I indicated above, sorry

dburckh
06-07-2007, 09:35 PM
I tried out the new changes, now most content will not play on my PS3 even those that were playing. Some play for just a few seconds then quit. I am getting a lot of the "connection to the media serrver could not be established, check your permissions" even when the video and audio plays. I enclosed a logout.

Snoots, that is pretty odd. I don't think there's any changes in the UPNP stuff verse the last version. This release just ads transcoding. I'm wondering if you are having a networking issue. Are you running wireless?

I'll compare the logs and see if anything is different, but I don't think anything has changed.

dburckh
06-07-2007, 09:49 PM
My bad. I did change something. This is interesting though, I consolidated the content server code for the web & upnp server. I'm surprised it mattered. I'll see if I can find the difference. I may be able to make more stuff play if I can what caused the problem.

snoots
06-07-2007, 10:39 PM
I'm running wired Gigabit

JustDan
06-14-2007, 03:36 AM
Small feature request, if I may.

One of the series I follow has a bad habit on D* of not having episode titles, only the program title. If I try to batch extract them, each episode overwrites the one before it.

I can extract them one at a time and rename them, but it would be handy if the suite could just append a numeric count to the file name.

I did not see such a feature covered in the ReadMe, or during a quick scan of the last 10 pages, but if it is there and I missed it, sorry for the noise.

dburckh
06-14-2007, 11:26 AM
Version 2.2 has an attribute FileTransferrer.fileNamePattern. Try FileTransferrer.fileNamePattern=%Default%%Unique%

See the \help\readme.htm for more info.

dburckh
06-17-2007, 06:48 PM
Well, I jumped right from 2.4 b4 to 2.5b1. I added so much stuff to this that it really is a new version. Here's the highlights:

Added "Save As..."->iPod - This allows one click Tivo to iPod conversion.
Added support for Audio and Pictures to UPNP and MyIHome.
Refactorred content management system. It's now extremely flexible.
Added mobile phone support to the web server (Well, at least for my Treo). It's kinda cool. It detects phones and automatic routes the user to the new XHTML pages.
Added extraction/transcoding functionality to web server.
Fixed PS3 UPNP Issues???

READ THIS:

Your application.properties file is now OBSOLETE (sorry). You'll need to update it.
If you want to transcode (to say your iPod). You are going to need FFMpeg. Put it in the ./ffmpeg when you extract the .zip. Here's a link for Windows people. http://ffdshow.faireal.net/mirror/ffmpeg/. You can extract this with 7-zip (Google it if you don't have it). You need all the files!

Potential Stuff for 2.5 Gold:

Configurable buttons for the UI (you pick the buttons you want on the UI)
ID3 tag support for audio (including By Artist folders, etc).
Automatic picture orientation correction
Vista UPNP support
iTunes integration

Notes:

SetupTest is pretty much broken.
The UI should work without reconfiguring too much (if any).
The new configuration format is undocumented, but I think it's pretty easy to figure out.
If you have not pulled down the prior betas, this version requires a dserver.tcl upgrade, .
This was a pretty huge refactor. I spent a good deal of time testing today, but ...
iPod conversion notes: There are 4 different options. The ones with "Screen" are meant to be viewed on the iPod screen. The ones with "TV" are higher quality (and larger) for external viewing. Use "...Wide" options if the video was a wide screen source (HD).
ffmpeg Rocks! Thanks to everyone that is working on it.

snoots
06-17-2007, 09:39 PM
I downloaded and installed the new version. Since we need to use the new application.properties file can you give me any optimal settings to try to get PS3 stuff working more reliably. It will play some files part way through then dies. It often posts the PS3 message
"Access to the media server has been denied" Check the settings of the Media server. " I also noticed my Linkplayer2 sees the server and plays more reliably but the list of tivo shows is inaccurate. It lists like 1 to 8 of 22 but going page forward list some of the same folders over and over. Thanks for knocking out a new version with so many new features !!!

This is sooo close to working for me on the PS3 side.

dburckh
06-17-2007, 10:06 PM
I downloaded and installed the new version. Since we need to use the new application.properties file can you give me any optimal settings to try to get PS3 stuff working more reliably. It will play some files part way through then dies. It often posts the PS3 message
"Access to the media server has been denied" Check the settings of the Media server. " I also noticed my Linkplayer2 sees the server and plays more reliably but the list of tivo shows is inaccurate. It lists like 1 to 8 of 22 but going page forward list some of the same folders over and over. Thanks for knocking out a new version with so many new features !!!

This is sooo close to working for me on the PS3 side.

I was really hoping this version would alleviate the "Access to the media server has been denied". There is no security on the server. It is probably a red herring for some other problem.

I did a quick Google on PS3 "Access to the media server has been denied". It appears the PS3 is really impatient. It takes a while to buffer up the Tivo stream. Try hitting the same title again after waiting a minute. TySuiteJ should keep downloading the file after the initial hit. Additionally, please make sure your firmware is up to date. The posts said 1.8 helped.

I'm not experiencing the multiple folders. Could this be a case sensitivity issue? (I can correct that) If not, could you start MyIHome, hit it with a browser, find the duplicates and send me the .html?

As for .properties settings, the content management properties have changed, but the rest are the same. I don't have any recommendations for the advanced settings other than what was in previous posts. Good luck. My future PS3 purchase is in your hands. :)

FYI: I have a friend of a friend that claims Sony is going to drop the price of PS3 $100 this month.

dburckh
06-17-2007, 10:08 PM
This contains updated "help" on the new content management system. Hopefully it's helpful.

snoots
06-17-2007, 10:34 PM
I'll go through the new help and also see what I can discover PS3 wise. I do have the lastest firmware installed. I also emailed sony to suggest they correct some of the issues. There are several DNLA servers out there and so far not one of them can handle video reliably. I have transcoded videoredo'd and they still don't play reliably. Hopefully as you say Sony will "fix" some of the issues. When it is working it is SWEET. ALso playing MotorStorm is a hoot on line.

dburckh
06-17-2007, 10:40 PM
Until then, Wii are with you in spirit. (Resident Evil 4 Wii coming out soooooon).

snoots
06-17-2007, 10:52 PM
The files show up correctly if I'm running myihome. I was running uPnP during the PS3 tests and it showed up on the Linkplayer2. Must be a difference in the code somewhere between the two lists.

dburckh
06-17-2007, 11:11 PM
(I've said this before, and had to eat my words.) That is really odd. The major rework on this release was having the UPNP, Web and MyIHome sharing the same content code. Does this happen with the PS3, LinkPlayer and Nero ShowTime? If so, I definitely have an issue. If it's just one, it might be an issue with my UPNP ID scheme (new). I've been testing with one Tivo, I'll try multiple.

snoots
06-17-2007, 11:30 PM
With the UPNP cmd running, the PS3 sees all the files under video.
On the Linkplayer2 it shows 9 files per screen but the titles are all the same but the numbers increase. 24 is the first folder on the Tivo and it shows at the top of the 3 pages. If I start up the myIhome command then the Linkplayer2 sees the total TIVO listing.

dburckh
06-17-2007, 11:38 PM
So, as I understand it:

PS3 - sees all files (you can change UpnpMediaServer.content=/Video/{Content.tivo} to just /{Content.tivo} to get rid of the Video folder)
MyIHome - sees all files
UPNP LinkPlayer - screwed up

Correct? I have a ":" in the tivo ID's. If the above is accurate I'll change it and we can see what happens.

snoots
06-17-2007, 11:40 PM
Yes PS3 sees them all, MyIhome sees them all, UpnP Linkplayer screwed up.

dburckh
06-18-2007, 12:04 AM
Try this. Strangely, my LinkTheater has no problems. It is a sibling to the LinkPlayer2. I've replace the ":" with an "_". The LinkPlayer XML parser may think the ":" represented a namespace.

Oh, my iPod transcoding beta tester (my wife) reports that the files work. No issues with FFWD, RWD, pause or Audio Sync.

tlphipps
06-18-2007, 01:45 AM
I'm trying to run the newest beta on my CentOS 5 Linux box, but I can't get the transcoding to work. Here's the error I get no matter what program or transcoding settings I try.

06/17/2007 23:38:59.826 INFO [common.TransferQueue] Queued /mnt/raid/video/Craft Lab.mov
06/17/2007 23:39:00.544 INFO [parser.RestreamingTyRecordParser] Video: Size: 480x480 Aspect: 4x3 fps: 29.97003
06/17/2007 23:39:01.346 INFO [common.TransferQueue] java.io.IOException: Bad file descriptor
java.io.IOException: Bad file descriptor
at gnu.java.nio.channels.FileChannelImpl.write(libgcj.so.7rh)
at java.io.FileOutputStream.write(libgcj.so.7rh)
at java.io.FileOutputStream.write(libgcj.so.7rh)
at parser.TyRecordParser.writePackHeader(TyRecordParser.java:251)
at parser.RestreamingTyRecordParser.writePacket(RestreamingTyRecordParser.java:476)
at parser.RestreamingTyRecordParser.append(RestreamingTyRecordParser.java:331)
at parser.RestreamingTyRecordParser.convert(RestreamingTyRecordParser.java:208)
at parser.TyRecordServer.parse(TyRecordServer.java:178)
at parser.TyRecordServer.parse(TyRecordServer.java:124)
at io.FileTransferrer.convertTyStream(FileTransferrer.java:399)
at io.FileTransferrer.getTranscodedFile(FileTransferrer.java:117)
at common.TransferQueue.run(TransferQueue.java:112)
at java.lang.Thread.run(libgcj.so.7rh)


Any ideas what I'm missing? BTW, this ROCKS!!!

JustDan
06-18-2007, 02:44 AM
Thanks for pointing out the FileTransferrer.fileNamePattern option, but
it doesn't quite work here.

I thought it was completely failing, as I deleted my test cases between
extractions. I just left one and tried to pull down two mode episodes.
The first new one seemed to properly detect the old file and had _1
appended the name, but the next also ended up with _1 and overwrote the
first....

dburckh
06-18-2007, 10:41 AM
I'm trying to run the newest beta on my CentOS 5 Linux box, but I can't get the transcoding to work. Here's the error I get no matter what program or transcoding settings I try.

06/17/2007 23:38:59.826 INFO [common.TransferQueue] Queued /mnt/raid/video/Craft Lab.mov
06/17/2007 23:39:00.544 INFO [parser.RestreamingTyRecordParser] Video: Size: 480x480 Aspect: 4x3 fps: 29.97003
06/17/2007 23:39:01.346 INFO [common.TransferQueue] java.io.IOException: Bad file descriptor
java.io.IOException: Bad file descriptor
at gnu.java.nio.channels.FileChannelImpl.write(libgcj.so.7rh)
at java.io.FileOutputStream.write(libgcj.so.7rh)
at java.io.FileOutputStream.write(libgcj.so.7rh)
at parser.TyRecordParser.writePackHeader(TyRecordParser.java:251)
at parser.RestreamingTyRecordParser.writePacket(RestreamingTyRecordParser.java:476)
at parser.RestreamingTyRecordParser.append(RestreamingTyRecordParser.java:331)
at parser.RestreamingTyRecordParser.convert(RestreamingTyRecordParser.java:208)
at parser.TyRecordServer.parse(TyRecordServer.java:178)
at parser.TyRecordServer.parse(TyRecordServer.java:124)
at io.FileTransferrer.convertTyStream(FileTransferrer.java:399)
at io.FileTransferrer.getTranscodedFile(FileTransferrer.java:117)
at common.TransferQueue.run(TransferQueue.java:112)
at java.lang.Thread.run(libgcj.so.7rh)


Definitely not a good thing. I don't have a Linux box to test with. Where did you get your ffmpeg? Did you build it? I'm 90% sure that the link I sent to the Windows binary won't work on Linux, but I don't claim to be a Linux expert.

Try changing the engine setting to:

Transcoder.engine.ffmpeg=bash ./ffmpeg/ffmpeg

If that fails, please send me the encoder_out.txt. It should be in your install directory.

dburckh
06-18-2007, 10:43 AM
Thanks for pointing out the FileTransferrer.fileNamePattern option, but
it doesn't quite work here.

I thought it was completely failing, as I deleted my test cases between
extractions. I just left one and tried to pull down two mode episodes.
The first new one seemed to properly detect the old file and had _1
appended the name, but the next also ended up with _1 and overwrote the
first....

Yeah, that sounds believable. I think I only tested it with one file. Should be an easy fix.

Found the problem. UNIQUE won't work if you add 2 jobs with the same name at the same time. This is due to the names being resolved when the job is added instead of before it's being run. It should work if you do one, wait for completion, then add the other. I'll fix it in the next beta.

snoots
06-18-2007, 08:15 PM
Linkplayer2 still shows the wrong titles using the upnp.cmd file. If I run the MyIhome.cmd it shows the correct files. I only bring this up for consistency since if MyIhome works I don't need upnp for the linkplayer2. However since I have to run upnp for the pS3 it would be good if I could just run that and not 2 different server apps.

snoots
06-18-2007, 09:11 PM
I have been playing around a lot tonight starting and stopping the upnp and myihome servers. My living room tivo has rebooted itself 3 times in about 3 hours. Is it possible that the starting and stopping dserver.tcl when the upnp and myihome servers could be causing the reboot?? I have not had this problem before. I don't know if this would be an issue or not.

dburckh
06-18-2007, 09:33 PM
I have been playing around a lot tonight starting and stopping the upnp and myihome servers. My living room tivo has rebooted itself 3 times in about 3 hours. Is it possible that the starting and stopping dserver.tcl when the upnp and myihome servers could be causing the reboot?? I have not had this problem before. I don't know if this would be an issue or not.

This could be caused by the constant restarting. I've never been able to consistently duplicate it. The best I can offer is to run dserver.tcl from rc.sysinit.author

snoots
06-18-2007, 11:11 PM
I'll add it tonight, and thanks again for all your hard work on this great tool set.

dburckh
06-19-2007, 12:41 AM
What's new/fixed:

Removed all ":" from object IDs
Added pagation support to the UPNP "Browse" and "Search" actions
Fixed %Unique% so it works with duplicate names in the live queue
Added photo scaling and orientation correction

Photo scaling will rescale an image to fit the clients display. I added this primarily to work around a display problem with my LinkTheater, but it can be used to speed image transfer over the network. It is enabled like so:

UpnpMediaServer.PHOTO!.rescale=true
UpnpMediaServer.client.height=1080

client.height is in pixels. A 720p TV would be 720, a 1080 TV would be 1080 and an SD TV would be 480.

Photo orientation correction is really cool (if I don't say so myself). Most newer cameras know which way the camera was held when a shot was taken. For some stupid reason, most programs ignore this. TySuiteJ will correct the orientation of a photo so the top is, well, on top. Enable it like so:

UpnpMediaServer.PHOTO!.correctOrientation=true

These settings also work for the MyIHomeWebServer.

Snoots, there is a slim chance pagation may fix your LinkPlayer2's UPNP issue.

snoots
06-19-2007, 02:53 PM
I'll try it when I get home. Saw your post on Blockbuster in the other thread, My take on it was better than yours since I drank the BluRay Kool Aid and got a PS3.

dburckh
06-19-2007, 03:54 PM
I've got like $600 bucks into HD DVD (movies and hardware). Luckily I can rip the movies and convert to BluDay if I have to.

JustDan
06-19-2007, 06:05 PM
A quick follow up to queuing multiple shows with the same name, the extraction process does create unique names. A small cosmetic issue is that
the interface lists the same name when the calls are queued.

dburckh
06-19-2007, 06:10 PM
A quick follow up to queuing multiple shows with the same name, the extraction process does create unique names. A small cosmetic issue is that
the interface lists the same name when the