PDA

View Full Version : MfsStream Web Module



gosquad
05-18-2002, 01:10 PM
well guys, I was thiiiiiiis close (/me puts fingers close together) to getting a working tivoweb front end to mfs_stream. I have a module displaying the current shows and their fsids. However, when I do this in tcl:

puts $chan [exec $source_dir/mfs_stream -s $filename]

I get this:

Tmk Assertion Failure:
BlockFailure, line 1771 ()
Tmk Fatal Error: Thread tivosh <158> died due to signal -2
1a12634 1a10e54 1a0d344 1b73cec 1c2da70 1c720d4 1c64690 1c415a0 1c58304 1c41e98 1c64e48 1c66350 1c2d6d0 1c083c4 1800134

and mr. dsr6000 goes into the infinite 'powering up' loop.

Sooo does anyone have an idea how I could fix this? If anything I could release the little web module for displaying fsids. If that's of any help to anyone. :)

John

keith721
05-18-2002, 02:40 PM
could it be that you're forgetting to include the FSID values in your command string, and leaving out the ">" output redirection syntax before your filename ?

just wondering . . . :)

gosquad
05-18-2002, 03:28 PM
Originally posted by keith721
could it be that you're forgetting to include the FSID values in your command string, and leaving out the ">" output redirection syntax before your filename ?

just wondering . . . :)

Nope. :) actually, i was trying to put it out to stdout so that it would come right over port 80. I guess $filename is a bit misleading, it's actually the fsids as a file name
(ie - 44545%203435.ty). I know the problem is now tcl.. I tries to alloc more memory in it's pool. but since it's exec method must copy the whole stack, it runs out of room and reboots. annoying.

John

AlphaWolf
05-18-2002, 03:47 PM
gosquad: if your tivo is still in the reboot loop, try using switcherstart -k when bash first shows up (prevents myworld from running which is what causes the rebooting), run tivoweb, clear the resource cache (forgot exactly which menu it is in), and reboot. Hopefuly when it boots back up it should be fine again.

gosquad
05-18-2002, 04:28 PM
Originally posted by AlphaWolf
gosquad: if your tivo is still in the reboot loop, try using switcherstart -k when bash first shows up (prevents myworld from running which is what causes the rebooting), run tivoweb, clear the resource cache (forgot exactly which menu it is in), and reboot. Hopefuly when it boots back up it should be fine again.

nope, I just unplug it and plug it back in and everything is a go again. Weird, but it works. :)

AlphaWolf
05-18-2002, 08:38 PM
Gosquad: Ah. Keep this thread informed of your progress, its nice to see that we finaly have an alternative to tivoapp in the works :) I would help but I am not much of a coder.

gosquad
05-20-2002, 12:11 PM
Ok.. I've scrapped my old idea of trying to exec a call to mfs_stream in the tcl script. What I've done now is written a small .c web server that just spits out the stdout from mfs_stream. this way, I list the fsids and title, description, etc. in a tivoweb module, then when I click on one, it launches the webserver and says 'Your download is ready. Click HERE to get it'. and the HERE link is an ahref to another port on the tivo (ie - 192.168.1.105:9002)..

If that makes any sense. :) I've been trying to get this done all morning, but other things keep popping up. I should have a beta for anyone who's interested in a bit.

I'll keep you up to date.

Cheers,
gosquad.

gosquad
05-20-2002, 04:49 PM
Ok, here it is! :) announcing (for a great lack of a better name) MfsStreamWebModule!

This will allow you to download .ty files from within tivoweb. no more netcat! no more tivoapp!

This hasn't been tested thoroughly, so I would like some feedback from the people in this thread before I put it in a sticky.

Read the readme.txt and let me know if you have any problems/questions/ideas, etc. I'd like to add the ability to sort on a column. and maybe configure the layout in a .cfg.

Also let me know what kind of speeds you get and how they compare to tivoapp and netcat (and smb for that matter). I've been getting around 1meg/sec with my turbonet.

gosquad.

gosquad
05-20-2002, 05:32 PM
AlphaWolf.. I wrote your name wrong in the readme! haha. (alpha killer.. wtf was I thinking?).. it'll be fixed in the next release. :)

gosquad

dertb
05-20-2002, 05:49 PM
placing the file tyhttpd in the tivoweb-tcl directory and chmod 755 results in the error "couldn't execute "./tyhttpd": no such file or directory" for me. I can drop the file on the root and then get a download prompt but i am unabl to get anything other than a 0 meg file to downlod... very interesting.. any ideas?

Perplexer
05-20-2002, 06:11 PM
Wow, that's pretty slick! I didn't do much testing, since my machine is currently encoding, but it's very easy and very functional. I even queued up a couple streams with GetRight (a download manager).

gosquad
05-20-2002, 06:23 PM
Originally posted by dertb
placing the file tyhttpd in the tivoweb-tcl directory and chmod 755 results in the error "couldn't execute "./tyhttpd": no such file or directory" for me. I can drop the file on the root and then get a download prompt but i am unabl to get anything other than a 0 meg file to downlod... very interesting.. any ideas?




dertb,

Hmm. This could be my lazy use of "./tyhttpd". If you know how to edit files on the tivo, open up mfsstream.itcl and replace this line:

set command "exec ./tyhttpd"
to
set command "exec /var/hack/tivoweb-tcl/tyhttpd"

of course, replacing /var/hack/tivoweb-tcl to point to your tivoweb directory. Also, are you running httpd-tt.tcl in your rc.sysint? Maybe that's the problem. I'll change this in the next release..

Let me know! Thanks,
gosquad

gosquad
05-20-2002, 06:26 PM
Originally posted by Perplexer
Wow, that's pretty slick! I didn't do much testing, since my machine is currently encoding, but it's very easy and very functional. I even queued up a couple streams with GetRight (a download manager).

perplexer, Great to hear! I wouldn't queue up too many (3-4 should be fine) as each one launches a new httpd (albeit a very small one) and the directivo sometimes likes to do wacky things when lots of processes are run (ie - reboot :) ). But then again, if you want to stretch it to the limit, let me know how it works out!

I'll download getright and try it out..

Cheers,
gosquad

mpauley
05-20-2002, 06:39 PM
Gosquad - Great job, got it to work first try and speed is pretty good. I run your script and Gary's APP on the same 145 MB file and your's took about 10 seconds longer. I split the file with Vsplit and everythingworks great!

Mike

gosquad
05-20-2002, 07:09 PM
Ok, I won't make this a continual thing, but here's v.91 of my tivoweb module. It now looks in your $PATH for tyhttpd and mfs_stream. Yes, another lazy way for me, but it should work for everyone.

So if you're upgrading, delete your old tyhttpd and mfs_stream from your tivoweb dir and just copy the provided ones somewhere in your path. (ie - /bin). You will also have to copy the new mfsstream.itcl into your web modules directory.

If you want to add another dir to your PATH, you can add the following line to /.profile

PATH=$PATH:/var/hack

It's just that easy! :) Just make sure to reboot if you want your PATH to be updated for all processes.

Let me know how you make out..

Cheers,
gosquad.

dertb
05-20-2002, 07:25 PM
The latest file seems to have taken care of both problems ..This rocks!!!

thanks

Karpa
05-20-2002, 08:35 PM
I get the following error:

Unable to locate server.

This is the source code of the D/L page:

<P>Your download of <B>The Shield</B> is ready. Click <a href="http://127.0.0.1 Bcast:127.255.255.255 Mask:255.0.0.0
UP BROADCAST LOOPBACK RUNNING MTU:3584 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 coll:0

eth0 Link encap:Ethernet HWaddr 00:0B:AD:01:02:03
inet addr:192.168.1.200:3102/The Shield.ty">here</a> to start!</P>


Is there a reason that it is looking for 127.0.0.1, instead of 192.168.1.200 (my tivo)? Any idea what could be wrong?

Thanks
Karpa

gosquad
05-20-2002, 08:47 PM
Originally posted by Karpa
I get the following error:

Unable to locate server.

This is the source code of the D/L page:

<P>Your download of <B>The Shield</B> is ready. Click <a href="http://127.0.0.1 Bcast:127.255.255.255 Mask:255.0.0.0
UP BROADCAST LOOPBACK RUNNING MTU:3584 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 coll:0

eth0 Link encap:Ethernet HWaddr 00:0B:AD:01:02:03
inet addr:192.168.1.200:3102/The Shield.ty">here</a> to start!</P>


Is there a reason that it is looking for 127.0.0.1, instead of 192.168.1.200 (my tivo)? Any idea what could be wrong?

Thanks
Karpa

What are you doing with a 'lo' entry in your ifconfig? :) You see, I cheated (once again) and I get the local address from 'ifconfig'. I don't have a loopback entry, so I was just parsing out everything between "inet addr:" and "Bcast". But you have alot between those. For now just change this line (line 6) in mfsstream.itcl:

regexp {inet addr:(.*) Bc} $test junk address

to

regexp {eth.*inet addr:(.*) Bc} $test junk address

I'll change this in the next release. Unless someone has a better way to grab the local address..

gosquad

gosquad
05-20-2002, 08:49 PM
That should read:

regexp {eth.*inet addr:(.*) Bc} $test junk address

Stupid smilies. :)

lsmod
05-20-2002, 09:39 PM
Originally posted by gosquad


regexp {eth.*inet addr:(.*) Bc} $test junk address



ROTFLMAO!

Thank god I never had to write in APL... :D:D:D:D

cloudz
05-20-2002, 10:58 PM
I installed the softwareand got the web services to run but still no download. When i tried to download the ty stream both IE and Netscape just close the download window after about 5 sec leaving a 0K file. What could be wrong? Thanks.

AlphaWolf
05-20-2002, 11:44 PM
Gosquad: it sucks, its too slow... :D j/k

Nice work, much better than using tivoapp.

Thus far I notice few (minor) bugs:

Ocasionaly I see this when I click on the MfsStream section, it appears near the top of the page:

INTERNAL SERVER ERROR
action_mfsstream '/' ''
error writing "file1": I/O error

Also, if you start downloading a stream, and decide you want to cancel it, tivoweb often seems to die for a while thereafter, and produces a few errors. Eventualy it recovers. Just to see what I am talking about, start downloading a stream, cancel it, then click the back button. Try it a few times, it seems to vary a lot.

So far as the speed goes, it seems a tad slower than tivoapp, but not by much, its a lot easier/better than the other methods so its worth a few seconds difference IMO. EDIT: actualy that seems to vary.

Two suggestions:

Change the main menu name to something else (like Download Videos or something more origional)

Works pretty damn good so far. Installation was flawless, the streams appear to work fine with vsplit (though I havent watched any all the way through yet). Add it to the extraction sticky thread. :)

gosquad
05-21-2002, 08:11 AM
Originally posted by AlphaWolf
Gosquad: it sucks, its too slow... :D j/k

Nice work, much better than using tivoapp.


Haha. Thanks. (I think :))



Thus far I notice few (minor) bugs:

Ocasionaly I see this when I click on the MfsStream section, it appears near the top of the page:

INTERNAL SERVER ERROR
action_mfsstream '/' ''
error writing "file1": I/O error


I have seen this, too. I'm pretty sure I know why it's happening. I will see if I'm right. :)


Also, if you start downloading a stream, and decide you want to cancel it, tivoweb often seems to die for a while thereafter, and produces a few errors. Eventualy it recovers. Just to see what I am talking about, start downloading a stream, cancel it, then click the back button. Try it a few times, it seems to vary a lot.


This might be due to the way I'm execing the tyhttpd process. I sure wish I could fork() this off. Oh well.. I'll look into it.



So far as the speed goes, it seems a tad slower than tivoapp, but not by much, its a lot easier/better than the other methods so its worth a few seconds difference IMO. EDIT: actualy that seems to vary.

This is great to hear! But how bad does it vary?

Two suggestions:


Change the main menu name to something else (like Download Videos or something more origional)

Well it says "MfsStream" and "Download TY Streams" now. That seems about right. :) Maybe I do need a better name.. Suggestions?? Anyone??



Works pretty damn good so far. Installation was flawless, the streams appear to work fine with vsplit (though I havent watched any all the way through yet). Add it to the extraction sticky thread. :)

I will as soon as I get these revisions in! :)

Cheers,
gosquad

gosquad
05-21-2002, 09:24 AM
Originally posted by cloudz
I installed the softwareand got the web services to run but still no download. When i tried to download the ty stream both IE and Netscape just close the download window after about 5 sec leaving a 0K file. What could be wrong? Thanks.

This sounds like it can't find the mfs_stream program. Make sure you've chmod 755'ed it and put it in the same location as your tyhttpd (in your $PATH somewhere).

Let me know if you still can't get it to work.

Oh, and to everyone.. I'll have a new revision out tonight. Real work calls. :)

gosquad

gosquad
05-21-2002, 07:05 PM
Originally posted by keither
Not to be bitchy, but I think the development of a Tivo WebServer interface to mfs_stream is out of the purvue for this topic. Perhaps GoSquad should create a new topic where he can post releases and people can go for support?

agreed. :) done.

gosquad
05-21-2002, 07:08 PM
Hey all. I've moved this out of the Splitting/Muxing thread to keep things tidy.

I will be posting a new version of my mfs_stream web module later this evening. It will fix the issues with tivoweb stalling and dying with "i/o errors" as well as a big issue with the incorrect size being passed for large shows.

Cheers,
gosquad

paddy
05-22-2002, 02:35 AM
Hi Gosquad,

I've installed your application as directed, but when I click on one of the shows to download I get the following in my browser:

tyhttpd is running on port: 2844

INTERNAL SERVER ERROR
action_mfsstream '/Outside the Lines/1703936/56785 56799 56809 56810' ''
couldn't execute "tyhttpd": no such file or directory

I have confirmed that tyhttpd is in my path. If I go to any directory I can type tyhttpd and get the following message:

ERROR, usage: tyhttpd portnum contentlength -s fsid1 fsid2

The difference for me is that my tivoweb is installed off of / instead of in a /var subdir, I'm not sure if that makes any difference. I am using your .91 release and my perms are set to 755 on the tyhttpd and mfs_stream files. Any help would be appreciated.

Paddy

Badness
05-22-2002, 02:53 AM
Very cool module, but I have a question. Is there any way in IE to make it save the file directly to the save location isntead of caching it then copying it to the save location?

tweaky
05-22-2002, 06:08 AM
Great app and great timing....


I just installed my TurboNet card a few days ago and was just figuring out how I was going to extract. Works perfectly.. BTW, what speeds are you getting for transfer? I am around 800K on a 10Mhz hubbed network (tivo and my computer only).

gosquad
05-22-2002, 08:23 AM
Ok here it is! v.92. Sorry about the delay. This should be more stable. and a big bug fix is included for your enjoyment. :) let me know how it works.

cheers,
gosquad

Blue Duck
05-22-2002, 08:23 AM
Badness,

As far as I know IE always does that copy stuff when dowloading a file, I've always thought it was entirely wrong to do that especially with a huge multi-gig file. Anyway, the way I got around it was using a download manager like GetRight. Getright intercepts all IE clicks on files and handles the downloads for you and doesn't do the copy nonsense. I really like Getright because it allows you to set up folders that you can quickly pick when dowloading (i.e. I made a Tivo Dumps folder and can quickly pick that now). I think there are other Download managers out there and I've tried a couple but in the end I recommend Getright. Hope that helps.

Tweaky,

I get right at 1.10 MB/s downloading a 1.2GB file on my 100MB full duplex network where the Tivo goes into a 100MB switch and then goes to a linksys 10/100 switch which is also connected to my computer.

Blue Duck

tweaky
05-22-2002, 08:33 AM
I can verify that Download Accelerator does NOT work.

AlphaWolf
05-22-2002, 09:11 AM
I would prefer to use download accelerator myself, getright requires spyware to be installed in order to run.

gosquad
05-22-2002, 10:17 AM
Originally posted by paddy
Hi Gosquad,

I've installed your application as directed, but when I click on one of the shows to download I get the following in my browser:

tyhttpd is running on port: 2844

INTERNAL SERVER ERROR
action_mfsstream '/Outside the Lines/1703936/56785 56799 56809 56810' ''
couldn't execute "tyhttpd": no such file or directory

I have confirmed that tyhttpd is in my path. If I go to any directory I can type tyhttpd and get the following message:

ERROR, usage: tyhttpd portnum contentlength -s fsid1 fsid2

The difference for me is that my tivoweb is installed off of / instead of in a /var subdir, I'm not sure if that makes any difference. I am using your .91 release and my perms are set to 755 on the tyhttpd and mfs_stream files. Any help would be appreciated.

Paddy

paddy, this could be because tyhttpd is in your $PATH in your bash shell, but not in the global. Try copying it to /bin.. If that doesn't work, let me know. In the next version, I plan on having a .cfg file to let you specifiy these types of things.

gosquad

gosquad
05-22-2002, 10:19 AM
Originally posted by tweaky
I can verify that Download Accelerator does NOT work.


Hmm, any idea how it handles downloads? Since my server is NOT a 100% complete (more like 1%) httpd server, it could be confusing Mr. Download Accelerator. Although it's replies are valid. Perhaps I will download this and figure out what's happening.

gosquad

AlphaWolf
05-22-2002, 11:07 AM
gosquad: I don't know much about the HTTP spec, what I do know is that download accelerator sends multiple resume requests, because it threads the download into multiple parts to speed it up.

CyberMop
05-22-2002, 02:31 PM
I thought this had to be too easy... This is much easier than all the other stuff I was reading I had to do in order to get video out of this thing... But this module will not work for me...

First I was getting an error when I clicked on a recording to extract video the tyhttpd did not exist... So, as suggested, I went into the mfsstream.itcl file and told it where to find the file....

Now it brings up the next screen with the shows and the links to click on for the while file or the files parts... Problem is when I click on them IE asks me where I want to save them, I select a location on my hard drive and then it says the download is complete and the is empty... I had a firewall running and I shut it down, but I still have the same problem... I have completly re-started the TiVo, but this is still not any help..... Suggestions.....


Thanks!

gosquad
05-22-2002, 02:46 PM
Originally posted by AlphaWolf
gosquad: I don't know much about the HTTP spec, what I do know is that download accelerator sends multiple resume requests, because it threads the download into multiple parts to speed it up.

Aha! That could be why. I don't support the Content-Range: header. and unless someone wants to add support for this in mfs_stream.. it ain't gonna happen. :)

gosquad

gosquad
05-22-2002, 02:47 PM
Originally posted by CyberMop
I thought this had to be too easy... This is much easier than all the other stuff I was reading I had to do in order to get video out of this thing... But this module will not work for me...

First I was getting an error when I clicked on a recording to extract video the tyhttpd did not exist... So, as suggested, I went into the mfsstream.itcl file and told it where to find the file....

Now it brings up the next screen with the shows and the links to click on for the while file or the files parts... Problem is when I click on them IE asks me where I want to save them, I select a location on my hard drive and then it says the download is complete and the is empty... I had a firewall running and I shut it down, but I still have the same problem... I have completly re-started the TiVo, but this is still not any help..... Suggestions.....


Thanks!

Have you tried moving the mfs_stream executable to /bin?

This will all be fully configurable (well within reason) in the next release. I swear. :)

gosquad

CyberMop
05-22-2002, 02:56 PM
Originally posted by gosquad


Have you tried moving the mfs_stream executable to /bin?

This will all be fully configurable (well within reason) in the next release. I swear. :)

gosquad

DAMN! It Worked!!!! Transfering at 1.47 MB/Sec!!!! Thanks for the fast reply.... 1 Question tho... Is this setup to run with the lowest possible priority so It will not cause problems with recording and viewing????

gosquad
05-22-2002, 03:06 PM
Originally posted by CyberMop


DAMN! It Worked!!!! Transfering at 1.47 MB/Sec!!!! Thanks for the fast reply.... 1 Question tho... Is this setup to run with the lowest possible priority so It will not cause problems with recording and viewing????

RTFM! :)

Installation
------------

1) copy mfs_stream (this is compiled with pri1) AND tyhttpd to anywhere in your PATH. If you don't know what this is, use /bin.


Two questions answered in one line! I can't believe how good I am at tech writing. haha.

gosquad

keither
05-22-2002, 03:14 PM
Regarding download accelerator --

While it WON'T increase your speed, you could set up the web server to handle content-length in 512MB chunks... :)

paddy
05-22-2002, 06:26 PM
Originally posted by gosquad


RTFM! :)

Installation
------------

1) copy mfs_stream (this is compiled with pri1) AND tyhttpd to anywhere in your PATH. If you don't know what this is, use /bin.


Two questions answered in one line! I can't believe how good I am at tech writing. haha.

gosquad

This worked for me too gosquad. Thanks for the help. :) I just wish I would get better than 600k/sec with my TurboNet. I think thats about what I was getting with TivoApp, but either way you did a great job with this and I look forward to any new features you add. :)

swede67
05-22-2002, 07:33 PM
Gosquad,

First of all, great job on the module, now I can take NFS out of the extraction picture. I did have one small issue - I don't run my TivoWeb on the standard port. Your calculation of the serverName does not account for this, and therefore the download will not work. I created a workaround by changing:

serverName = serverName.substring(0,serverName.indexOf("/"));

to

serverName = serverName.substring(0,serverName.indexOf(":"));

which fixes the the custom port problem, but breaks the server running on a standard port. It would be easy to account for either situation, but I will leave that up to you. :D

Any way, thanks again for your work.

JJBliss
05-22-2002, 09:55 PM
Nice work Gosquad...

Quick turnaround on versions and revisions RULE !!

Although, I'm still seeing Tivoweb getting hosed if you cancel a download before it completes..

Also, is there any way to kill the "zombie" process ?

The following is what I see after I cancel a process (before the newest version, the tyhttpd daemon just waited around out there):




root 125 0.0 0.4 612 128 ? S 01:55 0:00 /var/hack/elseed -i A
root 127 7.1 6.8 7408 1904 ? R 01:55 1:12 tivosh /var/hack/mvch
root 128 0.0 0.0 0 0 ? Z 01:58 0:00 (tyhttpd <zombie>)
root 137 0.0 1.1 1096 324 ? S 02:03 0:00 sleep 3600
root 138 0.0 0.0 0 0 p0 SW 01:52 0:00 /bin/bash -login
root 139 0.0 0.0 0 0 p0 RW 01:52 0:00 ps aux
bash-2.02#




Any ideas ?

JJ

Switch17
05-22-2002, 10:04 PM
I've installed your application as directed, but when I click on one of the shows to download I get the following in my browser:

tyhttpd is running on port: 2844

INTERNAL SERVER ERROR
action_mfsstream '/Outside the Lines/1703936/56785 56799 56809 56810' ''
couldn't execute "tyhttpd": no such file or directory

Paddy, I was having that same problem and it just now hit me what I was doing wrong. It was simply not following directions correctly. You need to place the mfs_stream, tyhttpd and tyhttpd.c files all in the /bin root sub-directory. It does not go in the /var/bin sub-directory.

gosquad
05-22-2002, 10:32 PM
Originally posted by JJBliss
Nice work Gosquad...

Quick turnaround on versions and revisions RULE !!

Although, I'm still seeing Tivoweb getting hosed if you cancel a download before it completes..

Also, is there any way to kill the "zombie" process ?

The following is what I see after I cancel a process (before the newest version, the tyhttpd daemon just waited around out there):



snip



Any ideas ?

JJ

JJBliss, thanks!

Yes, I have seen these damn zombie processes laying around as well. You see, I've been programming in Java for faaaar too long and am so used to nice Mr. Garbage Collector. :) I will try to find out what I'm doing wrong..

I haven't seen tivoweb die completely, but I will play around with cancelling downloads and see if i can make it crash and burn.

Cheers,
gosquad

gosquad
05-22-2002, 10:37 PM
Originally posted by swede67

I created a workaround by changing:

serverName = serverName.substring(0,serverName.indexOf("/"));

to

serverName = serverName.substring(0,serverName.indexOf(":"));

Any way, thanks again for your work.

Swede, thanks for the kind words and the bug. :) It will be fixed in the next release (tomorrow I hope). Even though it seems you're the only one running it on some wacked-out port. :)

gosquad.

JJBliss
05-22-2002, 10:38 PM
Originally posted by gosquad


I haven't seen tivoweb die completely, but I will play around with cancelling downloads and see if i can make it crash and burn.

Cheers,
gosquad

Update:

Ok. Tivoweb doesn't die completely. I still have control and quick response of all the modules EXCEPT mfsstream.

Works GREAT except when you cancel a download.

Still.. Kudos to a nice job.

Now, if we can get ANOTHER module that'll launch jdiner vsplit DIRECTLY from the Tvioweb app (excuse me, I just woke from a nap, and that dream is still in my head) and then auto mux it..

:p

Thanks again, man

JJ

AlphaWolf
05-22-2002, 11:12 PM
I think jdiner is working on a replacement for mfs_stream which spits out the finalized stream (extract, demultiplex, filter, then multiplex real time).

It should probably be compatible with gosquads module when it comes.

DSSPlayer
05-23-2002, 06:32 PM
Anyone know how to re-import a TY stream back into the DTivo? i.e. to save space. -
1) export a show to a .ty file.
2) delete the show from the Now Showing list
3) At a later date, re-import the .ty file back into Now Showing from an external NFS archive.

Is this possible???

SuperVHS
05-23-2002, 06:35 PM
SA TiVos shipped with 1.2 and 1.3 software had scripts on them that clearly showed that videos could be loaded onto the TiVo and properly show up on the Now Showing list.

The scripts that were on 1.2 and 1.3 s/w tivios were complete and had several steps:

Load the movie:
exec ele2pestriple videofile.mpv videofile.mpa $mfsPath

Create video data:
Date and Time
Recording Length
Title and Description
Expiration
etc......
the above loaded into Now Showing

So, It is possible to load a video onto the TiVo (at least with 1.2 and 1.3 software)

keith721
05-23-2002, 07:24 PM
it's a Sony SVR-2000 standalone, but the ele2pestriple binary executable file is still on my system, which came from the store with 2.5.1 installed. the file is located in the path /tvbin

bash-2.02# ele2pestriple -help
Usage: ele2pestriple [options] [videofile] [audiofile] outputfile
Options:
-help This help message
-video Video file only
-audio Audio file only
-caption Close captions present
-macrovision Macrovision encode
-blocksize Set the blocksize (default 128K)
-uneven Allow for uneven files
bash-2.02#
i *really* don't want to screw up my MFS database, but ya just gotta wonder if it still works... :D

gosquad
05-23-2002, 10:44 PM
Hey all.. Just a quick status report..

I have made a .cfg file so you can configure what information the module shows, and where the executables reside.

I have fixed the javascript bug that was reported by swede67.

And, best of all, I have about 90% done on a new tyhttpd that is MUCH more robust than the last one. It runs on one port. It can handle up to five concurent transfers. It won't zombie and go out of control. and it runs all the time so you don't have to click twice to get a .ty. just click on the name or the fsid and away you go. so now that i think about it, it doesn't use the javascript at all anymore. haha. ignore #2 above. :) I should have this out tomorrow. I hope. If work doesn't get in the way. :)

cheers,
gosquad

gosquad
05-25-2002, 04:58 PM
Ok, here's v.94 of the web modules. lots of new stuff.

tyhttpd is now run in rc.sysinit and will serve up to 'n' concurrent streams.

added a .cfg file file.

read the readme.txt for installation instructions. sorry, but i have to run! :) let me know if you find anything wrong!

enjoy!

gosquad

gosquad
05-25-2002, 05:14 PM
Sorry guys, I had to take it down.. there was a big bug in it.. :) I will fix it and repost soon..

Sorry again.

gosquad

gosquad
05-25-2002, 05:57 PM
Ok, here you go.. this should work a-ok..

enjoy..
gosquad

gosquad
05-26-2002, 09:39 AM
Ok, since this has been downloaded 35 times and no complaints, I assume it's working well? :)

I've found one big bug.. If you try to run this through an apache proxy, you will get a 0 byte .ty file. I have no idea why. But I'm looking into it. If you're using a proxy and want to let me know if you've had any luck, I'd appreciate it.

Thanks,
gosquad

angra
05-26-2002, 09:47 AM
Well I was downloading between your posts :)
I just got it, installed, and everything seems much smoother except for one odd difference, which I got over anyway.

out of the box, if I click on a show name, I get a screen of ty. If I click "save-as" I get a 4 byte file.

I do run a non-standard browser (opera), which is sometimes a bit odd in its performance. Also, I was able to get over the problem easily by explicitly telling my browser what to do with .ty extension links. So, this isnt a complaint per-se, just a dutiful testing report.

Karpa
05-26-2002, 11:11 AM
Gosquad,

When I try to d/l a .ty, the browser cannot seem to find port 2000. These are the important parts of rc.sysinit and mfsstream.cfg below. mfs_stream and tyhttpd are in /bin. Any idea what is wrong?


Thanks
Karpa

rc.sysinit:

echo "rc.sysinit is complete"

/bin/bash </dev/ttyS3 >& /dev/ttyS3 &
tnlited 23 /bin/bash -login &
insmod -f /lib/modules/ax88796.o macaddr=010203 timing=5
ifconfig eth0 192.168.1.200 netmask 255.255.255.0 up
route.tivo add default gw 192.168.1.1
/tivo-bin/tivoftpd

/path/to/tyhttpd 2000 4 >> /dev/null &

mfsstream.cfg:

#the header that will be displayed
header::<TH>Title</TH><TH>Episode</TH><TH>Description</TH><TH>Date</TH><TH>Size
#the content displayed
content::<TR><TD nowrap><A href="%title%.ty" onClick="return setLocation(%port%
#the path that contains mfs_stream
path::/bin
#the port that tyhttpd is running on.
port::2000

gosquad
05-26-2002, 11:33 AM
Originally posted by Karpa
Gosquad,

When I try to d/l a .ty, the browser cannot seem to find port 2000. These are the important parts of rc.sysinit and mfsstream.cfg below. mfs_stream and tyhttpd are in /bin. Any idea what is wrong?

/path/to/tyhttpd 2000 4 >> /dev/null &





change /path/to/ to the actual path that contains tyhttpd. :)

i have mine in /var/hack/tivoweb-tcl/

gosquad

gosquad
05-26-2002, 11:35 AM
Originally posted by angra
Well I was downloading between your posts :)
I just got it, installed, and everything seems much smoother except for one odd difference, which I got over anyway.

out of the box, if I click on a show name, I get a screen of ty. If I click "save-as" I get a 4 byte file.

I do run a non-standard browser (opera), which is sometimes a bit odd in its performance. Also, I was able to get over the problem easily by explicitly telling my browser what to do with .ty extension links. So, this isnt a complaint per-se, just a dutiful testing report.

hmm. strange, what 4 bytes are in the file? I only tested it with wget and ie 6, so thanks for the report!

gosquad

angra
05-26-2002, 11:48 AM
I could be mistaken about the 4 :). I'll go make it happen again and post what I get.

angra
05-26-2002, 11:53 AM
turns out I was way off:

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<HTML><HEAD>
<TITLE>404 Not Found</TITLE>
</HEAD><BODY>
<H1>Not Found</H1>
The requested URL was not found on this server.
</BODY></HTML>

that's from "save-target-as"

I tried with IE:
click: works correctly
save-as: IE could not find the site

so, this may all be working correctly, and my browser (opera) just needs nudging to work right.

aramis
05-26-2002, 12:03 PM
Thanks for such a useful bit of code, gosquad!

I found one small problem w/ .94 that seems to show up when a show is currently recording on my D-Tivo. I'm not sure if it's happening any time a recording is in progress or only when a show very recently started, but I'm getting this error on the MfsStream listing:
INTERNAL SERVER ERROR
action_mfsstream '/' ''
argument to math function didn't have numeric value

I found the size calculation in the printFsidInfo function was throwing that error. I wrapped the calculation in a try/catch like below, and it works, displaying nothing as the size. I don't know if anyone else is seeing the same problem, but any chance you could incorporate this in any future releases?

Here's the block of code (starts at line 109):



try {
set size [expr { double( $size ) * double (1024) }]
if { $size > 2147483648.0 } {
set size 0
}
regexp {(.*)\..*} $size junk size
set fsidInfo(size) $size
} catch errCode {set fsidInfo(size) 0}


Thanks again for writing this! I'm just starting to play w/ extraction, and this makes it so much easier to get the data out of the Tivo. Now if I can just get that "perfect" MPG stream parsed out of the mess Tivo calls an MPEG program stream... ;-)

Best regards,
Aramis

gosquad
05-26-2002, 12:12 PM
Originally posted by angra
turns out I was way off:

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<HTML><HEAD>
<TITLE>404 Not Found</TITLE>
</HEAD><BODY>
<H1>Not Found</H1>
The requested URL was not found on this server.
</BODY></HTML>

that's from "save-target-as"

I tried with IE:
click: works correctly
save-as: IE could not find the site

so, this may all be working correctly, and my browser (opera) just needs nudging to work right.

aha.. well when clicking on a link, it uses javascript to redirect you to the tyhttpd.. so that's why that doesn't work. I did it so it would work through a proxy and you don't have to hard code your ip anywhere in the .cfg file.

So I'll consider this a 'feature' :)

gosquad

gosquad
05-26-2002, 12:27 PM
I just can't stop today. :)

here's v.95. I think this might be the one I'll finally throw into the sticky.. unless someone finds something really wrong with it. this fixes the proxy bug and Aramis' size bug.

Enjoy.
gosquad

gopherhockey
05-26-2002, 12:52 PM
I like it, very nice!

Now I have a simple way to extract files if I'm actually at home, and a way to exctract them to my file server (using mfs_extract_tivoweb) if I'm away. (love unix services for win2k and its nfs capabilities)

Nice job...

Domenic
05-26-2002, 03:41 PM
Any chance that a future release could do the math for the fields that return info in seconds since Jan.1, 1970 so that the web page displays that actual date?

Thank you for the awesome app!

DOM

gosquad
05-26-2002, 04:33 PM
Originally posted by Domenic
Any chance that a future release could do the math for the fields that return info in seconds since Jan.1, 1970 so that the web page displays that actual date?

Thank you for the awesome app!

DOM

Yeah.. I thought about doing that and then forgot. :) I'll do it for .96.. I'd like you to be able to specify the clock format as well.. we'll see. :)

gosquad

lsmod
05-26-2002, 04:39 PM
Uh oh.

Where have I gone wrong? Clicking on MfsStream from the main TivoWeb page gives.



INTERNAL SERVER ERROR
action_mfsstream '/' ''
can't read "header": no such variable


Has to be something simple, right?

-Z

gosquad
05-26-2002, 05:31 PM
Originally posted by lsmod
Uh oh.

Where have I gone wrong? Clicking on MfsStream from the main TivoWeb page gives.



INTERNAL SERVER ERROR
action_mfsstream '/' ''
can't read "header": no such variable


Has to be something simple, right?

-Z

that means it can't find (or read) the modules/mfsstream.cfg file. make sure it's in modules/ off your tivoweb dir.

gosquad

lsmod
05-26-2002, 08:38 PM
Originally posted by gosquad


that means it can't find (or read) the modules/mfsstream.cfg file. make sure it's in modules/ off your tivoweb dir.

gosquad

Ermm...




bash-2.02# ls -l /var/hack/tivoweb-tcl/modules/
total 177
-rw-r--r-- 1 0 0 89284 Mar 17 19:11 0ui.itcl
-rw-r--r-- 1 0 0 13757 Mar 17 19:11 index.itcl
-rw-r--r-- 1 0 0 4593 Mar 17 19:11 info.itcl
-rw-r--r-- 1 0 0 7544 Mar 17 19:11 mail.itcl
-rw-r--r-- 1 0 0 3258 Mar 17 19:11 mfsbrowser.itcl
-rw-r--r-- 1 0 0 481 May 26 18:20 mfsstream.cfg
-rw-r--r-- 1 0 0 9254 May 26 18:18 mfsstream.itcl
-rw-r--r-- 1 0 0 729 Mar 17 19:11 remount.itcl
-rw-r--r-- 1 0 0 8776 Mar 17 19:11 resources.itcl
-rw-r--r-- 1 0 0 13921 Mar 17 19:11 sched.itcl
-rw-r--r-- 1 0 0 661 Mar 17 19:11 theme.itcl
-rw-r--r-- 1 0 0 2435 Mar 17 19:11 tvres-2.0.res
-rw-r--r-- 1 0 0 3442 Mar 17 19:11 tvres-2.5.res
-rw-r--r-- 1 0 0 12058 Mar 17 19:11 webremote.itcl
bash-2.02#
bash-2.02# cat mfsstream.cfg

#the header that will be displayed
header::<TH>Title</TH><TH>Episode</TH><TH>Description</TH><TH>Date</TH><TH>Size</TH>
#the content displayed
content::<TR><TD nowrap><A href="%title%.ty" onClick="return setLocation(%port%, '%size%/%path% -s %allparts%/%title%.ty');">%title%</A></TD><TD>%episode%</TD><TD>%description%&nbsp;</TD><TD>%date%</TD><TD nowrap>%dispsize% KB</TD></TR>
#the path that contains mfs_stream
path::/var/hack/
#the port that tyhttpd is running on.
port::2000bash-2.02#
bash-2.02#


I was thinking that mfsstream.itcl needed to be executable, but none of the files in modules are, so I don't think that's it.

Perhaps something else hosed in TivoWeb?

-Z

dlang
05-26-2002, 08:49 PM
in the mfsstream.cfg there is the path setting to find the tyhttpd program, it defaults to /var/hack, is that correct for your system?

gosquad
05-26-2002, 09:31 PM
hmm, well I basically use $tivowebdir/modules/mfsstream.cfg
it's weird that this isn't working.. have you modified mfsstream.cfg at all? could be a dos2unix problem...

gosquad

idokle
05-26-2002, 09:59 PM
man sucha great utility. I have one question though; Right now I use netcat and ExtractStreamDx1 to get a .ty file but when I convert it to mpeg about 3/4 of the movie my audio and video get out of sync. Is this still going to happen if I use this utility?

P.S. Icant really test it at this moment cause I'm doing an extraction.

mpauley
05-27-2002, 12:16 AM
idokle -

Try this and see if your conversion works out better:

http://www.dealdatabase.com/forum/showthread.php?s=&threadid=13565

Mike

AlphaWolf
05-27-2002, 12:46 AM
Originally posted by idokle
man sucha great utility. I have one question though; Right now I use netcat and ExtractStreamDx1 to get a .ty file but when I convert it to mpeg about 3/4 of the movie my audio and video get out of sync. Is this still going to happen if I use this utility?

P.S. Icant really test it at this moment cause I'm doing an extraction.

your problem is being caused by ExtractStreamDx1, which is now obsolete. You should be using mfs_stream instead, which is what gosquads tivoweb module includes and uses by default.

oPossum
05-27-2002, 01:13 AM
Any title that has a '&' in it, like 'Law & Order' shows '%title%' rather than '&' - 'Law %title% Order'.

oPossum
05-27-2002, 01:47 AM
IE6 complains about syntax on a few lines (44,49,50,51,53,54,55,59,61,65,79). The error message is "Error: Expected')'." I don't see anything wrong with those lines.

idokle
05-27-2002, 07:11 AM
mpauley,

thanx so much for the help man. I'll try that after I finish the Kobe Bryant Story. hehe. I Love the Lakers baby. Kobe is da man.

sorry. You guys rock.

gosquad
05-27-2002, 09:10 AM
Originally posted by oPossum
Any title that has a '&' in it, like 'Law & Order' shows '%title%' rather than '&' - 'Law %title% Order'.


Hmm, just noticed this last night as well. I'll look into it.

Workaround: don't record shows with '&' in the title. :) j/k

gosquad

gosquad
05-27-2002, 09:11 AM
Originally posted by oPossum
IE6 complains about syntax on a few lines (44,49,50,51,53,54,55,59,61,65,79). The error message is "Error: Expected')'." I don't see anything wrong with those lines.

now this is a strange one. Do the links still work when you click them?

gosquad

gosquad
05-28-2002, 06:26 PM
Well.. here's v.96.. added a copule new features and fixed a bug. My next step is to add 'EditTitle.tcl' functionality so you'll be able to modify titles, descriptions, etc. from within tivoweb.. That should prove VERY useful, IMHO.

enjoy..
gosquad

..oh I almost forgot.. You might have to fiddle with whichever .css file you're using with tivoweb.. I've made each line a table now so you can actually see it working as it pulls the information off the tivo.. however all the .css files I had (technophobe, sortof, etc) would put '1em' space after each table.. not a big deal, but might be annoying :)

Marksmanaz
05-28-2002, 09:19 PM
I have MfsStream installed but when I click on the name of the program to down load it says:

"this page cannot be displayed"

Here is what is in the address bar using IE6:

http://10.0.0.101:2000/180355072/.2F.var.2F.hack.2F.tivoweb-tcl%20-s%2084397%2084397%20/NHL%20Hockey.ty

I'm sure I'd did something wrong, just don't know what it is.

Thanks,
Marksmanaz

Marksmanaz
05-28-2002, 09:21 PM
The address it goes to is this:

10.0.0.101:2000/180355072/.2F.var.2F.hack.2F.tivoweb-tcl%20-s%2084397%2084397%20/NHL%20Hockey.ty

Marksamanaz

gosquad
05-28-2002, 10:25 PM
Originally posted by Marksmanaz
The address it goes to is this:

10.0.0.101:2000/180355072/.2F.var.2F.hack.2F.tivoweb-tcl%20-s%2084397%2084397%20/NHL%20Hockey.ty

Marksamanaz

do you have mfs_stream in /var/hack/tivoweb-tcl? If not, change the .cfg file.....

and make sure mfs_stream is chmod 755'ed!

gosquad

Marksmanaz
05-28-2002, 10:26 PM
I put the "quotes" in the rc.sysinit like this:

"/var/hack/tivoweb-tcl/tyhttpd 2000 4 >> /dev/null &"

My bad :)

Thanks,

Marksmanaz

gosquad
05-29-2002, 10:57 AM
well.. that was easy.. I've added the abilty to delete a title, change the title, episode and description. much thanks to netboy for the code.. I'll post .97 tonight after work. I might need some help in getting a nice layout for all the new links. You'll see what i mean when i post it.. if anyone is good at html and has a knack at nice ui/hf work, let me know. :)

gosquad

tweaky
05-29-2002, 11:11 AM
gosquad,

How about being able to change the date and time also? Similar to editTitle..

gosquad
05-29-2002, 11:30 AM
Originally posted by tweaky
gosquad,

How about being able to change the date and time also? Similar to editTitle..

Ok, I never saw the point in that.. but i'll add it in.. :)

gosquad

tweaky
05-29-2002, 11:39 AM
It just allows you to reorder/group files together....

Wooly
05-30-2002, 05:29 PM
edited out - double post by accident

Wooly
05-30-2002, 05:34 PM
Do you see any value in adding a little section at the top or bottom of the MfsStream page that provides some space useage information...sort of like this:

Disk Space Used: xxx MBytes
Disk Space Available: xxx MBytes

Alternatively (and more work) how about this:
Hours Recorded: xxx
Hours Available: xxx

It would be nice to be able to have the information available, and it really isn't anywhere else that I know of (at least in a user-friendly fashion, whereas your module IS).

mrblack51
05-30-2002, 05:58 PM
let me just address this issue, as just about everyone and their cousin has asked for the ability to see how many hours have been recorded.

the reason this has never really been developed, is because by design, the tivo should always be full. If you have suggestions turned on, then the tivo will always be full, but delete the oldest suggestions to make room for new programs.

now, many of you may say "but i don't use suggestions". well, that may be the case, but tivo wants you to use suggestions, and since most of the developers use suggestions, it hasn't been an issue. (i think i recall tivolutionary addressing this)

after discusing this with a few people, a better option might be to be indicate the ammount of space/hours used by suggestions vs the total space/hours available. this would essentially equate to free space.

not trying to be an idea crapper, just bring up some issues that might be relavant

gosquad
05-30-2002, 10:13 PM
Hmm.. Well..

1) this is a great idea

2) I really haven't looked into MFS that much to see how one could obtain this information. Perhaps just show the space used by /Recording/NowShowing or something.. I'll look into it some more.

Sorry to everyone about v.97 of this.. I have it about 90% done, just finishing up the date modification. Things have been crazy around here. Just got my dvd-r drive today, too.. so that doesn't help. :)

gosquad

Switch17
05-31-2002, 08:14 AM
Originally posted by lsmod
Uh oh.

Where have I gone wrong? Clicking on MfsStream from the main TivoWeb page gives.

code:

INTERNAL SERVER ERROR
action_mfsstream '/' ''
can't read "header": no such variable
I'm having this same problem with the new 96 version. I know I didnt' have any problems with the earlier 92 version. Since 92, I went and redid an entire drive by reextreming, and then using the extreme upgrade. I did have 92 working fine manually


Originally posted by gosquad

that means it can't find (or read) the modules/mfsstream.cfg file. make sure it's in modules/ off your tivoweb dir.

gosquad

Both moduels are in the the /tivoweb-tcl/modules directory. I've actually remove them and resent them a few times just to make sure they didn't somehow become dos files.


Originally posted by dllang

In the mfsstream.cfg there is the path setting to find the tyhttpd program, it defaults to /var/hack, is that correct for your system?

I'm unsure about this? Where in the mfsstream.cfg would set a path for the tyhttpd? Are you referring to the mfs_stream file? I have edited the path for mfs_stream in the mfsstream.cfg file to be /tivoweb-tcl, which is the new directory from the xtreme upgrade.

In rc.sysinit, my last line is as follows:
/tivoweb-tcl/tyhttpd 2000 4 >> /dev/null &

I'm using an T-60 on a Win98 system (yeah I know, not the best) with IE 6.0 if that helps anyone

gosquad
05-31-2002, 10:58 AM
Originally posted by Switch17

I'm unsure about this? Where in the mfsstream.cfg would set a path for the tyhttpd? Are you referring to the mfs_stream file? I have edited the path for mfs_stream in the mfsstream.cfg file to be /tivoweb-tcl, which is the new directory from the xtreme upgrade.

In rc.sysinit, my last line is as follows:
/tivoweb-tcl/tyhttpd 2000 4 >> /dev/null &

I'm using an T-60 on a Win98 system (yeah I know, not the best) with IE 6.0 if that helps anyone

Hmm. Yes, I did mean mfs_stream.. It looks like you have everything set up properly. PM me and I'll email you a debugging version you can try out so we can find out the problem..

gosquad

gosquad
06-02-2002, 10:53 AM
Here's the newest one for you all.. Read the readme to find out the exciting new features. It's late. I'm hungry. Going to eat. :)

gosquad

Switch17
06-02-2002, 02:24 PM
gosquad

I ran the modified version 96, but never received a 'Copy This' dump telling the path in my browser.

I grabbed the 97 version this morning, and can now at least see what I've got recorded, and can edit any of the titles, descriptions, etc. But when I click on any of my show titles I get a 'This Page cannot be displayed'. The web address popping up is this

"http://192.168.0.178:2000/0/.2F.bin%20-s%2084992%2085246%2085335%2085346%2085366%20/K-Pax.ty"

Not sure whats wrong. Everything else seems to work with the TivoWeb.

gosquad
06-02-2002, 02:32 PM
Originally posted by Switch17
gosquad

I ran the modified version 96, but never received a 'Copy This' dump telling the path in my browser.

I grabbed the 97 version this morning, and can now at least see what I've got recorded, and can edit any of the titles, descriptions, etc. But when I click on any of my show titles I get a 'This Page cannot be displayed'. The web address popping up is this

"http://192.168.0.178:2000/0/.2F.bin%20-s%2084992%2085246%2085335%2085346%2085366%20/K-Pax.ty"

Not sure whats wrong. Everything else seems to work with the TivoWeb.

This means that your tyhttpd isn't running. be sure to run it. :) It's weird that my modified version didn't work. strange. I didn't change anything with the .cfg file in .97, but hey.. if it works now great! :)

gosquad

gosquad

Switch17
06-02-2002, 07:37 PM
This means that your tyhttpd isn't running. be sure to run it

I think the extreme upgrade is doing something to cause a conflict somwhere. If I try to run tyhttpd manually, I get the following error

ERROR, usage: ./tyhttpd portnum maxnumconnections

A search here and at the Tivo community forums turned up blank. Any ideas what's causing this?

Is anyone else here using the the web module after setting up your tivo with extreme and then the extreme upgrade? I had this all running on a manually hacked tivo.

gosquad
06-02-2002, 09:09 PM
Originally posted by Switch17


I think the extreme upgrade is doing something to cause a conflict somwhere. If I try to run tyhttpd manually, I get the following error

ERROR, usage: ./tyhttpd portnum maxnumconnections

A search here and at the Tivo community forums turned up blank. Any ideas what's causing this?

Is anyone else here using the the web module after setting up your tivo with extreme and then the extreme upgrade? I had this all running on a manually hacked tivo.

I'll take it you're a unix newbie and not flame you with 100000 RTFMs.. :)

Installation:

5) add this line to /etc/rc.d/rc.sysint
"/path/to/tyhttpd 2000 4 >> /dev/null &"

2000 is the port number and 4 is the number of concurrent streams allowed.

gosquad

jdiner
06-02-2002, 11:01 PM
gosquad:

Check the sticky group. A new version of mfs_stream went up with source code. Technically just the mfs_stream.c file. But that was all that changed.

I found a memory leak in the code, you might already have it fixed. But it was in my code, i.e. part of the mfs_stream.c.

Was going to quickly I guess. Anyway, since you have been using it for others things I thought I would let you know...

--jdiner

dlang
06-02-2002, 11:20 PM
I ran into one problem several days ago where a quote (in this case a single quote ' ) in a show name caused the MfsStream web module to crash. I renamed the series so I don't know if the newest version still has this bug

gosquad
06-03-2002, 09:50 AM
Originally posted by jdiner
gosquad:

Check the sticky group. A new version of mfs_stream went up with source code. Technically just the mfs_stream.c file. But that was all that changed.

I found a memory leak in the code, you might already have it fixed. But it was in my code, i.e. part of the mfs_stream.c.

Was going to quickly I guess. Anyway, since you have been using it for others things I thought I would let you know...

--jdiner

jdiner.. thanks for the reminder.. I'll put that in tonight.

gosquad

gosquad
06-03-2002, 09:51 AM
Originally posted by dlang
I ran into one problem several days ago where a quote (in this case a single quote ' ) in a show name caused the MfsStream web module to crash. I renamed the series so I don't know if the newest version still has this bug

Hmm, I haven't seen this.. anyone else?

gosquad

gosquad
06-03-2002, 10:30 AM
I've updated the v97 version in the sticky with jdiner's new mfs_stream. From now on, I'll post the newest version in there.

cheers,
gosquad

AlphaWolf
06-04-2002, 01:54 AM
gosquad: I've got an idea for a new feature (actualy bubblelamps post earlier gave it to me), I figured your project would be best suited for it since its already in this area.

Since a lot of people are always curious of how much of their HDD space has taken up, I figure it wouldn't be that difficult for you to modify your module to tally up all of the space that the TYStreams are currently using, and display it readily somewhere in tivoweb. The user could easily approximate (bearing VBR in mind) how much recording time is available based on that, minus the OS space. (either that or a rough estimate could be displayed in the module if the exact hard disk size and ammount of space being used by the tivo OS can be determined somehow)

gosquad
06-04-2002, 08:09 AM
Originally posted by AlphaWolf
gosquad: I've got an idea for a new feature (actualy bubblelamps post earlier gave it to me), I figured your project would be best suited for it since its already in this area.

Since a lot of people are always curious of how much of their HDD space has taken up, I figure it wouldn't be that difficult for you to modify your module to tally up all of the space that the TYStreams are currently using, and display it readily somewhere in tivoweb. The user could easily approximate (bearing VBR in mind) how much recording time is available based on that, minus the OS space. (either that or a rough estimate could be displayed in the module if the exact hard disk size and ammount of space being used by the tivo OS can be determined somehow)

AlphaWolf,

This was exactly was I was thinking as well. The only problem (as you pointed out) is figuring out how much space the OS takes up. It should be a pretty static amount, imho. (minus log files and whatnot). I was also thinking of determining total space in NowShowing as well as space taken up by 'Until I Delete' shows. That might give you a better idea.

I'll look into it (and invite others to as well) to find the best (easiest/as good as we can get/etc) solution.

gosquad

arthur
06-04-2002, 06:42 PM
gosquad,
you're asking for trouble (just kidding)

The way I see it, it's like balancing your accounts or better yet budgetting.
There's the different types of recordings
green
yellow
yellow with exclaimation
and Tivo

I don't know if you ever used quicken, it displays bar charts that reflects income/expense over a period of time.

I think I would like to see (again just kidding, it would be nice, but I'm not requesting)
how much disposable space is available immediately (sum of all tivo recordings) (assuming that it's not a unfilled HD)
How much space would clear up due to Yellow Exclaimation mark recordings, and how finally the yellow that will turn into disposable space.

All this presented as a bar chart with time on X axis and space on Y axis

Nah, I'll settle with anything, even just space available.

THANK YOU for your contribution,
Appreciated

Arthur

jdiner
06-04-2002, 08:45 PM
Should be simple enough. Grab the out of the code of the standard FDISK style commands. This will give you the list of devs from the disk. (Yeah right. Should be a walk in the park.... :)

Then walk the NowPlaying list like so many other programs do. (I grabbed TivoApp's as the core for my own) and add the results up in the tcl code rather than build a list. Pass the size back and do some simple math.

hda4 and 7 are the boot partitions. Full or empty they aren't use for shows.

hda3 and 6 are used for rom files if I rememebr right. (There is a list of TivoFaq for all of this.)


Then you just start subtracting things. But having said all of this... I remember being told that there was a TivoWeb module that did this... Hummm. Who knows. I for one would like the functionality.

--jdiner

mrblack51
06-04-2002, 09:42 PM
hda3 and hda6 are kernel partitions
hda4 and hda7 are OS partitions
hda9 is the var partition

gosquad
06-04-2002, 09:57 PM
Originally posted by mrblack51
hda3 and hda6 are kernel partitions
hda4 and hda7 are OS partitions
hda9 is the var partition

hmm. i wonder if there's a way to do a df on hda3, 6 and 7.. but these should be a standard size for all tivos.. no?

gosquad

drapatin
06-04-2002, 10:06 PM
First

GREAT addition to the community!
'
This rocks!

But.. and she's got a BIG BUTT,
I am getting 30.6k at best.

jdiners tytool is seriously faster
tivoapp is seriously faster.

I have the files in /bin
I have /bin in the cfg
and i have /bin pointed to in rc.sysinit

what am i missing here??

(did I mention.. this ROCKS?)

AlphaWolf
06-04-2002, 11:31 PM
Now that I think about it more, I kinda recall how one of the people who worked at tivo posted on an AVS thread about how the tivo always sets aside 5 gigs for its own purposes, be that the OS, videos that tivo wants you to store for its advertizing spam, etc.

It could possibly be as easy as just querying fdisk (or pdisk) for the size of all of the MFS partitions, add that up, subtract 5 gigs, subtract how much space the tystreams are using=how much actual byte space is left, divided by 1gig/hour=approximate ammount of recording time left.

tweaky
06-05-2002, 06:05 AM
gosquad,

Thanks for adding in the editing abilities for the date and time.. The only problem is that I can't get them to work no matter what. I can change the Title/Description (other than you can't delete something and just insert blank text).

Any ideas?

gosquad
06-05-2002, 09:06 AM
Originally posted by tweaky
gosquad,

Thanks for adding in the editing abilities for the date and time.. The only problem is that I can't get them to work no matter what. I can change the Title/Description (other than you can't delete something and just insert blank text).

Any ideas?

Hmmm.. I never thought about the blank text.. I'll fix that.

I'll double check the date code tonight.. I had it working, but it might be a simple fix for you.. I'll let you know!

cheers,
gosquad

gosquad
06-05-2002, 09:10 AM
Originally posted by drapatin
First

GREAT addition to the community!
'
This rocks!

But.. and she's got a BIG BUTT,
I am getting 30.6k at best.

jdiners tytool is seriously faster
tivoapp is seriously faster.

I have the files in /bin
I have /bin in the cfg
and i have /bin pointed to in rc.sysinit

what am i missing here??

(did I mention.. this ROCKS?)


Hmmmmmm.. Well this is strange. I've consistently got around 800k/s. What browser are you using? Considering I'm using jdiner's mfs_stream it should just as fast as his tytool since it's coming down the same pipe. Anyone else see this?

gosquad

gosquad
06-05-2002, 09:21 AM
Originally posted by AlphaWolf
Now that I think about it more, I kinda recall how one of the people who worked at tivo posted on an AVS thread about how the tivo always sets aside 5 gigs for its own purposes, be that the OS, videos that tivo wants you to store for its advertizing spam, etc.

It could possibly be as easy as just querying fdisk (or pdisk) for the size of all of the MFS partitions, add that up, subtract 5 gigs, subtract how much space the tystreams are using=how much actual byte space is left, divided by 1gig/hour=approximate ammount of recording time left.

Hmm. yes, this does sound very plausible. Now I just need an fdisk.. Let's see if i can compile one. :)

gosquad

drapatin
06-05-2002, 09:36 AM
I dont know how to explain it.

I get 30 and no better.

I am using XP w/ IE6

same as with tivoapp / tytool

gosquad
06-05-2002, 10:54 AM
Well shit.. I have pdisk compiled, but I'm getting the infamous:

[14:59] /var/hack:> ./pdisk /dev/hda
Illegal Instruction

Man, i wish i was good in C. Java has made me sooo lazy. :)

Anyone good with PPC Linux and C?

gosquad

AlphaWolf
06-05-2002, 07:27 PM
I am still learning C, the best thing I have ever written was a demo that drew some hippiesh colored triangles and squares with the opengl API :)

drapatin: thats ass slow, not much better off than using a serial port :/...are you using a classic tivonet? I get relatively decent speeds with my turbonet but a tivonet shouldnt be that far behind...it could be some network overhead in gosquads code but I am not one to know...Maybe you oughta try the version of mfs_export thats not compiled with the lowest priority?

tweaky
06-05-2002, 07:54 PM
I get 1.2 M/s using a cross connect cable between my DTIVO and my computer..

jdiner
06-05-2002, 08:33 PM
Originally posted by gosquad
Well shit.. I have pdisk compiled, but I'm getting the infamous:

[14:59] /var/hack:> ./pdisk /dev/hda
Illegal Instruction

Man, i wish i was good in C. Java has made me sooo lazy. :)

Anyone good with PPC Linux and C?


I am. What do you need?

--jdiner

arthur
06-05-2002, 11:07 PM
Originally posted by tweaky
I get 1.2 M/s using a cross connect cable between my DTIVO and my computer..

Wow,
mine (with turbonet) starts around 800 and drops to just below 700 by the time it finishes.

mpauley
06-06-2002, 06:07 AM
What is the possibility to have the quality of the recording on the chart?

JJBliss
06-06-2002, 06:21 AM
Originally posted by mpauley
What is the possibility to have the quality of the recording on the chart?

Unnecessary for DTivo. All recordings are in BEST quality.

JJ

mpauley
06-06-2002, 06:25 AM
Yeah, I do different qualities for eash sho, depending what I want to do with it. DVDs 720x480, SVCD 480x480 and VCD 352x240.

Mike

gosquad
06-06-2002, 07:55 AM
Originally posted by jdiner


I am. What do you need?

--jdiner

jdiner, I knew you were :) I need a working version of fdisk or pdisk or something I could get information on all the 'non-mfs' partitions.

gosquad

gosquad
06-06-2002, 07:55 AM
Originally posted by mpauley
Yeah, I do different qualities for eash sho, depending what I want to do with it. DVDs 720x480, SVCD 480x480 and VCD 352x240.

Mike

can you record on the dtivo at these different resolutions?

gosquad

arthur
06-06-2002, 09:50 AM
I bet, I'm not the only one nor the first one to think of this, but wouldn't it be super great to be able to play those streams from within the browser, say like asf stream in media player or real player stream?

I undertsand that this requires mod to mfsStream, but I think it would be awesome.
What others think?

Arthur

gosquad
06-06-2002, 11:54 AM
Originally posted by arthur
I bet, I'm not the only one nor the first one to think of this, but wouldn't it be super great to be able to play those streams from within the browser, say like asf stream in media player or real player stream?

I undertsand that this requires mod to mfsStream, but I think it would be awesome.
What others think?

Arthur

Well when jdiner puts his muxing code in, and provided it's fast enough and the bandwidth is there.. (700k/s is what I get and it should be fast enough).. you should be able to play them in your browser.. Since I'll just be sending down "sopranos.mpg" as the title. I will just have to change the header from 'application/ty' to 'video/mpeg' or whatever it is.

gosquad

mpauley
06-06-2002, 01:30 PM
Sorry, I forgot I was in the DTivo section, but no. On the SA u can very easy. I would love to be able to watch a stream as its downloaded. I can help with coding if needed (...I know some VB but l learning more code.)

Mike

gosquad
06-06-2002, 01:55 PM
Originally posted by mpauley
Sorry, I forgot I was in the DTivo section, but no. On the SA u can very easy. I would love to be able to watch a stream as its downloaded. I can help with coding if needed (...I know some VB but l learning more code.)

Mike

well there's no real code involved.. If you can get me something that will spit out mpgs on the tivo, I'll hook it into the web module. The problem is watching AND recording.. you'd have to find a media player like thing that would do that..

gosquad

AlphaWolf
06-06-2002, 02:13 PM
It seems to me like all media players will only stream media that they get ahold of as a half ass attempt to prevent you from being able to play it back on your own independently (they want you to stick to their sucky media sites for all of your needs). You will have to either configure your browser to have a plugin download it, or to just download it strait to the hard drive. If the plugin downloads it, it wont save it anywhere, it deletes it when your done.

arthur
06-06-2002, 07:53 PM
AlphaWolf,

In the old days, I've seen things like ASF Recorder, which allowed you to save streaming files, I'm sure they can be modified to play and save at the same time.

just a thought, I'm sure thinbgs are much better now.

AnotherTiVoUser
07-02-2002, 04:12 PM
A few days ago after rebooting my TiVo, all my /var/hack files were gone.. I must have forgot to unmount my system files.
Anywayz.. I have all my files back in there and telnet and Tivoweb are working fine again.
I put all the mfsstream files back where they should be and the Mfsstream option shows up in TivoWeb.
However, I have files in my Now Showing screen but nothing shows up in the MfsStream page.
I've read and re-read this thread and the readme over and over again so I am pretty sure I didn't miss anything.

Any ideas?

thanks

gregggreg
07-02-2002, 08:18 PM
I'm about a month late with this response, so I apologize, I didn't come across this thread until just now. Why all this hassle with another webserver (tyhttpd) and execing mfs_stream when the TCL code to write out the contents of a ty steam from MFS is about 10 lines long and included on your tivo in /tvlib/tcl/tv/mfslib.tcl in the proc called FromMFS? You could change this slightly and have a very simple way of transferring the ty stream to the user's browser.

Unless mfs_stream is doing some crazy magic that I am unaware of? I am guessing it is doing the same thing that FromMFS does, namely finding the bytes for the given fsid and outputting them (to a file or stdout).

If I am right you can replace all this tyhttpd execing mfs_stream stuff and have everything self-contained within mfsstream.itcl.

Karpa
07-02-2002, 09:08 PM
When I try to download a stream, I click the name of the file and the page changes and the following is displayed in the browser.

tyhttpd is running on port: 4174


The browser then continues to load more of the page for a few minutes, but nothing happens.

Any idea what is wrong?

Thanks

Karpa

Karpa
07-03-2002, 05:24 PM
Along with the above problem, the web module crashes all communication with the TiVO (telnet, ftp, www). I have to unplug the unit and restart it.

Any ideas?

Karpa

SlipShod
07-04-2002, 11:35 PM
Every thing works for me but when I click on the name of a program I want to download I get Page can not be displayed. If I run the tyhttpd manually it works but it doesn't work after I restart the tivo. I am using the extreme upgrade all files are in the /tivoweb-tcl directory which is on the root in the upgrade. I have changed the path to reflect this in the cfg file. It has to be some way that it is not running from the rc.sysinit file. Here is the last part of that file.

if [ ! "$vmstat" = "" ]; then
echo "Starting memory statistic gathering"
vmstat 10 &
fi

[ ! -f /etc/rc.d/rc.sysinit.author ] || /etc/rc.d/rc.sysinit.author

echo "rc.sysinit is complete"

exec < /dev/ttyS3 >& /dev/ttyS3; bash --login

/tivoweb-tcl/tyhttpd 2000 4 >> /dev/null &


If I telnet in and type "./tyhttpd 2000 4" in the tivoweb-tcl directory I can download just fine. please help I must be doing something wrong I am somewhat new to the tivo world and I have serached high and low and can't find the answer. Thanks

****
Nevermind I got it I placed the line before the bash line I read that somewhere and it works great now.

Switch17
07-08-2002, 05:17 PM
For some reason, I can download the ty streams, or at least its saying its downloading them. But then at the end, I get an Error Copying File prompt that says

Cannot create or replace Behind Enemy Lines (or other ty stream): The parameter is incorrect.

Anyone have any ideas?

jdiner
07-08-2002, 07:50 PM
Switch17:

The file is too big for the Windows samba implementation. I normally see that when I try to move a TyStream file from one Windows machine to another.

--jdiner

IndieRockSteve
07-13-2002, 10:56 PM
hey guys, I've got mfs_stream runing with tivoweb, but when i try and download a file bigger than 2gigs i get an error and the download doesn't occur. I'm in linux, so its not a file size error, and i can download anything lower than 2gigs(I'm guessing here actually, the largest file i can get is really 1.3 gigs, which downloads fine, but if i try and download a 2.3gig file, its a no go)

anyone have any ideas?

I'm running 3.0 with mfsstream97 and the 3.0 module file.

thanks!

dlang
07-14-2002, 12:58 AM
I'm running linux and am having trouble downloading files > 2G as well.

the problem is that >2G file support on x86 linux is fairly new (within a year or so) and programs have to be specificly compiled to include large file support.

netscape and mozilla just plain refuse to download files if a zero size is reported (which mfsstream does to avoid IE refusing to download the files), Opera starts the download, but the version I have dies when it hits the 2G boundry

David Lang

gosquad
07-14-2002, 12:32 PM
Hmmm. well I'm not doing anything with files on my end (it's all coming from mfs_stream). It's odd that mozilla or opera won't download it if it goes over 2 gigs. I'm not sending the Content-Size header at all if it's greater than 2.3 gigs. So it sounds like a browser bug.. Since I can't send a content-size of greater than 2.3 gigs due to the http 1.1 protocol. Mozilla in Win32 works great.

gosquad


Originally posted by dlang
I'm running linux and am having trouble downloading files > 2G as well.

the problem is that >2G file support on x86 linux is fairly new (within a year or so) and programs have to be specificly compiled to include large file support.

netscape and mozilla just plain refuse to download files if a zero size is reported (which mfsstream does to avoid IE refusing to download the files), Opera starts the download, but the version I have dies when it hits the 2G boundry

David Lang

dlang
07-15-2002, 01:51 PM
mozilla and netscape appear to abort the download if there is no size given.

Opera starts the download and then aborts when it hits the 2G limit (I am not sure if the limit is in opera not being compiled to support large files or if it's in my kernel)

would it be possible to modify mfsstream to download large streams in multiple chunks?

TivoDvlpr
07-15-2002, 05:46 PM
I'm wondering if there is something missing myself, why call external mfs_stream software and this web server, if you can call FromMFS to write it to out, or modify it to put it right into $chan?

Are we missing something?

It would be pretty clean to have a 100% tcl version with no external software necessary.

gregggreg
07-15-2002, 09:47 PM
Originally posted by TivoDvlpr
I'm wondering if there is something missing myself, why call external mfs_stream software and this web server, if you can call FromMFS to write it to out, or modify it to put it right into $chan?

Are we missing something?

It would be pretty clean to have a 100% tcl version with no external software necessary.

Thank you, TivoDvlpr, I am wondering why no one has responded to my question. Maybe they just missed it? Perhaps they will notice it if we keep discussing it. ;)

If they keep ignoring it and I have a spare hour, I will try to implement it myself as I had no end of trouble trying to get the mfs_stream/tyhttpd thing to work. It just kept sending me zero length files. Maybe it was due to this Linux Mozilla bug that dlang is talking about. We shall see.

keith721
07-15-2002, 10:03 PM
<ramble>
some folks would just rather use a compiled C program, i suppose. there's something to be said about the performance of a binary executable versus an interpreted TCL script. but, many prefer the clarity and simplicity of scripting. as anyone who's used netcat/nc to pipe things over the network has experienced, running an extraction binary at full priority will definitely degrade the recording/playback performance of your TiVo. wonder what kind of performance hit using FromMFS in an extraction script would cause? we shall see...
</ramble>

gregggreg
07-16-2002, 12:39 AM
Originally posted by keith721
<ramble>
some folks would just rather use a compiled C program, i suppose. there's something to be said about the performance of a binary executable versus an interpreted TCL script. but, many prefer the clarity and simplicity of scripting. as anyone who's used netcat/nc to pipe things over the network has experienced, running an extraction binary at full priority will definitely degrade the recording/playback performance of your TiVo. wonder what kind of performance hit using FromMFS in an extraction script would cause? we shall see...
</ramble>

It is very easy in TCL to set the tivo-priority of the process and I think tivoweb already sets itself to the lowest priority, if not it is a one-liner to do so.

At least now the mfsstreamweb stuff just redirects to an already running external c program, but at first it actually forked a binary from tcl (as far as I can tell from the discussion here) and that is not pretty. I think having it all contained in tcl and therefore just dropping one script in the tivoweb modules directory is just about the simplest way to do this.

TivoDvlpr
07-16-2002, 12:41 AM
Whenver I try to call it, I get a message like:

only read 2141405632 bytes of 124

(I was testing on a small object)

What gives, have you gotten it to work?

gosquad
07-16-2002, 12:20 PM
Hey all.. sorry I haven't been more active in this latest discussion.. I'm a recently laid off software developer who has been pounding the pavement trying to find work. Oh, I wish it were 1999 again. :)

Anyway, I'm going to look into this FromMFS tcl function. Seems like it could be useful.

Oh, i forgot one thing.. if we do put it right into a tivoweb module (if it's even possible), we'll have to add a header into tivoweb directly.. (ie Content-Type: application/ty) since it will spit out text/html by default. Not a big deal, but requires changes directly to tivoweb. It would be nice if tivoweb had a .cfg file for all it's mime types. Maybe I'll add that too. :)

Cheers,
gosquad

TivoDvlpr
07-16-2002, 05:08 PM
Instead of creating a regulare module, it appears that we can create a content_handler as well, this will allow us to provide the headers as well as the content for the page. I'm going to try this tonight, if I'm successful I should have a content handler using a ".mfs" extension where the filename is the fsid. If it works, extraction of mfs files should be as simple as using a url:

http://tivo/<fsid>.mfs

If I do it right, that would start streaming the file directly from tivoweb...I'll keep you posed.

gregggreg
07-16-2002, 06:21 PM
Originally posted by TivoDvlpr
Instead of creating a regulare module, it appears that we can create a content_handler as well, this will allow us to provide the headers as well as the content for the page. I'm going to try this tonight, if I'm successful I should have a content handler using a ".mfs" extension where the filename is the fsid. If it works, extraction of mfs files should be as simple as using a url:

http://tivo/<fsid>.mfs

If I do it right, that would start streaming the file directly from tivoweb...I'll keep you posed.

I don't know if this matters much, but I'd rather see something like .ty as the extension. The items in mfs are usually tydbs or tystreams. MFS is just the filesystem where these things reside, not the file type. Anyway, just my 2 cents. Good luck.

TivoDvlpr
07-16-2002, 11:59 PM
I've got the code to send a file from tivoweb working, but I'm having trouble getting stuff out of mfs.

I'm taking an fsid that was being sent to mfs_export, and trying to do an [mfs size <fsid>] on it. When I do that, my TIVO crashes.

Any ideas on this one?

TivoDvlpr
07-17-2002, 12:14 AM
WARNING::WARNING::WARNING::WARNING

This is not tested code and I cannot get it to work, I am putting it here in case someone would like to help me figure out why this is not working. I have tested similar code, and the non-mfs related code works, it will transfer data as a file. Its the mfs stuff that's got me stumped.

Place the file in tivoweb's modules folder, then, restart tivoweb and from your browser's URL line enter:

http://tivo/<fsid>.ty

Thanx for any help!

gregggreg
07-19-2002, 02:32 PM
Originally posted by TivoDvlpr
WARNING::WARNING::WARNING::WARNING

This is not tested code and I cannot get it to work, I am putting it here in case someone would like to help me figure out why this is not working. I have tested similar code, and the non-mfs related code works, it will transfer data as a file. Its the mfs stuff that's got me stumped.

Place the file in tivoweb's modules folder, then, restart tivoweb and from your browser's URL line enter:

http://tivo/<fsid>.ty

Thanx for any help!

Wow yeah killed my DTivo, too when I tried to download a tystream. Bummer. I think it GSOD'd it too. Maybe we should take a little look at mfs_stream.c and see what it does. There is evidently a different between tydb files and tystream files. I've noticed this before since you can't do a dump_obj on tystreams, but you can on tydb's.

TivoDvlpr
07-19-2002, 03:42 PM
I've been looking at the mfs_stream code, that is a nice piece of work, especially the mfs.c/.h stuff. Its really got the mfs figured out.

A port to tcl of that would be good, probably wouldn't be too hard to do, I'm probably going to start looking at that.

Kevinesque
07-20-2002, 10:33 PM
Never mind. Its amazing what you'll find after you register!

Sorry for the wasted post...

dastalliteguy
07-21-2002, 10:22 AM
Short and sweet - I just wanted to thank Gosquad and any others who have helped to make this thing come to life. It works great! I'm getting 1.60mb/second on my transfers!

DaSatelliteGuy

IndieRockSteve
07-25-2002, 04:54 AM
has anyone figured out how to get mfsstream.itcl to download ty streams greater than 2gigs(i think its more than 5 FSID #'s)?

ashman5
07-28-2002, 03:42 PM
when i click on the MfsStream link in TivoWeb, i get the MfsSteam page but no links or fsid's. I'm using a 3.0 SA Tivo. any ideas?

Had to update to the 3.0 code...sorry.

Wooly
07-28-2002, 05:16 PM
Sure - save it to an NTFS Volume (or a Unix volume). Fat has a 2 gig file limitation.


Originally posted by IndieRockSteve
has anyone figured out how to get mfsstream.itcl to download ty streams greater than 2gigs(i think its more than 5 FSID #'s)?

dlang
07-29-2002, 07:00 PM
saving it to a unix volume doesn't solve the problem. I just confirmed this last night on a fresh install of linux where it definantly supports files >2G. The problem is that Mozilla (and netscape, galeon) get a file size of 0 and abort the download, Opera gets a filesize of 0 and starts downloading the file and then aborts becouse it isn't compiled with large file support (and since it's source isn't available you can't just recompile it)

keith721
07-29-2002, 09:08 PM
<dumbquestion> :rolleyes:
any reason why the http routines in this file (written in TCL) can't be run on the client side to retrieve the file, instead of using someone else's browser?
</dumbquestion>

they seemed to work well enough for 2.x Tivo downloads of slice files, etc. but apparently have been superceded by the 3.x compiled binaries /tvbin/http_get and /tvbin/http_post

JohnnyFlash
07-31-2002, 09:53 PM
Originally posted by gosquad



Hmmmmmm.. Well this is strange. I've consistently got around 800k/s. What browser are you using? Considering I'm using jdiner's mfs_stream it should just as fast as his tytool since it's coming down the same pipe. Anyone else see this?

gosquad

I'm having the same problem. I'm lucky to get 10K/s :(
I did get a decent transfer rate the very first time I tried to send a file, but after that it was in the toilet.

-JohnnyFlash

UPDATE: seems that it doesn't like running over a wireless network... hardwired and it zooms!

michaelt
08-05-2002, 03:19 PM
I select "MfsStream" from Tivo Web. The next page displays the list of shows. When I select a show I get "Internet Explorer returns an error on the address you just entered or clicked". I'm running XP and a Philips S/A. What have I done wrong ?

IndieRockSteve
08-06-2002, 01:18 AM
I am saving to a unix volume(I run linux only with a mix of reiserfs and ext3 volumes), the prblem lies not in the file system I'm saving to but to a problem with the module and how it works not being able to send a tystream of that size.


Originally posted by Wooly
Sure - save it to an NTFS Volume (or a Unix volume). Fat has a 2 gig file limitation.

buckster
11-19-2002, 09:35 PM
Originally posted by ashman5
when i click on the MfsStream link in TivoWeb, i get the MfsSteam page but no links or fsid's. I'm using a 3.0 SA Tivo. any ideas?

Had to update to the 3.0 code...sorry.

OK, I'm having this exact problem on the exact same type of machine

But i'm a really stupid newbie and I don't understand what "had to update to the 3.0 code means" Update what to the 3.0 code?

Sorry stupid newbie here, but god knows I"m trying

mrblack51
11-19-2002, 11:47 PM
that means that if you are using a tivo with 3.0 software, you need to get the updated version of mfstream that I posted a while back. otherwise, you can use the regular version

emc2
11-21-2002, 08:44 AM
i have mfs_stream working - sortof

I start download
file starts transferring
zooms for a sec or two
then sits idle for a couple of minutes
zooms for a sec or two
then sits idle for a couple of minutes
i watch the transfer rate on netmedic and at this rate it will take hours to download a 1.7g movie

I have XP and ie6 (some parts in german because of the sp1 i used but that is off topic)

how can i get the transfer to be continuous?
maybe a priority thing?
confuser is doing only this


any help is appreciated




signature-I WILL NEVER FORGET AND WE ARE COMING TO GET YOU

rd001
11-27-2002, 08:46 AM
Some nice work here, gosquad.

I knew you'd been up to something 'cause you were so quiet. And we all know you're a Tivo maniac... :)

Reno76
12-01-2002, 04:38 AM
Hi
I am trying to install mfsstream onto my UK SA Tivo but in my Linux newbieness I dont know how to add the
"/path/to/tyhttpd 2000 4 >> /dev/null &"
line to rc.sysinit!
I can copy the file to my pc and add the line but cant replace the exisiting file on the tivo.
So...
Do I have to add the line from a bash prompt?
In which case what do I need to type?
Does /path/to/ need replacing with the location of tyhttpd?

Do I need the quotes?
Do I have to add the line at any specific point in the script?

Sorry to appear dumb but its early days for me here and I really do appreciate your help guys:)

Reno76

Nikki
12-02-2002, 10:03 AM
Hi,

I'm attempting to download a ty file using mfsstream and TivoWeb over the Internet, but I am getting a very slow connection. The download sometimes pauses for 10 minutes at a time.

Instead, downloading a large log file from TiVoWeb over the Internet is no problem, 24 kBytes/s.

Over the Intranet, internally, I get 1 mbyte/s for everything from TiVo including mfsstream.

So what is causing the slow down for just mfsstream externally?

Is see that others are having a similar problem.

Any ideas?

Thanks,

Nikki

phedders
12-14-2002, 10:11 AM
I'm trying to get mfsstreamweb to work.

I'm using a UK Tivo with 2.5.5 software. Tivoweb-tcl 194 beta4 and now beta5.

This is th error I get when I click on the mfsstream option in tivoweb (note it displays the table header first, then this error):

INTERNAL SERVER ERROR
--cut here--
action_mfsstream '/' ''
syntax error in expression "*60*60"
while executing
"expr $tz*60*60"
(procedure "get_tzoffset" line 32)
invoked from within
"get_tzoffset $setuptz $daylightsavings"
("uplevel" body line 50)
invoked from within
"uplevel $body"
invoked from within
"transaction {uplevel $body}"
(procedure "RetryTransaction" line 5)
invoked from within
"RetryTransaction {
set fsidInfo(fsid) $fsid
try { set fsidInfo(rec) [db $db openid $fsid] } catch errCode {set fsidInfo(rec) "N/A"}
..."
(procedure "printFsidInfo" line 17)
invoked from within
"printFsidInfo $fsid $type $chan $db"
("uplevel" body line 2)
invoked from within
"uplevel $body"
invoked from within
"ForeachMfsFile fsid name type "/Recording/NowShowing" "" {
printFsidInfo $fsid $type $chan $db
}"
(procedure "::action_mfsstream" line 37)
invoked from within
"::action_$action $chan $part $env"
("eval" body line 1)
invoked from within
"eval {::action_$action $chan $part $env}"
--cut here--

Any help greatfully accepted!

MartinC
12-15-2002, 11:58 AM
I have the same problem, as I don't really know anything about tcl or what the get_tzoffset function does. In this thread there is a solution to the problem

http://dealdatabase.com/forum/showthread.php?s=&threadid=18811&highlight=gettzoffset

MartinC

Nikki
12-15-2002, 12:12 PM
I don't have the same problem with my UK TiVo, but I did have to hack the mfs_stream executable to get it working properly.

I don't know really, bit it looks like get_tzoffset returns a timezone offset in one hour units for daylight saving.

Regards,

Nikki

phedders
12-16-2002, 12:29 AM
TZget gets the timezone. During the winter in britain that is 0 - we are at GMT... so 0x60x60 is, erm undefined. Error.

neo96789
12-16-2002, 12:04 PM
Help!

I've installed the mfsstreamweb97 kit...

I'm running TivoWeb v1.9.4beta4 (and I've tried beta5 and 3)

I'm currently starting up tivoweb and tyhttpd manually (not in rc.sysinit)

I can select mfsstream from my tivoweb main menu, but it presents me with an empty list...

My tivo is SA running system software 3.0-01-1-000

I think I've done everything in the readme and that I've found here...

Does anyone have any suggestions for what to look at to see why I do not see anything on this list? I do see all the items in the UI/Now Showing display...

Thanks!
_David

lovegnome
12-16-2002, 04:59 PM
You the mfsstream.itcl file for 3.x.

For the sake of simplicity, I'll attach it. Just replace the old mfsstream.itcl with this one. As far as I know, everything else works the same.

[Or, if I'm too stupid to figure out how to attach the file, you should be able to find it for yourself, now that you know it exists.]

neo96789
12-17-2002, 10:38 AM
Originally posted by lovegnome
You the mfsstream.itcl file for 3.x.

[Or, if I'm too stupid to figure out how to attach the file, you should be able to find it for yourself, now that you know it exists.]

Thanks!...I found the file, installed it and all is good...I'm web-extracting as we speak!

FYI: Here's the reference where I found it:
http://www.dealdatabase.com/forum/showthread.php?s=&threadid=19482

-David

doneil
12-20-2002, 01:31 AM
Does anyone know how to get MfsStream working w/ DTivo & 3.1 code? I've installed v.97 and the itcl module for 3.X but I get the following when I try to select the item from the menu:

INTERNAL SERVER ERROR
--cut here--
action_mfsstream '/' ''
can't read "header": no such variable
while executing
"puts $chan $header"
(procedure "::action_mfsstream" line 34)
invoked from within
"::action_$action $chan $part $env"
("eval" body line 1)
invoked from within
"eval {::action_$action $chan $part $env}"
--cut here--

Looks like it's not compatible with either dTivo's, or b5 of the TivoWeb.

mrblack51
12-20-2002, 02:35 AM
doneil: I am using a dtivo with b5 and mfsstream. the key is to make sure you are using the version which supports 3.x units. there were changes in the mfs which need to be accounted for, which have been taken into account for the updated version

lovegnome
12-20-2002, 04:14 AM
Doneil-

Is the rest of Tivoweb working correctly with your 3.1 Directivo? On the one I'm maintaining (not mine), I had to edit ui.itcl by hand to work with the 3.1 code.

Easy way to tell is the 'User Interface' option won't be available.

If that's the problem, edit the ui.itcl and change both instances of "3.0" to "3."

If that doesn't work, I'm surprised by the number of times a reboot solves the problem.

doneil
12-20-2002, 02:01 PM
Yup,
TivoWeb works fine for me with the latest beta. I was surprised myself when everything checked out after the install.

A reboot didn't help, and I verified that the config was correct.

I am using the module that was labeled 'mfsstream3x-1.zip'... maybe I'm using the wrong one? Anyone got a link to the _latest_ file?

zodiacal
12-20-2002, 11:57 PM
i can't vsplit a .ty stream extracted with mfsstreamwebmodual.
i used mfsstream to successfully extract a .ty stream file from my 3.0 SA tivo using mfsstream 3.x update and mfsstreamwebmodual 97. However when i try to vsplit the .ty it outputs zero k audio/video files. i have tried vsplit12 and vsplit13. i tested the same show with tivoapp and used vsplit12 on the .ty file and it worked. the .ty file sizes of mfsstreamwebmodual and tivoapp's are different. if you have any thoughts on why mfsstreamwebmodual .ty files are doing this i will really appreciate it.

Nikki
12-22-2002, 02:59 PM
zodiacal,

By how many bytes are the two .ty file sizes different?

Nikki

zodiacal
12-22-2002, 10:08 PM
tivoapp= 85.8 MB (90,046,464 bytes)
mfsstream web modual= 86.0 MB (90,177,552 bytes)

its a small file size because i just recorded like 3mins of a show for testing.

Nikki
12-23-2002, 09:32 AM
zodiacal,

Do you have a HEX editor to be able to look at the first characters? You could even open in Wordpad. My .ty files begin with F5 46 7A BD, or Fz in Wordpad.

All my .ty files split to 0 bytes when the beginning was corrupted.

I'm wondering whether you have my problem which I finally fixed.

Nikki

zodiacal
12-23-2002, 12:10 PM
yeah it looks like this:
Priority set...
Fz

Nikki
12-23-2002, 12:24 PM
Yes, your problem is the text "Priority set...", it shouldn't be there.

For some reason mfs_stream has some verbose output and puts it directly onto the .ty file stream. I have modified my mfs_stream executable to stop this.

Replace your mfs_stream executable with mine attached. I think it will fix your problem.

Nikki

zodiacal
12-24-2002, 01:43 AM
hey thanks! it got vsplit to work at least but its having some trouble when i mplex them and try to play them it doesn't work in media player saying codec not found. with a 500MB .ty file it splits to a 180MB video and a 9MB audio file. this can't be right i don't think. what vsplit options do you use? when i vsplit i get a ton of errors like this:
Found an OOB packet... The Video Diff is: 00:01:21.198
Found an OOB packet... The Audio Diff is: 00:01:21.252
Is it in sequence??? It is OFF by exactly 2257.000000 frames.
Nope... Not in sequence... Skipping it...

Nikki
12-24-2002, 03:54 AM
I get errors like these but it never affects playback. I think it is normal to get those.

I use tytool5.exe or vsplit12.exe to split my .ty files. I use no extra options with vsplit12. With mplex I use -f 3 for the audio.

It won't play in media player unless you've already installed a codec that will decode mpegs. Best thing is to try it in WinDVD or PowerDVD.

Nikki

zodiacal
12-24-2002, 12:17 PM
ooo its working now i don't know why it didn't work last night maybe because i used -O 7 for the ms offset? dunno if im suposted to do it like that or not.. its working great now! thanks again! also its strange that the mpeg is like half the size of the audio video files sizes combinded? my .ty file is like 500MBs and my mpeg comes out to be 300MB. thats strange isn't it?

Nikki
12-24-2002, 12:53 PM
If the mpeg plays fine then it's odd.

Interesting, I thought I was the only one with the mfs_stream problem. Thanks for showing me I wasn't alone!

Nikki

zodiacal
12-24-2002, 01:02 PM
hey is there a way to change the url to the .ty file that mfsstream uses on the web pages? because every link is the same address if its the same tv show but a differn't episode... i have seen scripts that can concatonate the episode name to the show name but some shows don't have episodes it would be better if i could append the FSID or somthing unquie i want to use a download manager to download my shows over night and do the vsplit/muxing automaticly.

Nikki
12-24-2002, 01:15 PM
Yes, sort of.

Your download manager should give you the real link to your show. The link is contructed using JavaScript in the HTML. For example, using FreshDownload when I click on on the show "5th Gear", the whole link is shown:

http://172.16.2.50:2000/741343232/var/hack/mfs-stream%20-s%20461332%20461333%20/5th%20Gear.ty

The more readable with %20 converted to spaces:
http://172.16.2.50:2000/741343232/var/hack/mfs-stream -s 461332 461333 /5th Gear.ty

All I need to do is change the last bit "5th Gear.ty" to something else. It is this bit that gives it its file name on your PC. TiVo won't care.

Something like:
http://172.16.2.50:2000/741343232/var/hack/mfs-stream -s 461332 461333 /5th Gear-20-12-02.ty

I'll then have 5th Gear-20-12-02.ty downloaded to my PC.

Nikki

pghattas
01-01-2003, 01:41 PM
I am having trouble with mfstreamweb. Everytime I try to download something, it tells me that the ty file is 0 bytes in size. I did not see anyone else who was experiencing this problem unless I overlooked a thread. I have tried with and without the noscramble.o module. Do I need this module or should I not use it? Any help is appreciated. Thank you in advance

--- Running Sony T60 with 2.5.2., turbonet and final release of tivoweb 1.9.4

BubbleLamp
01-01-2003, 03:27 PM
Originally posted by pghattas
I am having trouble with mfstreamweb. Everytime I try to download something, it tells me that the ty file is 0 bytes in size. I did not see anyone else who was experiencing this problem unless I overlooked a thread. I have tried with and without the noscramble.o module. Do I need this module or should I not use it? Any help is appreciated. Thank you in advance

--- Running Sony T60 with 2.5.2., turbonet and final release of tivoweb 1.9.4

noscramble has to be loaded to allow non-encrypted programs to be recorded in the first place. Any previous recordings done when it wasn't loaded cannot be extracted now, regardless of it's load status.

pghattas
01-01-2003, 04:51 PM
Well like I stated, I did have the nocramble loaded when I recorded it but it still tells me 0 bytes when I download the ty file.

pancreas
01-02-2003, 08:46 AM
Hey all,

First time posting. I've been up all night with my T60 DTiVo. I'm doing pretty well, but I'm stuck on MfsStream.

Just following the directions from the README file in mfsstreamweb97.zip, everything seems to be working except that no files appear in the list? Is there something fundamental that I'm missing? Seems like I should have come accross it by now, but I'm baffled. Thanks.

-pancreas

neo96789
01-02-2003, 09:04 AM
pancreas:

Sounds similar to the problem that I was having...I have an SA Tivo with 3.x software...I needed to use the mfs stream that I found in this thread...
http://www.dealdatabase.com/forum/s...&threadid=19482

I don't know if this applies to dtivo, but it might be worth a shot...

-neo

Barrett
01-02-2003, 08:49 PM
I read through most of this thread, but what im not sure about is what is the advantage of using this over TyTool?

grytpype
01-04-2003, 08:03 PM
I have a SA Tivo with 3.0, running TivoWeb 1.9.4 final and the mfsstream that is supposed to work with 3.0.

When I click on the MFSStream link on the TivoWeb menu, I get the following output:

INTERNAL SERVER ERROR
--cut here--
action_mfsstream '/' ''
can't read "header": no such variable
while executing
"puts $chan $header"
(procedure "::action_mfsstream" line 34)
invoked from within
"::action_$action $chan $part $env"
("eval" body line 1)
invoked from within
"eval {::action_$action $chan $part $env}"
--cut here--

:confused:

zodiacal
01-05-2003, 01:26 AM
rc3105: how can you watch them as you download them using mfsstream? don't you have to wait until the .ty is downloaded before you can run vsplit/mplex?

gosquad
01-05-2003, 10:38 AM
Hey all.. sorry i've been totally awol from here as far as posting goes.. I'm going to look into the

action_mfsstream '/' ''
can't read "header": no such variable

problem in 3.0 tivos now. I'll try to stay around more now! :)

i've been laid off again so i'm doing some contract work that's been keeping me away. anyone need a quality software developer? :)

cheers,
gosquad

hom3l3ss
01-08-2003, 07:49 AM
I just installed Mfsstream97, everything is working except for the tyhttpd wouldn't run auotmatically after boot up, it works fine if I start it manually, where do you exatcly put the line "/tivoweb-tcl/tyhttpd 2000 4 >> /dev/null &" on rc.sysinit?

grytpype
01-08-2003, 01:24 PM
hom3l3ss, you can put that right at the end of the rc.sysinit. You can do that with the following invocation:

echo "/tivoweb-tcl/tyhttpd 2000 4 >> /dev/null &" >> rc.sysinit

Be sure to use >> and not just >. Or of course you could use a text editor.

You say it's working for you... may I ask, do you have a stand-alone Series 1 Tivo? Some of us are having trouble getting mfsstream to work on that platform.

hom3l3ss
01-08-2003, 02:51 PM
I have a T-60, I did what you told me but still no go.

gosquad
01-08-2003, 03:14 PM
try adding this line:

/tivoweb-tcl/tyhttpd 2000 4 >> /tmp/tyhttpd.log &

and see if it outputs anything to /tmp/tyhttpd.log after startup..

also, grytpype, i will have a new version for you to test in a couple minutes. :)

cheers,
gosquad

grytpype
01-08-2003, 03:51 PM
hom3l3ss, I think for my invocation to work you have to be in the /etc/rc.d directory. I should have said so. Try this:

echo "/tivoweb-tcl/tyhttpd 2000 4 >> /dev/null &" >> /etc/rc.d/rc.sysinit

artships
01-08-2003, 05:26 PM
Originally posted by grytpype
hom3l3ss, I think for my invocation to work you have to be in the /etc/rc.d directory. I should have said so. Try this:

echo "/tivoweb-tcl/tyhttpd 2000 4 >> /dev/null &" >> /etc/rc.d/rc.sysinit

Actually, tivoweb is in a different directory. Try this:

echo "/var/hack/tivoweb-tcl/tyhttpd 2000 4 >> /dev/null &" >> /etc/rc.d/rc.sysinit

grytpype
01-08-2003, 06:18 PM
artships, you're absolutely right.

gosquad
01-15-2003, 07:26 AM
Note: v98 has been uploaded to the howto sticky and a new topic has been started. This one was getting a touch too long.

cheers,

gosquad.

tungsten2k
01-16-2003, 05:16 PM
Originally posted by grytpype
artships, you're absolutely right. only if you're still in the stone ages and haven't moved all your stuff out of /var (or if you're using kraven's upgrade which has done the same) :D
how 'bout...

cat /etc/rc.d/rc.sysinit

and make sure that you don't already have a reference to tyhttpd at the end of the file. if you do, make sure it has the correct info. if not, you'll have to edit it. if there is no reference, then find the location of your tyhttpd and then execute the following command :

echo "*full path to your tyhttpd* 2000 4 >> /dev/null &" >> /etc/rc.d/rc.sysinit

IWantMyDTV
01-16-2003, 07:09 PM
Originally posted by gosquad

Originally posted by rc3105
or you could compile tydemux / mplex into vlc and register it as your "download manager" for .ty files like I did

--
Riley
Riley.. mind sharing this with us? :)

gosquad

I'll second that request.

dtv

roach
09-03-2003, 09:50 PM
Originally posted by rc3105
or you could compile tydemux / mplex into vlc and register it as your "download manager" for .ty files like I did :D

hey Riley, care to give a brief run down on how you did this?