MUX'ing, VSplit, and MPG2 files.

[Wooly]

This is disturbing - I can't believe that people haven't seen this classic!

Scarface is a film (one of many with Al Pacino, Michelle Pfeifer's first biggie (and also where she looks absolutely smokin' hot, IMO)) about a Cuban immigrant who takes over the drug trade in Miami...the hard way...and in a violent way. This is the movie that coined the phrase "a Cuban Necktie".

You must NOT see it via network TV - they'll cut out roughly 30% of the movie, and it really needs to be seen in WideScreen and uncut.

JDiner, PM me and I'll make you a DVD-R copy of my original and send it out to you. This won't do.


Originally posted by jdiner
Dude! Hang onto your files. There are a few things I would like you to check in the next little while. The in-line audio upsample code etc... It would just be really interesting to see how things line up without using the BeSweet program.

But as for scarface. I never saw it. What is it? Movie? Episode of something? Horror flick? (I never watch those... :)

--jdiner

[keith721]

but gotta admit, it seemed appropriate for the character Pacino plays. keep in mind, this was during the great 'snow' fall of the 80's cocaine explosion . . .

[bronco13]

Originally posted by Rotten

I have been playing with the new mpgs in DVD WS 1.3 and am able to produce a DVD with menu very easily, the one thing missing is the ability to have chapters. I am still working on this.

1. Mux with JDiner's vsplitmux L
2. import into DVD WS. Chapters will be erased if you make them
3. make menu with pointers to the titles first chapter
4. Save
5. Use DVD Patcher to change first header to 720X480 Variable (Max. 8000 kbps)

6. you will be asked if you want to relink files in DVD WS. Say no.

7. Create template as follows in DVD WS.

MPEG files
24 Bits, 720 x 480, 29.97 fps
(DVD-NTSC)
Video data rate: Variable (Max. 8000 kbps)
LPCM Audio, 48 KHz, Stereo

8. Make disc having Do Not Convert Compliant Files (on)
9. Thats it. it does not reencode the files and sync looks great.

I would like to have chapters for commercials but not too sure if it is possible yet.


Holy Siznat! This works like a charm! I too am having problems with the whole chapter thing. I'll do some reading and get back to you. I can make the chapters, but they don't seem to work...

Great job Rotten!

[FreydNot]

Originally posted by jdiner
But the fact that 2500 lines of mux code, became 450 in the last 7 days, and that the process now takes 24% of the time the first cut I had did is important to only a few... That it works on almost every stream I have doesn't matter. That the output plays on almost everything doesn't matter.

Holy Fu*kin Sh!t. From 2500 lines to 450? Thats amazing! And like a 300% speed increase (if I'm reading that right) to boot.

My hero :)

[jdiner]

Yeah. That is what happens when you have to figure everything out. I had multiple routines trying different techniques that I then compared the results on etc... Once I knew what to do it was possible to really scale things down. Not remove features just make the code as optimal as possible.

--jdiner

[bronco13]

Rotten,

I see what you mean with the chapters. Once the video file is patched all of the markers are gone! Now what? Oh well, I'll keep hacking a way...

[bronco13]

Rotten,

Have you tried to use DVD WS to SPLIT the file before patching? That way we could just add the individual streams as separate chapter???

Maybe???

[rd001]

Originally posted by jdiner

But the fact that 2500 lines of mux code, became 450 in the last 7 days, and that the process now takes 24% of the time the first cut I had did is important to only a few...Damn, now I'm showing wood here after that lurid description.

Eagerly awaiting your official release.

[koreth]

That's quite a code reduction! Jeez, it's like going from this (http://www.anomalies-unlimited.com/OddPics/Images/Arbit.jpg) to this (http://www.hedweb.com/animimag/rabbits.jpg)!

[JasonJLee]

jdiner:

In case you didn't see my last post, or your reply crossed over with it..

The same output is generated with an unedited binary.


To everyone..

I'm not reporting this to get anyone's back up. I'm not posting it to jump up and down on it if it is a problem (If it is, it's not serious enough to stop the output, which is perfect)

I'm just posting it to try to help!

I'm still not clear, as there is no doc with the file, if what I posted is actually normal. Everyone seems more ready to flame on around here than actually help.

There seem to be a lot of people here with issues, who like to jump all over people.

I must say, I stopped posting 'me too' posts about 2 years ago, and do my best to avoid flaming. It's just pure Noise, and slows down progress/makes following actual informational posts harder.
I post when

a) I have a problem
b) I have a suggestion for someone else's problem
c) I have a suggestion
d) I have a solution

Otherwise, I just don't bother. I run across to many '9000+' posters in other forums who just chat with buddies and flame without any real knowledge. Even proved them wrong a few times. Just turns into a pi**ing match. Especially if you give a damn about what the actual truth is. Got too much to do to waste time like that.

Anyway, I'll go and try a few more streams once I've cleared some disk space.

J

[snoopy]

Do you have a homepage where you have posted some of your most recent work. I need a copy of the latest vsplit so that I can begin using it on my TY streams to free up space. I understand that it is now complete? Please advise.

[laserfan]

Wow.

My prayer for jdiner: May the Lord bless thee and keep thee. May the Lord make His face shine upon thee and be gracious unto thee. May the Lord lift-up His countenance upon thee, and give thee strength! Amen!

[AlphaWolf]

Originally posted by bronco13
Why don't you just hex-edit out the 2000 in vsplit1l.exe?


Didn't jdiner just ask everybody to not post this information?

Just a quick note to explain why this is not hoarding as apparently some of you would like to think, I was bored one day, pulled up a hex editor, found out how to do this, and I let a few other reasonably well skilled people know how its done, with the specific instructions, DO NOT POST TO THE FORUMS. Now look what kind of trouble I get into.

Again I apologize jdiner, I need to learn to keep my mouth shut. (and people still wonder why high profile modifications are kept secretive) We'll see about fixing my mistake.

[bronco13]

This has absolutely nothing to do with nothing. Your just looking for another fight. Can't you ever start a new thread to pick your fights?

Yes, yes, we all know that you figured this out the second you downloaded the zip... Bravo.

Back off already, or you will ruin this thread too.

[AlphaWolf]

Who is the one ruining things here?


Originally posted by jdiner
Then people post hex-edit hacks to program I have stated over and over is a test version only. And what happens? With 24 hours I get innundated with comments via email, PMs, and here about problems with converting full streams using hacked binaries. All I have to say is "WELL DUH!" why do you think I have not posted a full version. IT ISN'T DONE! There are ISSUES to be dealt with.


Get rid of that before I get somebody to do it for you, thats all I ask.

[bronco13]

I didn't see that one Alpha. All ready pulled it...

[AlphaWolf]

The thing is, everybody openly shares information, unless they plan on selling it, or if it poses a forseeable danger. Theres pretty much no such thing as hoarding in freeware that I've ever seen. Its kept low to prevent from being used the wrong way.

just my 2 cents, and hopefuly this helps the rest of you understand.

[jdiner]

Originally posted by snoopy
Do you have a homepage where you have posted some of your most recent work. I need a copy of the latest vsplit so that I can begin using it on my TY streams to free up space. I understand that it is now complete? Please advise.

My Advice... DON'T! You can't run a full stream. What comes out is not ready to use yet. You can split it and that saves maybe 10% max, as you get rid of the tivo packaging. But in doing so you lose any chance of mux'ing it later and having it be sync'ed.

If you are out of space, my advice at this point is get more. A new HD will be much cheaper than the frustration down the road of not being able to use "well" the stuff that you have collected.

--jdiner

[GITM]

I am trying to open the output avi file in VirtualDub. I have tried 6 files from a DTivo and an SA and they all give me the same error:
MPEG Import Filter: pack synchronization error

Anyone know what's wrong? Does VirtualDub not support this type of file (I could have sworn I've opened similar)?

Thanks,
-GITM

[jdiner]

Found a bug. I accidently tightened things up when I added the latest byte-count fixes.

I found that I had removed the "close enough" from the thing. Every now and again on a DTivo stream you get a 4 or 6 packet drop in audio.

This used to be the kiss of death for "real" sync in splitting. But in mux'ing it is a split second hickup. I never meant to remove it. I was just going to fast at some point I guess. but it has been put back. Things that split to the end under Vsplit12 should once again split just fine.

I will be posting a new version at some point soon. There are just a few other things I am in the middle of. I have the code for handling this little bumps in place. Now I am just waiting on a stream that has a major hole in it to see what happens when I try to deal with that one.

--jdiner

[jdiner]

Originally posted by GITM
I am trying to open the output avi file in VirtualDub. I have tried 6 files from a DTivo and an SA and they all give me the same error:
MPEG Import Filter: pack synchronization error

Anyone know what's wrong? Does VirtualDub not support this type of file (I could have sworn I've opened similar)?

Umm. The output is an mpeg-2 file. Not an AVI. They are completely different.

You need to frame-serve the output from vsplit/mux to be able to load it into VirtualDub.

At one point Avery Lee mentioned that he had an MPEG-2 version almost ready to roll. But he then pulled it due to pressure from various entities. I think WMP support was pulled for much the same reason.

Anyway when you frame-serve it something else reads the MPEG-2 file and provides complete uncompressed frame data to the other tool. Look back from posts from me, and others, about using Dvd2AVI to do exactly this.

--jdiner

[jdiner]

I recently made a comment about the speed of the muxer itself.

I went through 3 major and completely different versions before any release here was ever made. The first one took almost 20 minutes to process the same 7 minute obscura clip. The most recent version I am working on here takes 1:14. But the first public release here took between 6 and 7 miuntes.

Of course, the earliest code also produced almost 16 millions lines of debug output for that same 7 minute clip. All of that takes time even when re-directing said output to a file.

--jdiner

[AlphaWolf]

Originally posted by jdiner
You can't run a full stream. What comes out is not ready to use yet. You can split it and that saves maybe 10% max, as you get rid of the tivo packaging. But in doing so you lose any chance of mux'ing it later and having it be sync'ed.


Just curious, is this the same reason why we can't edit anything yet without losing sync?

[durian]

Jdiner,
Is there a companion to TyFileSplit which allows one to rejoin seamlessly tyfiles ?

[jdiner]

No. I never thought about it. TyFileSplit was designed to get smaller sample pieces to try debugging with.

Under windows just do:

copy /b file.ty+file2.ty+file3.ty big.ty

And under unix do:

cat file.ty file2.ty file3.ty > big.ty

And that will join them.

--jdiner

[jdiner]

Originally posted by AlphaWolf
Just curious, is this the same reason why we can't edit anything yet without losing sync?
Is what the reason? That splitting loses sync? No the reason editig doesn't work is because the mux'ing has to be redone after editing. And redo'ing it means they recalc based on what is in the data. That flag is wrong. So... you have to do something else... What I am doing now.

--jdiner

[Hi8]

Well I must say I have been quite happy with the results I've been getting with my DTivo streams.

The only issue I've had/seen it trying to make "standard" or compliant formats for burning. Thank goodness for my APEX and other set-top players that play just about anything. My Sony S7700 hates the DVDs I create with the 480x480 res.. creates a split screen display..

IfoEdit always reports exceeded bitrates but the discs play fine. I suppose once jdiner bangs all the dents out, this is going to be one rock solid app.

I just can't keep up with authoring discs! I'm going to need to put my A04 in the fridge between burns to keep it cool.

I can now extract with tytool5 and author with ifoedit so quickly, and keep my now playing list so short, I'm having a tough time finding things to "TiVo"!

I know it is recommened to keep my streams until things are finalized, but my DVD-Rs are coming out perfect. I have had a few, that were way out of sync, but VERY few. (1out or 8 maybe.) Because all of what I'm extracting on my DTivo are no-commerical movies, I don't really care about editting.

I even played around with Chopper to hack/trim left&right of the .vob but it's not worth the time to re-create the IFOs for me. I have found a good price for media, last price .89each (Mertline) so keeping some of the min or so in the beginning and end of a SHO or TMC movie is no big deal. I'm going to keep those streams that have caused trouble for me in lipsync, perhaps jdiner will have a need at some point to examine to try and figure out why..???

I've finally got it down to to a predictible 4 step process:

1.) extract with tytool5
2.) vsplit -> .m2v & .m2a
3.) ifoedit -(DVDAuthor) with celltimes.txt chapters
4.) burn with Nero 5.x...



:D :D :D

[durian]

So:
- A well formatted tyfile is a sequence of records
- Thus, for storage purposes, one can TySplit a large tyfile over multiple CDs(DVDs) since the reverse operation is an appropriate COPY(Windows) or cat(linux) as long as these commands work for large(>2GB) files.

[jdiner]

Originally posted by durian
So:
- A well formatted tyfile is a sequence of records
- Thus, for storage purposes, one can TySplit a large tyfile over multiple CDs(DVDs) since the reverse operation is an appropriate COPY(Windows) or cat(linux) as long as these commands work for large(>2GB) files.

That is correct. The output of TyFileSplit is a perfect boundry based cut of the original file. So you can later copy/cat them back together and the end result will be byte for byte the same as the original.

--jdiner

[Wooly]

BTW, here are some other DVD-R links:

http://cdrom2go.com/optical_media/dvdr.htm#pack

They have 90 DVD-R's and 90 DVD Cases for $81.60 - you pay shipping, though

and...

http://www.qtccdr.com/cgi-bin/product-detail.cfm?category=DVDR%20Media&subcategory=4%2E7GB%20&product=DVDR%2DS4%2E7G%2D1X&unit=N

White-top media, 100 DVD-R's in a cakebox for $0.60 each, you pay shipping

BUT...

http://www.supermediastore.com/greatcom47dv.html

This is my favorite. Great media, 100 DVD-R's and 100 DVD Cases for $103, FREE SHIPPING. I burn these all day long and have NEVER HAD A COASTER, and they work in damned-near every player I've tried. Obviously, the price per unit gets lower when you buy a 200 or 500 pack.

FYI, I also use the same process that you do - perfect results, everytime.


Originally posted by Hi8
I have found a good price for media, last price .89each (Mertline) so keeping some of the min or so in the beginning and end of a SHO or TMC movie is no big deal.

...

I've finally got it down to to a predictible 4 step process:

1.) extract with tytool5
2.) vsplit -> .m2v & .m2a
3.) ifoedit -(DVDAuthor) with celltimes.txt chapters
4.) burn with Nero 5.x...



:D :D :D

[Hi8]

Originally posted by Wooly
BTW, here are some other DVD-R links:


BUT...

http://www.supermediastore.com/greatcom47dv.html

FYI, I also use the same process that you do - perfect results, everytime.

thanks for the link, I just ordered some DVD-RWs -

I don't like the cases - I have so many, storage is a problem. I use case-logic's CDP-25:
3-ring storage pages (http://www.thenerds.net/productpage.asp?pn=049935)

I can really fit quite allot in a standard 3-ring binder.

* yes that process is so fast, and reliable for non-editted streams, it's good enough as a final soloution for me. I've been experimenting with multiple titlesets using IFOEdit - (.096B1) which provides this feature. I was able to put 3 different full length movies on one disc. As each of the extractions totaled less than 4.5g. Chapters/Breaks separate them perfectly for selective viewing.

I suppose that a menu is the only thing that would be nice. But It's not going to stop me from continuing my current proceedure. I can wait for that icing on the cake!

[drapatin]

Whats with the posts about being surprised you can "write to dvd" ?

And whats with the "upsample" extra steps ?

Geeze - Us - H - Christmas

Just extract and vsplit and then do one of two things:

Use DVDPatcher to fake out SpruceUp and let it do the work - Viola! Perfect DVD

OR

Use IfoEdit to creat VOB's and then use Prassi to Burn - Viola! Perfect DVD.

I have so many DVD's now I ran out of the Gross of Boxes I bought.

[bronco13]

Anyone here know where to find + media? I got sucked into buying an HP dvd200i. The compatibility is great and all but I still can't find a 100 pack for under $170.00

[Pr.Sinister]

Originally posted by drapatin
Whats with the posts about being surprised you can "write to dvd" ?

And whats with the "upsample" extra steps ?

Geeze - Us - H - Christmas

Just extract and vsplit and then do one of two things:

Use DVDPatcher to fake out SpruceUp and let it do the work - Viola! Perfect DVD

OR

Use IfoEdit to creat VOB's and then use Prassi to Burn - Viola! Perfect DVD.

I have so many DVD's now I ran out of the Gross of Boxes I bought.

Just a little side note here... nothing to do with anything...

But it's Voila .... hehehehe

-Pr.

[jdiner]

Originally posted by bronco13
Anyone here know where to find + media? I got sucked into buying an HP dvd200i. The compatibility is great and all but I still can't find a 100 pack for under $170.00

Read back 5 total posts.

--jdiner

[digitalAir]

Originally posted by rc3105
a commercial version of tytool would be in direct violation of the dcma. crappy law, but law nonetheless. if that's not a recipe for expensive legal problems I dunno what is.

--
Riley

Um, I'm not a lawyer or anything remotely resembling one...

but It's my understanding that the DMCA states it is illegal to distribute sw that is specifically designed to circumvent other electronic encryption and/or copy-protection mechanisms...

Case in point DeCSS was specifically written to circumvent the CSS encryption implemented on commercial DVD's -- thus considered illegal.

TyTool/vsplit does not do this. All it does is pull non-encrypted data from the TiVo hard drive and strip out the TY chunk formatting and output the raw mpeg data... In essence all this tool does is reformat existing data... it does not circumvent any encryption or copy-protection mechanisms...

feel free to correct me if I'm wrong on this, though...

[laserfan]

Originally posted by digitalAir
...feel free to correct me if I'm wrong on this, though... ...or don't. PLEASE don't. The subject is splitting & muxing, folks!!!

[AlphaWolf]

Originally posted by digitalAir

TyTool/vsplit does not do this. All it does is pull non-encrypted data from the TiVo hard drive and strip out the TY chunk formatting and output the raw mpeg data... In essence all this tool does is reformat existing data... it does not circumvent any encryption or copy-protection mechanisms...


I would agree but then you have to remember what happened when somebody wrote software to convert e-book format to pdf. And commercial or not, the law is the same. Both DeCSS and that e-book converter were freeware.

The main difference is, if you sell commercial software, your much more likely to be sued (you wont be criminaly tried however), whereas with freeware, its not nearly as likely. Not sure why this is, I think its that some companies get pissed when your making a legal profit off of their idea for something they didn't think of, so they want to take those profits from you. Think back to sony over the playstation emulators, they sued all of the commercial emulator developers, but they didn't touch freeware developers, they completely left them alone.

[raleman]

I have read most of the posts in the thread, but forgive me if I ask anything that has already been answered. There are several one-hour-with-commercials programs on my TiVo that I would like to put on SVCD without commercials. TyTool works great. I was able to grab the video off the TiVo fine, and then demux it. But if I mux it with TMPEnc, (or bbmpeg) using the SVCD setting, I get a ton of buffer underflow errors. What does these meen exactly? The video plays fine on my PC, and I am able to edit the commercials out very easily with MPG2VCR, but when I burn that to SVCD with Nero 5, it plays fine in my computer but on my DVD player it only plays about 5 minutes near the beginning. I have the Sony DVP-NS715P, which plays anything. I got a similar result with VCDEasy, but I noticed that when it was scanning the video it reported a hand full of "non-mpeg1 audio header found" errors. I’m not sure if this has something to do with MPG2VCR’s editing or not. Also there are a ton of GOP errors in the video, which MPG2VCR’s GOP fixer will fix, but it doesn’t seem to make things any better. Is that GOP fixer worth running? Does it help or make thing worse? The new tysplit1l does a great mux, but editing doesn’t seem to work, and I don need to edit the commercials in order to fit it on one 80 minute SVCD.

[jdiner]

Well as always seems to happen, and that is probably a good thing.

I started with a complex algorithm for cetain things dealing with the mux'ing. Most notably the detection of holes in the data. After thinking about it for some time this morning I came up with a solution that I do believe is darn near perfect. It takes a bit more memory than the least pass but not bad. You will need about 7meg that can be devoted to splitting and mux'ing for the whole program. But this algortihm appears to correctly handles any of the holes in the data I have seen.

The 4 frame holes work. The 6 frame holes work. And perhaps best of all the 150 frame holes work. Only seen one of these but it is there... and now it works... :)

I am working on cleaning som things up right now. But once it is done expect another release. For those that had found problem clips get ready to try them again.

--jdiner

[rpongett]

Fantastic.

This thread is theraputic. I get excited about this thing every time I read it.