Avidemux Forum

Avidemux => Main version 2.6 => Topic started by: elese on January 22, 2018, 01:17:26 PM

Title: Indexing vob files on 2.7.0
Post by: elese on January 22, 2018, 01:17:26 PM
Hi,

I have been trying to edit .vob files I have ripped from a dvd, but indexing does not seem to work. I am using Ubuntu 16.04 x86_64 (Linux Mint 18.3).

Although an index2 file is generated (see attached), the index runs only to the first 37 seconds of the video, which is an hour long.  I have had the same with other .vob files I have tried.

It seems to be the same behaviour as if there were no index at all.  For example, when you try to open a .vob file in vlc or mplayer, where the position in the video cannot be navigated after the first 10 seconds or so.

I upgraded recently from 2.5.6, which was able to index .vob files

Is there anything I have missed? Do I now need to process the .vob files before passing them to Avidemux?

I would be happy to install from git or apply any patches.

Thank you for you help.

Title: Re: Indexing vob files on 2.7.0
Post by: eumagga0x2a on January 22, 2018, 02:11:57 PM
If you have upgraded from an older version, you should manually delete .idx2 files generated by that version. If this turns out to be insufficient, please test with Avidemux built from the current git master, see http://avidemux.org/smif/index.php/topic,18182.msg83108.html (http://avidemux.org/smif/index.php/topic,18182.msg83108.html).
Title: Re: Indexing vob files on 2.7.0
Post by: elese on January 24, 2018, 04:20:11 PM
Hi

I just found this thread, where the author reported the same problem. I meant above that v.2.7.0 does not seem to index .vob files, but v2.5.6 did.  I upgraded my system recently from Ubuntu 14.04 (which had v2.5.6) to 16.04 (which has v.2.7.0).

http://avidemux.org/smif/index.php/topic,16195.0.html

It seems that avidemux does not really do indexes for .vob files from v2.6 onwards.

It is a shame as the only alternatives really are MakeMKV (still free at the moment if you use the beta, but it is commercial) or ffmpeg on the command line. Avidemux is a good programme.

I have re-installed v2.5.6 though (using binaries from 14.04) and will just use that.

Cheers,

L
Title: Re: Indexing vob files on 2.7.0
Post by: eumagga0x2a on January 24, 2018, 09:21:26 PM
Quote from: elese on January 24, 2018, 04:20:11 PM
It seems that avidemux does not really do indexes for .vob files from v2.6 onwards.

This is simply not true. Avidemux treats .vob like any other MPEG program stream and its MpegPS demuxer creates an index (.idx2) file for all sequentially named VOBs. Obviosly, the file system with the DVD structure must be writable for that. Avidemux was never capable of following the DVD navigation though, thus it can't replace tools like Handbrake, but for simple DVDs without bells and whistles it works fine.

QuoteI have re-installed v2.5.6 though (using binaries from 14.04) and will just use that.

Does it really run?
Title: Re: Indexing vob files on 2.7.0
Post by: elese on January 28, 2018, 12:14:24 AM
QuoteIt seems that avidemux does not really do indexes for .vob files from v2.6 onwards.

This is simply not true. Avidemux treats .vob like any other MPEG program stream and its MpegPS demuxer creates an index (.idx2) file for all sequentially named VOBs. Obviosly, the file system with the DVD structure must be writable for that. Avidemux was never capable of following the DVD navigation though, thus it can't replace tools like Handbrake, but for simple DVDs without bells and whistles it works fine.

Of course you're right. Sorry. I tried it on a few commercial DVDs and it works perfectly.  I think I meant that for (a few?) home-recorded DVDs 2.5.x seems to handle indexing better than 2.6/2.7. On the thread above, on reply #29, Mean (the developer?) suggested this was due to mix-ups in the recording stream, which are correted by the dvd navigation info file, which avidemux does not use, as you say?

A few workarounds were suggested as being to rip the dvd into a container, like .mkv, that avidemux can use, or carry on with v2.5.x. I am happy doing this, but it would be interesting why the older indexing in 2.5.x, but not the newer in 2.6/2.7 can handle the stream. 

I have attached the index files generated with 2.5.4 (vob.idx) and with 2.7 (vob.idx2) to show what I have had with dvds made by my dvd-recorder.

I can upload a few .iso files (legally/publically available) to a site if this would help development?

Thanks for the reply.

Title: Re: Indexing vob files on 2.7.0
Post by: elese on January 28, 2018, 12:17:47 AM
Ok the version by 2.5.4 was too large to upload as an attachment so it is here:

https://www.solidfiles.com/v/BjP7WP6xR4ZzP
Title: Re: Indexing vob files on 2.7.0
Post by: elese on January 28, 2018, 12:33:37 AM
QuoteIf this turns out to be insufficient, please test with Avidemux built from the current git master, see http://avidemux.org/smif/index.php/topic,18182.msg83108.html.

Also I did try installing the latest version from git but unfortunately no difference really (180126_5122a864e5f) .  The .idx2 file above was generated from the git version.

As for old binaries, yes they work fine. I went to packages.ubuntu.com and download the .deb files and the dependencies and install them manually with dpkg -i. I appreciate this isn't the 'orthodox' way, but it was more convenient that compiling 2.5.6 from source.

The risk generally would be to mess up your system though having conflicting old and new libraries. It probably isn't a good idea to do it too much, and not with packages integral to the system for sure. I don't know what any serious repository maintainers would think though... there are probably threads out there about installing packages from older/newer releases or from different distros.

Title: Re: Indexing vob files on 2.7.0
Post by: Jan Gruuthuse on January 28, 2018, 05:16:21 AM
one of the reasons
- up to 2.5 branch avidemux is a frame based editor
- from 2.6 onwards avidemux is a time based as newer codecs are no longer frame based. Single image information is no longer stored in one frame, but rather in segments in past and upcoming segments.

Very rudimentary user explanation.
Title: Re: Indexing vob files on 2.7.0
Post by: Jan Gruuthuse on January 28, 2018, 05:33:22 AM
Quote from: elese on January 28, 2018, 12:14:24 AM
>8 >8 A few workarounds were suggested as being to rip the dvd into a container, like .mkv, that avidemux can use >8 >8

No, not ripping into mkv container. Re-muxing into mkv container.
You're aware that ripping can contain errors induced by the original dvd producers, (to prevent you from circumventing / as part of) the DRM on commercial dvd's.
Title: Re: Indexing vob files on 2.7.0
Post by: eumagga0x2a on January 28, 2018, 10:25:00 AM
Quote from: elese on January 28, 2018, 12:14:24 AM
I can upload a few .iso files (legally/publically available) to a site if this would help development?

This would be indeed the best. For starters you could provide Avidemux log from the latest git (delete .idx2 for an affected set of VOBs, run avidemux3_qt5 in terminal as

avidemux3_qt5 > ~/admlog.txt

open the first VOB of the set, let it index the set, then compress and attach admlog.txt from your home directory to your reply). From the provided index files I can only see that the current version fails to read the full video, but not why it happens.
Title: Re: Indexing vob files on 2.7.0
Post by: elese on January 30, 2018, 05:21:56 PM
Ok the video files and the Avidemux logs for two videos (creative commons licence) below.

I recorded them from Youtube on a Virgin media box/TV onto my DVD recorder, and then used dvd::rip to extract the .vob files. My wifi connection can sometimes vary a little but the recordings should generally be good.

I'm happy to do any patching etc.

https://drive.google.com/open?id=1bmlPa9mhxmFUEg4QXdvAHlQHhbXRsw41

https://drive.google.com/open?id=1l_kq6jKZnb2-1z2NrPP3Y2O0DOfHKsGi






Title: Re: Indexing vob files on 2.7.0
Post by: eumagga0x2a on January 30, 2018, 07:34:42 PM
Quote from: elese on January 30, 2018, 05:21:56 PM
I recorded them from Youtube on a Virgin media box/TV onto my DVD recorder, and then used dvd::rip to extract the .vob files.

Thank you, likely timestamps in the .VOB are reset after ~18 seconds into the video back to zero and Avidemux can't handle this right (though there is some code which tries to manage exactly this). mpv can't play the .VOB either.

But why are you doing all this and accept an awful video quality instead of a simple

youtube-dl -f 22 https://www.youtube.com/watch?v=qFTIc5frqw8

command which would give you a HD (720p) video in excellent quality?
Title: Re: Indexing vob files on 2.7.0
Post by: elese on January 31, 2018, 12:44:14 AM
The recordings I have been making have all been from live-to-air, not from Youtube.

I just used it this time for videos which would be legally re-distributable, in order to show what is happening with my DVD recorder.

QuoteThank you, likely timestamps in the .VOB are reset after ~18 seconds into the video back to zero and Avidemux can't handle this right (though there is some code which tries to manage exactly this). mpv can't play the .VOB either.

Ok... something like below then?

Quoteffmpeg -i in.vob -vf 'setpts=PTS-STARTPTS' -c:a copy -c:v copy out.vob
Title: Re: Indexing vob files on 2.7.0
Post by: eumagga0x2a on January 31, 2018, 06:57:16 AM
Now I really tested loading VTS_01_1.VOB in Avidemux and found no issues, resulting idx2 compressed and attached.
Title: Re: Indexing vob files on 2.7.0
Post by: Jan Gruuthuse on January 31, 2018, 08:34:55 AM
Quote from: elese on January 30, 2018, 05:21:56 PM

I recorded them from Youtube on a Virgin media box/TV onto my DVD recorder, and then used dvd::rip to extract the .vob files. My wifi connection can sometimes vary a little but the recordings should generally be good.

Somewhere in the process, going from digital to analogue (DVD recorder) could introduce these inconsistencies.
Title: Re: Indexing vob files on 2.7.0
Post by: AQUAR on January 31, 2018, 11:01:48 AM
Probably no conversion involving analogue video, with Virgin media box/TV to DVD recorder.

As mentioned earlier its probably due to these vobs being navigated with IFO data.
You might try something old like DVD decrypter and use that to extract the title of interest from the vobs (= a "simple vob set").
Title: Re: Indexing vob files on 2.7.0
Post by: Jan Gruuthuse on January 31, 2018, 12:28:00 PM
My understanding of (Standalone) DVD recorders = box connected to scart (https://en.wikipedia.org/wiki/SCART) (analogue) to record subscription (encoded) tv (cable, ...)
Not burning dvd's on computer ;)
Title: Re: Indexing vob files on 2.7.0
Post by: AQUAR on January 31, 2018, 12:56:47 PM
Yes that's true, I forgot that DVD recorders are crippled so as to avoid HDCP-compliancy.

Hard to imagine that the analogue to digital conversion would cause this kind of issue though.

   
Title: Re: Indexing vob files on 2.7.0
Post by: Jan Gruuthuse on January 31, 2018, 02:25:53 PM
Think this has something to do with buffering and burning the dvd.
Title: Re: Indexing vob files on 2.7.0
Post by: elese on February 01, 2018, 10:27:11 PM
QuoteNow I really tested loading VTS_01_1.VOB in Avidemux and found no issues, resulting idx2 compressed and attached.

I tried extracting the .vob files from the dvd using dvdbackup instead of dvdrip (which is a front-end for transcode), and they now seem to index fine...  You mentioned VTS_01_1.VOB, and transcode just generates a .vob split into 1GB files, without any of the IFO files etc, and not in the format on the DVD.

Is this a problem with using transcode? Are the timestamps or other necessary information lost?

If so, I just wonder whether a line of code would be worthwhile, to the effect of:  "...this vob file contains no timestamps [or whatever the  problem is], which are needed for indexing. For avidemux to process these, they must be extracted from DVDs using xyz-type software [i.e. not transcode]'?

QuoteMy understanding of (Standalone) DVD recorders = box connected to scart (analogue) to record subscription (encoded) tv (cable, ...)
Not burning dvd's on computer

With a SCART cable, yes. Like in the days of VHS...  :D




Title: Re: Indexing vob files on 2.7.0
Post by: eumagga0x2a on February 02, 2018, 10:22:53 AM
Again, I could not find any issues with the "25 years of Linux in 5 minutes" sample. Whatever tool has been used, the result works in Avidemux fine for me.
Title: Re: Indexing vob files on 2.7.0
Post by: elese on February 08, 2018, 11:42:45 PM
QuoteAgain, I could not find any issues with the "25 years of Linux in 5 minutes" sample. Whatever tool has been used, the result works in Avidemux fine for me.

Did you use the vob files generated by transcode though?

Direct links are below:

https://drive.google.com/file/d/1EdkST5wsRvgR3U1bxQ1IxeTL_fQyqlgV/view

https://drive.google.com/file/d/1rJ7syDwaz-NfdvSYrUWn4RsDtkpgpjfu/view

https://drive.google.com/file/d/1Yki-MBts5lxJqwKIInG4MSCP2PjmJHff/view
Title: Re: Indexing vob files on 2.7.0
Post by: eumagga0x2a on February 09, 2018, 09:35:26 PM
These don't work in Avidemux (however, ffmpeg can handle them and Avidemux is able to load mpg files generated by ffmpeg from the samples in copy mode), PsIndexer::handleScrReset fails with these files. The lack of time doesn't allow me to take this issue, unfortunately.

Thank you very much for the samples, hopefully they will allow to find a workaround soon.
Title: Re: Indexing vob files on 2.7.0
Post by: elese on February 09, 2018, 10:37:01 PM
QuoteThese don't work in Avidemux (however, ffmpeg can handle them and Avidemux is able to load mpg files generated by ffmpeg from the samples in copy mode), PsIndexer::handleScrReset fails with these files. The lack of time doesn't allow me to take this issue, unfortunately.

No worries. For anyone reading this thread, using dvdbackup (or AnyDVD on Windows, or equivalent) produced vobs that avidemux could work with.

Thanks for the replies, and to you other guys too