Author Topic: Avidemux 2.7.1 can't load 30Gb MPEG-TS HEVC file  (Read 460 times)

douche

  • Jr. Member
  • **
  • Posts: 95
Avidemux 2.7.1 can't load 30Gb MPEG-TS HEVC file
« on: July 08, 2018, 03:17:52 PM »
reproduce
1) import this file
2) avidemux stucks at indexing on 17-18%
3) file
Code: [Select]
General
ID                                       : 1 (0x1)
Complete name                            : E:\FIFA.World.Cup.2018.Round.of.16.Spain.Vs.Russia.2160p.WEB-DL.AAC2.0.HDR.HEVC.ts
Format                                   : MPEG-TS
File size                                : 29.5 GiB
Duration                                 : 3 h 35 min
Overall bit rate mode                    : Variable
Overall bit rate                         : 19.6 Mb/s

Video
ID                                       : 256 (0x100)
Menu ID                                  : 1 (0x1)
Format                                   : HEVC
Format/Info                              : High Efficiency Video Coding
Commercial name                          : HDR10
Format profile                           : Main 10@L5.1@Main
Codec ID                                 : 36
Duration                                 : 3 h 35 min
Width                                    : 3 840 pixels
Height                                   : 2 160 pixels
Display aspect ratio                     : 16:9
Frame rate                               : 50.000 FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 10 bits
Color range                              : Limited
Color primaries                          : BT.2020
Transfer characteristics                 : PQ
Matrix coefficients                      : BT.2020 non-constant
Mastering display color primaries        : BT.709
Mastering display luminance              : min: 0.0000 cd/m2, max: 0 cd/m2

Audio
ID                                       : 257 (0x101)
Menu ID                                  : 1 (0x1)
Format                                   : AAC
Format/Info                              : Advanced Audio Codec
Format version                           : Version 2
Format profile                           : LC
Muxing mode                              : ADTS
Codec ID                                 : 15
Duration                                 : 3 h 35 min
Bit rate mode                            : Variable
Channel(s)                               : 2 channels
Channel positions                        : Front: L R
Sampling rate                            : 48.0 kHz
Frame rate                               : 46.875 FPS (1024 SPF)
Compression mode                         : Lossy

Menu
ID                                       : 4096 (0x1000)
Menu ID                                  : 1 (0x1)
Duration                                 : 3 h 35 min
List                                     : 256 (0x100) (HEVC) / 257 (0x101) (AAC)
Service name                             : Service01
Service provider                         : FFmpeg
Service type                             : digital television

eumagga0x2a

  • Hero Member
  • *****
  • Posts: 2136
Re: Avidemux 2.7.1 can't load 30Gb MPEG-TS HEVC file
« Reply #1 on: July 08, 2018, 04:43:48 PM »
I don't think I'll try this at home, but would you please provide admlog.txt (compress it with 7z, gzip or zip if necessary) resulting from the attempt to index the video?

douche

  • Jr. Member
  • **
  • Posts: 95
Re: Avidemux 2.7.1 can't load 30Gb MPEG-TS HEVC file
« Reply #2 on: July 10, 2018, 04:12:55 PM »
idx2 file filled until 00:39:00.564 of video.
attached log.

eumagga0x2a

  • Hero Member
  • *****
  • Posts: 2136
Re: Avidemux 2.7.1 can't load 30Gb MPEG-TS HEVC file
« Reply #3 on: July 10, 2018, 04:33:33 PM »
I'm sorry, but could you please downgrade to the latest release, delete the idx2 file and retry? I have silenced the debug printout from the H265 indexer post-release as it produced incredible amount of messages causing other debug information being lost.

douche

  • Jr. Member
  • **
  • Posts: 95
Re: Avidemux 2.7.1 can't load 30Gb MPEG-TS HEVC file
« Reply #4 on: July 11, 2018, 04:25:01 PM »
Can't attach file it's too big (-> https://www.dropbox.com/s/0uqjgn7zqh75r75/admlog.7z?dl=0)
cut of log
Code: [Select]
SliceType==> 3 xxx
Startcode =35:NAL_H265_AUD, decoding image=1,00:03:30,900
Startcode =39:NAL_H265_SEI_PREFIX, decoding image=0,00:03:30,900
Startcode =0:NAL_H265_TRAIL_N, decoding image=0,00:03:30,900
SliceType==> 3 xxx
Startcode =35:NAL_H265_AUD, decoding image=1,00:03:30,902
Startcode =39:NAL_H265_SEI_PREFIX, decoding image=0,00:03:30,902
Startcode =0:NAL_H265_TRAIL_N, decoding image=0,00:03:30,902
SliceType==> 3 xxx
Startcode =35:NAL_H265_AUD, decoding image=1,00:03:30,904
Startcode =39:NAL_H265_SEI_PREFIX, decoding image=0,00:03:30,904
Startcode =0:NAL_H265_TRAIL_N, decoding image=0,00:03:30,904
SliceType==> 3 xxx
[Ts Demuxer] Pes Packet too big
[Ts Demuxer] Pes for Pid =0x256 does not contain payload start
[Ts Demuxer] Pes for Pid =0x256 does not contain payload start
[Ts Demuxer] Pes for Pid =0x256 does not contain payload start
[Ts Demuxer] Pes for Pid =0x256 does not contain payload start
[Ts Demuxer] Pes for Pid =0x256 does not contain payload start
[Ts Demuxer] Pes for Pid =0x256 does not contain payload start
[Ts Demuxer] Pes for Pid =0x256 does not contain payload start
[Ts Demuxer] Pes for Pid =0x256 does not contain payload start
[Ts Demuxer] Pes for Pid =0x256 does not contain payload start
[Ts Demuxer] Pes for Pid =0x256 does not contain payload start
[Ts Demuxer] Pes for Pid =0x256 does not contain payload start
[Ts Demuxer] Pes for Pid =0x256 does not contain payload start
[Ts Demuxer] Pes for Pid =0x256 does not contain payload start

eumagga0x2a

  • Hero Member
  • *****
  • Posts: 2136
Re: Avidemux 2.7.1 can't load 30Gb MPEG-TS HEVC file
« Reply #5 on: July 12, 2018, 11:16:16 AM »
Thank you, actually you have already pinpointed the issue:

Quote
Code: [Select]
[Ts Demuxer] Pes Packet too big

The PES packet payload size limit TS_PES_MAX_LIMIT, currently at https://github.com/mean00/avidemux2/blob/master/avidemux_plugins/ADM_demuxers/MpegTS/dmxTSPacket.cpp#L26, set to 2 MiB 9 years ago, is not sufficient for this stream. It would be great if you could provide a small (~300 MiB) sample, cut in binary way (like with the dd tool on Linux), from somewhere near the middle of the original TS file.


eumagga0x2a

  • Hero Member
  • *****
  • Posts: 2136
Re: Avidemux 2.7.1 can't load 30Gb MPEG-TS HEVC file
« Reply #7 on: July 14, 2018, 02:10:23 PM »
Thank you for the samples. TS_PES_MAX_LIMIT should be at least 2637792 to allow Avidemux to index the stream. I'm trying to find out whether it is safe to bump the limit.

eumagga0x2a

  • Hero Member
  • *****
  • Posts: 2136
Re: Avidemux 2.7.1 can't load 30Gb MPEG-TS HEVC file
« Reply #8 on: August 08, 2018, 10:59:10 PM »
Please try the latest nightly (r180807 or later) and report back whether it is able to index all your 4k TS files.

douche

  • Jr. Member
  • **
  • Posts: 95
Re: Avidemux 2.7.1 can't load 30Gb MPEG-TS HEVC file
« Reply #9 on: August 11, 2018, 03:42:16 PM »
All my huge .ts files processed.
Thanks.