No video in tests with v.2.6.3+ but no issue with 2.5.4

[theat934]

Hi all,

I used v.2.6.3 on MacOS to encode a .MTS raw camera file into an .AVI file ("testVideo.avi") with x.264 in full 1920x1080 resolution. Then I took "testVideo.avi" and tried to re-encode it into a lower 640x360 frame.

The x.264 settings in both cases are the same, but for the bitrate and video size. For example, here are the 640x360 encoding specifications taken from the stats file: #options: 640x360 fps=30000/1001 timebase=1001/30000 bitdepth=8 cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=9 psy=1 psy_rd=1.00:0.00 mixed_ref=0 me_range=16 chroma_me=0 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=2 b_pyramid=1 b_adapt=2 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=300 keyint_min=30 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=abr mbtree=1 bitrate=900 ratetol=1.0 qcomp=0.60 qpmin=10 qpmax=51 qpstep=4 ip_ratio=1.00 aq=1:1.00

No matter what I try, as soon as the encoder steps into the encoding pass (the main single, or the second in a two-pass specification) the encoder loops endlessly and only writes the audio to the output file. I always need to abort the process to terminate this loop. A window shot of the perpetual pass is attached below; the audio is size 0 because the snapshot comes from the very small sample "testVideo.avi".

The issue persisted when running the above tests under both v.2.6.3 and the presently current r8606. I also tried resizing the sample "testVideo.avi" in v.2.5.4 with the exact same options as above, and the process went flawlessly.

To try and reproduce/study the issue, you can obtain the sample "testVideo.avi" file (26.3 MB) at:
http://db.tt/BZf6Rt85

Thanks,
Alexander.