[FFmpeg-devel] H264 Decoder Crashing when enabling b-frames

[Rakesh Manganellore]

We are uisng x264 encoder and ffmpeg h264 decoder as part of our project.
Both x264 encoder and H264 decoder are working properly when we test them
separately (Encoder separately and Decoder Separately)

After integration, The h264 Baseline profile is working fine, Main profile
(Only CABAC enabled) is working fine.
when we enabled B-Frames, code is crashing at below location in "H264.c" in
function mc_dir_part ();

qpix_op[luma_xy](dest_y, src_y, h->mb_linesize); //FIXME try variable height
perhaps?

at this line, the 'src_y' is becoming null. So it is crashing.

When we traced the problem we stuck up at the function
''h264.c->fill_caches(H264Context *h, int mb_type, int for_deblock)'' at
lines

452 : *(uint32_t*)&h->ref_cache[list][scan8[0] + 0 - 1*8]= ((top_type ?
LIST_NOT_USED : PART_NOT_AVAILABLE)&0xFF)*0x01010101;

469 : h->ref_cache[list][cache_idx+8]= left_type[i] ? LIST_NOT_USED :
PART_NOT_AVAILABLE;

483 : h->ref_cache[list][scan8[0] - 1 - 1*8]= topleft_type ? LIST_NOT_USED :
PART_NOT_AVAILABLE;

493 : h->ref_cache[list][scan8[0] + 4 - 1*8]= topright_type ? LIST_NOT_USED
: PART_NOT_AVAILABLE;

At these lines the ref_cache array values becoming either LIST_NOT_USED(-1)
or PART_NOT_AVAILABLE (-2).
So when 'src_y' is taken from 'ref_cache 'array it is getting NULL

Please help me to solve the issue.