[MPlayer-dev-eng] sig11 in pp_postprocess

[Michael Niedermayer]

Hi

On Friday 27 June 2003 12:04, gabucino at mplayerhq.hu wrote:
[...]
> Program received signal SIGSEGV, Segmentation fault.
> [Switching to Thread 1024 (LWP 13895)]
> 0x831b2a9 in pp_postprocess (src=0x7e7e7e7e, srcStride=0x7e7e7e7e,
>     dst=0x898991fc, dstStride=0x89898989, width=-1802197638,
>     height=-1802201964,
>     QP_store=0x9f9fb8f8 <Address 0x9f9fb8f8 out of bounds>,
>     QPStride=-1616928865, vm=0xa9a9cb75, vc=0xa9a9a9a9,
> pict_type=-1263214861) at libpostproc/postprocess.c:838
> 838             if(QP_store==NULL || (mode->lumMode & FORCE_QUANT))
hmm, strange, this can only crash if mode isnt pointing to a allocated PPMode 
struct
perhaps try some memory debugger & make distclean :)

and if that doesnt help then perhaps post the output of:
------ vf_pp.c ---
#ifdef EMU_OLD
    if(name){
#endif
	for(i=0; i<=PP_QUALITY_MAX; i++){
            vf->priv->ppMode[i]= pp_get_mode_by_name_and_quality(name, i);
+fprintf(stderr, "alloc 1 %8X %d\n", vf->priv->ppMode[i], i);
            if(vf->priv->ppMode[i]==NULL) return -1;
        }
#ifdef EMU_OLD
    }else{
        /* hex mode for compatibility */
        for(i=0; i<=PP_QUALITY_MAX; i++){
	    PPMode *ppMode;
	    
	    ppMode= (PPMode*)memalign(8, sizeof(PPMode));
+fprintf(stderr, "alloc 2 %8X %d\n", ppMode, i);
-------------
    
    if(vf->priv->pp || !(mpi->flags&MP_IMGFLAG_DIRECT)){
	// do the postprocessing! (or copy if no DR)
+fprintf(stderr, "call %d %8X\n", vf->priv->pp, vf->priv->ppMode[ vf->priv->pp 
]);
	pp_postprocess(mpi->planes           ,mpi->stride,
		    vf->dmpi->planes,vf->dmpi->stride,
		    (mpi->w+7)&(~7),mpi->h,
		    mpi->qscale, mpi->qstride,
		    vf->priv->ppMode[ vf->priv->pp ], vf->priv->context,
#ifdef PP_PICT_TYPE_QP2
-------------
[...]

-- 
Michael
level[i]= get_vlc(); i+=get_vlc();		(violates patent EP0266049)
median(mv[y-1][x], mv[y][x-1], mv[y+1][x+1]);	(violates patent #5,905,535)
buf[i]= qp - buf[i-1];				(violates patent #?)
for more examples, see http://mplayerhq.hu/~michael/patent.html
stop it, see http://petition.eurolinux.org & http://petition.ffii.org/eubsa/en