[FFmpeg-cvslog] r19901 - trunk/tests/vsynth.regression.ref

[Vitor Sessak]

Reimar D?ffinger wrote:
> On Thu, Sep 17, 2009 at 09:33:47PM +0200, Vitor Sessak wrote:
>> reimar wrote:
>>> Author: reimar
>>> Date: Thu Sep 17 20:57:22 2009
>>> New Revision: 19901
>>>
>>> Log:
>>> Update dnxhd regression test to match the majority of FATE machines (which
>>> also have a much saner stddev).
>> I don't know about the stddev, but valgrind is not happy about this test 
>> (reading uninited memory). This is not a false-positive, since the 
>> md5sum differs for different --malloc-fill values.
> 
> I am well aware there is an issue, I suspected so upon my initial
> commit.
> However this updated value represents some kind of "goal" due to the
> much better stddev compared to the previous value and thus makes more
> sense.

I understand, but I think every test added that fail randomly makes 
"make test" less useful, since people consider it failing SNAFU. Are you 
planning to fix this issue any soon?

> While unfortunately failing regression test seem not particularly
> motivate to fix things, at least it will be documented that DV and DNxHD
> encoders are not reliable.

I think disabling this test and adding an entry in the bugtracker is 
better in this case...

-Vitor