[FFmpeg-devel] [PATCH v3] fate: Add a target for listing failed tests

[Martin Storsjö]

On Mon, 9 Dec 2024, Martin Storsjö wrote:

> If running tests with "make -j<N> fate", the execution will stop
> after the first failing test. To get an overview of the whole
> test suite, one rather would run "make -k -j<N> fate", which then
> again buries the results about what tests actually failed further
> up in the console log.
>
> Add a target so one can run "make fate-list-failing", to see a list
> of all tests that failed the last time they were executed.
>
> Also add a companion target "fate-clear-results" which removes all
> the old test results. (When executing a subset of tests, the result
> files of all tests that aren't executed stay untouched. This also
> allows getting rid of results for tests that no longer are present
> in the testsuite.)
>
> Co-authored-by: Alexander Strasser <eclipse7 at gmx.net>
> ---
> v3: Renamed the clear target to "fate-clear-reports", and updated
> the docs accordingly. Added the check for whether there are any
> *.rep files at all.
> ---
> doc/build_system.txt | 7 +++++++
> doc/fate.texi        | 7 +++++++
> tests/Makefile       | 6 ++++++
> 3 files changed, 20 insertions(+)

This was ok'd by Alexander on irc, so I pushed it (a couple of hours ago).

// Martin