[MPlayer-DOCS] [PATCH] How to do regression testing using CVS

[Guillaume POIRIER]

Hi there,
I've ripped off the doc on wine website
(http://www.winehq.org/site/docs/winedev-guide/x1344) to add
information about how to do regression tests using binary search to
our docs.

Comments?

Guillaume
--
Remember, if you ever need a helping hand, it's
at the end of your arm, as you get older, remember
you have another hand:
The first is to help yourself,
the second is to help others.
-- Audrey Hepburn
-------------- next part --------------
Index: en/bugreports.xml
===================================================================
RCS file: /cvsroot/mplayer/main/DOCS/xml/en/bugreports.xml,v
retrieving revision 1.11
diff -u -r1.11 bugreports.xml
--- en/bugreports.xml	31 Mar 2005 22:28:24 -0000	1.11
+++ en/bugreports.xml	26 Nov 2005 21:05:41 -0000
@@ -22,6 +22,75 @@
 mailing list will assist you if you have questions.
 </para>
 </sect1>
+<sect1 id="bugreports_regression_test">
+<title>How to do regression testing using CVS</title>
+<para>
+A problem that can happen sometimes is 'it used to work before, now it
+doesn't anymore...'.
+Here is a step by step procedure to try to pinpoint when the problem
+occurred. This is <emphasis role="bold">not</emphasis> for casual users.
+</para>
+<para>
+First, you'd need to fetch MPlayer's source tree from CVS.
+Instructions can be found at the bottom of
+<ulink url="http://www.mplayerhq.hu/homepage/dload.html">this page</ulink>.
+</para>
+<para>
+You will have now in the main/ directory an image of the CVS tree, on the
+client side.
+Now update this image to the date you want:
+<screen>
+cd main/
+cvs update -PAd -D "2004-08-23 CDT"
+</screen>
+The date format is YYYY-MM-DD HH:MM:SS.
+Using the CDT date format ensure that you will be able to extract patches
+in a way that will be compatible with the
+<ulink url="http://mplayerhq.hu/pipermail/mplayer-cvslog/">mplayer-cvslog archive</ulink>.
+</para>
+<para>
+Now proceed as for a normal update:
+<screen>
+./configure
+make
+</screen>
+</para>
+<para>
+If any non-programmer reads this, the fastest method to get at the point
+where the problem occurred is to use a binary search, that is, search the
+date of the breackage by repeatedly dividing the search interval in half.
+For example, if the problem occurred in 2003, start at mid-year, then is
+the problem is already here, back to 1st April, if not, to 1st October,
+and so on.
+</para>
+<para>
+If you have lot of hard disk free space (a full compile currently takes
+100 Mb), copy the oldest known working version before updating it, it will
+save time if you need to go back.
+(It's better to make distclean before going back in time, so you have to
+make everything if you don't backup the older version).
+</para>
+<para>
+When you have found the day where the problem happened, continue the search
+using the mplayer-cvslog archive (sorted by date) and a more precise cvs
+update including hour, minute, second:
+<screen>
+cvs update -PAd -D "2004-08-23 15:17:25 CDT"
+</screen>
+This will allow you to find easily the exact patch that did it.
+</para>
+<para>
+If you find the patch that is the cause of the problem, you have almost won;
+report about it to
+<ulink url="http://bugzilla.mplayerhq.hu/">MPlayer Bugzilla</ulink> or
+subscribe to 
+<ulink url="http://mplayerhq.hu/mailman/listinfo/mplayer-users">MPlayer-users</ulink>
+and post it there.
+There is a chance that the author will jump in to suggest a fix; or there
+is always the possibility to look hard at the patch until it is coerced to
+reveal where is the bug :-).
+</para>
+</sect1>
 <sect1 id="bugreports_report">
 <title>How to report bugs</title>
 <para>