[Mono-devel-list] no regression policy for System.XML
kostat at mainsoft.com
Tue May 31 05:22:57 EDT 2005
I would partially agree with Jose:
It seems reasonable to run all the XML tests before each commit. Since
the commit is made only 1-2 times per day, it's not very difficult to
wait for another 5 minutes. The benefit is clear: SVN is stable.
From the other side, running 'everything' is more complicated, as it
can take much more time and probability for a regression is relatively
low. So postponing it to the nightly build looks reasonable.
Jose Cornado wrote:
>My two cents:
>I think this should apply to the rest of the code base: the only real
>solution is to run everything with each build. The Mythical Man Month
>comes to mind.
>Excluding the slowest test will be risky. They are slow because they
>hit critical/complex paths more often than not. A bug caught here is
>worth more than anywhere else.
>The problem to solve is to increase the test/unit of time ratio so the
>slow and critical tests can be included.
>There is a hard limit set by the QA tools but a lot can still be
>achieved by playing around with the QA machines/lab setup.
>Mono-devel-list mailing list
>Mono-devel-list at lists.ximian.com
More information about the Mono-devel-list