[Mono-devel-list] NUnit Regression test suites.

[Miguel de Icaza]

Hey,

> > I would personally like to move tests that are known to fail into a
> > separate test assembly, so we at least have `positive' tests that are
> > supposed to work never fail.  This means that we can put them on the
> > tinderbox and track when we introduce a regression on the runtime,
> > currently days might pass before we find out about a regression.
> > 
> >     There are various possible approaches here:
> > 
> > 	* Build system changes to support two different assemblies
> > 	  (known passing, and known failures).
> > 
> > 	* Ifdef tests that fail (this makes it hard to actively track
> > 	  down bugs and fix them).
> > 
> > 	* Ifdef tests that fail, but file a bugzilla report for each
> > 	  failure (might clog Bugzilla).
> 
> We can use the [Ignore] attribute, so that the tests are still listed.
> 
> so, we would do:
> 
> [Ignore ("has failed since forever -- see bug #xxxxx")]

That works to kill a full test, so we need to move the tests into these
areas where they are just individual failures.

miguel.