[Mono-devel-list] NUnit Regression test suites.

[Sebastien Pouliot]

That's all fine with me :-)

Any other comments ?

Sebastien Pouliot
home: spouliot at videotron.ca
blog: http://pages.infinit.net/ctech/poupou.html


> -----Original Message-----
> From: Nick Drochak [mailto:ndrochak at gol.com]
> Sent: 14 janvier 2005 09:38
> To: spouliot at videotron.ca; mono-devel-list at ximian.com
> Subject: RE: [Mono-devel-list] NUnit Regression test suites.
>
>
> SP,
>
> >| -----Original Message-----
> >| > I planned to go
> >| > through the tests
> >| > again and put [Ignore("Bugzilla 39932")] and such on tests that
> >| > fail there.
> >|
> >| I don't think using [Ignore] is a good idea because:
> >| (a) the tests won't be executed under the MS runtime (with
> run-ondotnet).
> >| The tests risk to bitrot a long time - to the point of not working
> >| correctly on newer MS runtime by the time it is fixed on Mono (e.g.
> >| rarely
> >| used classes);
> >|
> >| (b) there is (or was) no easy way from nunit-console to "try"
> to execute
> >| an
> >| ignored test. So this gets a little harder for people who intend to fix
> >| the
> >| bugs in that category (as they have to change and recompile the test
> >| assembly).
> >|
> >| Using a different [Category] for those tests doesn't have those
> >| inconvenients.
> >|
>
> You are absolutely correct and I agree. I overlooked the .NET side.
>
> So, until someone gives us a more specific bug watching
> attribute, let's use
> [Category("NotMono_1_1")] and [Category("NotMono_2_0")] to avoid
> tests that
> shouldn't be run on a particular version of the framework.  Then we use
> [Category("MonoBug")] to exclude known bugs to get the tests useful for
> regression testing.
>
> I would suggest commenting the bug number, maybe like
>
> [Category("MonoBug")] // http://bugzilla.ximian.com/show_bug.cgi?id=71236
>
> This way we can identify those exclusions that can be removed
> once bugs are
> fixed.
>
> How's that sound?
>
> Nick D.
>
>