[Mono-devel-list] Test policy proposition

[RafaelMizrahi]

Hi Atsushi,

> We don't have "time" data.
If I understand you, "time" can be Now().

> "asserts" are always "1".
Why is that ? the stand_alone test suite report will have one test with an
assert for each xml test, that can pass or fail.

> There are "known failures" rather than "success"
In this case, Maybe Andrew proposal should remove the "known failures" 
And analyzing the status of the test suite should be done through the NUnit
reports system.
My major goal is to have a unified report system, and not to have a special
report for each stand_alone test suite.
I choose NUnit report because we (mainsoft and mono) already created a
report system for NUnit reports.

rafi

-----Original Message-----
From: Atsushi Eno [mailto:atsushi at ximian.com] 
Sent: Monday, May 30, 2005 6:18 PM
To: RafaelMizrahi
Cc: 'Andrew Skiba'; 'mono-devel mailing list'
Subject: Re: [Mono-devel-list] Test policy proposition

Hi Rafi,

RafaelMizrahi wrote:
> Atsushi, 
> I did not suggest to convert or to run them as NUnit,
> I just suggest that it is better to have their output as NUnit report.

Well, then how better is it?

We don't have "time" data.

"asserts" are always "1".

There are "known failures" rather than "success" which only has
"True" or "False". It would be mapped to [Category ("NotWorking")]
which is not reported in our NUnit tests. Or alternatively it
could be mapped to [Ignore], but there are another set of
ignore.lst file which holds tests to be ignored.

Atsushi Eno