[Mono-list] Linux test status

Martin Baulig martin@gnome.org
01 Mar 2002 19:37:02 +0100


Hi guys,

here's a new status report about the testsuite on Linux.

Currently, 23 of 26 tests run on Linux.

Missing are (see mcs/class/corlib/Test/System/MartinTests.cs):

====
        // MathTest: jit.c: line 1026 (mono_store_tree): assertion failed: (s->svt != VAL_UNKNOWN)

	// RandomTest: tree mismatch
	// (STIND_I4 ADDR_L[10] (CGT (LDIND_R8 ADDR_L[3]) CONST_R8))
	//
	// (STIND_I4 ADDR_L[10] (CGT (LDIND_R8 ADDR_L[3]) CONST_R8))
        // BR
	// file emit-x86.c: line 561 (mono_label_cfg): should not be reached

	// SByteTest: tree mismatch
	// (STIND_I4 ADDR_L[18] (MUL_OVF (CONV_OVF_I4 (LDIND_I1 ADDR_L[1])) CONST_I4))
	//
	// (STIND_I4 ADDR_L[18] (MUL_OVF (CONV_OVF_I4 (LDIND_I1 ADDR_L[1])) CONST_I4))
	// (STIND_I1 ADDR_L[1] (CONV_OVF_I1 (ADD_OVF (LDIND_I4 ADDR_L[18]) (SUB_OVF (LDIND_U2 ADDR_L[6]) CONST_I4))))
	// (STIND_I1 ADDR_L[5] CONST_I4)
	// BR
	// file emit-x86.c: line 561 (mono_label_cfg): should not be reached
====

Here are the complete test results (some errors are due to missing support in the runtime):

====
*** MultDiv: result mismatch for  .                                        #0  1.                                        #1
*** MultDiv: unexpected overflow for  .                                        #0  1.                                        #1
There were 11 errors:
1) System.BitConverter testsuite(MonoTests.System.RunBitConverterTest): An invalid argument was specified.(System.ArgumentException)
System.ArgumentException
An invalid argument was specified.System.ArgumentExceptionin System.Array:CopyTo ()
in MonoTests.System.BitConverterTest:PrivateTestBool ()
in MonoTests.System.BitConverterTest:TestBool ()
in MonoTests.System.RunBitConverterTest:RunTest ()
in NUnit.Framework.TestCase:RunBare ()
in .ProtectedProtect:Protect ()
2) MonoTests.System.ByteTests testcase(MonoTests.System.RunByteTest): The requested feature is not yet implemented(System.NotImplementedException)
System.NotImplementedException
The requested feature is not yet implementedSystem.NotImplementedExceptionin System.Byte:Parse ()
in System.Byte:Parse ()
in MonoTests.System.ByteTest:TestParse ()
in MonoTests.System.RunByteTest:RunTest ()
in NUnit.Framework.TestCase:RunBare ()
in .ProtectedProtect:Protect ()
3) MonoTests.System.DecimalTest2 testcase(MonoTests.System.RunDecimalTest2): Overflow on subtracting decimal nummbers(System.OverflowException)
System.OverflowException
Overflow on subtracting decimal nummbersSystem.OverflowExceptionin System.Decimal:Subtract ()
in System.Decimal:op_Subtraction ()
in MonoTests.System.DecimalTest2:ReportOpError ()
in MonoTests.System.DecimalTest2:TestMult ()
in MonoTests.System.RunDecimalTest2:RunTest ()
in NUnit.Framework.TestCase:RunBare ()
in .ProtectedProtect:Protect ()
4) MonoTests.System.Int16Test testcase(MonoTests.System.RunInt16Test): file codegen-x86.c: line 1489 (mono_burg_emit_43): should not be reached(System.ExecutionEngineException)
System.ExecutionEngineException
file codegen-x86.c: line 1489 (mono_burg_emit_43): should not be reachedSystem.ExecutionEngineExceptionin (unmanaged) System.Int16:Parse ()
in MonoTests.System.Int16Test:TestParse ()
in MonoTests.System.RunInt16Test:RunTest ()
in NUnit.Framework.TestCase:RunBare ()
in .ProtectedProtect:Protect ()
5) MonoTests.System.Int32Test testcase(MonoTests.System.RunInt32Test): Number overflow(System.OverflowException)
System.OverflowException
Number overflowSystem.OverflowExceptionin System.Int32:Parse ()
in MonoTests.System.Int32Test:TestParse ()
in MonoTests.System.RunInt32Test:RunTest ()
in NUnit.Framework.TestCase:RunBare ()
in .ProtectedProtect:Protect ()
6) MonoTests.System.Int64Test(MonoTests.System.RunInt64Test): Number overflow(System.OverflowException)
System.OverflowException
Number overflowSystem.OverflowExceptionin System.IntegerFormatter:FormatGeneral ()
in System.IntegerFormatter:NumberToString ()
in System.Int64:ToString ()
in System.Int64:ToString ()
in MonoTests.System.Int64Test:TestRoundTripGeneral ()
in MonoTests.System.RunInt64Test:RunTest ()
in NUnit.Framework.TestCase:RunBare ()
in .ProtectedProtect:Protect ()
7) MonoTests.System.StringTest testcase(MonoTests.System.RunStringTest): A null value was found where an object instance was required(System.NullReferenceException)
System.NullReferenceException
A null value was found where an object instance was requiredSystem.NullReferenceExceptionin System.String:Join ()
in MonoTests.System.StringTest:TestJoin ()
in MonoTests.System.RunStringTest:RunTest ()
in NUnit.Framework.TestCase:RunBare ()
in .ProtectedProtect:Protect ()
8) MonoTests.System.TimeSpanTest testcase(MonoTests.System.RunTimeSpanTest): The specified format is invalid(System.FormatException)
System.FormatException
The specified format is invalidSystem.FormatExceptionin System.IntegerFormatter:NumberToString ()
in System.Int32:ToString ()
in System.String:Format ()
in System.String:Format ()
in System.TimeSpan:ToString ()
in MonoTests.System.TimeSpanTest:TestCtors ()
in MonoTests.System.RunTimeSpanTest:RunTest ()
in NUnit.Framework.TestCase:RunBare ()
in .ProtectedProtect:Protect ()
9) MonoTests.System.UInt16Test testcase(MonoTests.System.RunUInt16Test): The requested feature is not yet implemented(System.NotImplementedException)
System.NotImplementedException
The requested feature is not yet implementedSystem.NotImplementedExceptionin System.UInt16:Parse ()
in System.UInt16:Parse ()
in MonoTests.System.UInt16Test:TestParse ()
in MonoTests.System.RunUInt16Test:RunTest ()
in NUnit.Framework.TestCase:RunBare ()
in .ProtectedProtect:Protect ()
10) MonoTests.System.UInt32Test testcase(MonoTests.System.RunUInt32Test): file codegen-x86.c: line 1562 (mono_burg_emit_49): should not be reached(System.ExecutionEngineException)
System.ExecutionEngineException
file codegen-x86.c: line 1562 (mono_burg_emit_49): should not be reachedSystem.ExecutionEngineExceptionin (unmanaged) System.UInt32:Parse ()
in MonoTests.System.UInt32Test:TestCompareTo ()
in MonoTests.System.RunUInt32Test:RunTest ()
in NUnit.Framework.TestCase:RunBare ()
in .ProtectedProtect:Protect ()
11) MonoTests.System.DateTimeTest testcase(MonoTests.System.RunDateTimeTest): Argument is out of range(System.ArgumentOutOfRangeException)
System.ArgumentOutOfRangeException
Argument is out of rangeSystem.ArgumentOutOfRangeExceptionin System.CurrentTimeZone:GetDaylightChanges ()
in System.TimeZone:IsDaylightSavingTime ()
in System.CurrentTimeZone:GetUtcOffset ()
in System.DateTime:.ctor ()
in System.DateTime:_DoParse ()
in System.DateTime:ParseExact ()
in System.DateTime:ParseExact ()
in System.DateTime:ParseExact ()
in MonoTests.System.DateTimeTest:TestParseExact ()
in MonoTests.System.RunDateTimeTest:RunTest ()
in NUnit.Framework.TestCase:RunBare ()
in .ProtectedProtect:Protect ()
There were 7 failures:
1) MonoTests.System.ArrayTest testsuite(MonoTests.System.RunArrayTest)
NUnit.Framework.AssertionFailedError
NUnit.Framework.AssertionFailedErrorin NUnit.Framework.Assertion:Fail ()
in NUnit.Framework.Assertion:Assert ()
in NUnit.Framework.Assertion:AssertNotNull ()
in MonoTests.System.ArrayTest:TestGetEnumerator ()
in MonoTests.System.RunArrayTest:RunTest ()
in NUnit.Framework.TestCase:RunBare ()
in .ProtectedProtect:Protect ()
2) MonoTests.System.ConsoleTest testsuite(MonoTests.System.RunConsoleTest) "Wrong line expected:<This is a readline test> but was:<>"
3) MonoTests.System.EnumTest testsuite(MonoTests.System.RunEnumTest) "Compare type mismatch not caught."
4) MonoTests.System.DecimalTest testcase(MonoTests.System.RunDecimalTest) "12.33333333333333333333333333333333333333 (format = 'F') != 12.35"
5) MonoTests.System.ObjectTest testsuite(MonoTests.System.RunObjectTest) "NaNs should always equal each other"
6) MonoTests.System.UInt64Test testcase(MonoTests.System.RunUInt64Test)
NUnit.Framework.AssertionFailedError
NUnit.Framework.AssertionFailedErrorin NUnit.Framework.Assertion:Fail ()
in NUnit.Framework.Assertion:Assert ()
in NUnit.Framework.Assertion:Assert ()
in MonoTests.System.UInt64Test:TestParse ()
in MonoTests.System.RunUInt64Test:RunTest ()
in NUnit.Framework.TestCase:RunBare ()
in .ProtectedProtect:Protect ()
7) MonoTests.System.DoubleTests testcase(MonoTests.System.RunDoubleTest) "CompareTo Failed expected:<0> but was:<-2147483648>"

FAILURES!!!
Tests Run: 23, Failures: 7, Errors: 11
======

I uploaded a RunTests.corlib.exe which attempts to call all tests to

        http://cip.uni-trier.de/baulig/misc/mono/

Btw. whoever wrote the tests, please make sure they pass on Windows - I got the following:

======
*** Div: result mismatch for 79228162514264337593543950335 #6  10 #4
Ist:7922816251426433759354395034  Soll:7922816251426433759354395033.5  delta=0.5  ==False
*** DivMult: unexpected overflow for 7922816251426433759354395034 #6  10 #4
Ist:0  Soll:79228162514264337593543950335  delta=-79228162514264337593543950335  ==False
*** Div: result mismatch for -79228162514264337593543950335 #7  10 #4
Ist:-7922816251426433759354395034  Soll:-7922816251426433759354395033.5  delta=-0.5  ==False
*** DivMult: unexpected overflow for -7922816251426433759354395034 #7  10 #4
Ist:0  Soll:-79228162514264337593543950335  delta=79228162514264337593543950335  ==False
There were 4 failures:
1) MonoTests.System.DecimalTest testcase(MonoTests.System.RunDecimalTest) "-79,228,162,514,264,337,593,543,950,335.000 (format = 'N3') != (79,228,162,514,264,337,593,543,950,335.000)"
2) MonoTests.System.DecimalTest2 testcase(MonoTests.System.RunDecimalTest2) "2 wrong division, 2 wrong overflows, 0
wrong divide by zero, "
======

I'm going to fix this after dinner.

-- 
Martin Baulig
martin@gnome.org