[Mono-dev] Test suite failures (Mono 2.10.2)

[David Schmitt]

On 24/06/11 19:02, Rodrigo Kumpera wrote:
> It's hard to do such a thing when you factor in that mono supports many
> dozens of targets and configurations and
> that sometimes those breaks were caused my maintainers - I have my share
> of faults.

I know how annoying it is to wait for unit tests to run before 
comitting. It's much better to send that off to some server and code on :)

> Thing is, right now the team at Xamarin has tons of stuff on its hand so
> getting the build infrastructure back on
> track, which helps us a lot, won't happen without community help.
>
> A good first step would be to get CI back working at least on linux. S,
> if someone wants to rebuild the continuous
> integration farm over linode (or other VPS) please speak up.

Non-functional unit tests are *the* major frustration for me when trying 
to work on mono. Since I'm building a product which also should run on 
mono, I do have a big interest in getting mono development back on 
track, and improve the release quality (e.g. by avoiding regressions 
through a working test infrastructure).

I've got extensive experience adminning Debian, a few years on RedHat, 
and I'm responsible for the CC.NET server at my company. So, please just 
tell me how I can help!


Best Regards, David
>
>
> On Thu, Jun 23, 2011 at 4:05 PM, Steve Bjorg <steveb at mindtouch.com
> <mailto:steveb at mindtouch.com>> wrote:
>
>     Here's a thought: only accept code changes that pass all tests?
>       Just saying...
>
>     - Steve
>
>     --------------
>     Steve G. Bjorg
>     http://mindtouch.com
>     http://twitter.com/bjorg
>
>     On Jun 23, 2011, at 11:43 AM, Zoltan Varga wrote:
>
>>     Hi,
>>
>>       Our test suite contains 1000s of tests, written by dozens of
>>     people, its a bit hard to keep them all passing.
>>
>>                         Zoltan
>>
>>     On Thu, Jun 23, 2011 at 7:44 PM, Harry Wilkinson
>>     <hwilkinson at mdsol.com <mailto:hwilkinson at mdsol.com>> wrote:
>>
>>         Hi,
>>
>>         I'm encountering some test failures with the Mono 2.10.2
>>         source tarball distributed at
>>         http://ftp.novell.com/pub/mono/sources/mono/
>>
>>         Basically I'm trying to package it for deployment on Ubuntu
>>         10.04.2 servers in a cloud configuration.  So far I've been
>>         building from source and encountered no significant problems
>>         other than the long build time.  I'd like to be able to reduce
>>         that by building it once and deploying a compiled package.  So
>>         I'm using dpkg-buildpackage.
>>
>>         However, now that I'm packaging rather than just building and
>>         installing, it seems that the test suite is run and there are
>>         some test failures.  The first and most obvious one is that it
>>         appears that a file is missing from the source tarball:
>>
>>         mcs/class/corlib/Test/System.Runtime.Serialization.Formatters.Binary/VersionTolerantSerialization/VersionTolerantSerializationTestLib/6.0/Address.cs
>>
>>         The file is there in the Git repo under the 2.10.2 tag, but
>>         it's not in the tarball.  Unfortunately it's referenced in the
>>         associated Makefile (mcs/class/corlib/Makefile).  The same
>>         applies to 2.10.1, so I'm guessing the file is omitted from
>>         whatever process builds the tarballs.
>>
>>         I switched to compiling from the source taken from Git,
>>         checkout out the 2.10.2 tag, and I get a different error
>>         (which is also what I get with the tarball version if I just
>>         hack the makefile):
>>
>>         make[8]: Entering directory
>>         `/home/hwilkinson/mono/mcs/class/System.Web.DynamicData'
>>         MCS     [net_2_0] System.Web.DynamicData_test_net_2_0.dll
>>         Test/../../System.Web/Test/mainsoft/NunitWeb/NunitWeb/MyTemplateControls.cs(43,19):
>>         error CS0507:
>>         `MyTemplateControls.TestTemplateControl.CreateChildControls()': cannot
>>         change access modifiers when overriding `protected' inherited
>>         member `System.Web.UI.Control.CreateChildControls()'
>>         /home/hwilkinson/mono/mcs/class/lib/net_2_0/System.Web.dll
>>         (Location of the symbol related to previous error)
>>         Compilation failed: 1 error(s), 0 warnings
>>         make[8]: *** [System.Web.DynamicData_test_net_2_0.dll] Error 1
>>
>>         It looks like this could well be an incorrect preprocessor
>>         definition 'SYSTEM_WEB_EXTENSIONS' (not sure whether it should
>>         be defined or not)
>>         in mcs/class/System.Web/Test/mainsoft/NunitWeb/NunitWeb/MyTemplateControls.cs.
>>
>>         Is this expected?  I had sort of assumed that a released
>>         version would have a passing test suite.  Am I doing something
>>         wrong?
>>
>>         Any advice (well, almost) would be gratefully received.
>>
>>         Thanks.
>>
>>         Harry Wilkinson
>>
>>         _______________________________________________
>>         Mono-devel-list mailing list
>>         Mono-devel-list at lists.ximian.com
>>         <mailto:Mono-devel-list at lists.ximian.com>
>>         http://lists.ximian.com/mailman/listinfo/mono-devel-list
>>
>>
>>     _______________________________________________
>>     Mono-devel-list mailing list
>>     Mono-devel-list at lists.ximian.com
>>     <mailto:Mono-devel-list at lists.ximian.com>
>>     http://lists.ximian.com/mailman/listinfo/mono-devel-list
>
>
>     _______________________________________________
>     Mono-devel-list mailing list
>     Mono-devel-list at lists.ximian.com
>     <mailto:Mono-devel-list at lists.ximian.com>
>     http://lists.ximian.com/mailman/listinfo/mono-devel-list
>
>
>
>
> _______________________________________________
> Mono-devel-list mailing list
> Mono-devel-list at lists.ximian.com
> http://lists.ximian.com/mailman/listinfo/mono-devel-list