[Mono-list] Exception in apache (mod_mono) error logs

Tomi bosak.tomas at gmail.com
Thu Feb 3 05:53:35 EST 2011 

Hi,

    I'm running mono (with sgen), xsp and mod_mono (all three from
master branch Jan 18 21:07:17 2011) on Ubuntu server (11.04) VPS where
are hosted 4 ASP.NET MVC 1 and 2 based web applications
(MonoAutoApplication disabled). I can see from time to time (usually
once or twice a day) this kind of message in apache error.log file
which is caused by the same web application every time (MVC 2 based
with some XML functionality in it - I don't know much about it since
I'm not a developer of this application):

..
Stacktrace:

  at System.Web.UI.Page.ProcessException (System.Exception) <0x00025>
  at System.Web.UI.Page.ProcessRequest (System.Web.HttpContext) <0x001a7>
  at System.Web.Mvc.ViewPage.ProcessRequest (System.Web.HttpContext) <0x00033>
  at System.Web.Mvc.HttpHandlerUtil/ServerExecuteHttpHandlerWrapper/<ProcessRequest>c__AnonStorey50.<>m__7D
() <0x00028>
  at System.Web.Mvc.HttpHandlerUtil/ServerExecuteHttpHandlerWrapper/<Wrap>c__AnonStorey51.<>m__7E
() <0x00014>
  at System.Web.Mvc.HttpHandlerUtil/ServerExecuteHttpHandlerWrapper.Wrap<TResult>
(System.Func`1<TResult>) <0x00027>
  at System.Web.Mvc.HttpHandlerUtil/ServerExecuteHttpHandlerWrapper.Wrap
(System.Action) <0x00067>
  at System.Web.Mvc.HttpHandlerUtil/ServerExecuteHttpHandlerWrapper.ProcessRequest
(System.Web.HttpContext) <0x0006f>
  at System.Web.HttpServerUtility.Execute
(System.Web.IHttpHandler,System.IO.TextWriter,bool,string,string,bool,bool)
<0x0043e>
  at System.Web.HttpServerUtility.Execute
(System.Web.IHttpHandler,System.IO.TextWriter,bool) <0x0006b>
  at System.Web.HttpServerUtilityWrapper.Execute
(System.Web.IHttpHandler,System.IO.TextWriter,bool) <0x00037>
  at System.Web.Mvc.ViewPage.RenderView (System.Web.Mvc.ViewContext) <0x001e9>
  at System.Web.Mvc.WebFormView.RenderViewPage
(System.Web.Mvc.ViewContext,System.Web.Mvc.ViewPage) <0x00082>
  at System.Web.Mvc.WebFormView.Render
(System.Web.Mvc.ViewContext,System.IO.TextWriter) <0x000af>
  at System.Web.Mvc.ViewResultBase.ExecuteResult
(System.Web.Mvc.ControllerContext) <0x00158>
  at System.Web.Mvc.ControllerActionInvoker.InvokeActionResult
(System.Web.Mvc.ControllerContext,System.Web.Mvc.ActionResult)
<0x0001d>
  at System.Web.Mvc.ControllerActionInvoker/<InvokeActionResultWithFilters>c__AnonStorey38.<>m__47
() <0x00022>
  at System.Web.Mvc.ControllerActionInvoker.InvokeActionResultFilter
(System.Web.Mvc.IResultFilter,System.Web.Mvc.ResultExecutingContext,System.Func`1<System.Web.Mvc.ResultExecutedContext>)
<0x000c3>
  at System.Web.Mvc.ControllerActionInvoker/<InvokeActionResultWithFilters>c__AnonStorey38/<InvokeActionResultWithFilters>c__AnonStorey39.<>m__4A
() <0x0001f>
  at System.Web.Mvc.ControllerActionInvoker.InvokeActionResultWithFilters
(System.Web.Mvc.ControllerContext,System.Collections.Generic.IList`1<System.Web.Mvc.IResultFilter>,System.Web.Mvc.ActionResult)
<0x00151>
  at System.Web.Mvc.ControllerActionInvoker.InvokeAction
(System.Web.Mvc.ControllerContext,string) <0x00264>
  at System.Web.Mvc.Controller.ExecuteCore () <0x0006f>
  at System.Web.Mvc.ControllerBase.Execute
(System.Web.Routing.RequestContext) <0x00038>
  at System.Web.Mvc.ControllerBase.System.Web.Mvc.IController.Execute
(System.Web.Routing.RequestContext) <0x00015>
  at System.Web.Mvc.MvcHandler/<BeginProcessRequest>c__AnonStorey5A.<>m__90
() <0x0002e>
  at System.Web.Mvc.Async.AsyncResultWrapper/<MakeVoidDelegate>c__AnonStorey28.<>m__2A
() <0x00015>
  at (wrapper delegate-invoke) <Module>.invoke_AsyncVoid__this__ () <0xffffffff>
  at System.Web.Mvc.Async.AsyncResultWrapper/<BeginSynchronous>c__AnonStorey2A`1<System.Web.Mvc.Async.AsyncVoid>.<>m__2D
(System.IAsyncResult) <0x00015>
  at (wrapper delegate-invoke)
<Module>.invoke_AsyncVoid__this___IAsyncResult (System.IAsyncResult)
<0xffffffff>
  at System.Web.Mvc.Async.AsyncResultWrapper/WrappedAsyncResult`1<System.Web.Mvc.Async.AsyncVoid>.End
() <0x00069>
  at System.Web.Mvc.Async.AsyncResultWrapper.End<System.Web.Mvc.Async.AsyncVoid>
(System.IAsyncResult,object) <0x0001f>
  at System.Web.Mvc.Async.AsyncResultWrapper.End
(System.IAsyncResult,object) <0x00013>
  at System.Web.Mvc.MvcHandler.EndProcessRequest (System.IAsyncResult) <0x0001b>
  at System.Web.Mvc.MvcHandler.System.Web.IHttpAsyncHandler.EndProcessRequest
(System.IAsyncResult) <0x00018>
  at System.Web.HttpApplication.async_handler_complete_cb
(System.IAsyncResult) <0x000fb>
  at System.Web.Mvc.Async.AsyncResultWrapper/WrappedAsyncResult`1<System.Web.Mvc.Async.AsyncVoid>.Begin
(System.AsyncCallback,object,int) <0x000e7>
  at System.Web.Mvc.Async.AsyncResultWrapper.BeginSynchronous<System.Web.Mvc.Async.AsyncVoid>
(System.AsyncCallback,object,System.Func`1<System.Web.Mvc.Async.AsyncVoid>,object)
<0x000f3>
  at System.Web.Mvc.Async.AsyncResultWrapper.BeginSynchronous
(System.AsyncCallback,object,System.Action,object) <0x00037>
  at System.Web.Mvc.MvcHandler.BeginProcessRequest
(System.Web.HttpContextBase,System.AsyncCallback,object) <0x0025f>
  at System.Web.Mvc.MvcHandler.BeginProcessRequest
(System.Web.HttpContext,System.AsyncCallback,object) <0x00053>
  at System.Web.Mvc.MvcHandler.System.Web.IHttpAsyncHandler.BeginProcessRequest
(System.Web.HttpContext,System.AsyncCallback,object) <0x00023>
  at System.Web.HttpApplication/<Pipeline>c__Iterator3.MoveNext () <0x033d8>
  at System.Web.HttpApplication.Tick () <0x0003d>
  at System.Web.HttpApplication.Start (object) <0x00197>
  at System.Web.HttpApplication.System.Web.IHttpHandler.ProcessRequest
(System.Web.HttpContext) <0x0003b>
  at System.Web.HttpRuntime.Process (System.Web.HttpWorkerRequest) <0x00223>
  at System.Web.HttpRuntime.RealProcessRequest (object) <0x00097>
  at System.Web.HttpRuntime.ProcessRequest
(System.Web.HttpWorkerRequest) <0x0004b>
  at Mono.WebServer.MonoWorkerRequest.ProcessRequest () <0x00083>
  at Mono.WebServer.BaseApplicationHost.ProcessRequest
(Mono.WebServer.MonoWorkerRequest) <0x00083>
  at Mono.WebServer.ModMonoApplicationHost.ProcessRequest
(int,string,string,string,string,string,int,string,int,string,string[],string[],object)
<0x00523>
  at (wrapper remoting-invoke-with-check)
Mono.WebServer.ModMonoApplicationHost.ProcessRequest
(int,string,string,string,string,string,int,string,int,string,string[],string[],object)
<0xffffffff>
  at Mono.WebServer.ModMonoWorker.InnerRun (object) <0x0065f>
  at Mono.WebServer.ModMonoWorker.Run (object) <0x0002f>
  at (wrapper runtime-invoke)
<Module>.runtime_invoke_void__this___object
(object,intptr,intptr,intptr) <0xffffffff>

Native stacktrace:

	/usr/local/bin/mono() [0x491e71]
	/lib/libpthread.so.0(+0xfc80) [0x7fa4651b0c80]
	/lib/libc.so.6(gsignal+0x35) [0x7fa464e52b45]
	/lib/libc.so.6(abort+0x186) [0x7fa464e56496]
	/usr/local/bin/mono() [0x5d313c]
	/usr/local/bin/mono() [0x5d31f5]
	/usr/local/bin/mono() [0x5c92c9]
	/usr/local/bin/mono() [0x4ca4b4]
	/usr/local/bin/mono() [0x4199aa]
	/usr/local/bin/mono() [0x41b8fd]
	/usr/local/bin/mono() [0x41c82d]
	/usr/local/bin/mono() [0x41d0bd]
	/usr/local/bin/mono() [0x493a79]
	[0x41657bba]

Debug info from gdb:


=================================================================
Got a SIGABRT while executing native code. This usually indicates
a fatal error in the mono runtime or one of the native libraries
used by your application.
=================================================================

[Mon Jan 31 11:39:29 2011] [error] (104)Connection reset by peer:
read_data failed
[Mon Jan 31 11:39:29 2011] [error] Command stream corrupted, last command was -1
[Mon Jan 31 11:39:29 2011] [error] (70014)End of file found: read_data failed
[Mon Jan 31 11:39:29 2011] [error] Command stream corrupted, last command was 1
Listening on: /tmp/mod_mono_server_mywebsite
Root directory: /var/www/my.web.site
...

There were also these kind of messages:

...
[Mon Jan 31 11:38:27 2011] [alert] (11)Resource temporarily
unavailable: apr_thread_create: unable to create worker thread
[Mon Jan 31 11:38:27 2011] [emerg] (22)Invalid argument:
ap_queue_info_set_idle failed. Attempting to shutdown process
gracefully.
// now few hundreds of these:
[Mon Jan 31 11:38:27 2011] [crit] (22)Invalid argument: ap_queue_pop failed
// and then few tens of these:
[Mon Jan 31 11:38:29 2011] [alert] (11)Resource temporarily
unavailable: apr_thread_create: unable to create worker thread
// and then the same exception as stated earlier

I moved this web application from my older VPS instance, where was
stable installation of mono 2.4.something (with boehm) because it was
causing memory leaks, to current one with sgen GC (I suspected boehm
for those memory leaks). Today I found this application not properly
working when accessing it through browser (instead of browsing, the
download option popups) and only restart of apache set it back to
normal. This error log messages is probably the only clue I have since
I can't determine which parts of web application are causing these
problems. Any ideas what might be wrong? I can supply apache
configuration if it will help. Thanks for your time and help.

More information about the Mono-list mailing list