[Mono-list] Mono segfault ( Internal error: pc 0x ... in read in psymtab, but not in symtab )

Yury Serdyuk yury at serdyuk.botik.ru
Wed Feb 19 07:36:10 UTC 2014


Hi all !

Mono crashes every time on my application which uses many threads.

I have tried it under several versions of Mono:

1)    Mono  3.0.7   ( without sgen )

> Stacktrace:
>
>
> Native stacktrace:
>
>     mono [0x4a558c]
>     mono [0x4fbbcd]
>     mono [0x416876]
>     /lib64/libpthread.so.0 [0x2b4fcf040b10]
>     mono [0x52e2f4]
>     [0x40564fa6]
>
> Debug info from gdb:
>
> Mono support loaded.
> [Thread debugging using libthread_db enabled]
> [New Thread 0x4244f940 (LWP 9014)]
> [New Thread 0x41375940 (LWP 9012)]
> [New Thread 0x40fd6940 (LWP 9011)]
> [New Thread 0x40dd5940 (LWP 9010)]
> [New Thread 0x4224e940 (LWP 9009)]
> [New Thread 0x4204d940 (LWP 9008)]
> [New Thread 0x41e4c940 (LWP 9007)]
> [New Thread 0x41c4b940 (LWP 9006)]
> [New Thread 0x40bd4940 (LWP 9005)]
> [New Thread 0x4092b940 (LWP 9004)]
> [New Thread 0x4055f940 (LWP 9003)]
> warning: no loadable sections found in added symbol-file 
> system-supplied DSO at 0x7fff289fc000
> 0x00002b4fcf0401c1 in nanosleep () from /lib64/libpthread.so.0
>   12 Thread 0x4055f940 (LWP 9003)  0x00002b4fcf03cee9 in 
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   11 Thread 0x4092b940 (LWP 9004)  0x00002b4fcf03cee9 in 
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   10 Thread 0x40bd4940 (LWP 9005)  0x00002b4fcf03cee9 in 
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   9 Thread 0x41c4b940 (LWP 9006)  0x00002b4fcf03cee9 in 
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   8 Thread 0x41e4c940 (LWP 9007)  0x00002b4fcf03cee9 in 
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   7 Thread 0x4204d940 (LWP 9008)  0x00002b4fcf03cee9 in 
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   6 Thread 0x4224e940 (LWP 9009)  0x00002b4fcf03cee9 in 
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   5 Thread 0x40dd5940 (LWP 9010)  0x00002b4fcf03ed01 in sem_wait ()
>    from /lib64/libpthread.so.0
>   4 Thread 0x40fd6940 (LWP 9011)  0x00002b4fcf0401c1 in nanosleep ()
>    from /lib64/libpthread.so.0
>   3 Thread 0x41375940 (LWP 9012)  0x00002b4fcf03fb3b in accept ()
>    from /lib64/libpthread.so.0
>   2 Thread 0x4244f940 (LWP 9014)  0x00002b4fcf04068f in waitpid ()
>    from /lib64/libpthread.so.0
> * 1 Thread 0x2b4fcf5a6260 (LWP 9002)  0x00002b4fcf0401c1 in nanosleep ()
>    from /lib64/libpthread.so.0
>
> Thread 12 (Thread 0x4055f940 (LWP 9003)):
> #0  0x00002b4fcf03cee9 in pthread_cond_wait@@GLIBC_2.3.2 ()
>    from /lib64/libpthread.so.0
> #1  0x000000000060097b in GC_wait_marker () at pthread_support.c:1905
> #2  0x00000000005f75f6 in GC_help_marker (my_mark_no=12148) at mark.c:1116
> #3  0x00000000005ff681 in GC_mark_thread (id=0x0) at pthread_support.c:559
> #4  0x00002b4fcf03873d in start_thread () from /lib64/libpthread.so.0
> #5  0x00002b4fcf3214bd in clone () from /lib64/libc.so.6
>
> Thread 11 (Thread 0x4092b940 (LWP 9004)):
> #0  0x00002b4fcf03cee9 in pthread_cond_wait@@GLIBC_2.3.2 ()
>    from /lib64/libpthread.so.0
> #1  0x000000000060097b in GC_wait_marker () at pthread_support.c:1905
> #2  0x00000000005f75f6 in GC_help_marker (my_mark_no=12148) at mark.c:1116
> #3  0x00000000005ff681 in GC_mark_thread (id=0x1) at pthread_support.c:559
> #4  0x00002b4fcf03873d in start_thread () from /lib64/libpthread.so.0
> #5  0x00002b4fcf3214bd in clone () from /lib64/libc.so.6
>
> Thread 10 (Thread 0x40bd4940 (LWP 9005)):
> #0  0x00002b4fcf03cee9 in pthread_cond_wait@@GLIBC_2.3.2 ()
>    from /lib64/libpthread.so.0
> #1  0x000000000060097b in GC_wait_marker () at pthread_support.c:1905
> #2  0x00000000005f75f6 in GC_help_marker (my_mark_no=12148) at mark.c:1116
> #3  0x00000000005ff681 in GC_mark_thread (id=0x2) at pthread_support.c:559
> #4  0x00002b4fcf03873d in start_thread () from /lib64/libpthread.so.0
> #5  0x00002b4fcf3214bd in clone () from /lib64/libc.so.6
>
> Thread 9 (Thread 0x41c4b940 (LWP 9006)):
> #0  0x00002b4fcf03cee9 in pthread_cond_wait@@GLIBC_2.3.2 ()
>    from /lib64/libpthread.so.0
> #1  0x000000000060097b in GC_wait_marker () at pthread_support.c:1905
> #2  0x00000000005f75f6 in GC_help_marker (my_mark_no=12148) at mark.c:1116
> #3  0x00000000005ff681 in GC_mark_thread (id=0x3) at pthread_support.c:559
> #4  0x00002b4fcf03873d in start_thread () from /lib64/libpthread.so.0
> #5  0x00002b4fcf3214bd in clone () from /lib64/libc.so.6
>
> Thread 8 (Thread 0x41e4c940 (LWP 9007)):
> #0  0x00002b4fcf03cee9 in pthread_cond_wait@@GLIBC_2.3.2 ()
>    from /lib64/libpthread.so.0
> #1  0x000000000060097b in GC_wait_marker () at pthread_support.c:1905
> #2  0x00000000005f75f6 in GC_help_marker (my_mark_no=12148) at mark.c:1116
> #3  0x00000000005ff681 in GC_mark_thread (id=0x4) at pthread_support.c:559
> #4  0x00002b4fcf03873d in start_thread () from /lib64/libpthread.so.0
> #5  0x00002b4fcf3214bd in clone () from /lib64/libc.so.6
>
> Thread 7 (Thread 0x4204d940 (LWP 9008)):
> #0  0x00002b4fcf03cee9 in pthread_cond_wait@@GLIBC_2.3.2 ()
>    from /lib64/libpthread.so.0
> #1  0x000000000060097b in GC_wait_marker () at pthread_support.c:1905
> #2  0x00000000005f75f6 in GC_help_marker (my_mark_no=12148) at mark.c:1116
> #3  0x00000000005ff681 in GC_mark_thread (id=0x5) at pthread_support.c:559
> #4  0x00002b4fcf03873d in start_thread () from /lib64/libpthread.so.0
> #5  0x00002b4fcf3214bd in clone () from /lib64/libc.so.6
>
> Thread 6 (Thread 0x4224e940 (LWP 9009)):
> #0  0x00002b4fcf03cee9 in pthread_cond_wait@@GLIBC_2.3.2 ()
>    from /lib64/libpthread.so.0
> #1  0x000000000060097b in GC_wait_marker () at pthread_support.c:1905
> #2  0x00000000005f75f6 in GC_help_marker (my_mark_no=12148) at mark.c:1116
> #3  0x00000000005ff681 in GC_mark_thread (id=0x6) at pthread_support.c:559
> #4  0x00002b4fcf03873d in start_thread () from /lib64/libpthread.so.0
> #5  0x00002b4fcf3214bd in clone () from /lib64/libc.so.6
>
> Thread 5 (Thread 0x40dd5940 (LWP 9010)):
> #0  0x00002b4fcf03ed01 in sem_wait () from /lib64/libpthread.so.0
> #1  0x00000000005eb208 in mono_sem_wait (sem=0x932e40, alertable=1)
>     at mono-semaphore.c:113
> #2  0x000000000059a69b in finalizer_thread (unused=<value optimized out>)
>     at gc.c:1077
> #3  0x0000000000577f2b in start_wrapper_internal (data=0x1b53d000)
>     at threads.c:593
> #4  start_wrapper (data=0x1b53d000) at threads.c:639
> #5  0x00000000005dfbdd in thread_start_routine (args=<value optimized 
> out>)
>     at wthreads.c:288
> #6  0x00000000005eecdc in inner_start_thread (arg=<value optimized out>)
>     at mono-threads-posix.c:49
> #7  0x0000000000600618 in GC_start_routine (arg=0x2aaaaad9dfc0)
>     at pthread_support.c:1510
> #8  0x00002b4fcf03873d in start_thread () from /lib64/libpthread.so.0
> #9  0x00002b4fcf3214bd in clone () from /lib64/libc.so.6
>
> Thread 4 (Thread 0x40fd6940 (LWP 9011)):
> warning: (Internal error: pc 0xb2c5f in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0xb2c60 in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0xb2c5f in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0xb2c60 in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0x36f83 in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0x36f84 in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0x36f83 in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0x36f84 in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0xb2c5f in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0xb2c60 in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0xb2c5f in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0xb2c60 in read in psymtab, but not in 
> symtab.)
>
> #0  0x00002b4fcf0401c1 in nanosleep () from /lib64/libpthread.so.0
> #1  0x00000000005dec88 in SleepEx (ms=5, alertable=1) at wthreads.c:836
> #2  0x000000000057a44e in 
> ves_icall_System_Threading_Thread_Sleep_internal (
>     ms=5) at threads.c:1164
> #3  0x00000000405655fa in ?? ()
> #4  0x000000001b5e2430 in ?? ()
> #5  0x00002aaaab92acd0 in ?? ()
> #6  0x0000000040fd5da0 in ?? ()
> #7  0x00002aaaab1680cb in System.Reflection.MethodBase:Invoke 
> (this=..., obj=
>     exceptions.RuntimeError
> Error reading string from inferior: Input/output error
> exceptions.RuntimeError
> Error reading string from inferior: Input/output error
> 1090346400, parameters=exceptions.RuntimeError
> Cannot access memory at address 0x48
> exceptions.RuntimeError
> Cannot access memory at address 0x48
> 1090346080) from /home/serdyuk/m-3.0.7/lib/mono/2.0/mscorlib.dll.so
> #8  0x00002aaaab92acd0 in ?? ()
> #9  0x00002aaaab92acd0 in ?? ()
> warning: (Internal error: pc 0xb2c5f in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0xb2c5f in read in psymtab, but not in 
> symtab.)
>
> #10 0x00000000000b2c60 in ?? (warning: (Internal error: pc 0xb2c5f in 
> read in psymtab, but not in symtab.)
>
> )
> #11 0x00002aaaab8ee000 in ?? ()
> #12 0x00002aaaab28d517 in System.Threading.Thread:Sleep 
> (millisecondsTimeout=
>     5) at <unknown>:449
> #13 0x0000000040565672 in ?? ()
> #14 0x00000000405634b0 in ?? ()
> #15 0x000000001b5c5758 in ?? ()
> #16 0x00002aaaaad97cb0 in ?? ()
> #17 0x00002aaaaad97cb0 in ?? ()
> #18 0x00002aaaaad95e60 in ?? ()
> #19 0x00002aaaaadaad20 in ?? ()
> warning: (Internal error: pc 0x36f83 in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0x36f83 in read in psymtab, but not in 
> symtab.)
>
> #20 0x0000000000036f84 in ?? (warning: (Internal error: pc 0x36f83 in 
> read in psymtab, but not in symtab.)
>
> )
> #21 0x00002aaaab924f00 in ?? ()
> warning: (Internal error: pc 0xb2c5f in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0xb2c5f in read in psymtab, but not in 
> symtab.)
>
> #22 0x00000000000b2c60 in ?? (warning: (Internal error: pc 0xb2c5f in 
> read in psymtab, but not in symtab.)
>
> )
> #23 0x00002aaaab28dd49 in System.Threading.Thread:StartInternal (this=...)
>     at <unknown>:734
> #24 0x000000004056352c in ?? ()
> #25 0x0000000000000000 in ?? ()
>
> Thread 3 (Thread 0x41375940 (LWP 9012)):
> #0  0x00002b4fcf03fb3b in accept () from /lib64/libpthread.so.0
> #1  0x00000000005d9209 in _wapi_accept (fd=3, addr=0x0, addrlen=0x0)
>     at sockets.c:221
> #2  0x000000000056e1d3 in 
> ves_icall_System_Net_Sockets_Socket_Accept_internal
>     (sock=3, error=0x41374cac, blocking=<value optimized out>)
>     at socket-io.c:865
> #3  0x0000000040fdb2f3 in ?? ()
> #4  0x000000001b6b1210 in ?? ()
> #5  0x000000004157a00c in ?? ()
> #6  0x00002aaaab931f60 in ?? ()
> #7  0x00002aaaab8f95d8 in ?? ()
> #8  0x00000000405634b0 in ?? ()
> #9  0x0000000041374ce0 in ?? ()
> #10 0x0000000041374c20 in ?? ()
> #11 0x000000001b5c5758 in ?? ()
> #12 0x00002aaaab92aeb0 in ?? ()
> #13 0x00002aaaab938770 in ?? ()
> #14 0xffffffffffffffff in ?? ()
> #15 0x0000000040fdafec in ?? ()
> #16 0x0000000041374da0 in ?? ()
> #17 0x0000000040560f4a in ?? ()
> #18 0x000000001b6b1210 in ?? ()
> #19 0x0000000000000000 in ?? ()
>
> Thread 2 (Thread 0x4244f940 (LWP 9014)):
> #0  0x00002b4fcf04068f in waitpid () from /lib64/libpthread.so.0
> #1  0x00000000004a5627 in mono_handle_native_sigsegv (
>     signal=<value optimized out>, ctx=<value optimized out>)
>     at mini-exceptions.c:2331
> #2  0x00000000004fbbcd in mono_arch_handle_altstack_exception (sigctx=
>     0x2aaaaba43c40, fault_addr=<value optimized out>, stack_ovf=0)
>     at exceptions-amd64.c:884
> #3  0x0000000000416876 in mono_sigsegv_signal_handler (_dummy=11, info=
>     0x2aaaaba43d70, context=0x2aaaaba43c40) at mini.c:6379
> #4  <signal handler called>
> #5  ves_icall_System_Array_FastCopy (source=0x2aaab022a280, source_idx=0,
>     dest=0x2aaab026a0c8, dest_idx=0, length=1) at icall.c:700
> #6  0x0000000040564fa6 in ?? ()
> #7  0x000000004244eba0 in ?? ()
> #8  0x00002aaaab29709f in 
> System.Collections.Generic.EqualityComparer`1/DefaultComparer:Equals 
> (this=..., x=-1415957120, y=-1339907456) at <unknown>:100
> #9  0x000000004244e100 in ?? ()
> #10 0x000000004244dfe0 in ?? ()
> #11 0x0000000000000000 in ?? ()
>
> Thread 1 (Thread 0x2b4fcf5a6260 (LWP 9002)):
> #0  0x00002b4fcf0401c1 in nanosleep () from /lib64/libpthread.so.0
> #1  0x00000000005dec88 in SleepEx (ms=0, alertable=1) at wthreads.c:836
> #2  0x000000000057a44e in 
> ves_icall_System_Threading_Thread_Sleep_internal (
>     ms=-1) at threads.c:1164
> #3  0x00000000405655fa in ?? ()
> #4  0x000000001b539880 in ?? ()
> #5  0x00000000458f457a in ?? ()
> #6  0x00000000530439b9 in ?? ()
> #7  0x0000000000000000 in ?? ()
>
> =================================================================
> Got a SIGSEGV while executing native code. This usually indicates
> a fatal error in the mono runtime or one of the native libraries
> used by your application.
> =================================================================


2)    Mono 3.0.7   ( with sgen )

> Stacktrace:
>
>
> Native stacktrace:
>
>     mono-sgen [0x4a536c]
>     mono-sgen [0x4fb9ad]
>     mono-sgen [0x416656]
>     /lib64/libpthread.so.0 [0x2b085a947b10]
>     mono-sgen [0x5c4f77]
>     mono-sgen [0x5c87ab]
>     mono-sgen [0x5c9522]
>     mono-sgen [0x5deed4]
>     mono-sgen [0x5df722]
>     [0x418719bd]
>
> Debug info from gdb:
>
> Mono support loaded.
> [Thread debugging using libthread_db enabled]
> [New Thread 0x40957940 (LWP 9356)]
> [New Thread 0x41cdf940 (LWP 9354)]
> [New Thread 0x42076940 (LWP 9353)]
> [New Thread 0x40745940 (LWP 9352)]
> warning: no loadable sections found in added symbol-file 
> system-supplied DSO at 0x7fff211fc000
> 0x00002b085ab847bf in sigsuspend () from /lib64/libc.so.6
>   5 Thread 0x40745940 (LWP 9352)  0x00002b085ab847bf in sigsuspend ()
>    from /lib64/libc.so.6
>   4 Thread 0x42076940 (LWP 9353)  0x00002b085ab847bf in sigsuspend ()
>    from /lib64/libc.so.6
>   3 Thread 0x41cdf940 (LWP 9354)  0x00002b085ab847bf in sigsuspend ()
>    from /lib64/libc.so.6
>   2 Thread 0x40957940 (LWP 9356)  0x00002b085a94768f in waitpid ()
>    from /lib64/libpthread.so.0
> * 1 Thread 0x2b085aead2a0 (LWP 9351)  0x00002b085ab847bf in sigsuspend ()
>    from /lib64/libc.so.6
>
> Thread 5 (Thread 0x40745940 (LWP 9352)):
> #0  0x00002b085ab847bf in sigsuspend () from /lib64/libc.so.6
> #1  0x00000000005beec4 in suspend_thread (info=0x11f692c0, 
> context=0x40744940)
>     at sgen-os-posix.c:113
> #2  0x00000000005befe5 in suspend_handler (sig=<value optimized out>,
>     siginfo=<value optimized out>, context=0x40744940) at 
> sgen-os-posix.c:134
> #3  <signal handler called>
> #4  0x00002b085a945d01 in sem_wait () from /lib64/libpthread.so.0
> #5  0x00000000006162b8 in mono_sem_wait (sem=0x94ee00, alertable=1)
>     at mono-semaphore.c:113
> #6  0x000000000059a367 in finalizer_thread (unused=<value optimized out>)
>     at gc.c:1077
> #7  0x0000000000577d3b in start_wrapper_internal (data=0x11f6ab40)
>     at threads.c:593
> #8  start_wrapper (data=0x11f6ab40) at threads.c:639
> #9  0x000000000060ac8d in thread_start_routine (args=<value optimized 
> out>)
>     at wthreads.c:288
> #10 0x000000000061ae3c in inner_start_thread (arg=<value optimized out>)
>     at mono-threads-posix.c:49
> #11 0x00002b085a93f73d in start_thread () from /lib64/libpthread.so.0
> #12 0x00002b085ac284bd in clone () from /lib64/libc.so.6
>
> Thread 4 (Thread 0x42076940 (LWP 9353)):
> #0  0x00002b085ab847bf in sigsuspend () from /lib64/libc.so.6
> #1  0x00000000005beec4 in suspend_thread (info=0x120395b0, 
> context=0x42075810)
>     at sgen-os-posix.c:113
> #2  0x00000000005befe5 in suspend_handler (sig=<value optimized out>,
>     siginfo=<value optimized out>, context=0x42075810) at 
> sgen-os-posix.c:134
> #3  <signal handler called>
> #4  0x00002b085a9471c1 in nanosleep () from /lib64/libpthread.so.0
> #5  0x0000000000609d38 in SleepEx (ms=5, alertable=1) at wthreads.c:836
> #6  0x000000000057a25e in 
> ves_icall_System_Threading_Thread_Sleep_internal (
>     ms=5) at threads.c:1164
> #7  0x00000000402e69fa in ?? ()
> #8  0x0000000011ff25d0 in ?? ()
> #9  0x00002aaaace11b68 in ?? ()
> #10 0x0000000042075e30 in ?? ()
> #11 0x0000000041d032db in ?? ()
> #12 0x00002aaaab3612b0 in ?? ()
> #13 0x0000000042075e30 in ?? ()
> #14 0x0000000042075ce0 in ?? ()
> #15 0x00002aaaaea084e0 in ?? ()
> #16 0x00002aaaaea084e0 in ?? ()
> #17 0x00000000000b2c60 in ?? ()
> #18 0x0000000000000005 in ?? ()
> #19 0x00000000402e695c in ?? ()
> #20 0x00002aaaab3612b0 in ?? ()
> #21 0x0000000000000001 in ?? ()
> #22 0x00002aaaae2025e8 in ?? ()
> #23 0x00000000402e66dc in ?? ()
> #24 0x000000004186e610 in ?? ()
> #25 0x0000000012018508 in ?? ()
> #26 0x00002aaaab010060 in ?? ()
> #27 0x00002aaaab010060 in ?? ()
> #28 0x00002aaaab010060 in ?? ()
> #29 0x00002aaaaada7c10 in ?? ()
> #30 0x0000000000036f84 in ?? ()
> #31 0x00002aaaab3626f8 in ?? ()
> #32 0x00000000000b2c60 in ?? ()
> #33 0x00000000402e6642 in ?? ()
> #34 0x0000000011f07768 in ?? ()
> #35 0x00002aaaab010168 in ?? ()
> #36 0x00000000402e5731 in ?? ()
> #37 0x000000004186e6bf in ?? ()
> #38 0x000000004186e610 in ?? ()
> #39 0x00000000005a5c92 in mono_runtime_class_init_full (vtable=
>     vtable(0x42075fc0), raise_exception=0) at object.c:299
> #40 0x000000000041e314 in mono_jit_runtime_invoke (method=
>     "System.Threading.ThreadStart:Invoke ()", obj=0x2aaaab010168, params=
>     0x42076010, exc=0x0) at mini.c:6261
> #41 0x000000000059e6cb in mono_runtime_invoke (method=
>     "System.Threading.ThreadStart:Invoke ()", obj=0x2aaaab010168, params=
>     0x42076010, exc=0x0) at object.c:2830
> #42 0x0000000000577e1e in start_wrapper_internal (data=0x120300d0)
>     at threads.c:599
> #43 start_wrapper (data=0x120300d0) at threads.c:639
> #44 0x000000000060ac8d in thread_start_routine (args=<value optimized 
> out>)
>     at wthreads.c:288
> #45 0x000000000061ae3c in inner_start_thread (arg=<value optimized out>)
>     at mono-threads-posix.c:49
> #46 0x00002b085a93f73d in start_thread () from /lib64/libpthread.so.0
> #47 0x00002b085ac284bd in clone () from /lib64/libc.so.6
>
> Thread 3 (Thread 0x41cdf940 (LWP 9354)):
> #0  0x00002b085ab847bf in sigsuspend () from /lib64/libc.so.6
> #1  0x00000000005beec4 in suspend_thread (info=0x12129330, 
> context=0x41cde7b0)
>     at sgen-os-posix.c:113
> #2  0x00000000005befe5 in suspend_handler (sig=<value optimized out>,
>     siginfo=<value optimized out>, context=0x41cde7b0) at 
> sgen-os-posix.c:134
> #3  <signal handler called>
> #4  0x00002b085a946b39 in accept () from /lib64/libpthread.so.0
> #5  0x00000000006042b9 in _wapi_accept (fd=3, addr=0x0, addrlen=0x0)
>     at sockets.c:221
> #6  0x000000000056dfe3 in 
> ves_icall_System_Net_Sockets_Socket_Accept_internal
>     (sock=3, error=0x41cded1c, blocking=<value optimized out>)
>     at socket-io.c:865
> #7  0x0000000041acfe03 in ?? ()
> #8  0x0000000011ff2c60 in ?? ()
> #9  0x00002aaaab3612b0 in ?? ()
> #10 0x00002aaaab0604e0 in ?? ()
> #11 0x00002aaaab05fb10 in ?? ()
> #12 0x000000004186e610 in ?? ()
> #13 0x0000000041cded50 in ?? ()
> #14 0x0000000041cdec80 in ?? ()
> #15 0x0000000012018508 in ?? ()
> #16 0x00002aaaab063e18 in ?? ()
> #17 0x00002aaaab3617e8 in ?? ()
> #18 0xffffffffffffffff in ?? ()
> #19 0x0000000041acfaac in ?? ()
> #20 0x00002aaaaad854d8 in ?? ()
> #21 0x0000000000000000 in ?? ()
>
> Thread 2 (Thread 0x40957940 (LWP 9356)):
> #0  0x00002b085a94768f in waitpid () from /lib64/libpthread.so.0
> #1  0x00000000004a5407 in mono_handle_native_sigsegv (
>     signal=<value optimized out>, ctx=<value optimized out>)
>     at mini-exceptions.c:2331
> #2  0x00000000004fb9ad in mono_arch_handle_altstack_exception (sigctx=
>     0x2aaaaaf9cc40, fault_addr=<value optimized out>, stack_ovf=0)
>     at exceptions-amd64.c:884
> #3  0x0000000000416656 in mono_sigsegv_signal_handler (_dummy=11, info=
>     0x2aaaaaf9cd70, context=0x2aaaaaf9cc40) at mini.c:6379
> #4  <signal handler called>
> #5  pin_objects_from_addresses (section=0x2aaaaad28010, ctx=...)
>     at ../../mono/metadata/sgen-gc.h:728
> #6  sgen_pin_objects_in_section (section=0x2aaaaad28010, ctx=...)
>     at sgen-gc.c:1329
> #7  0x00000000005c87ab in collect_nursery (unpin_queue=0x0,
>     finish_up_concurrent_mark=0) at sgen-gc.c:2563
> #8  0x00000000005c9522 in sgen_perform_collection (requested_size=4096,
>     generation_to_collect=0, reason=<value optimized out>, 
> wait_to_finish=0)
>     at sgen-gc.c:3422
> #9  0x00000000005deed4 in mono_gc_alloc_obj_nolock (vtable=
>     vtable("Oyster.Math.IntX"), size=<value optimized out>)
>     at sgen-alloc.c:288
> #10 0x00000000005df722 in mono_gc_alloc_obj (vtable=
>     vtable("Oyster.Math.IntX"), size=40) at sgen-alloc.c:446
> #11 0x00000000418719bd in ?? ()
> #12 0x0000000040956c20 in ?? ()
> #13 0x00002aaaaee44668 in ?? ()
> #14 0x00002aaaaad811e0 in ?? ()
> #15 0x00002aaaaad811e0 in ?? ()
> #16 0x00002aaaab067eb8 in ?? ()
> #17 0x0000000000000024 in ?? ()
> #18 0x0000000040956260 in ?? ()
> #19 0x00002aaaab067e90 in ?? ()
> #20 0x0000000040957920 in ?? ()
> #21 0x0000000000000028 in ?? ()
> #22 0x0000000012153d20 in ?? ()
> #23 0x0000000041868f08 in ?? ()
> #24 0x0000000000000003 in ?? ()
> #25 0x0000000000000002 in ?? ()
> #26 0x00002aaaada7e128 in ?? ()
> #27 0x00002aaaab2d18e0 in ?? ()
> #28 0x0000000000000001 in ?? ()
> #29 0x00000000409583e8 in ?? ()
> #30 0x0000000000000003 in ?? ()
> #31 0x0000000000000024 in ?? ()
> #32 0x00002aaaaee44668 in ?? ()
> #33 0x00002aaaab3cd7a8 in ?? ()
> #34 0x00002aaaab2d1948 in ?? ()
> #35 0x00002aaaada7c928 in ?? ()
> #36 0x00002aaa00000001 in ?? ()
> #37 0x00002aaaaed44e70 in ?? ()
> #38 0x00002aaa00000000 in ?? ()
> #39 0x0000000000000000 in ?? ()
>
> Thread 1 (Thread 0x2b085aead2a0 (LWP 9351)):
> #0  0x00002b085ab847bf in sigsuspend () from /lib64/libc.so.6
> #1  0x00000000005beec4 in suspend_thread (info=0x11f06a30, context=
>     0x7fff210d23d0) at sgen-os-posix.c:113
> #2  0x00000000005befe5 in suspend_handler (sig=<value optimized out>,
>     siginfo=<value optimized out>, context=0x7fff210d23d0)
>     at sgen-os-posix.c:134
> #3  <signal handler called>
> #4  0x00002b085a9471c1 in nanosleep () from /lib64/libpthread.so.0
> #5  0x0000000000609d38 in SleepEx (ms=0, alertable=1) at wthreads.c:836
> #6  0x000000000057a25e in 
> ves_icall_System_Threading_Thread_Sleep_internal (
>     ms=-1) at threads.c:1164
> #7  0x00000000402e69fa in ?? ()
> #8  0x0000000011f64740 in ?? ()
> #9  0x000000004629a1fa in ?? ()
> #10 0x0000000053044d7b in ?? ()
> #11 0x0000000000000000 in ?? ()
>
> =================================================================
> Got a SIGSEGV while executing native code. This usually indicates
> a fatal error in the mono runtime or one of the native libraries
> used by your application.
> =================================================================


3)    Mono 3.2.6   ( with sgen by default )

> Stacktrace:
>
>
> Native stacktrace:
>
>     mono [0x4ae20c]
>     mono [0x50767d]
>     mono [0x416b46]
>     /lib64/libpthread.so.0 [0x2aad24bf7b10]
>     mono [0x5d1c77]
>     mono [0x5d549d]
>     mono [0x5d6234]
>     mono [0x5ec064]
>     mono [0x5ec8c5]
>     [0x417da03d]
>
> Debug info from gdb:
>
> Mono support loaded.
> [Thread debugging using libthread_db enabled]
> [New Thread 0x40bd9940 (LWP 9426)]
> [New Thread 0x41491940 (LWP 9424)]
> [New Thread 0x4127f940 (LWP 9423)]
> [New Thread 0x4107e940 (LWP 9422)]
> warning: no loadable sections found in added symbol-file 
> system-supplied DSO at 0x7fffd9dfc000
> 0x00002aad24e347bf in sigsuspend () from /lib64/libc.so.6
>   5 Thread 0x4107e940 (LWP 9422)  0x00002aad24e347bf in sigsuspend ()
>    from /lib64/libc.so.6
>   4 Thread 0x4127f940 (LWP 9423)  0x00002aad24e347bf in sigsuspend ()
>    from /lib64/libc.so.6
>   3 Thread 0x41491940 (LWP 9424)  0x00002aad24e347bf in sigsuspend ()
>    from /lib64/libc.so.6
>   2 Thread 0x40bd9940 (LWP 9426)  0x00002aad24bf768f in waitpid ()
>    from /lib64/libpthread.so.0
> * 1 Thread 0x2aad2515d2a0 (LWP 9421)  0x00002aad24e347bf in sigsuspend ()
>    from /lib64/libc.so.6
>
> Thread 5 (Thread 0x4107e940 (LWP 9422)):
> #0  0x00002aad24e347bf in sigsuspend () from /lib64/libc.so.6
> #1  0x00000000005cbae9 in suspend_thread (info=0x1e306400, 
> context=0x4107d940)
>     at sgen-os-posix.c:120
> #2  0x00000000005cbbf5 in suspend_handler (sig=<value optimized out>,
>     siginfo=<value optimized out>, context=0x4107d940) at 
> sgen-os-posix.c:141
> #3  <signal handler called>
> #4  0x00002aad24bf5d01 in sem_wait () from /lib64/libpthread.so.0
> #5  0x00000000006245e8 in mono_sem_wait (sem=0x95f8c0, alertable=1)
>     at mono-semaphore.c:116
> #6  0x00000000005a6cf7 in finalizer_thread (unused=<value optimized out>)
>     at gc.c:1073
> #7  0x000000000058434b in start_wrapper_internal (data=0x1e305e70)
>     at threads.c:608
> #8  start_wrapper (data=0x1e305e70) at threads.c:653
> #9  0x0000000000618b9d in thread_start_routine (args=<value optimized 
> out>)
>     at wthreads.c:294
> #10 0x0000000000629073 in inner_start_thread (arg=<value optimized out>)
>     at mono-threads-posix.c:49
> #11 0x00002aad24bef73d in start_thread () from /lib64/libpthread.so.0
> #12 0x00002aad24ed84bd in clone () from /lib64/libc.so.6
>
> Thread 4 (Thread 0x4127f940 (LWP 9423)):
> warning: (Internal error: pc 0xb2c60 in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0xb2c60 in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0x36f83 in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0x36f84 in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0x36f83 in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0x36f84 in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0xb2c60 in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0xb2c60 in read in psymtab, but not in 
> symtab.)
>
> #0  0x00002aad24e347bf in sigsuspend () from /lib64/libc.so.6
> #1  0x00000000005cbae9 in suspend_thread (info=0x1e3b2570, 
> context=0x4127e810)
>     at sgen-os-posix.c:120
> #2  0x00000000005cbbf5 in suspend_handler (sig=<value optimized out>,
>     siginfo=<value optimized out>, context=0x4127e810) at 
> sgen-os-posix.c:141
> #3  <signal handler called>
> #4  0x00002aad24bf71c1 in nanosleep () from /lib64/libpthread.so.0
> #5  0x0000000000617c18 in SleepEx (ms=5, alertable=1) at wthreads.c:842
> #6  0x00000000005868ae in 
> ves_icall_System_Threading_Thread_Sleep_internal (
>     ms=5) at threads.c:1261
> #7  0x00000000417d579a in ?? ()
> #8  0x000000001e3b0ff0 in ?? ()
> #9  0x00002aaab046e008 in ?? ()
> #10 0x000000004127ee30 in ?? ()
> #11 0x00002aaaac7c4f9b in System.Reflection.MethodBase:Invoke 
> (this=..., obj=
>     exceptions.RuntimeError
> Error reading string from inferior: Input/output error
> exceptions.RuntimeError
> Error reading string from inferior: Input/output error
> 1093135920, parameters=exceptions.RuntimeError
> Cannot access memory at address 0x48
> exceptions.RuntimeError
> Cannot access memory at address 0x48
> 1093135584) from /home/serdyuk/m-3.2.6/lib/mono/2.0/mscorlib.dll.so
> #12 0x00002aaab046e008 in ?? ()
> #13 0x00002aaab046e008 in ?? ()
> #14 0x00000000000b2c60 in ?? ()
> #15 0x00002aaaab0af508 in ?? ()
> #16 0x00002aaaac8fc1e7 in System.Threading.Thread:Sleep 
> (millisecondsTimeout=
>     5) at <unknown>:418
> #17 0x00000000417d5812 in ?? ()
> #18 0x00000000417d34c0 in ?? ()
> #19 0x000000001e3b3408 in ?? ()
> #20 0x00002aaaab00f4e8 in ?? ()
> #21 0x00002aaaab00f4e8 in ?? ()
> #22 0x00002aaaab00f550 in ?? ()
> #23 0x00002aaaab009228 in ?? ()
> warning: (Internal error: pc 0x36f83 in read in psymtab, but not in 
> symtab.)
>
> warning: (Internal error: pc 0x36f83 in read in psymtab, but not in 
> symtab.)
>
> #24 0x0000000000036f84 in ?? (warning: (Internal error: pc 0x36f83 in 
> read in psymtab, but not in symtab.)
>
> )
> #25 0x00002aaaab0b0950 in ?? ()
> #26 0x00000000000b2c60 in ?? ()
> #27 0x00002aaaac8fc5e9 in System.Threading.Thread:StartInternal (this=...)
>     at <unknown>:682
> #28 0x00000000417d356f in ?? ()
> #29 0x00000000417d34c0 in ?? ()
> #30 0x00000000005b1b82 in mono_runtime_class_init_full (vtable=
>     vtable(0x4127efc0), raise_exception=0) at object.c:299
> #31 0x000000000041ee84 in mono_jit_runtime_invoke (method=
>     "System.Threading.ThreadStart:Invoke ()", obj=0x2aaaab00f5f0, params=
>     0x4127f010, exc=0x0) at mini.c:6473
> #32 0x00000000005ab06b in mono_runtime_invoke (method=
>     "System.Threading.ThreadStart:Invoke ()", obj=0x2aaaab00f5f0, params=
>     0x4127f010, exc=0x0) at object.c:2827
> #33 0x000000000058442e in start_wrapper_internal (data=0x1e3b1320)
>     at threads.c:614
> #34 start_wrapper (data=0x1e3b1320) at threads.c:653
> #35 0x0000000000618b9d in thread_start_routine (args=<value optimized 
> out>)
>     at wthreads.c:294
> #36 0x0000000000629073 in inner_start_thread (arg=<value optimized out>)
>     at mono-threads-posix.c:49
> #37 0x00002aad24bef73d in start_thread () from /lib64/libpthread.so.0
> #38 0x00002aad24ed84bd in clone () from /lib64/libc.so.6
>
> Thread 3 (Thread 0x41491940 (LWP 9424)):
> #0  0x00002aad24e347bf in sigsuspend () from /lib64/libc.so.6
> #1  0x00000000005cbae9 in suspend_thread (info=0x1e486260, 
> context=0x414907b0)
>     at sgen-os-posix.c:120
> #2  0x00000000005cbbf5 in suspend_handler (sig=<value optimized out>,
>     siginfo=<value optimized out>, context=0x414907b0) at 
> sgen-os-posix.c:141
> #3  <signal handler called>
> #4  0x00002aad24bf6b39 in accept () from /lib64/libpthread.so.0
> #5  0x0000000000612199 in _wapi_accept (fd=3, addr=0x0, addrlen=0x0)
>     at sockets.c:221
> #6  0x000000000057a4a3 in 
> ves_icall_System_Net_Sockets_Socket_Accept_internal
>     (sock=3, error=0x41490d1c, blocking=<value optimized out>)
>     at socket-io.c:868
> #7  0x0000000041289383 in ?? ()
> #8  0x000000001e48a050 in ?? ()
> #9  0x00002aaaab0af508 in ?? ()
> #10 0x00002aaaab05ef70 in ?? ()
> #11 0x00002aaaab05e5a0 in ?? ()
> #12 0x00000000417d34c0 in ?? ()
> #13 0x0000000041490d50 in ?? ()
> #14 0x0000000041490c80 in ?? ()
> #15 0x000000001e3b3408 in ?? ()
> #16 0x00002aaaab0628a8 in ?? ()
> #17 0x00002aaaab0afa40 in ?? ()
> #18 0xffffffffffffffff in ?? ()
> #19 0x0000000041288fdc in ?? ()
> #20 0x00002aaaaad854d8 in ?? ()
> #21 0x0000000000000000 in ?? ()
>
> Thread 2 (Thread 0x40bd9940 (LWP 9426)):
> #0  0x00002aad24bf768f in waitpid () from /lib64/libpthread.so.0
> #1  0x00000000004ae2a7 in mono_handle_native_sigsegv (
>     signal=<value optimized out>, ctx=<value optimized out>)
>     at mini-exceptions.c:2344
> #2  0x000000000050767d in mono_arch_handle_altstack_exception (sigctx=
>     0x2aaaaafc3c40, fault_addr=<value optimized out>, stack_ovf=0)
>     at exceptions-amd64.c:921
> #3  0x0000000000416b46 in mono_sigsegv_signal_handler (_dummy=11, info=
>     0x2aaaaafc3d70, context=0x2aaaaafc3c40) at mini.c:6591
> #4  <signal handler called>
> #5  pin_objects_from_addresses (section=0x2aaaaad28010, ctx=...)
>     at ../../mono/metadata/sgen-gc.h:769
> #6  sgen_pin_objects_in_section (section=0x2aaaaad28010, ctx=...)
>     at sgen-gc.c:1341
> #7  0x00000000005d549d in collect_nursery (unpin_queue=0x0,
>     finish_up_concurrent_mark=0) at sgen-gc.c:2575
> #8  0x00000000005d6234 in sgen_perform_collection (requested_size=4096,
>     generation_to_collect=0, reason=0x6fe85a "Nursery full", 
> wait_to_finish=0)
>     at sgen-gc.c:3445
> #9  0x00000000005ec064 in mono_gc_alloc_obj_nolock (vtable=
>     vtable("Oyster.Math.IntX"), size=<value optimized out>)
>     at sgen-alloc.c:288
> #10 0x00000000005ec8c5 in mono_gc_alloc_obj (vtable=
>     vtable("Oyster.Math.IntX"), size=40) at sgen-alloc.c:465
> #11 0x00000000417da03d in ?? ()
> #12 0x0000000040bd8c20 in ?? ()
> #13 0x0000000000000000 in ?? ()
>
> Thread 1 (Thread 0x2aad2515d2a0 (LWP 9421)):
> #0  0x00002aad24e347bf in sigsuspend () from /lib64/libc.so.6
> #1  0x00000000005cbae9 in suspend_thread (info=0x1e2c5ae0, context=
>     0x7fffd9dd9100) at sgen-os-posix.c:120
> #2  0x00000000005cbbf5 in suspend_handler (sig=<value optimized out>,
>     siginfo=<value optimized out>, context=0x7fffd9dd9100)
>     at sgen-os-posix.c:141
> #3  <signal handler called>
> #4  0x00002aad24bf71c1 in nanosleep () from /lib64/libpthread.so.0
> #5  0x0000000000617c18 in SleepEx (ms=0, alertable=1) at wthreads.c:842
> #6  0x00000000005868ae in 
> ves_icall_System_Threading_Thread_Sleep_internal (
>     ms=-1) at threads.c:1261
> #7  0x00000000417d579a in ?? ()
> #8  0x000000001e302770 in ?? ()
> #9  0x00000000463d55fc in ?? ()
> #10 0x0000000053045001 in ?? ()
> #11 0x0000000000000000 in ?? ()
>
> =================================================================
> Got a SIGSEGV while executing native code. This usually indicates
> a fatal error in the mono runtime or one of the native libraries
> used by your application.
> =================================================================


System information:

> Linux beda.cluster 2.6.18-238.12.1.el5.lustre18.mm #1 SMP Thu Jul 14 
> 18:50:00 MSD 2011 x86_64 x86_64 x86_64 GNU/Linux


Unfortunately, it's very hard to reproduce the bug externally because
my program is the large distributed (on several machines) application 
with several libraries.

Any ideas, please ?

Yury




More information about the Mono-list mailing list