[Building Sakai] sakai crash under 1.6

Charles Hedrick hedrick at rutgers.edu
Sat May 23 07:56:16 PDT 2009


We brought up 2.6 under Java 1.6. After running fine for 2 days 2 of  
our 4 front ends crashed this morning. Any ideas what is going on? In  
addition to a new Java we also did Solaris maintenance. That installed  
a new version of pkcs11_softtoken_extra

# more hs_err_pid2883.log
#
# An unexpected error has been detected by Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0xfffffd7cae0cc0ee, pid=2883, tid=349560
#
# Java VM: Java HotSpot(TM) 64-Bit Server VM (11.3-b02 mixed mode  
solaris-amd64)
# Problematic frame:
# C  [pkcs11_softtoken_extra.so.1+0x3c0ee]
#
# If you would like to submit a bug report, please visit:
#   http://java.sun.com/webapps/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

---------------  T H R E A D  ---------------

Current thread (0x00000000072aa000):  JavaThread "Thread-348924"  
daemon [_thread
_in_native, id=349560, stack(0xfffffd7c923a0000,0xfffffd7c924a0000)]

siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR),  
si_addr=0x0000000
000000000
# cat hs_err_pid2883.log
#
# An unexpected error has been detected by Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0xfffffd7cae0cc0ee, pid=2883, tid=349560
#
# Java VM: Java HotSpot(TM) 64-Bit Server VM (11.3-b02 mixed mode  
solaris-amd64)
# Problematic frame:
# C  [pkcs11_softtoken_extra.so.1+0x3c0ee]
#
# If you would like to submit a bug report, please visit:
#   http://java.sun.com/webapps/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

---------------  T H R E A D  ---------------

Current thread (0x00000000072aa000):  JavaThread "Thread-348924"  
daemon [_thread_in_native, id=349560,  
stack(0xfffffd7c923a0000,0xfffffd7c924a0000)]

siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR),  
si_addr=0x0000000000000000

Registers:
RAX=0xfffffd7c9249e040, RBX=0x0000000000000012,  
RCX=0x0000000000000012, RDX=0xfffffd7c9249e040
RSP=0xfffffd7c9249df58, RBP=0xfffffd7c9249df80,  
RSI=0xfffffd7c9249e040, RDI=0x0000000000000008
, R8=0xfffffd7c9249e038, R9=0x0000000000000001,  
R10=0x92f9271b2e24d31d, R11=0x325b2c83b6bb0a02,  
R12=0xfffffd7c9249e038, R13=0xfffffd7c9249e040,  
R14=0xfffffd7c9249e040, R15=0x0000000000000012
RIP=0xfffffd7cae0cc0ee, RFLAGS=0x0000000000010202

Top of Stack: (sp=0xfffffd7c9249df58)
0xfffffd7c9249df58:   fffffd7c9249e040 fffffd7c9249e038
0xfffffd7c9249df68:   fffffd7cae0b4b32 0000000000000007
0xfffffd7c9249df78:   fffffd7c9249e038 fffffd7c9249df90
0xfffffd7c9249df88:   fffffd7cae0acdf5 fffffd7c9249dfa0
0xfffffd7c9249df98:   fffffd7cae0ace9b fffffd7c9249dfe0
0xfffffd7c9249dfa8:   fffffd7cae0abe9c 0000000005e68970
0xfffffd7c9249dfb8:   0000000000000005 fffffd7c9249e040
0xfffffd7c9249dfc8:   0000000000000000 0000000000000012
0xfffffd7c9249dfd8:   00000000072aa1c0 fffffd7c9249dff0
0xfffffd7c9249dfe8:   fffffd7ffaa45534 fffffd7c9249f080
0xfffffd7c9249dff8:   fffffd7ffaa879cd 00000000072aa000
0xfffffd7c9249e008:   0000000000000000 0000000000000017
0xfffffd7c9249e018:   0000000005e68970 0000000000000001
0xfffffd7c9249e028:   00000000072aa000 00000000072aa1c0
0xfffffd7c9249e038:   0000000000001000 325b2c83b6bb0a02
0xfffffd7c9249e048:   92f9271b2e24d31d 00000000000034d6
0xfffffd7c9249e058:   fffffd7ffaa61ca0 fffffd7c9249e080
0xfffffd7c9249e068:   fffffd7ffe8dfa33 00000000072aa000
0xfffffd7c9249e078:   fffffd7ffea00871 fffffd7c9249e180
0xfffffd7c9249e088:   0000000000000010 00000000072aa1c0
0xfffffd7c9249e098:   0000000002d9e970 00000000035e40f0
0xfffffd7c9249e0a8:   00000000072aa1c0 00000000072aa000
0xfffffd7c9249e0b8:   0000000000000000 00000000072aa000
0xfffffd7c9249e0c8:   0000000000000000 0000000000000000
0xfffffd7c9249e0d8:   fffffd7fff103d04 fffffd7fff1094ec
0xfffffd7c9249e0e8:   00000000072aa1c0 fffffd009249e120
0xfffffd7c9249e0f8:   fffffd00ae09ef91 fffffd7c9249e130
0xfffffd7c9249e108:   fffffd7ffaa8d94b 0000000000000000
0xfffffd7c9249e118:   fffffd7c9249e180 fffffd7c9249e180
0xfffffd7c9249e128:   00000000072aa1c0 fffffd7c9249f180
0xfffffd7c9249e138:   fffffd7ffaa8c650 00000000072aa000
0xfffffd7c9249e148:   fffffd7c9249f368 fffffd7c9249f2d8

Instructions: (pc=0xfffffd7cae0cc0ee)
0xfffffd7cae0cc0de:   00 00 48 09 c9 75 01 c3 41 54 41 55 48 83 c7 08
0xfffffd7cae0cc0ee:   44 8b 47 f8 44 8b 67 fc 83 bf 00 01 00 00 ff 0f

Stack: [0xfffffd7c923a0000,0xfffffd7c924a0000],   
sp=0xfffffd7c9249df58,  free space=1015k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code,  
C=native code)
C  [pkcs11_softtoken_extra.so.1+0x3c0ee]
C  [pkcs11_softtoken_extra.so.1+0x1cdf5]  C_DecryptFinal+0x745
C  [pkcs11_softtoken_extra.so.1+0x1ce9b]  C_DecryptFinal+0x7eb
C  [pkcs11_softtoken_extra.so.1+0x1be9c]  C_EncryptUpdate+0xac
C  [libpkcs11.so.1+0x15534]  C_EncryptUpdate+0x34
C  [libj2pkcs11.so+0x79cd]   
Java_sun_security_pkcs11_wrapper_PKCS11_C_1EncryptUpdate+0x11d
J  sun.security.pkcs11.wrapper.PKCS11.C_EncryptUpdate(JJ[BIIJ[BII)I

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
J  sun.security.pkcs11.wrapper.PKCS11.C_EncryptUpdate(JJ[BIIJ[BII)I
J  sun.security.pkcs11.P11Cipher.implUpdate([BII[BII)I
J  sun.security.pkcs11.P11Cipher.engineUpdate([BII[BI)I
J  com.sun.net.ssl.internal.ssl.CipherBox.encrypt([BII)I
J  com.sun.net.ssl.internal.ssl.SSLSocketImpl.writeRecord(Lcom/sun/net/ 
ssl/internal/ssl/OutputRecord;)V
j  com.sun.net.ssl.internal.ssl.SSLSocketImpl.sendAlert(BB)V+222
j  com.sun.net.ssl.internal.ssl.SSLSocketImpl.fatal(BLjava/lang/ 
String;Ljava/lang/Throwable;)V+82
j  com.sun.net.ssl.internal.ssl.SSLSocketImpl.fatal(BLjava/lang/ 
Throwable;)V+4
j  com.sun.net.ssl.internal.ssl.SSLSocketImpl.handleException(Ljava/ 
lang/Exception;Z)V+112
j  com.sun.net.ssl.internal.ssl.SSLSocketImpl.handleException(Ljava/ 
lang/Exception;)V+3
J  com.sun.net.ssl.internal.ssl.AppInputStream.read([BII)I
J  java.io.BufferedInputStream.fill()V
J  com.sun.jndi.ldap.Connection.run()V
j  java.lang.Thread.run()V+11
v  ~StubRoutines::call_stub

---------------  P R O C E S S  ---------------

Java Threads: ( => current thread )
   0x0000000006699800 JavaThread "Keep-Alive-Timer" daemon  
[_thread_blocked, id=349750,  
stack(0xfffffd7c91a97000,0xfffffd7c91b97000)]
=>0x00000000072aa000 JavaThread "Thread-348924" daemon  
[_thread_in_native, id=349560,  
stack(0xfffffd7c923a0000,0xfffffd7c924a0000)]
   0x00000000064f2400 JavaThread "Thread-348903" daemon  
[_thread_in_native, id=349539,  
stack(0xfffffd7c939f9000,0xfffffd7c93af9000)]
   0x0000000006d8b400 JavaThread "Thread-348893" daemon  
[_thread_in_native, id=349529,  
stack(0xfffffd7c92ded000,0xfffffd7c92eed000)]
   0x00000000069a6800 JavaThread "idle thread" daemon  
[_thread_blocked, id=349523,  
stack(0xfffffd7c95822000,0xfffffd7c95922000)]
   0x0000000006f06000 JavaThread "Thread-348881" daemon  
[_thread_in_native, id=349516,  
stack(0xfffffd7c9501a000,0xfffffd7c9511a000)]
   0x00000000092cd000 JavaThread "Thread-348874" daemon  
[_thread_in_native, id=349509,  
stack(0xfffffd7c95b25000,0xfffffd7c95c25000)]
   0x0000000008a2ac00 JavaThread "Thread-348857" daemon  
[_thread_in_native, id=349492,  
stack(0xfffffd7c91c99000,0xfffffd7c91d99000)]
   0x0000000008a2e400 JavaThread "Thread-348850" daemon  
[_thread_in_native, id=349485,  
stack(0xfffffd7c94f19000,0xfffffd7c95019000)]
   0x000000000647d000 JavaThread "Thread-348845" daemon  
[_thread_in_native, id=349480,  
stack(0xfffffd7c93bfb000,0xfffffd7c93cfb000)]
   0x00000000058eb800 JavaThread "Thread-348815" daemon  
[_thread_in_native, id=349449,  
stack(0xfffffd7c992af000,0xfffffd7c993af000)]
   0x00000000074cc400 JavaThread "Thread-348808" daemon  
[_thread_in_native, id=349442,  
stack(0xfffffd7c92fef000,0xfffffd7c930ef000)]
   0x000000000714fc00 JavaThread "Thread-348800" daemon  
[_thread_in_native, id=349434,  
stack(0xfffffd7c94201000,0xfffffd7c94301000)]
   0x00000000042b2400 JavaThread "Thread-348792" daemon  
[_thread_in_native, id=349425,  
stack(0xfffffd7c931f1000,0xfffffd7c932f1000)]
   0x000000000351ac00 JavaThread "Thread-348779" daemon  
[_thread_in_native, id=349411,  
stack(0xfffffd7c936f6000,0xfffffd7c937f6000)]
   0x000000000773d800 JavaThread "Thread-348757" daemon  
[_thread_in_native, id=349388,  
stack(0xfffffd7c9617f000,0xfffffd7c9627f000)]
   0x00000000085c8800 JavaThread "Thread-348733" daemon  
[_thread_in_native, id=349363,  
stack(0xfffffd7c91996000,0xfffffd7c91a96000)]
   0x0000000004c77000 JavaThread "Timer-333244" daemon  
[_thread_blocked, id=335455,  
stack(0xfffffd7c924a1000,0xfffffd7c925a1000)]
   0x00000000064f4000 JavaThread "Thread-333359" daemon  
[_thread_in_native, id=333810,  
stack(0xfffffd7c91e9b000,0xfffffd7c91f9b000)]
   0x0000000007409c00 JavaThread "Thread-323203" daemon  
[_thread_in_native, id=323521,  
stack(0xfffffd7c8ed75000,0xfffffd7c8ee75000)]
   0x0000000005e3c800 JavaThread "http-443-Processor221" daemon  
[_thread_blocked, id=317661,  
stack(0xfffffd7c9271f000,0xfffffd7c9281f000)]
   0x0000000005ee5000 JavaThread "http-443-Processor218" daemon  
[_thread_blocked, id=317658,  
stack(0xfffffd7c930f0000,0xfffffd7c931f0000)]
   0x00000000062ee800 JavaThread "http-443-Processor217" daemon  
[_thread_blocked, id=317657,  
stack(0xfffffd7c934f4000,0xfffffd7c935f4000)]
   0x0000000005e3ac00 JavaThread "http-443-Processor216" daemon  
[_thread_blocked, id=317656,  
stack(0xfffffd7c938f8000,0xfffffd7c939f8000)]
   0x0000000004496000 JavaThread "http-443-Processor215" daemon  
[_thread_in_native, id=317655,  
stack(0xfffffd7c93cfc000,0xfffffd7c93dfc000)]
   0x0000000006322400 JavaThread "http-443-Processor214" daemon  
[_thread_in_native, id=317654,  
stack(0xfffffd7c93dfd000,0xfffffd7c93efd000)]
   0x0000000006260000 JavaThread "http-443-Processor213" daemon  
[_thread_blocked, id=317653,  
stack(0xfffffd7c93efe000,0xfffffd7c93ffe000)]
   0x0000000005a13800 JavaThread "http-443-Processor212" daemon  
[_thread_blocked, id=317652,  
stack(0xfffffd7c94100000,0xfffffd7c94200000)]
   0x0000000008653400 JavaThread "http-443-Processor211" daemon  
[_thread_blocked, id=317651,  
stack(0xfffffd7c94403000,0xfffffd7c94503000)]
   0x00000000054e7800 JavaThread "http-443-Processor210" daemon  
[_thread_blocked, id=317650,  
stack(0xfffffd7c9521c000,0xfffffd7c9531c000)]
   0x0000000008653c00 JavaThread "http-443-Processor209" daemon  
[_thread_blocked, id=317649,  
stack(0xfffffd7c9531d000,0xfffffd7c9541d000)]
   0x00000000070ac800 JavaThread "http-443-Processor208" daemon  
[_thread_blocked, id=317648,  
stack(0xfffffd7c95c26000,0xfffffd7c95d26000)]
   0x00000000016b2000 JavaThread "http-443-Processor207" daemon  
[_thread_blocked, id=317647,  
stack(0xfffffd7c937f7000,0xfffffd7c938f7000)]
   0x0000000005a14800 JavaThread "http-443-Processor206" daemon  
[_thread_blocked, id=317646,  
stack(0xfffffd7c9511b000,0xfffffd7c9521b000)]
   0x0000000006314800 JavaThread "http-443-Processor205" daemon  
[_thread_blocked, id=317645,  
stack(0xfffffd7c94302000,0xfffffd7c94402000)]
   0x0000000003c33c00 JavaThread "http-443-Processor204" daemon  
[_thread_blocked, id=317644,  
stack(0xfffffd7c933f3000,0xfffffd7c934f3000)]
   0x0000000005402400 JavaThread "http-443-Processor203" daemon  
[_thread_blocked, id=317643,  
stack(0xfffffd7c92cec000,0xfffffd7c92dec000)]
   0x00000000042aa800 JavaThread "http-443-Processor202" daemon  
[_thread_blocked, id=317642,  
stack(0xfffffd7c96381000,0xfffffd7c96481000)]
   0x0000000008a50400 JavaThread "http-443-Processor201" daemon  
[_thread_blocked, id=317641,  
stack(0xfffffd7c9541e000,0xfffffd7c9551e000)]
   0x0000000005e8e000 JavaThread "Thread-10708" daemon  
[_thread_in_native, id=10940,  
stack(0xfffffd7c935f5000,0xfffffd7c936f5000)]
   0x00000000055d6400 JavaThread "Thread-10705" daemon  
[_thread_in_native, id=10937,  
stack(0xfffffd7c95923000,0xfffffd7c95a23000)]
   0x0000000006991400 JavaThread "Thread-10704" daemon  
[_thread_in_native, id=10936,  
stack(0xfffffd7c8fa82000,0xfffffd7c8fb82000)]
   0x0000000006ee1c00 JavaThread "Thread-9556" daemon  
[_thread_in_native, id=9773,  
stack(0xfffffd7c8e870000,0xfffffd7c8e970000)]
   0x0000000006329400 JavaThread "Thread-9526" daemon  
[_thread_in_native, id=9743,  
stack(0xfffffd7c8dc64000,0xfffffd7c8dd64000)]
   0x0000000003dfd800 JavaThread "Thread-6074" daemon  
[_thread_in_native, id=6211,  
stack(0xfffffd7c95f29000,0xfffffd7c96029000)]
   0x0000000003dfcc00 JavaThread "Thread-6072" daemon  
[_thread_in_native, id=6209,  
stack(0xfffffd7c8f179000,0xfffffd7c8f279000)]
   0x000000000589d000 JavaThread "Thread-6070" daemon  
[_thread_in_native, id=6207,  
stack(0xfffffd7c9068e000,0xfffffd7c9078e000)]
   0x0000000005782c00 JavaThread "Thread-6069" daemon  
[_thread_in_native, id=6205,  
stack(0xfffffd7c8ceeb000,0xfffffd7c8cfeb000)]
   0x00000000063c8400 JavaThread "Thread-6067" daemon  
[_thread_in_native, id=6203,  
stack(0xfffffd7c911ff000,0xfffffd7c912ff000)]
   0x0000000003fe6800 JavaThread "Thread-6065" daemon  
[_thread_in_native, id=6201,  
stack(0xfffffd7c91d9a000,0xfffffd7c91e9a000)]
   0x0000000005f37000 JavaThread "Thread-6064" daemon  
[_thread_in_native, id=6200,  
stack(0xfffffd7c91390000,0xfffffd7c91490000)]
   0x00000000063f2c00 JavaThread "Thread-6062" daemon  
[_thread_in_native, id=6198,  
stack(0xfffffd7c8f67e000,0xfffffd7c8f77e000)]
   0x00000000062b5000 JavaThread "http-443-Processor200" daemon  
[_thread_in_native, id=6012,  
stack(0xfffffd7c8b1f1000,0xfffffd7c8b2f1000)]
   0x0000000005b38800 JavaThread "http-443-Processor196" daemon  
[_thread_blocked, id=6008, stack(0xfffffd7c8b5f5000,0xfffffd7c8b6f5000)]
   0x00000000062b1000 JavaThread "http-443-Processor195" daemon  
[_thread_in_native, id=6007,  
stack(0xfffffd7c8b6f6000,0xfffffd7c8b7f6000)]
   0x00000000062b0000 JavaThread "http-443-Processor194" daemon  
[_thread_blocked, id=6006, stack(0xfffffd7c8b7f7000,0xfffffd7c8b8f7000)]
   0x00000000042b0c00 JavaThread "http-443-Processor191" daemon  
[_thread_in_native, id=6003,  
stack(0xfffffd7c8bafa000,0xfffffd7c8bbfa000)]
   0x00000000042afc00 JavaThread "http-443-Processor190" daemon  
[_thread_blocked, id=6002, stack(0xfffffd7c8bbfb000,0xfffffd7c8bcfb000)]
   0x00000000042aec00 JavaThread "http-443-Processor189" daemon  
[_thread_blocked, id=6001, stack(0xfffffd7c8bcfc000,0xfffffd7c8bdfc000)]
   0x0000000005462c00 JavaThread "http-443-Processor188" daemon  
[_thread_blocked, id=6000, stack(0xfffffd7c8bdfd000,0xfffffd7c8befd000)]
   0x0000000005461c00 JavaThread "http-443-Processor187" daemon  
[_thread_blocked, id=5999, stack(0xfffffd7c8bfff000,0xfffffd7c8c0ff000)]
   0x0000000005461000 JavaThread "http-443-Processor186" daemon  
[_thread_blocked, id=5998, stack(0xfffffd7c8c100000,0xfffffd7c8c200000)]
   0x0000000005460000 JavaThread "http-443-Processor185" daemon  
[_thread_blocked, id=5997, stack(0xfffffd7c8c706000,0xfffffd7c8c806000)]
   0x0000000007a98400 JavaThread "http-443-Processor184" daemon  
[_thread_in_native, id=5996,  
stack(0xfffffd7c8cfec000,0xfffffd7c8d0ec000)]
   0x0000000007a97800 JavaThread "http-443-Processor183" daemon  
[_thread_blocked, id=5995, stack(0xfffffd7c8ec74000,0xfffffd7c8ed74000)]
   0x0000000007a96c00 JavaThread "http-443-Processor182" daemon  
[_thread_blocked, id=5994, stack(0xfffffd7c8befe000,0xfffffd7c8bffe000)]
   0x00000000064ce000 JavaThread "http-443-Processor181" daemon  
[_thread_blocked, id=5993, stack(0xfffffd7c8d63f000,0xfffffd7c8d73f000)]
   0x00000000064cd400 JavaThread "http-443-Processor180" daemon  
[_thread_blocked, id=5992, stack(0xfffffd7c8d4be000,0xfffffd7c8d5be000)]
   0x00000000071dd400 JavaThread "http-443-Processor179" daemon  
[_thread_blocked, id=5991, stack(0xfffffd7c8c807000,0xfffffd7c8c907000)]
   0x00000000063c9800 JavaThread "http-443-Processor178" daemon  
[_thread_blocked, id=5990, stack(0xfffffd7c8cdea000,0xfffffd7c8ceea000)]
   0x00000000063c9000 JavaThread "http-443-Processor177" daemon  
[_thread_in_native, id=5989,  
stack(0xfffffd7c8d0ed000,0xfffffd7c8d1ed000)]
   0x0000000001148800 JavaThread "jforum" daemon [_thread_blocked,  
id=3676, stack(0xfffffd7c8d334000,0xfffffd7c8d434000)]
   0x0000000001e77000 JavaThread "Thread-2351" daemon  
[_thread_in_native, id=2471,  
stack(0xfffffd7c8c201000,0xfffffd7c8c301000)]
   0x00000000054d4400 JavaThread "http-443-Processor173" daemon  
[_thread_blocked, id=2139, stack(0xfffffd7c8da62000,0xfffffd7c8db62000)]
   0x00000000059ff800 JavaThread "http-443-Processor172" daemon  
[_thread_blocked, id=2138, stack(0xfffffd7c8de66000,0xfffffd7c8df66000)]
   0x000000000283d000 JavaThread "http-443-Processor166" daemon  
[_thread_blocked, id=2132, stack(0xfffffd7c8f981000,0xfffffd7c8fa81000)]
   0x0000000005732000 JavaThread "http-443-Processor162" daemon  
[_thread_blocked, id=2128, stack(0xfffffd7c9078f000,0xfffffd7c9088f000)]
   0x00000000059eac00 JavaThread "http-443-Processor161" daemon  
[_thread_blocked, id=2127, stack(0xfffffd7c90890000,0xfffffd7c90990000)]
   0x0000000005e5d800 JavaThread "http-443-Processor155" daemon  
[_thread_blocked, id=2121, stack(0xfffffd7c9229f000,0xfffffd7c9239f000)]
   0x0000000003173000 JavaThread "http-443-Processor153" daemon  
[_thread_blocked, id=2119, stack(0xfffffd7c95721000,0xfffffd7c95821000)]
   0x0000000001b08000 JavaThread "http-443-Processor149" daemon  
[_thread_in_native, id=1533,  
stack(0xfffffd7c92beb000,0xfffffd7c92ceb000)]
   0x0000000006b37800 JavaThread "http-443-Processor144" daemon  
[_thread_blocked, id=1528, stack(0xfffffd7c94610000,0xfffffd7c94710000)]
   0x0000000005df0000 JavaThread "http-443-Processor141" daemon  
[_thread_blocked, id=1525, stack(0xfffffd7c9551f000,0xfffffd7c9561f000)]
   0x0000000005ded400 JavaThread "http-443-Processor138" daemon  
[_thread_in_native, id=1522,  
stack(0xfffffd7c95a24000,0xfffffd7c95b24000)]
   0x0000000004eebc00 JavaThread "http-443-Processor134" daemon  
[_thread_in_native, id=1518,  
stack(0xfffffd7c96280000,0xfffffd7c96380000)]
   0x0000000004eea000 JavaThread "http-443-Processor132" daemon  
[_thread_blocked, id=1516, stack(0xfffffd7c96482000,0xfffffd7c96582000)]
   0x0000000004fff800 JavaThread "http-443-Processor131" daemon  
[_thread_blocked, id=1515, stack(0xfffffd7c96630000,0xfffffd7c96730000)]
   0x0000000004474800 JavaThread "http-443-Processor129" daemon  
[_thread_blocked, id=1513, stack(0xfffffd7c8f57d000,0xfffffd7c8f67d000)]
   0x0000000004474000 JavaThread "http-443-Processor128" daemon  
[_thread_in_native, id=1512,  
stack(0xfffffd7c8fe86000,0xfffffd7c8ff86000)]
   0x0000000006e6b000 JavaThread "MERGE2.FindSubgroups thread" daemon  
[_thread_blocked, id=1372, stack(0xfffffd7c8d1ee000,0xfffffd7c8d2ee000)]
   0x0000000005dc4800 JavaThread "Java2D Disposer" daemon  
[_thread_blocked, id=1369, stack(0xfffffd7c8d75f000,0xfffffd7c8d85f000)]
   0x000000000742cc00 JavaThread "http-443-Processor125" daemon  
[_thread_blocked, id=813, stack(0xfffffd7c8d860000,0xfffffd7c8d960000)]
   0x0000000005f3b000 JavaThread "http-443-Processor124" daemon  
[_thread_blocked, id=812, stack(0xfffffd7c8d961000,0xfffffd7c8da61000)]
   0x0000000005b73c00 JavaThread "http-443-Processor118" daemon  
[_thread_blocked, id=806, stack(0xfffffd7c8df67000,0xfffffd7c8e067000)]
   0x00000000035e9400 JavaThread "http-443-Processor117" daemon  
[_thread_in_native, id=805,  
stack(0xfffffd7c8e068000,0xfffffd7c8e168000)]
   0x0000000005154c00 JavaThread "http-443-Processor116" daemon  
[_thread_blocked, id=804, stack(0xfffffd7c8e169000,0xfffffd7c8e269000)]
   0x00000000059fe800 JavaThread "http-443-Processor114" daemon  
[_thread_in_native, id=802,  
stack(0xfffffd7c8e36b000,0xfffffd7c8e46b000)]
   0x0000000006437400 JavaThread "http-443-Processor109" daemon  
[_thread_in_native, id=797,  
stack(0xfffffd7c8ea72000,0xfffffd7c8eb72000)]
   0x0000000006436400 JavaThread "http-443-Processor108" daemon  
[_thread_blocked, id=796, stack(0xfffffd7c90b93000,0xfffffd7c90c93000)]
   0x00000000070a3000 JavaThread "http-443-Processor106" daemon  
[_thread_in_native, id=794,  
stack(0xfffffd7c90a92000,0xfffffd7c90b92000)]
   0x0000000004d86c00 JavaThread "Thread-413" daemon  
[_thread_in_native, id=518,  
stack(0xfffffd7c8e971000,0xfffffd7c8ea71000)]
   0x0000000005186800 JavaThread "Thread-411" daemon  
[_thread_in_native, id=516,  
stack(0xfffffd7c8eb73000,0xfffffd7c8ec73000)]
   0x0000000005fc0400 JavaThread "File Reaper" daemon  
[_thread_blocked, id=515, stack(0xfffffd7c8ef77000,0xfffffd7c8f077000)]
   0x000000000513e000 JavaThread "Thread-332" daemon  
[_thread_in_native, id=436,  
stack(0xfffffd7c92aea000,0xfffffd7c92bea000)]
   0x000000000570f400 JavaThread "http-443-Processor71" daemon  
[_thread_in_native, id=283,  
stack(0xfffffd7c91693000,0xfffffd7c91793000)]
   0x000000000478e800 JavaThread "http-443-Processor61" daemon  
[_thread_blocked, id=273, stack(0xfffffd7c9209d000,0xfffffd7c9219d000)]
   0x000000000478d400 JavaThread "http-443-Processor60" daemon  
[_thread_blocked, id=272, stack(0xfffffd7c9219e000,0xfffffd7c9229e000)]
   0x0000000002d2b000 JavaThread "http-443-Processor56" daemon  
[_thread_in_native, id=268,  
stack(0xfffffd7c925a2000,0xfffffd7c926a2000)]
   0x0000000003382000 JavaThread "http-443-Processor52" daemon  
[_thread_in_native, id=264,  
stack(0xfffffd7c929e9000,0xfffffd7c92ae9000)]
   0x0000000005e05800 JavaThread "http-443-Processor47" daemon  
[_thread_in_native, id=231,  
stack(0xfffffd7c92eee000,0xfffffd7c92fee000)]
   0x0000000001e22800 JavaThread "http-443-Processor43" daemon  
[_thread_blocked, id=227, stack(0xfffffd7c932f2000,0xfffffd7c933f2000)]
   0x00000000038e5000 JavaThread "http-443-Processor35" daemon  
[_thread_in_native, id=219,  
stack(0xfffffd7c93afa000,0xfffffd7c93bfa000)]
   0x00000000048f4400 JavaThread "http-443-Processor30" daemon  
[_thread_blocked, id=214, stack(0xfffffd7c93fff000,0xfffffd7c940ff000)]
   0x00000000048da000 JavaThread "http-443-Processor26" daemon  
[_thread_blocked, id=210, stack(0xfffffd7c94504000,0xfffffd7c94604000)]
   0x00000000039fec00 JavaThread "FinalizableReferenceQueue" daemon  
[_thread_blocked, id=197, stack(0xfffffd7c94711000,0xfffffd7c94811000)]
   0x000000000407dc00 JavaThread "TP-Monitor" daemon [_thread_blocked,  
id=189, stack(0xfffffd7c94812000,0xfffffd7c94912000)]
   0x000000000407c400 JavaThread "TP-Processor4" daemon  
[_thread_in_native, id=188,  
stack(0xfffffd7c94913000,0xfffffd7c94a13000)]
   0x0000000004f45400 JavaThread "TP-Processor3" daemon  
[_thread_blocked, id=187, stack(0xfffffd7c94a14000,0xfffffd7c94b14000)]
   0x0000000004449400 JavaThread "TP-Processor2" daemon  
[_thread_blocked, id=186, stack(0xfffffd7c94b15000,0xfffffd7c94c15000)]
   0x000000000444a400 JavaThread "TP-Processor1" daemon  
[_thread_blocked, id=185, stack(0xfffffd7c94c16000,0xfffffd7c94d16000)]
   0x0000000004f43c00 JavaThread "http-443-Monitor" [_thread_blocked,  
id=184, stack(0xfffffd7c94d17000,0xfffffd7c94e17000)]
   0x0000000003db3000 JavaThread "http-443-Processor25" daemon  
[_thread_in_native, id=183,  
stack(0xfffffd7c94e18000,0xfffffd7c94f18000)]
   0x0000000003b07800 JavaThread "http-443-Processor17" daemon  
[_thread_blocked, id=175, stack(0xfffffd7c95620000,0xfffffd7c95720000)]
   0x0000000004c31800 JavaThread "http-443-Processor9" daemon  
[_thread_blocked, id=167, stack(0xfffffd7c95e28000,0xfffffd7c95f28000)]
   0x0000000004343800 JavaThread "http-443-Processor7" daemon  
[_thread_blocked, id=165, stack(0xfffffd7c9602a000,0xfffffd7c9612a000)]
   0x0000000004058800 JavaThread "http-80-Monitor" [_thread_blocked,  
id=158, stack(0xfffffd7c96731000,0xfffffd7c96831000)]
   0x0000000004f62c00 JavaThread "http-80-Processor25" daemon  
[_thread_blocked, id=157, stack(0xfffffd7c96832000,0xfffffd7c96932000)]
   0x0000000002870000 JavaThread "http-80-Processor24" daemon  
[_thread_blocked, id=156, stack(0xfffffd7c96933000,0xfffffd7c96a33000)]
   0x000000000286e800 JavaThread "http-80-Processor23" daemon  
[_thread_blocked, id=155, stack(0xfffffd7c96a34000,0xfffffd7c96b34000)]
   0x0000000004555800 JavaThread "http-80-Processor22" daemon  
[_thread_blocked, id=154, stack(0xfffffd7c96b35000,0xfffffd7c96c35000)]
   0x00000000032aac00 JavaThread "http-80-Processor21" daemon  
[_thread_blocked, id=153, stack(0xfffffd7c96c36000,0xfffffd7c96d36000)]
   0x0000000004595800 JavaThread "http-80-Processor20" daemon  
[_thread_blocked, id=152, stack(0xfffffd7c96d37000,0xfffffd7c96e37000)]
   0x0000000004e9e400 JavaThread "http-80-Processor19" daemon  
[_thread_in_native, id=151,  
stack(0xfffffd7c96e38000,0xfffffd7c96f38000)]
   0x0000000003e29800 JavaThread "http-80-Processor18" daemon  
[_thread_blocked, id=150, stack(0xfffffd7c96f39000,0xfffffd7c97039000)]
   0x0000000002832000 JavaThread "http-80-Processor17" daemon  
[_thread_blocked, id=149, stack(0xfffffd7c9703a000,0xfffffd7c9713a000)]
   0x00000000053f3800 JavaThread "http-80-Processor16" daemon  
[_thread_blocked, id=148, stack(0xfffffd7c9713b000,0xfffffd7c9723b000)]
   0x0000000002a04800 JavaThread "http-80-Processor15" daemon  
[_thread_blocked, id=147, stack(0xfffffd7c9723c000,0xfffffd7c9733c000)]
   0x00000000036e2400 JavaThread "http-80-Processor14" daemon  
[_thread_blocked, id=146, stack(0xfffffd7c9733d000,0xfffffd7c9743d000)]
   0x00000000029c7800 JavaThread "http-80-Processor13" daemon  
[_thread_blocked, id=145, stack(0xfffffd7c9743e000,0xfffffd7c9753e000)]
   0x0000000003be5c00 JavaThread "http-80-Processor12" daemon  
[_thread_blocked, id=144, stack(0xfffffd7c9753f000,0xfffffd7c9763f000)]
   0x0000000002cce800 JavaThread "http-80-Processor11" daemon  
[_thread_blocked, id=143, stack(0xfffffd7c97640000,0xfffffd7c97740000)]
   0x0000000003b5f000 JavaThread "http-80-Processor10" daemon  
[_thread_blocked, id=142, stack(0xfffffd7c97741000,0xfffffd7c97841000)]
   0x0000000001951c00 JavaThread "http-80-Processor9" daemon  
[_thread_blocked, id=141, stack(0xfffffd7c97842000,0xfffffd7c97942000)]
   0x00000000046f4400 JavaThread "http-80-Processor8" daemon  
[_thread_blocked, id=140, stack(0xfffffd7c97943000,0xfffffd7c97a43000)]
   0x0000000002f48000 JavaThread "http-80-Processor7" daemon  
[_thread_blocked, id=139, stack(0xfffffd7c97a44000,0xfffffd7c97b44000)]
   0x0000000002f48c00 JavaThread "http-80-Processor6" daemon  
[_thread_blocked, id=138, stack(0xfffffd7c97b45000,0xfffffd7c97c45000)]
   0x00000000056fc000 JavaThread "http-80-Processor5" daemon  
[_thread_blocked, id=137, stack(0xfffffd7c97c46000,0xfffffd7c97d46000)]
   0x0000000004504400 JavaThread "http-80-Processor4" daemon  
[_thread_blocked, id=136, stack(0xfffffd7c97d47000,0xfffffd7c97e47000)]
   0x00000000031fec00 JavaThread "http-80-Processor3" daemon  
[_thread_blocked, id=135, stack(0xfffffd7c97e48000,0xfffffd7c97f48000)]
   0x000000000134fc00 JavaThread "http-80-Processor2" daemon  
[_thread_blocked, id=134, stack(0xfffffd7c97f49000,0xfffffd7c98049000)]
   0x00000000053fa400 JavaThread "http-80-Processor1" daemon  
[_thread_blocked, id=133, stack(0xfffffd7c9804a000,0xfffffd7c9814a000)]
   0x0000000002f49400 JavaThread  
"ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon  
[_thread_blocked, id=132, stack(0xfffffd7c9824c000,0xfffffd7c9834c000)]
   0x0000000003e6fc00 JavaThread "Timer-16" daemon [_thread_blocked,  
id=131, stack(0xfffffd7c9814b000,0xfffffd7c9824b000)]
   0x00000000048ee000 JavaThread "UDP mcast receiver" daemon  
[_thread_in_native, id=129,  
stack(0xfffffd7c9834d000,0xfffffd7c9844d000)]
   0x0000000003cebc00 JavaThread "UDP.UcastReceiverThread" daemon  
[_thread_in_native, id=128,  
stack(0xfffffd7c9844e000,0xfffffd7c9854e000)]
   0x00000000011fc800 JavaThread "TimeScheduler.Thread" daemon  
[_thread_blocked, id=127, stack(0xfffffd7c9854f000,0xfffffd7c9864f000)]
   0x0000000003942c00 JavaThread "MessageDispatcher up processing  
thread" daemon [_thread_blocked, id=126,  
stack(0xfffffd7c98650000,0xfffffd7c98750000)]
   0x00000000056eb800 JavaThread "UpHandler (GMS)" daemon  
[_thread_blocked, id=125, stack(0xfffffd7c98751000,0xfffffd7c98851000)]
   0x0000000003388400 JavaThread "DownHandler (GMS)" daemon  
[_thread_blocked, id=124, stack(0xfffffd7c98852000,0xfffffd7c98952000)]
   0x00000000056fa400 JavaThread "UpHandler (UNICAST)" daemon  
[_thread_blocked, id=123, stack(0xfffffd7c98953000,0xfffffd7c98a53000)]
   0x0000000003288000 JavaThread "UpHandler (FD)" daemon  
[_thread_blocked, id=122, stack(0xfffffd7c98a54000,0xfffffd7c98b54000)]
   0x0000000004248000 JavaThread "DownHandler (FD)" daemon  
[_thread_blocked, id=121, stack(0xfffffd7c98b55000,0xfffffd7c98c55000)]
   0x0000000003387800 JavaThread "DownHandler (UDP)" daemon  
[_thread_blocked, id=120, stack(0xfffffd7c98c56000,0xfffffd7c98d56000)]
   0x0000000004260400 JavaThread "Timer-15" daemon [_thread_blocked,  
id=119, stack(0xfffffd7c98ed8000,0xfffffd7c98fd8000)]
   0x0000000002d9cc00 JavaThread "Store  
org.theospi.portfolio.presentation.control.ViewPresentationControl.XML  
Spool Thread" daemon [_thread_blocked, id=118,  
stack(0xfffffd7c99143000,0xfffffd7c99243000)]
   0x00000000033fe400 JavaThread "Remote delivery thread  
(0)" [_thread_in_native, id=116,  
stack(0xfffffd7c9942b000,0xfffffd7c9952b000)]
   0x00000000033fc800 JavaThread "default Worker #49" daemon  
[_thread_blocked, id=115, stack(0xfffffd7c9952c000,0xfffffd7c9962c000)]
   0x00000000033fbc00 JavaThread "default Worker #48" daemon  
[_thread_blocked, id=114, stack(0xfffffd7c9962d000,0xfffffd7c9972d000)]
   0x0000000001efe400 JavaThread "default Worker #47" daemon  
[_thread_blocked, id=113, stack(0xfffffd7c9972e000,0xfffffd7c9982e000)]
   0x0000000001efd400 JavaThread "default Worker #46" daemon  
[_thread_blocked, id=112, stack(0xfffffd7c9982f000,0xfffffd7c9992f000)]
   0x0000000001efc800 JavaThread "default Worker #45" daemon  
[_thread_blocked, id=111, stack(0xfffffd7c99977000,0xfffffd7c99a77000)]
   0x0000000001efb800 JavaThread "default Worker #44" daemon  
[_thread_blocked, id=110, stack(0xfffffd7c99a78000,0xfffffd7c99b78000)]
   0x0000000001efa800 JavaThread "default Worker #43" daemon  
[_thread_blocked, id=109, stack(0xfffffd7c99b79000,0xfffffd7c99c79000)]
   0x0000000001ef9800 JavaThread "default Worker #42" daemon  
[_thread_blocked, id=108, stack(0xfffffd7c99c7a000,0xfffffd7c99d7a000)]
   0x0000000001ef8c00 JavaThread "default Worker #41" daemon  
[_thread_blocked, id=107, stack(0xfffffd7c99d7b000,0xfffffd7c99e7b000)]
   0x0000000001ef7c00 JavaThread "default Worker #40" daemon  
[_thread_blocked, id=106, stack(0xfffffd7c99e7c000,0xfffffd7c99f7c000)]
   0x0000000001ef6c00 JavaThread "default Worker #39" daemon  
[_thread_blocked, id=105, stack(0xfffffd7c99f7d000,0xfffffd7c9a07d000)]
   0x0000000001ef0800 JavaThread "default Worker #38" daemon  
[_thread_blocked, id=104, stack(0xfffffd7c9a07e000,0xfffffd7c9a17e000)]
   0x0000000001eefc00 JavaThread "default Worker #37" daemon  
[_thread_blocked, id=103, stack(0xfffffd7c9a17f000,0xfffffd7c9a27f000)]
   0x0000000001eeec00 JavaThread "default Worker #36" daemon  
[_thread_blocked, id=102, stack(0xfffffd7c9a280000,0xfffffd7c9a380000)]
   0x0000000002fc4c00 JavaThread "default Worker #35" daemon  
[_thread_blocked, id=101, stack(0xfffffd7c9a381000,0xfffffd7c9a481000)]
   0x0000000002fc3c00 JavaThread "default Worker #34" daemon  
[_thread_blocked, id=100, stack(0xfffffd7c9a482000,0xfffffd7c9a582000)]
   0x0000000002fc3000 JavaThread "default Worker #33" daemon  
[_thread_blocked, id=99, stack(0xfffffd7c9a583000,0xfffffd7c9a683000)]
   0x0000000002fc2000 JavaThread "default Worker #32" daemon  
[_thread_blocked, id=98, stack(0xfffffd7c9a684000,0xfffffd7c9a784000)]
   0x0000000002fc1000 JavaThread "default Worker #31" daemon  
[_thread_blocked, id=97, stack(0xfffffd7c9a785000,0xfffffd7c9a885000)]
   0x0000000002fbb000 JavaThread "default Worker #30" daemon  
[_thread_blocked, id=96, stack(0xfffffd7c9a886000,0xfffffd7c9a986000)]
   0x000000000112f000 JavaThread "default Worker #29" daemon  
[_thread_blocked, id=95, stack(0xfffffd7c9a987000,0xfffffd7c9aa87000)]
   0x000000000112e000 JavaThread "default Worker #28" daemon  
[_thread_blocked, id=94, stack(0xfffffd7c9aa88000,0xfffffd7c9ab88000)]
   0x000000000112d000 JavaThread "default Worker #27" daemon  
[_thread_blocked, id=93, stack(0xfffffd7c9ab89000,0xfffffd7c9ac89000)]
   0x0000000001126c00 JavaThread "default Worker #26" daemon  
[_thread_blocked, id=92, stack(0xfffffd7c9ac8a000,0xfffffd7c9ad8a000)]
   0x0000000001126000 JavaThread "default Worker #25" daemon  
[_thread_blocked, id=91, stack(0xfffffd7c9ad8b000,0xfffffd7c9ae8b000)]
   0x0000000002d6b400 JavaThread "default Worker #24" daemon  
[_thread_blocked, id=90, stack(0xfffffd7c9ae8c000,0xfffffd7c9af8c000)]
   0x0000000002d6a400 JavaThread "default Worker #23" daemon  
[_thread_blocked, id=89, stack(0xfffffd7c9af8d000,0xfffffd7c9b08d000)]
   0x0000000002d73400 JavaThread "default Worker #22" daemon  
[_thread_blocked, id=88, stack(0xfffffd7c9b08e000,0xfffffd7c9b18e000)]
   0x0000000004a14400 JavaThread "default Worker #21" daemon  
[_thread_blocked, id=87, stack(0xfffffd7c9b18f000,0xfffffd7c9b28f000)]
   0x0000000002d72000 JavaThread "default Worker #20" daemon  
[_thread_blocked, id=86, stack(0xfffffd7c9b290000,0xfffffd7c9b390000)]
   0x0000000002d6bc00 JavaThread "default Worker #19" daemon  
[_thread_blocked, id=85, stack(0xfffffd7c9b391000,0xfffffd7c9b491000)]
   0x0000000004a13800 JavaThread "default Worker #18" daemon  
[_thread_blocked, id=84, stack(0xfffffd7c9b492000,0xfffffd7c9b592000)]
   0x0000000002d69400 JavaThread "default Worker #17" daemon  
[_thread_blocked, id=83, stack(0xfffffd7c9b593000,0xfffffd7c9b693000)]
   0x0000000002997c00 JavaThread "default Worker #16" daemon  
[_thread_blocked, id=82, stack(0xfffffd7c9b694000,0xfffffd7c9b794000)]
   0x0000000002995c00 JavaThread "default Worker #15" daemon  
[_thread_blocked, id=81, stack(0xfffffd7c9b795000,0xfffffd7c9b895000)]
   0x0000000002996400 JavaThread "default Worker #14" daemon  
[_thread_blocked, id=80, stack(0xfffffd7c9b896000,0xfffffd7c9b996000)]
   0x0000000001749400 JavaThread "default Worker #13" daemon  
[_thread_blocked, id=79, stack(0xfffffd7c9b997000,0xfffffd7c9ba97000)]
   0x0000000001748400 JavaThread "default Worker #12" daemon  
[_thread_blocked, id=78, stack(0xfffffd7c9ba98000,0xfffffd7c9bb98000)]
   0x0000000001747800 JavaThread "default Worker #11" daemon  
[_thread_in_native, id=77, stack(0xfffffd7c9bb99000,0xfffffd7c9bc99000)]
   0x0000000004520000 JavaThread "default Worker #10" daemon  
[_thread_blocked, id=76, stack(0xfffffd7c9bc9a000,0xfffffd7c9bd9a000)]
   0x0000000003994400 JavaThread "default Worker #9" daemon  
[_thread_blocked, id=75, stack(0xfffffd7c9bd9b000,0xfffffd7c9be9b000)]
   0x0000000003993400 JavaThread "default Worker #8" daemon  
[_thread_blocked, id=74, stack(0xfffffd7c9be9c000,0xfffffd7c9bf9c000)]
   0x00000000030c1400 JavaThread "default Worker #7" daemon  
[_thread_blocked, id=73, stack(0xfffffd7c9bf9d000,0xfffffd7c9c09d000)]
   0x00000000030c1c00 JavaThread "default Worker #6" daemon  
[_thread_blocked, id=72, stack(0xfffffd7c9c09e000,0xfffffd7c9c19e000)]
   0x00000000016f1c00 JavaThread "default Worker #5" daemon  
[_thread_blocked, id=71, stack(0xfffffd7c9c19f000,0xfffffd7c9c29f000)]
   0x0000000004a52400 JavaThread "default Worker #4" daemon  
[_thread_blocked, id=70, stack(0xfffffd7c9c2a0000,0xfffffd7c9c3a0000)]
   0x0000000004540800 JavaThread "default Worker #3" daemon  
[_thread_blocked, id=69, stack(0xfffffd7c9c3a1000,0xfffffd7c9c4a1000)]
   0x0000000002819800 JavaThread "default Worker #2" daemon  
[_thread_blocked, id=68, stack(0xfffffd7c9c4a2000,0xfffffd7c9c5a2000)]
   0x000000000281e800 JavaThread "default Worker #1" daemon  
[_thread_blocked, id=67, stack(0xfffffd7c9c5a3000,0xfffffd7c9c6a3000)]
   0x0000000002cbe400 JavaThread "default Worker #0" daemon  
[_thread_blocked, id=66, stack(0xfffffd7c9c6a4000,0xfffffd7c9c7a4000)]
   0x0000000004f65000 JavaThread "Thread-22" [_thread_blocked, id=65,  
stack(0xfffffd7c9c8ae000,0xfffffd7c9c9ae000)]
   0x0000000003839000 JavaThread  
"org 
.sakaiproject.sitestats.impl.StatsUpdateManagerImpl" [_thread_blocked,  
id=61, stack(0xfffffd7c9c9cb000,0xfffffd7c9cacb000)]
   0x00000000032b6800 JavaThread "Store  
uk.ac.cam.caret.sakai.rwiki.service.api.radeox.RenderCache Spool  
Thread" daemon [_thread_blocked, id=60,  
stack(0xfffffd7c9cacc000,0xfffffd7c9cbcc000)]
   0x0000000001340400 JavaThread "Store  
org 
.sakaiproject 
.api.privacy.PrivacyManager.PrivacyQueryCache.queryGetPrivacy Spool  
Thread" daemon [_thread_blocked, id=59,  
stack(0xfffffd7c9cbcd000,0xfffffd7c9cccd000)]
   0x00000000016fd400 JavaThread "Store  
org.sakaiproject.user.api.AuthenticationManager Spool Thread" daemon  
[_thread_blocked, id=58, stack(0xfffffd7c9ccce000,0xfffffd7c9cdce000)]
   0x0000000003f5f400 JavaThread "Timer-14" daemon [_thread_blocked,  
id=57, stack(0xfffffd7c9cdcf000,0xfffffd7c9cecf000)]
   0x0000000001355800 JavaThread "Store  
org 
.sakaiproject.citation.api.SearchManager.metasearchSessionManagerCache  
Spool Thread" daemon [_thread_blocked, id=56,  
stack(0xfffffd7c9cef4000,0xfffffd7c9cff4000)]
   0x0000000002863400 JavaThread "Store  
org.sakaiproject.citation.api.SearchManager.sessionContextCache Spool  
Thread" daemon [_thread_blocked, id=55,  
stack(0xfffffd7c9cff5000,0xfffffd7c9d0f5000)]
   0x0000000004af4400 JavaThread "SakaiClusterService.Maintenance"  
daemon [_thread_blocked, id=54,  
stack(0xfffffd7c9d0f6000,0xfffffd7c9d1f6000)]
   0x0000000003dd9c00 JavaThread "Timer-13" daemon [_thread_blocked,  
id=53, stack(0xfffffd7c9d1f7000,0xfffffd7c9d2f7000)]
   0x0000000004da8c00 JavaThread  
"org.sakaiproject.calendar.impl.BaseExternalCalendarSubscriptionService 
$SubscriptionCacheMap" [_thread_blocked, id=52,  
stack(0xfffffd7c9d2f8000,0xfffffd7c9d3f8000)]
   0x0000000001342400 JavaThread  
"org.sakaiproject.calendar.impl.BaseExternalCalendarSubscriptionService 
$SubscriptionCacheMap" [_thread_blocked, id=51,  
stack(0xfffffd7c9d3f9000,0xfffffd7c9d4f9000)]
   0x0000000003217c00 JavaThread "Store  
org.theospi.portfolio.wizard.mgt.impl.WizardManagerImpl.cache Spool  
Thread" daemon [_thread_blocked, id=50,  
stack(0xfffffd7c9d5fb000,0xfffffd7c9d6fb000)]
   0x00000000031e5000 JavaThread "Thread-5" daemon [_thread_in_native,  
id=39, stack(0xfffffd7c9d4fa000,0xfffffd7c9d5fa000)]
   0x0000000004a3e800 JavaThread  
"org.etudes.mneme.impl.MnemeServiceImpl" [_thread_blocked, id=37,  
stack(0xfffffd7c9d6fc000,0xfffffd7c9d7fc000)]
   0x0000000003c97400 JavaThread  
"org.etudes.mneme.impl.SubmissionServiceImpl" [_thread_blocked, id=36,  
stack(0xfffffd7c9d7fd000,0xfffffd7c9d8fd000)]
   0x00000000032e0000 JavaThread "Timer-1" daemon [_thread_blocked,  
id=35, stack(0xfffffd7c9d8fe000,0xfffffd7c9d9fe000)]
   0x0000000001b52000 JavaThread "QuartzScheduler_QuartzScheduler- 
ha1.oirt.rutgers.edu_MisfireHandler" [_thread_blocked, id=34,  
stack(0xfffffd7c9d9ff000,0xfffffd7c9daff000)]
   0x000000000323e000 JavaThread  
"QuartzScheduler_QuartzSchedulerThread" [_thread_blocked, id=33,  
stack(0xfffffd7c9db25000,0xfffffd7c9dc25000)]
   0x00000000013d2c00 JavaThread  
"QuartzScheduler_Worker-4" [_thread_blocked, id=32,  
stack(0xfffffd7c9dc26000,0xfffffd7c9dd26000)]
   0x00000000013d1c00 JavaThread  
"QuartzScheduler_Worker-3" [_thread_blocked, id=31,  
stack(0xfffffd7c9dd27000,0xfffffd7c9de27000)]
   0x000000000368fc00 JavaThread  
"QuartzScheduler_Worker-2" [_thread_blocked, id=30,  
stack(0xfffffd7c9de28000,0xfffffd7c9df28000)]
   0x0000000003681000 JavaThread  
"QuartzScheduler_Worker-1" [_thread_blocked, id=29,  
stack(0xfffffd7c9df29000,0xfffffd7c9e029000)]
   0x0000000002d7ac00 JavaThread  
"QuartzScheduler_Worker-0" [_thread_blocked, id=28,  
stack(0xfffffd7c9e02a000,0xfffffd7c9e12a000)]
   0x0000000004c46800 JavaThread  
"org.sakaiproject.event.impl.ClusterEventTracking$$EnhancerByCGLIB$ 
$37de531" daemon [_thread_blocked, id=27,  
stack(0xfffffd7c9e12b000,0xfffffd7c9e22b000)]
   0x0000000004c45800 JavaThread "FinalizableReferenceQueue" daemon  
[_thread_blocked, id=26, stack(0xfffffd7c9e22c000,0xfffffd7c9e32c000)]
   0x0000000004c48400 JavaThread "Store  
org.sakaiproject.springframework.orm.hibernate.L2Cache Spool Thread"  
daemon [_thread_blocked, id=25,  
stack(0xfffffd7c9e32d000,0xfffffd7c9e42d000)]
   0x00000000027e7c00 JavaThread "Store  
org.sakaiproject.db.BaseDbFlatStorage.SAKAI_USER_PROPERTY Spool  
Thread" daemon [_thread_blocked, id=24,  
stack(0xfffffd7c9e42e000,0xfffffd7c9e52e000)]
   0x00000000027e7800 JavaThread "Store  
org.sakaiproject.db.BaseDbFlatStorage.SAKAI_SITE_GROUP_PROPERTY Spool  
Thread" daemon [_thread_blocked, id=23,  
stack(0xfffffd7c9e52f000,0xfffffd7c9e62f000)]
   0x00000000025a2800 JavaThread "Store  
org.sakaiproject.db.BaseDbFlatStorage.SAKAI_ALIAS_PROPERTY Spool  
Thread" daemon [_thread_blocked, id=22,  
stack(0xfffffd7c9e630000,0xfffffd7c9e730000)]
   0x00000000023f9000 JavaThread "Store  
org.sakaiproject.db.BaseDbFlatStorage.SAKAI_REALM_PROPERTY Spool  
Thread" daemon [_thread_blocked, id=21,  
stack(0xfffffd7c9e731000,0xfffffd7c9e831000)]
   0x0000000001a03400 JavaThread "Store  
org.sakaiproject.db.BaseDbFlatStorage.SAKAI_SITE_PAGE_PROPERTY Spool  
Thread" daemon [_thread_blocked, id=20,  
stack(0xfffffd7c9e832000,0xfffffd7c9e932000)]
   0x00000000023f8800 JavaThread "Store  
org.sakaiproject.db.BaseDbFlatStorage.SAKAI_SITE_PROPERTY Spool  
Thread" daemon [_thread_blocked, id=19,  
stack(0xfffffd7c9e933000,0xfffffd7c9ea33000)]
   0x0000000003b33000 JavaThread "Timer-0" daemon [_thread_blocked,  
id=18, stack(0xfffffd7c9ea34000,0xfffffd7c9eb34000)]
   0x000000000331ec00 JavaThread "Sakai.SessionComponent.Maintenance"  
daemon [_thread_blocked, id=17,  
stack(0xfffffd7c9eb35000,0xfffffd7c9ec35000)]
   0x0000000000f21c00 JavaThread "Low Memory Detector" daemon  
[_thread_blocked, id=15, stack(0xfffffd7c9f8f9000,0xfffffd7c9f9f9000)]
   0x0000000000f1f400 JavaThread "CompilerThread1" daemon  
[_thread_blocked, id=14, stack(0xfffffd7c9f9fa000,0xfffffd7c9fafa000)]
   0x0000000000f1d800 JavaThread "CompilerThread0" daemon  
[_thread_blocked, id=13, stack(0xfffffd7c9fafb000,0xfffffd7c9fbfb000)]
   0x0000000000f1c000 JavaThread "Signal Dispatcher" daemon  
[_thread_blocked, id=12, stack(0xfffffd7c9fbfc000,0xfffffd7c9fcfc000)]
   0x0000000000f1ac00 JavaThread "Surrogate Locker Thread (CMS)"  
daemon [_thread_blocked, id=11,  
stack(0xfffffd7c9fcfd000,0xfffffd7c9fdfd000)]
   0x0000000000ef4400 JavaThread "Finalizer" daemon [_thread_blocked,  
id=10, stack(0xfffffd7c9fdfe000,0xfffffd7c9fefe000)]
   0x0000000000ef2c00 JavaThread "Reference Handler" daemon  
[_thread_blocked, id=9, stack(0xfffffd7c9feff000,0xfffffd7c9ffff000)]
   0x0000000000428c00 JavaThread "main" [_thread_in_native, id=2,  
stack(0xfffffd7ffe29f000,0xfffffd7ffe39f000)]

Other Threads:
   0x0000000000eedc00 VMThread [stack:  
0xfffffd7ca0cff000,0xfffffd7ca0dff000] [id=8]
   0x0000000000f2dc00 WatcherThread [stack:  
0xfffffd7c9f7f8000,0xfffffd7c9f8f8000] [id=16]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap
  par new generation   total 2831168K, used 291724K  
[0xfffffd7cae200000, 0xfffffd7d6e200000, 0xfffffd7d6e200000)
   eden space 2516608K,   0% used [0xfffffd7cae200000,  
0xfffffd7cae72dac0, 0xfffffd7d47ba0000)
   from space 314560K,  91% used [0xfffffd7d47ba0000,  
0xfffffd7d593556e8, 0xfffffd7d5aed0000)
   to   space 314560K,   0% used [0xfffffd7d5aed0000,  
0xfffffd7d5aed0000, 0xfffffd7d6e200000)
  concurrent mark-sweep generation total 10166272K, used 3109415K  
[0xfffffd7d6e200000, 0xfffffd7fdaa00000, 0xfffffd7fdaa00000)
  concurrent-mark-sweep perm gen total 524288K, used 358305K  
[0xfffffd7fdaa00000, 0xfffffd7ffaa00000, 0xfffffd7ffaa00000)

Dynamic libraries:
0x0000000000400000      /usr/jdk/instances/jdk1.6.0_13/bin/amd64/java
0xfffffd7fff3a0000      /lib/64/libthread.so.1
0xfffffd7fff370000      /usr/jdk/instances/jdk1.6.0_13/bin/amd64/../../ 
jre/lib/amd64/jli/libjli.so
0xfffffd7fff350000      /lib/64/libdl.so.1
0xfffffd7fff1f0000      /lib/64/libc.so.1
0xfffffd7ffe600000      /usr/jdk/instances/jdk1.6.0_13/jre/lib/amd64/ 
server/libjvm.so
0xfffffd7fff190000      /lib/64/libsocket.so.1
0xfffffd7fff1c0000      /usr/lib/64/libsched.so.1
0xfffffd7fff160000      /lib/64/libm.so.1
0xfffffd7ffe5d0000      /usr/lib/64/libCrun.so.1
0xfffffd7fff140000      /lib/64/libdoor.so.1
0xfffffd7ffe500000      /lib/64/libnsl.so.1
0xfffffd7ffe490000      /lib/64/libm.so.2
0xfffffd7ffe460000      /lib/64/libscf.so.1
0xfffffd7ffe440000      /lib/64/libuutil.so.1
0xfffffd7ffe420000      /lib/64/libgen.so.1
0xfffffd7ffe400000      /lib/64/libmd.so.1
0xfffffd7ffe3e0000      /lib/64/libmp.so.2
0xfffffd7ffe270000      /usr/jdk/instances/jdk1.6.0_13/jre/lib/amd64/ 
native_threads/libhpi.so
0xfffffd7ffe220000      /usr/jdk/instances/jdk1.6.0_13/jre/lib/amd64/ 
libverify.so
0xfffffd7ffe1d0000      /usr/jdk/instances/jdk1.6.0_13/jre/lib/amd64/ 
libjava.so
0xfffffd7ffe1a0000      /usr/jdk/instances/jdk1.6.0_13/jre/lib/amd64/ 
libzip.so
0xfffffd7ffaac0000      /usr/jdk/instances/jdk1.6.0_13/jre/lib/amd64/ 
libnet.so
0xfffffd7ffaa80000      /usr/jdk/instances/jdk1.6.0_13/jre/lib/amd64/ 
libj2pkcs11.so
0xfffffd7ffaa30000      /usr/lib/amd64/libpkcs11.so
0xfffffd7ffaa10000      /usr/lib/64/libcryptoutil.so.1
0xfffffd7cae090000      /usr/lib/security/64/pkcs11_softtoken_extra.so
0xfffffd7c9ced0000      /usr/jdk/instances/jdk1.6.0_13/jre/lib/amd64/ 
libmanagement.so
0xfffffd7c8cce0000      /usr/jdk/instances/jdk1.6.0_13/jre/lib/amd64/ 
libawt.so
0xfffffd7c8d740000      /usr/jdk/instances/jdk1.6.0_13/jre/lib/amd64/ 
headless/libmawt.so
0xfffffd7c8cc20000      /usr/jdk/instances/jdk1.6.0_13/jre/lib/amd64/ 
libfontmanager.so
0xfffffd7c8d5f0000      /usr/jdk/instances/jdk1.6.0_13/jre/lib/amd64/ 
libdcpr.so
0xfffffd7c8d5d0000      /usr/jdk/instances/jdk1.6.0_13/jre/lib/amd64/ 
libnio.so
0xfffffd7c8d4a0000      /lib/64/librt.so.1
0xfffffd7c8d480000      /lib/64/libaio.so.1
0xfffffd7c965e0000      /usr/jdk/instances/jdk1.6.0_13/jre/lib/amd64/ 
libjpeg.so
0xfffffd7c95db0000      /usr/jdk/instances/jdk1.6.0_13/jre/lib/amd64/ 
libcmm.so

VM Arguments:
jvm_args: -Dsun.lang.ClassLoader.allowArraySyntax=true -Xmx13000m - 
Xms13000m -Xmn3g -XX:+UseConcMarkSweepGC -XX:+UseParNewGC - 
XX:SurvivorRatio=8 -XX:TargetSurvivorRatio=90 - 
XX:MaxTenuringThreshold=15 -XX:MaxPermSize=512m -XX:PermSize=64m -XX: 
+UseMembar -XX:-UseThreadPriorities -verbose:gc -XX:+PrintGCDetails - 
XX:+PrintGCTimeStamps -XX:+PrintTenuringDistribution -XX: 
+PrintAdaptiveSizePolicy -XX:+PrintGCApplicationConcurrentTime -XX: 
+PrintGCApplicationStoppedTime -Djava.awt.headless=true - 
Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager - 
Djava.util.logging.config.file=/army/sunone/sakai-production/servers/ 
sakai-ha1/apache-tomcat-5.5.20/conf/logging.properties - 
Djava.endorsed.dirs=/army/sunone/sakai-production/servers/sakai-ha1/ 
apache-tomcat-5.5.20/common/endorsed -Dcatalina.base=/army/sunone/ 
sakai-production/servers/sakai-ha1/apache-tomcat-5.5.20 - 
Dcatalina.home=/army/sunone/sakai-production/servers/sakai-ha1/apache- 
tomcat-5.5.20 -Djava.io.tmpdir=/army/sunone/sakai-production/servers/ 
sakai-ha1/apache-tomcat-5.5.20/temp
java_command: org.apache.catalina.startup.Bootstrap start
Launcher Type: SUN_STANDARD

Environment Variables:
JAVA_HOME=/usr/java
PATH=/usr/local/X11R5/bin:/usr/openwin/bin:/usr/local/bin:/usr/local/ 
gnubin:/opt/SUNWspro/bin:/usr/ccs/bin:/usr/bin:/usr/sbin:/usr/ucb:/ 
bin:/sbin:/usr/local/sbin:/army/sakai-dev/maven-1.0.2/bin:/army/sakai- 
dev/mysql/bin:/opt/sfw/bin
LD_LIBRARY_PATH=/usr/jdk/instances/jdk1.6.0_13/jre/lib/amd64/server:/ 
usr/jdk/instances/jdk1.6.0_13/jre/lib/amd64:/usr/jdk/instances/ 
jdk1.6.0_13/jre/../lib/amd64
SHELL=/bin/tcsh
HOSTTYPE=i86pc
OSTYPE=solaris
MACHTYPE=i386

Signal Handlers:
SIGSEGV: [libjvm.so+0x95f100], sa_mask[0]=0xffbffeff,  
sa_flags=0x0000000c
SIGBUS: [libjvm.so+0x95f100], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGFPE: [libjvm.so+0x34ef20], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGPIPE: [libjvm.so+0x34ef20], sa_mask[0]=0xffbffeff,  
sa_flags=0x0000000c
SIGXFSZ: [libjvm.so+0x34ef20], sa_mask[0]=0xffbffeff,  
sa_flags=0x0000000c
SIGILL: [libjvm.so+0x34ef20], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGUSR2: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGQUIT: [libjvm.so+0x85e5c0], sa_mask[0]=0xffbffeff,  
sa_flags=0x00000004
SIGHUP: [libjvm.so+0x85e5c0], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGTERM: [libjvm.so+0x85e5c0], sa_mask[0]=0xffbffeff,  
sa_flags=0x00000004
SIG39: [libjvm.so+0x861130], sa_mask[0]=0x00000000, sa_flags=0x00000008
SIG40: [libjvm.so+0x34ef20], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c


---------------  S Y S T E M  ---------------

OS:                       Solaris 10 10/08 s10x_u6wos_07b X86
            Copyright 2008 Sun Microsystems, Inc.  All Rights Reserved.
                         Use is subject to license terms.
                             Assembled 27 October 2008

uname:SunOS 5.10 Generic_139556-08 i86pc  (T2 libthread)
rlimit: STACK 10240k, CORE 0k, NOFILE 65536, AS infinity
load average:0.02 0.02 0.01

CPU:total 4 (2 cores per cpu, 1 threads per core) family 15 model 33  
stepping 2, cmov, cx8, fxsr, mmx, sse, sse2, sse3, mmxext, 3dnow,  
3dnowext

Memory: 4k page, physical 16645672k(7330628k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (11.3-b02) for solaris- 
amd64 JRE (1.6.0_13-b03), built on Mar  9 2009 01:14:10 by "" with  
Workshop 5.8

time: Fri May 22 21:54:22 2009
elapsed time: 175925 seconds



More information about the sakai-dev mailing list