[Deploying Sakai] Help needed with bean instantiation problem after startup

Jean-Francois Leveque jean-francois.leveque at upmc.fr
Mon Jan 24 06:03:46 PST 2011


Hi all,

Looks like something wrong happens with my servers 2 hours after startup 
on Mondays only, even if restarts happen every day. All nodes are 
affected at different times because they don't restart at the same time. 
Because the 3 nodes restart in chain with a 30 minutes interval, I doubt 
this is environmental conditions that last for 1 hour.

If I restart my nodes afterwards, I get no problem.

My Sakai version is 2.7 with a 1.1.10 kernel and it seems this happens 
since I did a few changes and a kernel update from a patched 1.1.9 to 
1.1.10 less than 2 weeks ago.

Any idea how to understand the following?

While I get the following at startup time:
2011-01-24 03:00:11,351  INFO main 
org.sakaiproject.util.ComponentsLoader - loadComponentPackage: 
/usr/local/tomcat/components/archive-pack

I get the error that follows:
> 2011-01-24 05:00:31,635 ERROR main org.sakaiproject.util.NoisierDefaultListableBeanFactory - Failed to preinstantiate the singleton named org.sakaiproject.archive.api.ArchiveService. Destroying all Spring beans.
> org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.sakaiproject.archive.api.ArchiveService' defined in file [/usr/local/apache-tomcat-5.5.30/components/archive-pack/WEB-INF/components.xml]: Cannot resolve reference to bean 'org_sakaiproject_archive_impl_SiteArchiver' while setting bean property 'siteArchiver'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org_sakaiproject_archive_impl_SiteArchiver' defined in file [/usr/local/apache-tomcat-5.5.30/components/archive-pack/WEB-INF/components.xml]: Cannot resolve reference to bean 'org.sakaiproject.content.api.ContentHostingService' while setting bean property 'contentHostingService'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.sakaiproject.content.api.ContentHostingService' defined in file [/usr/local/apache-tomcat-5.5.30/components/sakai-kernel-component/WEB
-INF/content-components.xml]: Invocation of init method failed; nested exception is java.lang.Error: java.sql.SQLException: Already closed.
>         at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:275)
>         at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:104)
>         at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1245)
>         at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1010)
>         at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:472)
>         at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory$1.run(AbstractAutowireCapableBeanFactory.java:409)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:380)
>         at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:264)
>         at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
>         at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:261)
>         at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:185)
>         at org.sakaiproject.util.NoisierDefaultListableBeanFactory.getBean(NoisierDefaultListableBeanFactory.java:114)
>         at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:164)
>         at org.sakaiproject.util.NoisierDefaultListableBeanFactory.preInstantiateSingletons(NoisierDefaultListableBeanFactory.java:73)
>         at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:728)
>         at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:380)
>         at org.sakaiproject.component.impl.SpringCompMgr.init(SpringCompMgr.java:154)
>         at org.sakaiproject.component.cover.ComponentManager.getInstance(ComponentManager.java:98)
>         at org.sakaiproject.component.impl.ContextLoader.loadParentContext(ContextLoader.java:107)
>         at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:195)
>         at org.sakaiproject.component.impl.ContextLoader.initWebApplicationContext(ContextLoader.java:64)
>         at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:45)
>         at org.sakaiproject.util.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:56)
>         at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:3795)
>         at org.apache.catalina.core.StandardContext.start(StandardContext.java:4252)
>         at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:760)
>         at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:740)
>         at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:544)
>         at org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:634)
>         at org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:561)
>         at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:496)
>         at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1203)
>         at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:319)
>         at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:120)
>         at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1022)
>         at org.apache.catalina.core.StandardHost.start(StandardHost.java:736)
>         at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1014)
>         at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:443)
>         at org.apache.catalina.core.StandardService.start(StandardService.java:448)
>         at org.apache.catalina.core.StandardServer.start(StandardServer.java:700)
>         at org.apache.catalina.startup.Catalina.start(Catalina.java:552)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:295)
>         at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:433)
> Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org_sakaiproject_archive_impl_SiteArchiver' defined in file [/usr/local/apache-tomcat-5.5.30/components/archive-pack/WEB-INF/components.xml]: Cannot resolve reference to bean 'org.sakaiproject.content.api.ContentHostingService' while setting bean property 'contentHostingService'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.sakaiproject.content.api.ContentHostingService' defined in file [/usr/local/apache-tomcat-5.5.30/components/sakai-kernel-component/WEB-INF/content-components.xml]: Invocation of init method failed; nested exception is java.lang.Error: java.sql.SQLException: Already closed.
>         at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:275)
>         at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:104)
>         at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1245)
>         at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1010)
>         at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:472)
>         at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory$1.run(AbstractAutowireCapableBeanFactory.java:409)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:380)
>         at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:264)
>         at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
>         at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:261)
>         at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:185)
>         at org.sakaiproject.util.NoisierDefaultListableBeanFactory.getBean(NoisierDefaultListableBeanFactory.java:114)
>         at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:164)
>         at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:269)
>         ... 47 more
> Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.sakaiproject.content.api.ContentHostingService' defined in file [/usr/local/apache-tomcat-5.5.30/components/sakai-kernel-component/WEB-INF/content-components.xml]: Invocation of init method failed; nested exception is java.lang.Error: java.sql.SQLException: Already closed.
>         at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1338)
>         at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:473)
>         at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory$1.run(AbstractAutowireCapableBeanFactory.java:409)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:380)
>         at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:264)
>         at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
>         at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:261)
>         at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:185)
>         at org.sakaiproject.util.NoisierDefaultListableBeanFactory.getBean(NoisierDefaultListableBeanFactory.java:114)
>         at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:164)
>         at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:269)
>         ... 61 more
> Caused by: java.lang.Error: java.sql.SQLException: Already closed.
>         at org.sakaiproject.db.impl.BasicSqlService.returnConnection(BasicSqlService.java:280)
>         at org.sakaiproject.content.impl.DbContentService.validateUTF8Db(DbContentService.java:3268)
>         at org.sakaiproject.content.impl.DbContentService.init(DbContentService.java:392)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeCustomInitMethod(AbstractAutowireCapableBeanFactory.java:1414)
>         at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1375)
>         at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1335)
>         ... 72 more
> Caused by: java.sql.SQLException: Already closed.
>         at org.apache.commons.dbcp.PoolableConnection.close(PoolableConnection.java:84)
>         at org.apache.commons.dbcp.PoolingDataSource$PoolGuardConnectionWrapper.close(PoolingDataSource.java:181)
>         at org.sakaiproject.db.impl.BasicSqlService.returnConnection(BasicSqlService.java:276)
>         ... 81 more
> java.lang.Exception: traceback
>         at org.sakaiproject.util.NoisierDefaultListableBeanFactory.destroySingletons(NoisierDefaultListableBeanFactory.java:96)
>         at org.sakaiproject.util.NoisierDefaultListableBeanFactory.preInstantiateSingletons(NoisierDefaultListableBeanFactory.java:83)
>         at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:728)
>         at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:380)
>         at org.sakaiproject.component.impl.SpringCompMgr.init(SpringCompMgr.java:154)
>         at org.sakaiproject.component.cover.ComponentManager.getInstance(ComponentManager.java:98)
>         at org.sakaiproject.component.impl.ContextLoader.loadParentContext(ContextLoader.java:107)
>         at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:195)
>         at org.sakaiproject.component.impl.ContextLoader.initWebApplicationContext(ContextLoader.java:64)
>         at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:45)
>         at org.sakaiproject.util.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:56)
>         at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:3795)
>         at org.apache.catalina.core.StandardContext.start(StandardContext.java:4252)
>         at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:760)
>         at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:740)
>         at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:544)
>         at org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:634)
>         at org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:561)
>         at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:496)
>         at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1203)
>         at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:319)
>         at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:120)
>         at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1022)
>         at org.apache.catalina.core.StandardHost.start(StandardHost.java:736)
>         at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1014)
>         at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:443)
>         at org.apache.catalina.core.StandardService.start(StandardService.java:448)
>         at org.apache.catalina.core.StandardServer.start(StandardServer.java:700)
>         at org.apache.catalina.startup.Catalina.start(Catalina.java:552)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:295)
>         at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:433)

--
Jean-Francois Leveque
Australe CTO (local Sakai)
University Pierre and Marie Curie
France


More information about the production mailing list