[Deploying Sakai] [Building Sakai] Sakai Instances 100% CPU Usage

david.horwitz@uct.ac.za david.horwitz at uct.ac.za
Tue Jul 3 08:50:42 PDT 2012


We saw this on at least 1 sakai boxes and several non sakai ones. Stephen who is in ct could supply more

Sent from my HTC

----- Reply message -----
From: "Beth Kirschner" <bkirschn at umich.edu>
To: <production at collab.sakaiproject.org>
Cc: "dev sakai" <sakai-dev at collab.sakaiproject.org>
Subject: [Building Sakai] Sakai Instances 100% CPU Usage
Date: Tue, Jul 3, 2012 5:36 pm


Relevant info from RHEL is at: https://access.redhat.com/knowledge/articles/15145 (other Linux distributions also have the problem though).

- Beth

On Jul 3, 2012, at 11:22 AM, Beth Kirschner wrote:

> There was a leap second this weekend (June 30, 8pm EDT) which we believe caused all our servers to hit 100% CPU usage simultaneously. Has anyone else in the Sakai community seen this? We're running:
> 	Linux 2.6.32-220.17.1.el6.x86_64 
> 	java version "1.6.0_22" 
> 
> Thanks,
> - Beth
> 
> Begin forwarded message:
>> 
>> 
>> 
>> URL = http://wiki.os-ux.com/java-leap-second-bug-30-june-1-july-2012-fix/
>> 
>> 
>> 
>> java leap second bug – 30 June / 1 July 2012 – fix
>> If your java applications suddenly started to use 100% CPU, you’ve hit java leap second bug (actually it’s a bug in Linux kernel, just java programs seem to be severely affected).
>> 
>> First, you may check if you have the following in your dmesg:
>> 
>> 
>> [10703552.860274] Clock: inserting leap second 23:59:60 UTC
>> 
>> Fortunately the fix is straightforward:
>> 
>> /etc/init.d/ntpd stop
>> date -s "$(date)"
>> 
>> /etc/init.d/ntpd start
>> 
>> (the other suggested way around the web would be date `date +"%m%d%H%M%C%y.%S"`, having the same effect).
>> 
>> You don’t have to restart your java applications (tomcat, solr, wowza, or whatever using java); it should be enough to run the above commands.
>> 
>> You may want to enable ntp the next day (there were some reports that enabling it makes java misbehave on some installations).
>> 
>> Apparently this issue has knocked down lots of Linux servers running Debian, Ubuntu, CentOS and the like around the globe!
>> 
>>  read more
>> 
>> (via wpkg.org)
>> 
>> Author: Vucomir Ianculov on July 3, 2012 
>> Category: Linux / Unix 
>> Tags: date, java, kernel, linux, ntpd, Zimbra
>>  
>> 
> 

_______________________________________________
sakai-dev mailing list
sakai-dev at collab.sakaiproject.org
http://collab.sakaiproject.org/mailman/listinfo/sakai-dev

TO UNSUBSCRIBE: send email to sakai-dev-unsubscribe at collab.sakaiproject.org with a subject of "unsubscribe"

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://collab.sakaiproject.org/pipermail/production/attachments/20120703/d969b405/attachment-0001.html 


More information about the production mailing list