[Building Sakai] Trunk broken by failed test in ElasticSearch

Tue Jul 9 12:03:41 PDT 2013

I've written this up as https://jira.sakaiproject.org/browse/SAK-23777

- Beth

On Jul 8, 2013, at 12:29 PM, John Bush <jbush at anisakai.com> wrote:

> yeah, the library I'm using doesn't take fondly to using threads in unit tests, so the elasticsearch tests give funny results, sometimes it works, sometimes it doesn't.  It's on my list of thing to fix.
> 
> 
> On Sun, Jul 7, 2013 at 7:38 PM, Jim Eng <jimeng at umich.edu> wrote:
> Just a heads-up to anyone involved in ElasticSearch.   Unless you skip tests when building trunk of sakai, the build fails in a failed test described below.
> 
> Thanks.
> 
> Jim
> 
> 
> 
> On Jul 7, 2013, at 8:39 AM, "Thomas, Gregory J" <gjthomas at iupui.edu> wrote:
> 
> > Yes, the nightly servers do skip tests.
> >
> > Greg
> > ________________________________________
> > From: sakai-dev-bounces at collab.sakaiproject.org [sakai-dev-bounces at collab.sakaiproject.org] on behalf of Jim Eng [jimeng at umich.edu]
> > Sent: Friday, July 05, 2013 1:04 PM
> > To: sakai-dev Developers
> > Subject: [Building Sakai] Skipping tests on nightly2 builds?
> >
> > Sorry if this is asked and answered.
> >
> > I have tried a couple times recently to build the sakai-trunk-all branch.  I did a fresh check-out this morning and put my laptop to work truing to build and deploy it to a fresh tomcat.  That ended with a failed test in ElasticSearch, the same as it did the last time I tried, a few days ago.
> >
> > So I looked at the build-logs for the Oracle-build of trunk on nightly2.  That succeeded, but it appears that that build skips tests.
> >
> > I thought I better ask whether there is an automated build that does not skip tests that would bring a problem like this to the attention of developers on that project.  If there isn't, I would like to report the problem.  Part of the build log from my laptop is included below.
> >
> > Thanks.
> >
> > Jim
> >
> >
> >
> >
> > ------------------------------------------------------
> > T E S T S
> > -------------------------------------------------------
> > Running org.sakaiproject.search.elasticsearch.ElasticSearchTest
> > 0 [main] INFO com.github.javafaker.Faker - Using default locale en
> > 12:41:37,897  INFO ElasticSearchService:169 - Initializing ElasticSearch...
> > 12:41:37,902  INFO ElasticSearchService:222 - Setting ElasticSearch storage area to: /var/folders/11/mst3g1ys07n7mltv6mhpxr680000gp/T//1373042497733/elasticsearch/server1
> > 17043 [main] INFO com.github.javafaker.Faker - Using default locale en
> > 12:41:53,264  INFO ElasticSearchService:169 - Initializing ElasticSearch...
> > 12:41:53,265  INFO ElasticSearchService:222 - Setting ElasticSearch storage area to: /var/folders/11/mst3g1ys07n7mltv6mhpxr680000gp/T//1373042513262/elasticsearch/server1
> > 24222 [main] INFO com.github.javafaker.Faker - Using default locale en
> > 12:42:00,667  INFO ElasticSearchService:169 - Initializing ElasticSearch...
> > 12:42:00,668  INFO ElasticSearchService:222 - Setting ElasticSearch storage area to: /var/folders/11/mst3g1ys07n7mltv6mhpxr680000gp/T//1373042520656/elasticsearch/server1
> > 35462 [main] INFO com.github.javafaker.Faker - Using default locale en
> > 12:42:11,676  INFO ElasticSearchService:169 - Initializing ElasticSearch...
> > 12:42:11,677  INFO ElasticSearchService:222 - Setting ElasticSearch storage area to: /var/folders/11/mst3g1ys07n7mltv6mhpxr680000gp/T//1373042531672/elasticsearch/server1
> > 48184 [main] INFO com.github.javafaker.Faker - Using default locale en
> > 12:42:24,360  INFO ElasticSearchService:169 - Initializing ElasticSearch...
> > 12:42:24,360  INFO ElasticSearchService:222 - Setting ElasticSearch storage area to: /var/folders/11/mst3g1ys07n7mltv6mhpxr680000gp/T//1373042544359/elasticsearch/server1
> > 55157 [main] INFO com.github.javafaker.Faker - Using default locale en
> > 12:42:31,273  INFO ElasticSearchService:169 - Initializing ElasticSearch...
> > 12:42:31,274  INFO ElasticSearchService:222 - Setting ElasticSearch storage area to: /var/folders/11/mst3g1ys07n7mltv6mhpxr680000gp/T//1373042551272/elasticsearch/server1
> > 12:42:37,182  INFO ElasticSearchIndexBuilder:431 - Rebuilding the index for '851-954-6936 x5460'
> > 12:42:37,476  INFO ElasticSearchIndexBuilder:684 - bulk request of batch size: 20 took 234 ms
> > 12:42:37,515  INFO ElasticSearchIndexBuilder:684 - bulk request of batch size: 20 took 6 ms
> > 12:42:37,558  INFO ElasticSearchIndexBuilder:684 - bulk request of batch size: 20 took 8 ms
> > 12:42:37,593  INFO ElasticSearchIndexBuilder:684 - bulk request of batch size: 20 took 5 ms
> > 12:42:37,633  INFO ElasticSearchIndexBuilder:684 - bulk request of batch size: 20 took 7 ms
> > 12:42:37,645  INFO ElasticSearchIndexBuilder:684 - bulk request of batch size: 6 took 2 ms
> > 12:42:37,645  INFO ElasticSearchIndexBuilder:473 - Queued 106 docs for indexing from site: 851-954-6936 x5460 in 443 ms
> > 12:42:39,460  INFO ElasticSearchIndexBuilder:684 - bulk request of batch size: 106 took 116 ms
> > 12:42:39,460  INFO ElasticSearchIndexBuilder:659 - Finished indexing 106 docs in 277 ms
> > 106
> > 66096 [main] INFO com.github.javafaker.Faker - Using default locale en
> > 12:42:42,301  INFO ElasticSearchService:169 - Initializing ElasticSearch...
> > 12:42:42,302  INFO ElasticSearchService:222 - Setting ElasticSearch storage area to: /var/folders/11/mst3g1ys07n7mltv6mhpxr680000gp/T//1373042562301/elasticsearch/server1
> > 12:42:49,977  INFO ElasticSearchIndexBuilder:982 - Refreshing the index for '(394)893-0526 x4732'
> > 12:42:51,537  INFO ElasticSearchIndexBuilder:684 - bulk request of batch size: 1 took 178 ms
> > 12:42:51,537  INFO ElasticSearchIndexBuilder:659 - Finished indexing 1 docs in 184 ms
> > 78398 [main] INFO com.github.javafaker.Faker - Using default locale en
> > 12:42:54,394  INFO ElasticSearchService:169 - Initializing ElasticSearch...
> > 12:42:54,395  INFO ElasticSearchService:222 - Setting ElasticSearch storage area to: /var/folders/11/mst3g1ys07n7mltv6mhpxr680000gp/T//1373042574393/elasticsearch/server1
> > 84924 [main] INFO com.github.javafaker.Faker - Using default locale en
> > 12:43:01,084  INFO ElasticSearchService:169 - Initializing ElasticSearch...
> > 12:43:01,086  INFO ElasticSearchService:222 - Setting ElasticSearch storage area to: /var/folders/11/mst3g1ys07n7mltv6mhpxr680000gp/T//1373042581080/elasticsearch/server1
> > 12:43:07,277  INFO ElasticSearchIndexBuilder:431 - Rebuilding the index for '810-509-9561 x583'
> > 12:43:07,706  INFO ElasticSearchIndexBuilder:684 - bulk request of batch size: 106 took 36 ms
> > 12:43:07,707  INFO ElasticSearchIndexBuilder:473 - Queued 106 docs for indexing from site: 810-509-9561 x583 in 207 ms
> > 12:43:10,860  INFO ElasticSearchIndexBuilder:684 - bulk request of batch size: 106 took 92 ms
> > 12:43:10,860  INFO ElasticSearchIndexBuilder:659 - Finished indexing 106 docs in 582 ms
> > Tests run: 9, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 98.774 sec <<< FAILURE!
> >
> > Results :
> >
> > Failed tests:   deleteDoc(org.sakaiproject.search.elasticsearch.ElasticSearchTest)
> >
> > Tests run: 9, Failures: 1, Errors: 0, Skipped: 0
> >
> >
> > _______________________________________________
> > sakai-dev mailing list
> > sakai-dev at collab.sakaiproject.org
> > http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
> >
> > TO UNSUBSCRIBE: send email to sakai-dev-unsubscribe at collab.sakaiproject.org with a subject of "unsubscribe"
> 
> _______________________________________________
> sakai-dev mailing list
> sakai-dev at collab.sakaiproject.org
> http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
> 
> TO UNSUBSCRIBE: send email to sakai-dev-unsubscribe at collab.sakaiproject.org with a subject of "unsubscribe"
> 
> 
> 
> -- 
> John Bush
> 602-490-0470
> 
> ** This message is neither private nor confidential in fact the US government is storing it in a warehouse located in Utah for future data mining use cases should they arise. **
> _______________________________________________
> sakai-dev mailing list
> sakai-dev at collab.sakaiproject.org
> http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
> 
> TO UNSUBSCRIBE: send email to sakai-dev-unsubscribe at collab.sakaiproject.org with a subject of "unsubscribe"