[Deploying Sakai] Search tool and rebuilding index
Lucas Lo Vercio
lucaslovercio at gmail.com
Wed Dec 21 05:58:14 PST 2011
Thanks David
Oh, a forgot more considerations and outputs.
As you said in the thread, before run "Rebuild Whole Index", I cleaned the
tables and deleted the folders sakai\indexwork and sakai\search
As you can see next, in the chronicle that i did, I always have 1 document
in the index
*In sakai.properties*
# Search Tool #
search.enable = true
#search.indexbuild = true
localIndexBase at org.sakaiproject.search.api.JournalSettings
=${sakai.home}/indexwork
sharedJournalBase at org.sakaiproject.search.api.JournalSettings
=${sakai.home}/search
-----------------------------------------------------
*When I clicked Rebuild Whole Index:*
"Index contains 1 documents and 1 pending"
global Rebuild Locked to 2001 2011-12-21 09:01:20.76
NodeName Wed Dec 21 09:06:58 AMT 2011 running status
mainsegment 4KB Wed Dec 21 09:00:15 AMT 2011
Total 4KB
----------------------------------
*Console:*
2011-12-21 09:01:38,734 INFO IndexManager
org.sakaiproject.search.indexer.impl.SearchBuilderQueueManager - Locked
Master item to this node Action:Rebuild State:invalid:2001 Locked:2001
Resource:_master_control_global
*
after a few minutes (there are a fex lines of the output):*
2011-12-21 09:03:23,820 INFO IndexManager
org.sakaiproject.search.indexer.impl.SearchBuilderQueueManager - Rebuild
for aaa (1/4606)
2011-12-21 09:03:24,731 INFO IndexManager
org.sakaiproject.search.indexer.impl.SearchBuilderQueueManager - Rebuild
for ~admin (2/4606)
2011-12-21 09:03:25,139 INFO IndexManager
org.sakaiproject.search.indexer.impl.SearchBuilderQueueManager - Rebuild
for !admin (3/4606)
2011-12-21 09:03:25,472 INFO IndexManager
org.sakaiproject.search.indexer.impl.SearchBuilderQueueManager - Rebuild
for anuncios1 (4/4606)
2011-12-21 09:03:26,464 INFO IndexManager
org.sakaiproject.search.indexer.impl.SearchBuilderQueueManager - Rebuild
for anuncios2 (5/4606)
2011-12-21 09:03:26,789 INFO IndexManager
org.sakaiproject.search.indexer.impl.SearchBuilderQueueManager - Rebuild
for Configuracion Sitio - Aula Virtual (6/4606)
2011-12-21 09:03:27,331 INFO IndexManager
org.sakaiproject.search.indexer.impl.SearchBuilderQueueManager - Rebuild
for 133L (7/4606)
2011-12-21 09:03:27,781 INFO IndexManager
org.sakaiproject.search.indexer.impl.SearchBuilderQueueManager - Rebuild
for 133M (8/4606)
[...]
2011-12-21 09:03:31,289 INFO IndexManager
org.sakaiproject.search.indexer.impl.SearchBuilderQueueManager - Rebuild
for 126BN (24/4606)
2011-12-21 09:03:31,389 INFO IndexManager
org.sakaiproject.search.indexer.impl.SearchBuilderQueueManager - Rebuild
for 90f94cf7-df21-47df-8672-96d0fb9d70c9 (25/4606)
2011-12-21 09:03:32,941 INFO IndexManager
org.sakaiproject.search.indexer.impl.SearchBuilderQueueManager - Rebuild
for Capacitacion EPD (26/4606)
2011-12-21 09:03:33,015 INFO IndexManager
org.sakaiproject.search.indexer.impl.SearchBuilderQueueManager - Rebuild
for PruebaGestion (27/4606)
[...]
2011-12-21 09:09:10,825 INFO IndexManager
org.sakaiproject.search.indexer.impl.SearchBuilderQueueManager - sleeping
to stop GC craziness
2011-12-21 09:09:10,825 INFO IndexManager
org.sakaiproject.search.indexer.impl.SearchBuilderQueueManager - done
1000/4606
[...]
2011-12-21 09:12:08,860 INFO IndexManager
org.sakaiproject.search.indexer.impl.SearchBuilderQueueManager - Rebuild
for ~fd828fe5-fb52-4ff8-ad07-b61a2954a267 (1547/4606)
2011-12-21 09:12:08,994 INFO IndexManager
org.sakaiproject.search.indexer.impl.SearchBuilderQueueManager - Rebuild
for ~fedb076f-1ee2-4ac0-b5da-5ea8a99b219d (1548/4606)
*After half an hour:*
2011-12-21 09:34:51,444 INFO IndexManager
org.sakaiproject.search.journal.impl.SharedFilesystemJournalStorage -
++++++ Saving
C:\Desarrollo-Sakai\apache-tomcat-5.5.33-ulp\sakai\indexwork\indexer-work\indextx-1324472298029
to shared
2011-12-21 09:34:52,509 INFO IndexManager
org.sakaiproject.search.indexer.impl.TransactionalIndexWorker - Indexed 100
documents in 1993796 ms 0.0501555826172788 documents/second into save point
1
2011-12-21 09:35:03,994 INFO IndexManager
org.sakaiproject.search.component.adapter.contenthosting.ContentHostingContentProducer
- Digesting /content/user/aa34e00d-1b64-48af-9165-715f39c32a7c/la indiecita
2011-12-21 09:35:04,007 ERROR IndexManager
org.sakaiproject.search.util.DigestStorageUtil - error creating
digestStorePath: //searchdigest/
2011-12-21 09:35:55,074 INFO IndexManager
org.sakaiproject.profile2.logic.SakaiProxyImpl - User with id:
aa590ed5-e95c-4d01-8a97-65f5336ba2ce does not exist : class
org.sakaiproject.user.api.UserNotDefinedException : null
2011-12-21 09:35:55,075 ERROR IndexManager
org.sakaiproject.profile2.entity.ProfileContentProducer - Caught exception
whilst getting user display name for id
'aa590ed5-e95c-4d01-8a97-65f5336ba2ce'
java.lang.NullPointerException
at
org.sakaiproject.profile2.entity.ProfileContentProducer.getTitle(ProfileContentProducer.java:204)
at
org.sakaiproject.search.indexer.impl.TransactionalIndexWorker.processTransaction(TransactionalIndexWorker.java:355)
at
org.sakaiproject.search.indexer.impl.TransactionalIndexWorker.process(TransactionalIndexWorker.java:132)
at
org.sakaiproject.search.indexer.impl.ConcurrentSearchIndexBuilderWorkerImpl.runOnce(ConcurrentSearchIndexBuilderWorkerImpl.java:273)
at
org.sakaiproject.search.journal.impl.IndexManagementTimerTask.run(IndexManagementTimerTask.java:137)
at java.util.TimerThread.mainLoop(Unknown Source)
at java.util.TimerThread.run(Unknown Source)
2011-12-21 09:35:55,094 INFO IndexManager
org.sakaiproject.profile2.logic.SakaiProxyImpl - User with id:
aa590ed5-e95c-4d01-8a97-65f5336ba2ce does not exist : class
org.sakaiproject.user.api.UserNotDefinedException : null
2011-12-21 09:35:55,094 ERROR IndexManager
org.sakaiproject.profile2.entity.ProfileContentProducer - Caught exception
whilst getting user display name for id
'aa590ed5-e95c-4d01-8a97-65f5336ba2ce'
java.lang.NullPointerException
at
org.sakaiproject.profile2.entity.ProfileContentProducer.getTitle(ProfileContentProducer.java:204)
at
org.sakaiproject.search.indexer.impl.TransactionalIndexWorker.processTransaction(TransactionalIndexWorker.java:396)
at
org.sakaiproject.search.indexer.impl.TransactionalIndexWorker.process(TransactionalIndexWorker.java:132)
at
org.sakaiproject.search.indexer.impl.ConcurrentSearchIndexBuilderWorkerImpl.runOnce(ConcurrentSearchIndexBuilderWorkerImpl.java:273)
at
org.sakaiproject.search.journal.impl.IndexManagementTimerTask.run(IndexManagementTimerTask.java:137)
at java.util.TimerThread.mainLoop(Unknown Source)
at java.util.TimerThread.run(Unknown Source)
2011-12-21 09:36:49,552 ERROR IndexManager
org.sakaiproject.chat2.model.impl.ChatContentProducer -
org.sakaiproject.user.api.UserNotDefinedException
id=5d0f2d77-ab44-4d34-aaee-f56d89bfd48f
2011-12-21 09:36:49,757 ERROR IndexManager
org.sakaiproject.chat2.model.impl.ChatContentProducer -
org.sakaiproject.user.api.UserNotDefinedException
id=5d0f2d77-ab44-4d34-aaee-f56d89bfd48f
2011-12-21 09:36:49,993 ERROR IndexManager
org.sakaiproject.chat2.model.impl.ChatContentProducer -
org.sakaiproject.user.api.UserNotDefinedException
id=5d0f2d77-ab44-4d34-aaee-f56d89bfd48f
2011-12-21 09:37:04,376 INFO http-8080-Processor24
org.sakaiproject.search.component.service.impl.BaseSearchServiceImpl -
getSearchSuggestion( aaa)
2011-12-21 09:37:04,376 INFO http-8080-Processor24
org.sakaiproject.search.component.service.impl.BaseSearchServiceImpl - did
you mean feature is not enabled
2011-12-21 09:37:06,444 INFO http-8080-Processor24
org.sakaiproject.search.component.service.impl.BaseSearchServiceImpl -
getSearchSuggestion( aaa)
2011-12-21 09:37:06,444 INFO http-8080-Processor24
org.sakaiproject.search.component.service.impl.BaseSearchServiceImpl - did
you mean feature is not enabled
2011-12-21 09:37:09,783 INFO IndexManager
org.sakaiproject.search.component.adapter.contenthosting.ContentHostingContentProducer
- Digesting /content/group/Curso de e-Tramix Sakai CLE/Gestion
Academica/3-Alumnos.doc
2011-12-21 09:37:10,558 ERROR IndexManager
org.sakaiproject.search.util.DigestStorageUtil - error creating
digestStorePath: //searchdigest/
2011-12-21 09:39:24,005 INFO IndexManager
org.sakaiproject.search.component.adapter.contenthosting.ContentHostingContentProducer
- Digesting /content/group/Curso de e-Tramix Sakai CLE/Ayuda Tramix Sakai
CLE/03 MODULOS.pdf
2011-12-21 09:39:25,747 ERROR IndexManager
org.sakaiproject.search.util.DigestStorageUtil - error creating
digestStorePath: //searchdigest/
-------------------
*and in the portal:*
"Index contains 1 documents and 1987 pending"
*after a few minutes*
"Index contains 1 documents and 14232 pending"
---------------
*When I tried to find PruebaGestion (look in the console output that the
SearchBuilderQueueManager process it)*
2011-12-21 09:31:10,346 INFO http-8080-Processor24
org.sakaiproject.search.component.service.impl.BaseSearchServiceImpl -
getSearchSuggestion( PruebaGestion)
2011-12-21 09:31:10,346 INFO http-8080-Processor24
org.sakaiproject.search.component.service.impl.BaseSearchServiceImpl - did
you mean feature is not enabled
*and in the portal *-> No results were found
Thanks again!!
2011/12/21 David Horwitz <david.horwitz at uct.ac.za>
> **
> Hi
>
> One thing to check is that there are documents in your index. If you go
> into the index you should see something like:
>
> "Index contains 431483 documents and 3057325 pending"
>
> (We have a rebuild running which is why the pending is so high). The
> searchbuilderitem table could include items that are pending or locked ...
>
> D
>
>
> On 12/21/2011 02:45 PM, Lucas Lo Vercio wrote:
>
> I would like to know about version of Sakai and Search tool are you
> talking about.. I use Sakai 2.8.0 and the Search 1.3.2, and I haven't
> deployment problems, but the search doesn't return results. I configured
> sakai.properties with the recommendations that you put in this thread. The
> search tool and sakai are running on the same Tomcat.
>
> I checked the tables in the db (oracle) and they seem to be ok (the table
> searchbuilderitem has more than 9000 entries).
>
> Another doubt is about the recommended utilization of the Search Tool...
> when should I rebuild the site index? the whole index? what's "reload
> index"?
>
> As you probably notice, i'm really lost!
> Can you help me?
>
> Thanks!
>
> --
> Lucas D. Lo Vercio
> sites.google.com/site/lucaslovercio/
>
>
> _______________________________________________
> production mailing listproduction at collab.sakaiproject.orghttp://collab.sakaiproject.org/mailman/listinfo/production
>
> TO UNSUBSCRIBE: send email to production-unsubscribe at collab.sakaiproject.org with a subject of "unsubscribe"
>
>
--
Lucas D. Lo Vercio
sites.google.com/site/lucaslovercio/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://collab.sakaiproject.org/pipermail/production/attachments/20111221/c87c7eed/attachment.html
More information about the production
mailing list