[Deploying Sakai] External users provided by LDAP cleanup

Warwick Chapman warwickchapman at gmail.com
Thu Aug 4 05:37:14 PDT 2011


Thanks, sorry about that.

-- Warwick Bruce Chapman | +27 83 7797 094 | http://warwickchapman.com


On Thu, Aug 4, 2011 at 12:04 PM, Jean-Francois Leveque <
jean-francois.leveque at upmc.fr> wrote:

> Warwick,
>
> Because this issue seams less critical, I've lowered the priority.
>
> cheers,
> J-F
>
>
> On 02/08/2011 23:45, Warwick Chapman wrote:
>
>> Steve, Zhen
>>
>> As per your comments on SAK-20957, I connected to Sakai via Tomcat
>> directly (8080) and the "An internal server error occurred. Please try
>> again later." message did not display.  I suspect this message is
>> produced by Pound which I am using as a reverse proxy.
>>
>> So then, as the bug report suggest, this is purely an issue of the WARN
>> messages in the log and about housekeeping for sites.
>>
>> -- Warwick Bruce Chapman | +27 83 7797 094 | http://warwickchapman.com
>>
>>
>> On Tue, Aug 2, 2011 at 4:10 PM, Steve Swinsburg
>> <steve.swinsburg at gmail.com <mailto:steve.swinsburg at gmail.**com<steve.swinsburg at gmail.com>>>
>> wrote:
>>
>>    Could the error at least be dropped to debug? It's a known issue
>>    that deleted users still hang around in the realms and unlikely to
>>    be fixed so tools just need to code around it.
>>
>>    It's not really a warning since it doesn't present anything to the
>>    user, only to someone watching the logs.
>>
>>    cheers.
>>    Steve
>>
>>
>>
>>
>>    On 03/08/2011, at 12:00 AM, Zhen Qian wrote:
>>
>>     Is there a provider id associated with site/group realm for those
>>>    1100 users? If so, you can go to the admin Realms tool to delete
>>>    it. That should handle the warning log messages.
>>>
>>>    According to SAK-2973, deleted users are still member of the site.
>>>    However, Site Info tool now won't show the user entry in UI, but
>>>    log the "user not defined" warning message instead. However, I
>>>    couldn't see the problem of "internal system error" as reported in
>>>    SAK-20957.
>>>
>>>    I tried (1) add/remove internal users; (2) turn
>>>    on -Dsakai.demo=true in JAVA_OPTS setting, add the provider id to
>>>    site, then remove this setting. Now I got all those "user not
>>>    defined" error, but the Site Info tool is still functioning.
>>>
>>>    Thanks,
>>>
>>>    - Zhen
>>>
>>>    On Aug 2, 2011, at 5:53 AM, Warwick Chapman wrote:
>>>
>>>     J-F
>>>>
>>>>    I have done this.  Please confirm it is as you require.
>>>>
>>>>    I am stuck in a position now where I cannot get to "Site Info" to
>>>>    remove these now ghost participants or add the new ones... Any
>>>>    ideas how I get around this for now?
>>>>
>>>>    -- Warwick Bruce Chapman | +27 83 7797 094
>>>>    <tel:%2B27%2083%207797%20094> | http://warwickchapman.com
>>>>    <http://warwickchapman.com/>
>>>>
>>>>
>>>>    On Tue, Aug 2, 2011 at 11:34 AM, Jean-Francois Leveque
>>>>    <jean-francois.leveque at upmc.fr
>>>>    <mailto:jean-francois.leveque@**upmc.fr<jean-francois.leveque at upmc.fr>>>
>>>> wrote:
>>>>
>>>>        Warwick
>>>>
>>>>        Please upload your PNG file with a .png suffix to the JIRA
>>>>        issue and add all relevant comments.
>>>>
>>>>        The change in the error is expected. I'm really not sure
>>>>        which way to solve this will be best.
>>>>
>>>>        If there was a way to manually launch removal of one site's
>>>>        subscriptions that are not displayed because the user cannot
>>>>        be found, I think it would be better. We could then remove
>>>>        the MyWS sites for users that have no other site and we could
>>>>        then cleanup users that have no site.
>>>>
>>>>        I think the main problem is that Site Info hides the users it
>>>>        cannot find without returning any error.
>>>>
>>>>        What do you think?
>>>>
>>>>        Steve, do you think we should now go to the dev list?
>>>>
>>>>        cheers,
>>>>        J-F
>>>>
>>>>
>>>>        On 02/08/2011 11:11, Warwick Chapman wrote:
>>>>
>>>>            Steve, J-F
>>>>
>>>>            Screenie attached.
>>>>
>>>>            I tried removing the removed users from SAKAI_USER_ID_MAP
>>>>            but now all
>>>>            that happens is that the error messages after the crash
>>>>            no longer have
>>>>            the EID's but the User ID's which I assume are in each site's
>>>>            configuration for participants.
>>>>
>>>>            Surely if a user no longer exists in SAKAI_USER or in the
>>>>            SAKAI_USER_ID_MAP it should automatically be removed from the
>>>>            participant list of any site?
>>>>
>>>>            The 1100+ errors now dumped look like this:
>>>>            2011-08-02 10:54:02,797  WARN http-8080-Processor20
>>>>            org.sakaiproject.site.util.__**SiteParticipantHelper -
>>>>            SiteParticipantHelper.__**prepareParticipants: user not
>>>> defined
>>>>            135464b1-7a99-4434-94d0-__**95e4316f1243
>>>>            2011-08-02 10:54:02,797  WARN http-8080-Processor20
>>>>            org.sakaiproject.site.util.__**SiteParticipantHelper -
>>>>            SiteParticipantHelper.__**prepareParticipants: user not
>>>> defined
>>>>            603a7cf8-36f5-4de1-bfaa-__**dcd59c59a0ad
>>>>
>>>>            Reading up on increasing the debut level.
>>>>
>>>>            -- Warwick Bruce Chapman | +27 83 7797 094
>>>>            <tel:%2B27%2083%207797%20094> | http://warwickchapman.com
>>>>            <http://warwickchapman.com/>
>>>>
>>>>
>>>>            On Tue, Aug 2, 2011 at 9:57 AM, Jean-Francois Leveque
>>>>            <jean-francois.leveque at upmc.fr
>>>>            <mailto:jean-francois.leveque@**upmc.fr<jean-francois.leveque at upmc.fr>
>>>> >
>>>>            <mailto:jean-francois.leveque@**__upmc.fr
>>>>            <mailto:jean-francois.leveque@**upmc.fr<jean-francois.leveque at upmc.fr>
>>>> >>>
>>>>
>>>>            wrote:
>>>>
>>>>               I've raised Priority to Critical and added a comment
>>>>            with Warwick's
>>>>               crash information.
>>>>
>>>>               cheers,
>>>>               J-F
>>>>
>>>>
>>>>               On 02/08/2011 05:57, Steve Swinsburg wrote:
>>>>
>>>>                   I'm getting this on internal users as well. I
>>>>            added a user to a site
>>>>                   then deleted the user via the Admin Users tool and
>>>>            in Site Info
>>>>                   I get:
>>>>
>>>>                   2011-08-02 13:54:33,838 WARN http-8081-Processor22
>>>>                   org.sakaiproject.site.util.___**_SiteParticipantHelper
>>>> -
>>>>                   SiteParticipantHelper.____**prepareParticipants:
>>>>            user not defined
>>>>                   b52ec79d-940d-4124-9f21-____**29092796616c
>>>>
>>>>            https://jira.sakaiproject.org/**____browse/SAK-20957<https://jira.sakaiproject.org/____browse/SAK-20957>
>>>>            <https://jira.sakaiproject.**org/__browse/SAK-20957<https://jira.sakaiproject.org/__browse/SAK-20957>
>>>> >
>>>>            <https://jira.sakaiproject.__**org/browse/SAK-20957
>>>>            <https://jira.sakaiproject.**org/browse/SAK-20957<https://jira.sakaiproject.org/browse/SAK-20957>
>>>> >>
>>>>
>>>>                   cheers,
>>>>                   Steve
>>>>
>>>>
>>>>
>>>>
>>>>                   On 02/08/2011, at 10:46 AM, Warwick Chapman wrote:
>>>>
>>>>                       Steve
>>>>
>>>>                       Do you have any idea why I'd be getting a
>>>>            "crash" when trying to
>>>>                       access "Site Info" for one of the project
>>>>            sites with such users?
>>>>
>>>>                       All I get is "An internal server error
>>>>            occurred. Please try
>>>>                       again
>>>>                       later." before the list of users spews out
>>>>            into catalina.out
>>>>
>>>>                       -- Warwick Bruce Chapman | +27 83 7797 094
>>>>            <tel:%2B27%2083%207797%20094>
>>>>            <tel:%2B27%2083%207797%20094> | http://warwickchapman.com
>>>>            <http://warwickchapman.com/>
>>>>            <http://warwickchapman.com/>
>>>>
>>>>
>>>>                       On Tue, Aug 2, 2011 at 2:07 AM, Steve Swinsburg
>>>>            <steve.swinsburg at gmail.com <mailto:steve.swinsburg at gmail.**
>>>> com <steve.swinsburg at gmail.com>>
>>>>            <mailto:steve.swinsburg at gmail.**__com
>>>>            <mailto:steve.swinsburg at gmail.**com<steve.swinsburg at gmail.com>
>>>> >>
>>>>            <mailto:steve.swinsburg at gmail.
>>>>
>>>>            <mailto:steve.swinsburg at gmail.**>____com
>>>>            <mailto:steve.swinsburg at gmail.**__com
>>>>            <mailto:steve.swinsburg at gmail.**com<steve.swinsburg at gmail.com>>>>>
>>>> wrote:
>>>>
>>>>                           Unfortunately this is a known issue:
>>>>            https://jira.sakaiproject.org/**____browse/SAK-2973<https://jira.sakaiproject.org/____browse/SAK-2973>
>>>>            <https://jira.sakaiproject.**org/__browse/SAK-2973<https://jira.sakaiproject.org/__browse/SAK-2973>
>>>> >
>>>>            <https://jira.sakaiproject.__**org/browse/SAK-2973
>>>>            <https://jira.sakaiproject.**org/browse/SAK-2973<https://jira.sakaiproject.org/browse/SAK-2973>
>>>> >>
>>>>
>>>>                           (and see linked issues)
>>>>
>>>>                           The tool will probably need a workaround
>>>>            for if there is
>>>>                       a user in
>>>>                           a site but no actual user because they
>>>>            have been deleted.
>>>>
>>>>                           cheers,
>>>>                           Steve
>>>>
>>>>
>>>>                           On 02/08/2011, at 8:57 AM, Warwick Chapman
>>>>            wrote:
>>>>
>>>>                               Well
>>>>
>>>>                               I have 1100 users in this category and
>>>>            now whenever
>>>>                           I try to
>>>>                               visit "Site Info" for sites which all
>>>>            of those users
>>>>                           were a
>>>>                               member of, all I get is "An internal
>>>>            server error
>>>>                           occurred.
>>>>                               Please try again later." and
>>>>            catalina.out gets 1100
>>>>                           messages like
>>>>                               this:
>>>>
>>>>                               2011-08-02 00:49:25,559 WARN
>>>>            http-8080-Processor24
>>>>
>>>>             org.sakaiproject.site.util.___**_SiteParticipantHelper -
>>>>
>>>>             SiteParticipantHelper.____**prepareParticipants: user
>>>>                           not defined username1
>>>>                               2011-08-02 00:49:25,559 WARN
>>>>            http-8080-Processor24
>>>>
>>>>             org.sakaiproject.site.util.___**_SiteParticipantHelper -
>>>>
>>>>             SiteParticipantHelper.____**prepareParticipants: user
>>>>                           not defined username2
>>>>
>>>>                               -- Warwick Bruce Chapman | +27 83 7797
>>>>            094 <tel:%2B27%2083%207797%20094>
>>>>            <tel:%2B27%2083%207797%20094>
>>>>            <tel:%2B27%2083%207797%20094> | http://warwickchapman.com
>>>>            <http://warwickchapman.com/>
>>>>
>>>>            <http://warwickchapman.com/>
>>>>
>>>>
>>>>                               On Mon, Aug 1, 2011 at 4:52 PM,
>>>>            Jean-Francois Leveque
>>>>            <jean-francois.leveque at upmc.fr
>>>>            <mailto:jean-francois.leveque@**upmc.fr<jean-francois.leveque at upmc.fr>
>>>> >
>>>>            <mailto:jean-francois.leveque@**__upmc.fr
>>>>            <mailto:jean-francois.leveque@**upmc.fr<jean-francois.leveque at upmc.fr>
>>>> >>
>>>>            <mailto:jean-francois.leveque@
>>>>            <mailto:jean-francois.leveque@**>____upmc.fr <
>>>> http://upmc.fr/>
>>>>            <mailto:jean-francois.leveque@**__upmc.fr
>>>>            <mailto:jean-francois.leveque@**upmc.fr<jean-francois.leveque at upmc.fr>>>>>
>>>> wrote:
>>>>
>>>>                                   Hi Warwick,
>>>>
>>>>                                   I've been busy and because this
>>>>            doesn't bother
>>>>                           users, I
>>>>                                   didn't work on it. :(
>>>>
>>>>                                   The only idea I have so far is to
>>>>            remove site
>>>>                           subscriptions
>>>>                                   for those users, but I don't know
>>>>            which way is
>>>>                           best. I don't
>>>>                                   know which other things should be
>>>>            removed in
>>>>                           order not to
>>>>                                   break anything. Haven't tried any
>>>>            way of doing
>>>>                           this yet.
>>>>
>>>>                                   What do you think ?
>>>>
>>>>                                   J-F
>>>>
>>>>
>>>>                                   On 01/08/2011 11:55, Warwick
>>>>            Chapman wrote:
>>>>
>>>>                                       Hi J-F
>>>>
>>>>                                       I have this same issue now.
>>>>            Did you ever
>>>>                           find a solution
>>>>                                       to this?
>>>>
>>>>                                       -- Warwick Bruce Chapman | +27
>>>>            83 7797 094 <tel:%2B27%2083%207797%20094>
>>>>            <tel:%2B27%2083%207797%20094>
>>>>            <tel:%2B27%2083%207797%20094> | http://warwickchapman.com
>>>>            <http://warwickchapman.com/>
>>>>
>>>>            <http://warwickchapman.com/>
>>>>
>>>>
>>>>                                       On Wed, Sep 22, 2010 at 4:15 PM,
>>>>                           Jean-Francois Leveque
>>>>            <jean-francois.leveque at upmc.fr
>>>>            <mailto:jean-francois.leveque@**upmc.fr<jean-francois.leveque at upmc.fr>
>>>> >
>>>>            <mailto:jean-francois.leveque@**__upmc.fr
>>>>            <mailto:jean-francois.leveque@**upmc.fr<jean-francois.leveque at upmc.fr>
>>>> >>
>>>>            <mailto:jean-francois.leveque@
>>>>            <mailto:jean-francois.leveque@**>____upmc.fr <
>>>> http://upmc.fr/>
>>>>            <mailto:jean-francois.leveque@**__upmc.fr
>>>>            <mailto:jean-francois.leveque@**upmc.fr<jean-francois.leveque at upmc.fr>
>>>> >>>
>>>>            <mailto:jean-francois.leveque@
>>>>            <mailto:jean-francois.leveque@**>
>>>>            <mailto:jean-francois.leveque@
>>>>            <mailto:jean-francois.leveque@**>__>____upmc.fr
>>>>            <http://upmc.fr/> <http://upmc.fr <http://upmc.fr/>>
>>>>
>>>>
>>>>            <mailto:jean-francois.leveque@
>>>>            <mailto:jean-francois.leveque@**>____upmc.fr <
>>>> http://upmc.fr/>
>>>>            <mailto:jean-francois.leveque@**__upmc.fr
>>>>            <mailto:jean-francois.leveque@**upmc.fr<jean-francois.leveque at upmc.fr>
>>>> >>>>>
>>>>
>>>>                                       wrote:
>>>>
>>>>                                       Hi all,
>>>>
>>>>                                       I have external users provided
>>>>            by LDAP.
>>>>
>>>>                                       Some are not in the directory
>>>>            anymore and
>>>>                           I'm getting
>>>>                                       messages such as :
>>>>
>>>>                                       2010-09-22 15:53:47,008 WARN
>>>>            TP-Processor22
>>>>
>>>>
>>>>             org.sakaiproject.site.util.___**___SiteParticipantHelper -
>>>>
>>>>
>>>>             SiteParticipantHelper.______**prepareParticipants: user not
>>>>                                       defined ...
>>>>
>>>>                                       2010-09-22 15:54:22,988 WARN
>>>>            TP-Processor14
>>>>
>>>>
>>>>             org.sakaiproject.site.tool.___**___helper.__**
>>>> managegroupsectionrole.______**rsf.GroupListProducer
>>>>                                       -
>>>>
>>>>
>>>>             org.sakaiproject.site.tool.___**___helper.__**
>>>> managegroupsectionrole.______**rsf.GroupListProducer at ______**
>>>> 7762e799fillInComponent:
>>>>                                       cannot find user with id ...
>>>>
>>>>                                       How can I remove those users
>>>>            and at least
>>>>                           the data that
>>>>                                       leads to those
>>>>                                       warnings?
>>>>
>>>>                                       Help with further cleanup of
>>>>            data related to
>>>>                           those users
>>>>                                       is welcome.
>>>>
>>>>                                       Cheers,
>>>>
>>>>                                       J-F
>>>>
>>>>                                       --
>>>>                                       Jean-Francois Leveque
>>>>                                       Australe CTO (local Sakai)
>>>>                                       University Pierre and Marie Curie
>>>>                                       France
>>>>
>>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://collab.sakaiproject.org/pipermail/production/attachments/20110804/dc6bef32/attachment-0001.html 


More information about the production mailing list