[Deploying Sakai] External users provided by LDAP cleanup

Jean-Francois Leveque jean-francois.leveque at upmc.fr
Thu Aug 4 07:46:04 PDT 2011


At least this lead us to discuss this.

I'm not sure there's a clean solution so far and I'm still looking for one.

J-F

On 04/08/2011 14:37, Warwick Chapman wrote:
> Thanks, sorry about that.
>
> -- Warwick Bruce Chapman | +27 83 7797 094 | http://warwickchapman.com
>
>
> On Thu, Aug 4, 2011 at 12:04 PM, Jean-Francois Leveque
> <jean-francois.leveque at upmc.fr <mailto:jean-francois.leveque at upmc.fr>>
> wrote:
>
>     Warwick,
>
>     Because this issue seams less critical, I've lowered the priority.
>
>     cheers,
>     J-F
>
>
>     On 02/08/2011 23:45, Warwick Chapman wrote:
>
>         Steve, Zhen
>
>         As per your comments on SAK-20957, I connected to Sakai via Tomcat
>         directly (8080) and the "An internal server error occurred.
>         Please try
>         again later." message did not display.  I suspect this message is
>         produced by Pound which I am using as a reverse proxy.
>
>         So then, as the bug report suggest, this is purely an issue of
>         the WARN
>         messages in the log and about housekeeping for sites.
>
>         -- Warwick Bruce Chapman | +27 83 7797 094
>         <tel:%2B27%2083%207797%20094> | http://warwickchapman.com
>
>
>         On Tue, Aug 2, 2011 at 4:10 PM, Steve Swinsburg
>         <steve.swinsburg at gmail.com <mailto:steve.swinsburg at gmail.com>
>         <mailto:steve.swinsburg at gmail.__com
>         <mailto:steve.swinsburg at gmail.com>>> wrote:
>
>             Could the error at least be dropped to debug? It's a known issue
>             that deleted users still hang around in the realms and
>         unlikely to
>             be fixed so tools just need to code around it.
>
>             It's not really a warning since it doesn't present anything
>         to the
>             user, only to someone watching the logs.
>
>             cheers.
>             Steve
>
>
>
>
>             On 03/08/2011, at 12:00 AM, Zhen Qian wrote:
>
>                 Is there a provider id associated with site/group realm
>             for those
>                 1100 users? If so, you can go to the admin Realms tool
>             to delete
>                 it. That should handle the warning log messages.
>
>                 According to SAK-2973, deleted users are still member of
>             the site.
>                 However, Site Info tool now won't show the user entry in
>             UI, but
>                 log the "user not defined" warning message instead.
>             However, I
>                 couldn't see the problem of "internal system error" as
>             reported in
>                 SAK-20957.
>
>                 I tried (1) add/remove internal users; (2) turn
>                 on -Dsakai.demo=true in JAVA_OPTS setting, add the
>             provider id to
>                 site, then remove this setting. Now I got all those
>             "user not
>                 defined" error, but the Site Info tool is still functioning.
>
>                 Thanks,
>
>                 - Zhen
>
>                 On Aug 2, 2011, at 5:53 AM, Warwick Chapman wrote:
>
>                     J-F
>
>                     I have done this.  Please confirm it is as you require.
>
>                     I am stuck in a position now where I cannot get to
>                 "Site Info" to
>                     remove these now ghost participants or add the new
>                 ones... Any
>                     ideas how I get around this for now?
>
>                     -- Warwick Bruce Chapman | +27 83 7797 094
>                 <tel:%2B27%2083%207797%20094>
>                 <tel:%2B27%2083%207797%20094> | http://warwickchapman.com
>                 <http://warwickchapman.com/>
>
>
>                     On Tue, Aug 2, 2011 at 11:34 AM, Jean-Francois Leveque
>                 <jean-francois.leveque at upmc.fr
>                 <mailto:jean-francois.leveque at upmc.fr>
>                 <mailto:jean-francois.leveque at __upmc.fr
>                 <mailto:jean-francois.leveque at upmc.fr>>> wrote:
>
>                         Warwick
>
>                         Please upload your PNG file with a .png suffix
>                 to the JIRA
>                         issue and add all relevant comments.
>
>                         The change in the error is expected. I'm really
>                 not sure
>                         which way to solve this will be best.
>
>                         If there was a way to manually launch removal of
>                 one site's
>                         subscriptions that are not displayed because the
>                 user cannot
>                         be found, I think it would be better. We could
>                 then remove
>                         the MyWS sites for users that have no other site
>                 and we could
>                         then cleanup users that have no site.
>
>                         I think the main problem is that Site Info hides
>                 the users it
>                         cannot find without returning any error.
>
>                         What do you think?
>
>                         Steve, do you think we should now go to the dev
>                 list?
>
>                         cheers,
>                         J-F
>
>
>                         On 02/08/2011 11:11, Warwick Chapman wrote:
>
>                             Steve, J-F
>
>                             Screenie attached.
>
>                             I tried removing the removed users from
>                 SAKAI_USER_ID_MAP
>                             but now all
>                             that happens is that the error messages
>                 after the crash
>                             no longer have
>                             the EID's but the User ID's which I assume
>                 are in each site's
>                             configuration for participants.
>
>                             Surely if a user no longer exists in
>                 SAKAI_USER or in the
>                             SAKAI_USER_ID_MAP it should automatically be
>                 removed from the
>                             participant list of any site?
>
>                             The 1100+ errors now dumped look like this:
>                             2011-08-02 10:54:02,797  WARN
>                 http-8080-Processor20
>
>                   org.sakaiproject.site.util.____SiteParticipantHelper -
>
>                   SiteParticipantHelper.____prepareParticipants: user
>                 not defined
>                             135464b1-7a99-4434-94d0-____95e4316f1243
>                             2011-08-02 10:54:02,797  WARN
>                 http-8080-Processor20
>
>                   org.sakaiproject.site.util.____SiteParticipantHelper -
>
>                   SiteParticipantHelper.____prepareParticipants: user
>                 not defined
>                             603a7cf8-36f5-4de1-bfaa-____dcd59c59a0ad
>
>                             Reading up on increasing the debut level.
>
>                             -- Warwick Bruce Chapman | +27 83 7797 094
>                 <tel:%2B27%2083%207797%20094>
>                 <tel:%2B27%2083%207797%20094> | http://warwickchapman.com
>                 <http://warwickchapman.com/>
>
>
>                             On Tue, Aug 2, 2011 at 9:57 AM,
>                 Jean-Francois Leveque
>                 <jean-francois.leveque at upmc.fr
>                 <mailto:jean-francois.leveque at upmc.fr>
>                 <mailto:jean-francois.leveque at __upmc.fr
>                 <mailto:jean-francois.leveque at upmc.fr>>
>                 <mailto:jean-francois.leveque@
>                 <mailto:jean-francois.leveque@>____upmc.fr <http://upmc.fr>
>                 <mailto:jean-francois.leveque at __upmc.fr
>                 <mailto:jean-francois.leveque at upmc.fr>>>>
>
>                             wrote:
>
>                                I've raised Priority to Critical and
>                 added a comment
>                             with Warwick's
>                                crash information.
>
>                                cheers,
>                                J-F
>
>
>                                On 02/08/2011 05:57, Steve Swinsburg wrote:
>
>                                    I'm getting this on internal users as
>                 well. I
>                             added a user to a site
>                                    then deleted the user via the Admin
>                 Users tool and
>                             in Site Info
>                                    I get:
>
>                                    2011-08-02 13:54:33,838 WARN
>                 http-8081-Processor22
>
>                 org.sakaiproject.site.util.______SiteParticipantHelper -
>
>                 SiteParticipantHelper.______prepareParticipants:
>                             user not defined
>
>                 b52ec79d-940d-4124-9f21-______29092796616c
>
>                 https://jira.sakaiproject.org/______browse/SAK-20957
>                 <https://jira.sakaiproject.org/____browse/SAK-20957>
>                 <https://jira.sakaiproject.__org/__browse/SAK-20957
>                 <https://jira.sakaiproject.org/__browse/SAK-20957>>
>                 <https://jira.sakaiproject.____org/browse/SAK-20957
>                 <https://jira.sakaiproject.__org/browse/SAK-20957
>                 <https://jira.sakaiproject.org/browse/SAK-20957>>>
>
>                                    cheers,
>                                    Steve
>
>
>
>
>                                    On 02/08/2011, at 10:46 AM, Warwick
>                 Chapman wrote:
>
>                                        Steve
>
>                                        Do you have any idea why I'd be
>                 getting a
>                 "crash" when trying to
>                                        access "Site Info" for one of the
>                 project
>                             sites with such users?
>
>                                        All I get is "An internal server
>                 error
>                             occurred. Please try
>                                        again
>                                        later." before the list of users
>                 spews out
>                             into catalina.out
>
>                                        -- Warwick Bruce Chapman | +27 83
>                 7797 094 <tel:%2B27%2083%207797%20094>
>                 <tel:%2B27%2083%207797%20094>
>                 <tel:%2B27%2083%207797%20094> | http://warwickchapman.com
>                 <http://warwickchapman.com/>
>                 <http://warwickchapman.com/>
>
>
>                                        On Tue, Aug 2, 2011 at 2:07 AM,
>                 Steve Swinsburg
>                 <steve.swinsburg at gmail.com
>                 <mailto:steve.swinsburg at gmail.com>
>                 <mailto:steve.swinsburg at gmail.__com
>                 <mailto:steve.swinsburg at gmail.com>>
>                 <mailto:steve.swinsburg at gmail.
>                 <mailto:steve.swinsburg at gmail.>____com
>                 <mailto:steve.swinsburg at gmail.__com
>                 <mailto:steve.swinsburg at gmail.com>>>
>                 <mailto:steve.swinsburg at gmail
>                 <mailto:steve.swinsburg at gmail>.
>
>                 <mailto:steve.swinsburg at gmail
>                 <mailto:steve.swinsburg at gmail>.__>____com
>                 <mailto:steve.swinsburg at gmail.
>                 <mailto:steve.swinsburg at gmail.>____com
>                 <mailto:steve.swinsburg at gmail.__com
>                 <mailto:steve.swinsburg at gmail.com>>>>> wrote:
>
>                                            Unfortunately this is a known
>                 issue:
>                 https://jira.sakaiproject.org/______browse/SAK-2973
>                 <https://jira.sakaiproject.org/____browse/SAK-2973>
>                 <https://jira.sakaiproject.__org/__browse/SAK-2973
>                 <https://jira.sakaiproject.org/__browse/SAK-2973>>
>                 <https://jira.sakaiproject.____org/browse/SAK-2973
>                 <https://jira.sakaiproject.__org/browse/SAK-2973
>                 <https://jira.sakaiproject.org/browse/SAK-2973>>>
>
>                                            (and see linked issues)
>
>                                            The tool will probably need a
>                 workaround
>                             for if there is
>                                        a user in
>                                            a site but no actual user
>                 because they
>                             have been deleted.
>
>                                            cheers,
>                                            Steve
>
>
>                                            On 02/08/2011, at 8:57 AM,
>                 Warwick Chapman
>                             wrote:
>
>                                                Well
>
>                                                I have 1100 users in this
>                 category and
>                             now whenever
>                                            I try to
>                                                visit "Site Info" for
>                 sites which all
>                             of those users
>                                            were a
>                                                member of, all I get is
>                 "An internal
>                             server error
>                                            occurred.
>                                                Please try again later." and
>                             catalina.out gets 1100
>                                            messages like
>                                                this:
>
>                                                2011-08-02 00:49:25,559 WARN
>                             http-8080-Processor24
>
>
>                 org.sakaiproject.site.util.______SiteParticipantHelper -
>
>
>                 SiteParticipantHelper.______prepareParticipants: user
>                                            not defined username1
>                                                2011-08-02 00:49:25,559 WARN
>                             http-8080-Processor24
>
>
>                 org.sakaiproject.site.util.______SiteParticipantHelper -
>
>
>                 SiteParticipantHelper.______prepareParticipants: user
>                                            not defined username2
>
>                                                -- Warwick Bruce Chapman
>                 | +27 83 7797
>                             094 <tel:%2B27%2083%207797%20094>
>                 <tel:%2B27%2083%207797%20094>
>                 <tel:%2B27%2083%207797%20094> | http://warwickchapman.com
>                 <http://warwickchapman.com/>
>
>                 <http://warwickchapman.com/>
>
>
>                                                On Mon, Aug 1, 2011 at
>                 4:52 PM,
>                             Jean-Francois Leveque
>                 <jean-francois.leveque at upmc.fr
>                 <mailto:jean-francois.leveque at upmc.fr>
>                 <mailto:jean-francois.leveque at __upmc.fr
>                 <mailto:jean-francois.leveque at upmc.fr>>
>                 <mailto:jean-francois.leveque@
>                 <mailto:jean-francois.leveque@>____upmc.fr <http://upmc.fr>
>                 <mailto:jean-francois.leveque at __upmc.fr
>                 <mailto:jean-francois.leveque at upmc.fr>>>
>                 <mailto:jean-francois.leveque@
>                 <mailto:jean-francois.leveque@>
>                 <mailto:jean-francois.leveque@
>                 <mailto:jean-francois.leveque@>__>____upmc.fr
>                 <http://upmc.fr> <http://upmc.fr/>
>                 <mailto:jean-francois.leveque@
>                 <mailto:jean-francois.leveque@>____upmc.fr <http://upmc.fr>
>                 <mailto:jean-francois.leveque at __upmc.fr
>                 <mailto:jean-francois.leveque at upmc.fr>>>>> wrote:
>
>                                                    Hi Warwick,
>
>                                                    I've been busy and
>                 because this
>                             doesn't bother
>                                            users, I
>                                                    didn't work on it. :(
>
>                                                    The only idea I have
>                 so far is to
>                             remove site
>                                            subscriptions
>                                                    for those users, but
>                 I don't know
>                             which way is
>                                            best. I don't
>                                                    know which other
>                 things should be
>                             removed in
>                                            order not to
>                                                    break anything.
>                 Haven't tried any
>                             way of doing
>                                            this yet.
>
>                                                    What do you think ?
>
>                                                    J-F
>
>
>                                                    On 01/08/2011 11:55,
>                 Warwick
>                             Chapman wrote:
>
>                                                        Hi J-F
>
>                                                        I have this same
>                 issue now.
>                             Did you ever
>                                            find a solution
>                                                        to this?
>
>                                                        -- Warwick Bruce
>                 Chapman | +27
>                             83 7797 094 <tel:%2B27%2083%207797%20094>
>                 <tel:%2B27%2083%207797%20094>
>                 <tel:%2B27%2083%207797%20094> | http://warwickchapman.com
>                 <http://warwickchapman.com/>
>
>                 <http://warwickchapman.com/>
>
>
>                                                        On Wed, Sep 22,
>                 2010 at 4:15 PM,
>                                            Jean-Francois Leveque
>                 <jean-francois.leveque at upmc.fr
>                 <mailto:jean-francois.leveque at upmc.fr>
>                 <mailto:jean-francois.leveque at __upmc.fr
>                 <mailto:jean-francois.leveque at upmc.fr>>
>                 <mailto:jean-francois.leveque@
>                 <mailto:jean-francois.leveque@>____upmc.fr <http://upmc.fr>
>                 <mailto:jean-francois.leveque at __upmc.fr
>                 <mailto:jean-francois.leveque at upmc.fr>>>
>                 <mailto:jean-francois.leveque@
>                 <mailto:jean-francois.leveque@>
>                 <mailto:jean-francois.leveque@
>                 <mailto:jean-francois.leveque@>__>____upmc.fr
>                 <http://upmc.fr> <http://upmc.fr/>
>                 <mailto:jean-francois.leveque@
>                 <mailto:jean-francois.leveque@>____upmc.fr <http://upmc.fr>
>                 <mailto:jean-francois.leveque at __upmc.fr
>                 <mailto:jean-francois.leveque at upmc.fr>>>>
>                 <mailto:jean-francois.leveque@
>                 <mailto:jean-francois.leveque@>
>                 <mailto:jean-francois.leveque@
>                 <mailto:jean-francois.leveque@>__>
>                 <mailto:jean-francois.leveque@
>                 <mailto:jean-francois.leveque@>
>                 <mailto:jean-francois.leveque@
>                 <mailto:jean-francois.leveque@>__>__>____upmc.fr
>                 <http://upmc.fr>
>                 <http://upmc.fr/> <http://upmc.fr <http://upmc.fr/>>
>
>
>                 <mailto:jean-francois.leveque@
>                 <mailto:jean-francois.leveque@>
>                 <mailto:jean-francois.leveque@
>                 <mailto:jean-francois.leveque@>__>____upmc.fr
>                 <http://upmc.fr> <http://upmc.fr/>
>                 <mailto:jean-francois.leveque@
>                 <mailto:jean-francois.leveque@>____upmc.fr <http://upmc.fr>
>                 <mailto:jean-francois.leveque at __upmc.fr
>                 <mailto:jean-francois.leveque at upmc.fr>>>>>>
>
>                                                        wrote:
>
>                                                        Hi all,
>
>                                                        I have external
>                 users provided
>                             by LDAP.
>
>                                                        Some are not in
>                 the directory
>                             anymore and
>                                            I'm getting
>                                                        messages such as :
>
>                                                        2010-09-22
>                 15:53:47,008 WARN
>                             TP-Processor22
>
>
>
>                 org.sakaiproject.site.util.________SiteParticipantHelper -
>
>
>
>                 SiteParticipantHelper.________prepareParticipants: user not
>                                                        defined ...
>
>                                                        2010-09-22
>                 15:54:22,988 WARN
>                             TP-Processor14
>
>
>
>                 org.sakaiproject.site.tool.________helper.____managegroupsectionrole.________rsf.GroupListProducer
>                                                        -
>
>
>
>                 org.sakaiproject.site.tool.________helper.____managegroupsectionrole.________rsf.GroupListProducer at ________7762e799fillInComponent:
>                                                        cannot find user
>                 with id ...
>
>                                                        How can I remove
>                 those users
>                             and at least
>                                            the data that
>                                                        leads to those
>                                                        warnings?
>
>                                                        Help with further
>                 cleanup of
>                             data related to
>                                            those users
>                                                        is welcome.
>
>                                                        Cheers,
>
>                                                        J-F
>
>                                                        --
>                                                        Jean-Francois Leveque
>                                                        Australe CTO
>                 (local Sakai)
>                                                        University Pierre
>                 and Marie Curie
>                                                        France
>
>


-- 
Jean-François Lévêque
Responsable technique Sakai
Université Pierre et Marie Curie

--
Jean-Francois Leveque
Australe (local Sakai CLE) CTO
University Pierre and Marie Curie
France


More information about the production mailing list