login error after stash update

[Andrei Nastasa]

Hello

I updated stash from version 3.4.0 to the latest version (3.11.2) and i am unable to login.

I follower the procedure described at https://confluence.atlassian.com/stash/lockout-recovery-process-443024025.html but still no luck.

There are a lot of errors in the log file:

2015-09-04 16:30:52,086 DEBUG [clusterScheduler_Worker-2]  c.a.s.i.crowd.HibernateDirectoryDao Updating object: com.atlassian.crowd.model.directory.DirectoryImpl@5421bbc0[lowerName=fd_activedirectory - corp.fdinternal.org,description=<null>,type=CONNECTOR,implementationClass=com.atlassian.crowd.directory.MicrosoftActiveDirectory,allowedOperations=[UPDATE_USER_ATTRIBUTE, UPDATE_GROUP_ATTRIBUTE],attributes={ldap.basedn=DC=corp,DC=fdinternal,DC=org, ldap.user.filter=(&(objectCategory=Person)(sAMAccountName=*)(|(memberof=CN=G-Stash-admins,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org)(memberof=CN=G-Stash-bi_developers,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org)(memberof=CN=G-Stash-bt_developers,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org)(memberof=CN=G-Stash-erp_developers,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org)(memberof=CN=G-Stash-innobyte_developers,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org)(memberof=CN=G-Stash-it_infrastructure,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org)(memberof=CN=G-Stash-mobile_developers,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org)(memberof=CN=G-Stash-qa,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org)(memberof=CN=G-Stash-qa_innobyte,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org)(memberof=CN=G-stash-web_developers,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org))), com.atlassian.crowd.directory.sync.currentstartsynctime=1441373452076, ldap.user.username=sAMAccountName, ldap.usermembership.use=false, com.atlassian.crowd.directory.sync.lastdurationms=2258, ldap.password=********, autoAddGroups=, crowd.sync.incremental.enabled=false, ldap.group.usernames=member, ldap.pagedresults.size=1000, ldap.read.timeout=120000, ldap.connection.timeout=10000, ldap.group.filter=(objectCategory=Group), ldap.userdn=sys.stash@corp.fdinternal.org, ldap.roles.disabled=true, ldap.external.id=objectGUID, ldap.url=ldaps://dc01.corp.fdinternal.org:636, ldap.usermembership.use.for.groups=false, ldap.pagedresults=true, ldap.user.password=unicodePwd, ldap.user.lastname=sn, ldap.group.name=cn, ldap.user.objectclass=user, directory.cache.synchronise.interval=3600, ldap.nestedgroups.disabled=false, ldap.secure=true, ldap.referral=false, ldap.user.username.rdn=cn, com.atlassian.crowd.directory.sync.issynchronising=true, ldap.propogate.changes=false, ldap.group.dn=OU=Stash,OU=Applications, ldap.pool.timeout=0, ldap.user.displayname=displayName, ldap.relaxed.dn.standardisation=true, ldap.user.firstname=givenName, com.atlassian.crowd.directory.sync.laststartsynctime=1441370564763, ldap.user.email=mail, ldap.user.group=memberOf, localUserStatusEnabled=false, ldap.user.encryption=sha, ldap.local.groups=false, ldap.group.description=description, ldap.user.dn=OU=Accounts, ldap.group.objectclass=group, ldap.search.timelimit=60000}]
2015-09-04 16:30:52,155 INFO  [clusterScheduler_Worker-2]  c.a.c.d.DbCachingRemoteDirectory INCREMENTAL synchronisation for directory [ 1867777 ] starting
2015-09-04 16:30:52,205 INFO  [clusterScheduler_Worker-2]  c.a.c.d.DbCachingRemoteDirectory Attempting INCREMENTAL synchronisation for directory [ 1867777 ]
2015-09-04 16:30:52,206 INFO  [clusterScheduler_Worker-2]  c.a.c.d.DbCachingRemoteDirectory Incremental synchronisation for directory [ 1867777 ] was not completed, falling back to a full synchronisation
2015-09-04 16:30:52,206 INFO  [clusterScheduler_Worker-2]  c.a.c.d.DbCachingRemoteDirectory INCREMENTAL synchronisation for directory [ 1867777 ] was not successful, attempting FULL
2015-09-04 16:30:52,455 INFO  [CrowdUsnChangedCacheRefresher:thread-2]  c.a.c.d.l.c.UsnChangedCacheRefresher found [ 10 ] remote groups in [ 223ms ]
2015-09-04 16:30:52,521 INFO  [CrowdUsnChangedCacheRefresher:thread-1]  c.a.c.d.l.c.UsnChangedCacheRefresher found [ 51 ] remote users in [ 305ms ]
2015-09-04 16:30:52,721 INFO  [clusterScheduler_Worker-2]  c.a.c.d.DbCachingRemoteChangeOperations scanned and compared [ 51 ] users for delete in DB cache in [ 197ms ]
2015-09-04 16:30:52,721 INFO  [clusterScheduler_Worker-2]  c.a.c.d.DbCachingRemoteChangeOperations scanned for deleted users in [ 199ms ]
2015-09-04 16:30:52,812 INFO  [spring-startup]  c.a.j.s.l.LifecycleDispatcherServlet$1$1 FrameworkServlet 'springMvc': initialization completed in 125119 ms
2015-09-04 16:30:52,835 INFO  [clusterScheduler_Worker-2]  c.a.c.d.DbCachingRemoteChangeOperations scanning [ 51 ] users to add or update
2015-09-04 16:30:52,852 INFO  [clusterScheduler_Worker-2]  c.a.c.d.DirectoryCacheImplUsingChangeOperations scanned and compared [ 51 ] users for update in DB cache in [ 119ms ]
2015-09-04 16:30:52,864 INFO  [clusterScheduler_Worker-2]  c.a.c.d.DirectoryCacheImplUsingChangeOperations synchronised [ 51 ] users in [ 131ms ]
2015-09-04 16:30:52,883 INFO  [clusterScheduler_Worker-2]  c.a.c.d.DbCachingRemoteChangeOperations scanned and compared [ 10 ] groups for delete in DB cache in [ 18ms ]
2015-09-04 16:30:52,887 INFO  [clusterScheduler_Worker-2]  c.a.c.d.DirectoryCacheImplUsingChangeOperations scanning [ 10 ] groups to add or update
2015-09-04 16:30:52,899 INFO  [clusterScheduler_Worker-2]  c.a.c.d.DbCachingRemoteChangeOperations scanned and compared [ 10 ] groups for update in DB cache in [ 11ms ]
2015-09-04 16:30:52,909 INFO  [clusterScheduler_Worker-2]  c.a.c.d.DirectoryCacheImplUsingChangeOperations synchronized [ 10 ] groups in [ 22ms ]
2015-09-04 16:30:53,317 DEBUG [http-nio-7990-exec-5] @1PR4N0Cx990x3x0 127.0.0.1 "GET / HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-auth-crowd-sso:crowdSsoAuthHandler
2015-09-04 16:30:53,318 DEBUG [http-nio-7990-exec-5] @1PR4N0Cx990x3x0 127.0.0.1 "GET / HTTP/1.1" c.a.s.p.a.c.i.CrowdSsoAuthenticationHandler Skipping Crowd SSO as it is not enabled
2015-09-04 16:30:53,318 DEBUG [http-nio-7990-exec-5] @1PR4N0Cx990x3x0 127.0.0.1 "GET / HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-authentication:crowdHttpAuthHandler
2015-09-04 16:30:53,318 DEBUG [http-nio-7990-exec-5] @1PR4N0Cx990x3x0 127.0.0.1 "GET / HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-authentication:rememberMeAuthHandler
2015-09-04 16:30:53,325 DEBUG [http-nio-7990-exec-5] @1PR4N0Cx990x3x0 127.0.0.1 "GET / HTTP/1.1" c.a.s.i.i18n.PluginI18nService No values found in any valid locale for key ProviderManager.providerNotFound and locales [en_US, en]
2015-09-04 16:30:53,398 DEBUG [http-nio-7990-exec-6] @1PR4N0Cx990x4x0 127.0.0.1 "GET /projects HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-auth-crowd-sso:crowdSsoAuthHandler
2015-09-04 16:30:53,398 DEBUG [http-nio-7990-exec-6] @1PR4N0Cx990x4x0 127.0.0.1 "GET /projects HTTP/1.1" c.a.s.p.a.c.i.CrowdSsoAuthenticationHandler Skipping Crowd SSO as it is not enabled
2015-09-04 16:30:53,398 DEBUG [http-nio-7990-exec-6] @1PR4N0Cx990x4x0 127.0.0.1 "GET /projects HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-authentication:crowdHttpAuthHandler
2015-09-04 16:30:53,398 DEBUG [http-nio-7990-exec-6] @1PR4N0Cx990x4x0 127.0.0.1 "GET /projects HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-authentication:rememberMeAuthHandler
2015-09-04 16:30:53,400 DEBUG [http-nio-7990-exec-6] @1PR4N0Cx990x4x0 127.0.0.1 "GET /projects HTTP/1.1" c.a.s.i.i18n.PluginI18nService No values found in any valid locale for key ProviderManager.providerNotFound and locales [en_US, en]
2015-09-04 16:30:53,470 INFO  [http-nio-7990-exec-6] @1PR4N0Cx990x4x0 127.0.0.1 "GET /projects HTTP/1.1" o.h.c.internal.StandardQueryCache HHH000248: Starting query cache at region: query.publicRepositoryCountByProject
2015-09-04 16:30:53,558 DEBUG [http-nio-7990-exec-6] @1PR4N0Cx990x4x0 127.0.0.1 "GET /projects HTTP/1.1" c.a.s.i.i18n.PluginI18nService No values found in any valid locale for key AbstractAccessDecisionManager.accessDenied and locales [en_US, en]
2015-09-04 16:30:53,567 DEBUG [http-nio-7990-exec-6] @1PR4N0Cx990x4x0 127.0.0.1 "GET /projects HTTP/1.1" c.a.s.i.s.s.StashLoginUrlAuthenticationEntryPoint Redirecting /mvc/projects to /login?next=/projects
2015-09-04 16:30:53,613 DEBUG [http-nio-7990-exec-7] @1PR4N0Cx990x5x0 127.0.0.1 "GET /login HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-auth-crowd-sso:crowdSsoAuthHandler
2015-09-04 16:30:53,613 DEBUG [http-nio-7990-exec-7] @1PR4N0Cx990x5x0 127.0.0.1 "GET /login HTTP/1.1" c.a.s.p.a.c.i.CrowdSsoAuthenticationHandler Skipping Crowd SSO as it is not enabled
2015-09-04 16:30:53,613 DEBUG [http-nio-7990-exec-7] @1PR4N0Cx990x5x0 127.0.0.1 "GET /login HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-authentication:crowdHttpAuthHandler
2015-09-04 16:30:53,613 DEBUG [http-nio-7990-exec-7] @1PR4N0Cx990x5x0 127.0.0.1 "GET /login HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-authentication:rememberMeAuthHandler
2015-09-04 16:30:53,616 DEBUG [http-nio-7990-exec-7] @1PR4N0Cx990x5x0 127.0.0.1 "GET /login HTTP/1.1" c.a.s.i.i18n.PluginI18nService No values found in any valid locale for key ProviderManager.providerNotFound and locales [en_US, en]
2015-09-04 16:30:54,320 INFO  [clusterScheduler_Worker-2]  c.a.c.d.DbCachingRemoteDirectory FULL synchronisation complete for directory [ 1867777 ] in [ 2165ms ]
2015-09-04 16:30:54,329 DEBUG [clusterScheduler_Worker-2]  c.a.s.i.crowd.HibernateDirectoryDao Updating object: com.atlassian.crowd.model.directory.DirectoryImpl@315507c0[lowerName=fd_activedirectory - corp.fdinternal.org,description=<null>,type=CONNECTOR,implementationClass=com.atlassian.crowd.directory.MicrosoftActiveDirectory,allowedOperations=[UPDATE_USER_ATTRIBUTE, UPDATE_GROUP_ATTRIBUTE],attributes={ldap.basedn=DC=corp,DC=fdinternal,DC=org, ldap.user.filter=(&(objectCategory=Person)(sAMAccountName=*)(|(memberof=CN=G-Stash-admins,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org)(memberof=CN=G-Stash-bi_developers,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org)(memberof=CN=G-Stash-bt_developers,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org)(memberof=CN=G-Stash-erp_developers,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org)(memberof=CN=G-Stash-innobyte_developers,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org)(memberof=CN=G-Stash-it_infrastructure,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org)(memberof=CN=G-Stash-mobile_developers,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org)(memberof=CN=G-Stash-qa,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org)(memberof=CN=G-Stash-qa_innobyte,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org)(memberof=CN=G-stash-web_developers,OU=Stash,OU=Applications,DC=corp,DC=fdinternal,DC=org))), com.atlassian.crowd.directory.sync.currentstartsynctime=null, ldap.user.username=sAMAccountName, ldap.usermembership.use=false, com.atlassian.crowd.directory.sync.lastdurationms=2253, ldap.password=********, autoAddGroups=, crowd.sync.incremental.enabled=false, ldap.group.usernames=member, ldap.pagedresults.size=1000, ldap.read.timeout=120000, ldap.connection.timeout=10000, ldap.group.filter=(objectCategory=Group), ldap.userdn=sys.stash@corp.fdinternal.org, ldap.roles.disabled=true, ldap.external.id=objectGUID, ldap.url=ldaps://dc01.corp.fdinternal.org:636, ldap.usermembership.use.for.groups=false, ldap.pagedresults=true, ldap.user.password=unicodePwd, ldap.user.lastname=sn, ldap.group.name=cn, ldap.user.objectclass=user, directory.cache.synchronise.interval=3600, ldap.nestedgroups.disabled=false, ldap.secure=true, ldap.referral=false, ldap.user.username.rdn=cn, com.atlassian.crowd.directory.sync.issynchronising=false, ldap.propogate.changes=false, ldap.group.dn=OU=Stash,OU=Applications, ldap.pool.timeout=0, ldap.user.displayname=displayName, ldap.relaxed.dn.standardisation=true, ldap.user.firstname=givenName, com.atlassian.crowd.directory.sync.laststartsynctime=1441373452076, ldap.user.email=mail, ldap.user.group=memberOf, localUserStatusEnabled=false, ldap.user.encryption=sha, ldap.local.groups=false, ldap.group.description=description, ldap.user.dn=OU=Accounts, ldap.group.objectclass=group, ldap.search.timelimit=60000}]
2015-09-04 16:30:55,095 DEBUG [http-nio-7990-exec-6] @1PR4N0Cx990x14x0 127.0.0.1 "GET /rest/shortcuts/latest/shortcuts/0329d81/bundled HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-auth-crowd-sso:crowdSsoAuthHandler
2015-09-04 16:30:55,095 DEBUG [http-nio-7990-exec-6] @1PR4N0Cx990x14x0 127.0.0.1 "GET /rest/shortcuts/latest/shortcuts/0329d81/bundled HTTP/1.1" c.a.s.p.a.c.i.CrowdSsoAuthenticationHandler Skipping Crowd SSO as it is not enabled
2015-09-04 16:30:55,095 DEBUG [http-nio-7990-exec-6] @1PR4N0Cx990x14x0 127.0.0.1 "GET /rest/shortcuts/latest/shortcuts/0329d81/bundled HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-authentication:crowdHttpAuthHandler
2015-09-04 16:30:55,095 DEBUG [http-nio-7990-exec-6] @1PR4N0Cx990x14x0 127.0.0.1 "GET /rest/shortcuts/latest/shortcuts/0329d81/bundled HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-authentication:rememberMeAuthHandler
2015-09-04 16:30:55,099 DEBUG [http-nio-7990-exec-6] @1PR4N0Cx990x14x0 127.0.0.1 "GET /rest/shortcuts/latest/shortcuts/0329d81/bundled HTTP/1.1" c.a.s.i.i18n.PluginI18nService No values found in any valid locale for key ProviderManager.providerNotFound and locales [en_US, en]
2015-09-04 16:30:55,277 INFO  [http-nio-7990-exec-6] @1PR4N0Cx990x14x0 127.0.0.1 "GET /rest/shortcuts/latest/shortcuts/0329d81/bundled HTTP/1.1" c.s.j.s.i.a.WebApplicationImpl Initiating Jersey application, version 'Jersey: 1.8-atlassian-16 03/23/2015 10:20 PM'
2015-09-04 16:30:55,523 DEBUG [localScheduler_Worker-1]  c.a.s.i.s.s.PluginSchedulerAdapter PluginScheduler requires job data to be Serializable and will be enforced in Stash 4.0+. key=JobHandler, valueClass=class com.atlassian.analytics.client.upload.RemoteFilterRead
2015-09-04 16:31:09,141 DEBUG [http-nio-7990-exec-9] @1PR4N0Cx991x16x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-auth-crowd-sso:crowdSsoAuthHandler
2015-09-04 16:31:09,177 DEBUG [http-nio-7990-exec-9] @1PR4N0Cx991x16x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.p.a.c.i.CrowdSsoAuthenticationHandler Skipping Crowd SSO as it is not enabled
2015-09-04 16:31:09,177 DEBUG [http-nio-7990-exec-9] @1PR4N0Cx991x16x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-authentication:crowdHttpAuthHandler
2015-09-04 16:31:09,186 DEBUG [http-nio-7990-exec-9] @1PR4N0Cx991x16x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.user.DefaultUserService Authenticating user: recovery_admin
2015-09-04 16:31:09,269 DEBUG [http-nio-7990-exec-9] @1PR4N0Cx991x16x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.user.HibernateStashUserDao recovery_admin: Using slug "recovery_admin"
2015-09-04 16:31:09,350 DEBUG [http-nio-7990-exec-9] @1PR4N0Cx991x16x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.a.PluginHttpAuthenticationSuccessHandler onAuthenticationSuccess - delegating to com.atlassian.stash.internal.user.RecentlyAccessedRepositoriesAuthenticationSuccessHandler
2015-09-04 16:31:09,367 DEBUG [AtlassianEvent::thread-1] @1PR4N0Cx991x16x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.stash.internal.crowd.RiotPolice Couldn't update the lastAuthenticationTimestamp attribute for recovery_admin
com.atlassian.crowd.exception.OperationNotPermittedException: com.atlassian.crowd.exception.ApplicationPermissionException: Not allowed to update user attributes 'recovery_admin' in directory 'Recovery Mode Directory'.
    at com.atlassian.crowd.embedded.core.CrowdServiceImpl.setUserAttribute(CrowdServiceImpl.java:408) ~[embedded-crowd-core-2.8.4-m1.jar:na]
    at com.atlassian.crowd.embedded.core.CrowdServiceImpl.setUserAttribute(CrowdServiceImpl.java:392) ~[embedded-crowd-core-2.8.4-m1.jar:na]
    at com.atlassian.stash.internal.crowd.RiotPolice$15.internalExecute(RiotPolice.java:589) ~[stash-service-impl-3.11.2.jar:na]
    at com.atlassian.stash.internal.crowd.RiotPolice$VoidCrowdCallback.execute(RiotPolice.java:734) [stash-service-impl-3.11.2.jar:na]
    at com.atlassian.stash.internal.crowd.RiotPolice$VoidCrowdCallback.execute(RiotPolice.java:730) [stash-service-impl-3.11.2.jar:na]
    at com.atlassian.stash.internal.crowd.RiotPolice.execute(RiotPolice.java:685) [stash-service-impl-3.11.2.jar:na]
    at com.atlassian.stash.internal.crowd.RiotPolice.setUserAttribute(RiotPolice.java:584) [stash-service-impl-3.11.2.jar:na]
    at com.atlassian.stash.internal.user.DefaultUserService.updateLastAuthentication(DefaultUserService.java:493) [stash-service-impl-3.11.2.jar:na]
    at com.atlassian.stash.internal.user.UserAuthenticationTracker.onAuthenticationSuccess(UserAuthenticationTracker.java:35) [stash-service-impl-3.11.2.jar:na]
    at com.atlassian.event.internal.SingleParameterMethodListenerInvoker.invoke(SingleParameterMethodListenerInvoker.java:36) [atlassian-event-2.3.5.jar:na]
    at com.atlassian.stash.internal.event.AsyncBatchingInvokersTransformer$AsyncInvokerBatch.invoke(AsyncBatchingInvokersTransformer.java:100) [stash-platform-3.11.2.jar:na]
    at com.atlassian.event.internal.AsynchronousAbleEventDispatcher$1$1.run(AsynchronousAbleEventDispatcher.java:48) [atlassian-event-2.3.5.jar:na]
    at com.atlassian.sal.core.executor.ThreadLocalDelegateRunnable.run(ThreadLocalDelegateRunnable.java:38) [sal-core-2.13.4.jar:na]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_45]
    at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45]
    ... 31 frames trimmed
Caused by: com.atlassian.crowd.exception.ApplicationPermissionException: Not allowed to update user attributes 'recovery_admin' in directory 'Recovery Mode Directory'.
    at com.atlassian.crowd.manager.application.ApplicationServiceGeneric.storeUserAttributes(ApplicationServiceGeneric.java:755) ~[crowd-core-2.8.4-m1.jar:na]
    at com.atlassian.crowd.embedded.core.CrowdServiceImpl.setUserAttribute(CrowdServiceImpl.java:404) ~[embedded-crowd-core-2.8.4-m1.jar:na]
    ... 15 common frames omitted
2015-09-04 16:31:09,378 DEBUG [http-nio-7990-exec-9] @1PR4N0Cx991x16x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.a.PluginHttpAuthenticationSuccessHandler onAuthenticationSuccess - delegating to com.atlassian.stash.internal.auth.RememberMeAuthenticationSuccessHandler
2015-09-04 16:31:09,422 DEBUG [http-nio-7990-exec-9] @1PR4N0Cx991x16x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.a.DefaultRememberMeService Created new remember-me series 'e0e4168561a0cb43a3bf20d83b7f9463502f18ff' for user 'recovery_admin'
2015-09-04 16:31:09,450 DEBUG [http-nio-7990-exec-9] @1PR4N0Cx991x16x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.a.PluginHttpAuthenticationSuccessHandler onAuthenticationSuccess - delegating to com.atlassian.stash.plugin.auth.crowd.internal.CrowdSsoAuthenticationHandler
2015-09-04 16:31:09,450 DEBUG [http-nio-7990-exec-9] @1PR4N0Cx991x16x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.a.PluginHttpAuthenticationSuccessHandler onAuthenticationSuccess - delegating to com.atlassian.stash.internal.auth.SessionCreatingAuthenticationSuccessHandler
2015-09-04 16:31:09,452 DEBUG [http-nio-7990-exec-9] @1PR4N0Cx991x16x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.a.PluginHttpAuthenticationSuccessHandler onAuthenticationSuccess - delegating to com.atlassian.stash.internal.auth.RedirectingAuthenticationSuccessHandler
2015-09-04 16:31:09,526 DEBUG [http-nio-7990-exec-9] @1PR4N0Cx991x16x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.a.PluginHttpAuthenticationSuccessHandler onAuthenticationSuccess - com.atlassian.stash.internal.auth.RedirectingAuthenticationSuccessHandler handled authentication success
2015-09-04 16:31:09,814 DEBUG [http-nio-7990-exec-1] @1PR4N0Cx991x17x0 127.0.0.1 "GET /getting-started HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-auth-crowd-sso:crowdSsoAuthHandler
2015-09-04 16:31:09,814 DEBUG [http-nio-7990-exec-1] @1PR4N0Cx991x17x0 127.0.0.1 "GET /getting-started HTTP/1.1" c.a.s.p.a.c.i.CrowdSsoAuthenticationHandler Skipping Crowd SSO as it is not enabled
2015-09-04 16:31:09,814 DEBUG [http-nio-7990-exec-1] @1PR4N0Cx991x17x0 127.0.0.1 "GET /getting-started HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-authentication:crowdHttpAuthHandler
2015-09-04 16:31:09,814 DEBUG [http-nio-7990-exec-1] @1PR4N0Cx991x17x0 127.0.0.1 "GET /getting-started HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-authentication:rememberMeAuthHandler
2015-09-04 16:31:09,818 DEBUG [http-nio-7990-exec-1] @1PR4N0Cx991x17x0 127.0.0.1 "GET /getting-started HTTP/1.1" c.a.s.i.i18n.PluginI18nService No values found in any valid locale for key ProviderManager.providerNotFound and locales [en_US, en]
2015-09-04 16:31:09,819 DEBUG [http-nio-7990-exec-1] @1PR4N0Cx991x17x0 127.0.0.1 "GET /getting-started HTTP/1.1" c.a.s.i.i18n.PluginI18nService No values found in any valid locale for key AbstractAccessDecisionManager.accessDenied and locales [en_US, en]
2015-09-04 16:31:09,820 DEBUG [http-nio-7990-exec-1] @1PR4N0Cx991x17x0 127.0.0.1 "GET /getting-started HTTP/1.1" c.a.s.i.s.s.StashLoginUrlAuthenticationEntryPoint Redirecting /mvc/getting-started to /login?next=/getting-started?next%3D/projects
2015-09-04 16:31:09,861 DEBUG [http-nio-7990-exec-2] @1PR4N0Cx991x18x0 127.0.0.1 "GET /login HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-auth-crowd-sso:crowdSsoAuthHandler
2015-09-04 16:31:09,861 DEBUG [http-nio-7990-exec-2] @1PR4N0Cx991x18x0 127.0.0.1 "GET /login HTTP/1.1" c.a.s.p.a.c.i.CrowdSsoAuthenticationHandler Skipping Crowd SSO as it is not enabled
2015-09-04 16:31:09,861 DEBUG [http-nio-7990-exec-2] @1PR4N0Cx991x18x0 127.0.0.1 "GET /login HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-authentication:crowdHttpAuthHandler
2015-09-04 16:31:09,861 DEBUG [http-nio-7990-exec-2] @1PR4N0Cx991x18x0 127.0.0.1 "GET /login HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-authentication:rememberMeAuthHandler
2015-09-04 16:31:09,876 DEBUG [http-nio-7990-exec-2] @1PR4N0Cx991x18x0 127.0.0.1 "GET /login HTTP/1.1" c.a.s.i.i18n.PluginI18nService No values found in any valid locale for key ProviderManager.providerNotFound and locales [en_US, en]
2015-09-04 16:31:52,290 DEBUG [http-nio-7990-exec-3] @1PR4N0Cx991x19x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-auth-crowd-sso:crowdSsoAuthHandler
2015-09-04 16:31:52,309 DEBUG [http-nio-7990-exec-3] @1PR4N0Cx991x19x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.p.a.c.i.CrowdSsoAuthenticationHandler Skipping Crowd SSO as it is not enabled
2015-09-04 16:31:52,309 DEBUG [http-nio-7990-exec-3] @1PR4N0Cx991x19x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-authentication:crowdHttpAuthHandler
2015-09-04 16:31:52,309 DEBUG [http-nio-7990-exec-3] @1PR4N0Cx991x19x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.user.DefaultUserService Authenticating user: recovery_admin
2015-09-04 16:31:52,343 DEBUG [http-nio-7990-exec-3] @1PR4N0Cx991x19x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.a.PluginHttpAuthenticationSuccessHandler onAuthenticationSuccess - delegating to com.atlassian.stash.internal.user.RecentlyAccessedRepositoriesAuthenticationSuccessHandler
2015-09-04 16:31:52,348 DEBUG [AtlassianEvent::thread-1] @1PR4N0Cx991x19x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.stash.internal.crowd.RiotPolice Couldn't update the lastAuthenticationTimestamp attribute for recovery_admin
com.atlassian.crowd.exception.OperationNotPermittedException: com.atlassian.crowd.exception.ApplicationPermissionException: Not allowed to update user attributes 'recovery_admin' in directory 'Recovery Mode Directory'.
    at com.atlassian.crowd.embedded.core.CrowdServiceImpl.setUserAttribute(CrowdServiceImpl.java:408) ~[embedded-crowd-core-2.8.4-m1.jar:na]
    at com.atlassian.crowd.embedded.core.CrowdServiceImpl.setUserAttribute(CrowdServiceImpl.java:392) ~[embedded-crowd-core-2.8.4-m1.jar:na]
    at com.atlassian.stash.internal.crowd.RiotPolice$15.internalExecute(RiotPolice.java:589) ~[stash-service-impl-3.11.2.jar:na]
    at com.atlassian.stash.internal.crowd.RiotPolice$VoidCrowdCallback.execute(RiotPolice.java:734) [stash-service-impl-3.11.2.jar:na]
    at com.atlassian.stash.internal.crowd.RiotPolice$VoidCrowdCallback.execute(RiotPolice.java:730) [stash-service-impl-3.11.2.jar:na]
    at com.atlassian.stash.internal.crowd.RiotPolice.execute(RiotPolice.java:685) [stash-service-impl-3.11.2.jar:na]
    at com.atlassian.stash.internal.crowd.RiotPolice.setUserAttribute(RiotPolice.java:584) [stash-service-impl-3.11.2.jar:na]
    at com.atlassian.stash.internal.user.DefaultUserService.updateLastAuthentication(DefaultUserService.java:493) [stash-service-impl-3.11.2.jar:na]
    at com.atlassian.stash.internal.user.UserAuthenticationTracker.onAuthenticationSuccess(UserAuthenticationTracker.java:35) [stash-service-impl-3.11.2.jar:na]
    at com.atlassian.event.internal.SingleParameterMethodListenerInvoker.invoke(SingleParameterMethodListenerInvoker.java:36) [atlassian-event-2.3.5.jar:na]
    at com.atlassian.stash.internal.event.AsyncBatchingInvokersTransformer$AsyncInvokerBatch.invoke(AsyncBatchingInvokersTransformer.java:100) [stash-platform-3.11.2.jar:na]
    at com.atlassian.event.internal.AsynchronousAbleEventDispatcher$1$1.run(AsynchronousAbleEventDispatcher.java:48) [atlassian-event-2.3.5.jar:na]
    at com.atlassian.sal.core.executor.ThreadLocalDelegateRunnable.run(ThreadLocalDelegateRunnable.java:38) [sal-core-2.13.4.jar:na]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_45]
    at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45]
    ... 31 frames trimmed
Caused by: com.atlassian.crowd.exception.ApplicationPermissionException: Not allowed to update user attributes 'recovery_admin' in directory 'Recovery Mode Directory'.
    at com.atlassian.crowd.manager.application.ApplicationServiceGeneric.storeUserAttributes(ApplicationServiceGeneric.java:755) ~[crowd-core-2.8.4-m1.jar:na]
    at com.atlassian.crowd.embedded.core.CrowdServiceImpl.setUserAttribute(CrowdServiceImpl.java:404) ~[embedded-crowd-core-2.8.4-m1.jar:na]
    ... 15 common frames omitted
2015-09-04 16:31:52,360 DEBUG [http-nio-7990-exec-3] @1PR4N0Cx991x19x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.a.PluginHttpAuthenticationSuccessHandler onAuthenticationSuccess - delegating to com.atlassian.stash.internal.auth.RememberMeAuthenticationSuccessHandler
2015-09-04 16:31:52,369 DEBUG [http-nio-7990-exec-3] @1PR4N0Cx991x19x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.a.DefaultRememberMeService Created new remember-me series '6c89fae52345a24f3ead976b1fc8d550337f9e52' for user 'recovery_admin'
2015-09-04 16:31:52,377 DEBUG [http-nio-7990-exec-3] @1PR4N0Cx991x19x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.a.PluginHttpAuthenticationSuccessHandler onAuthenticationSuccess - delegating to com.atlassian.stash.plugin.auth.crowd.internal.CrowdSsoAuthenticationHandler
2015-09-04 16:31:52,377 DEBUG [http-nio-7990-exec-3] @1PR4N0Cx991x19x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.a.PluginHttpAuthenticationSuccessHandler onAuthenticationSuccess - delegating to com.atlassian.stash.internal.auth.SessionCreatingAuthenticationSuccessHandler
2015-09-04 16:31:52,378 DEBUG [http-nio-7990-exec-3] @1PR4N0Cx991x19x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.a.PluginHttpAuthenticationSuccessHandler onAuthenticationSuccess - delegating to com.atlassian.stash.internal.auth.RedirectingAuthenticationSuccessHandler
2015-09-04 16:31:52,386 DEBUG [http-nio-7990-exec-3] @1PR4N0Cx991x19x0 127.0.0.1 "POST /j_stash_security_check HTTP/1.1" c.a.s.i.a.PluginHttpAuthenticationSuccessHandler onAuthenticationSuccess - com.atlassian.stash.internal.auth.RedirectingAuthenticationSuccessHandler handled authentication success
2015-09-04 16:31:52,403 DEBUG [http-nio-7990-exec-10] @1PR4N0Cx991x20x0 127.0.0.1 "GET /getting-started HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-auth-crowd-sso:crowdSsoAuthHandler
2015-09-04 16:31:52,403 DEBUG [http-nio-7990-exec-10] @1PR4N0Cx991x20x0 127.0.0.1 "GET /getting-started HTTP/1.1" c.a.s.p.a.c.i.CrowdSsoAuthenticationHandler Skipping Crowd SSO as it is not enabled
2015-09-04 16:31:52,403 DEBUG [http-nio-7990-exec-10] @1PR4N0Cx991x20x0 127.0.0.1 "GET /getting-started HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-authentication:crowdHttpAuthHandler
2015-09-04 16:31:52,403 DEBUG [http-nio-7990-exec-10] @1PR4N0Cx991x20x0 127.0.0.1 "GET /getting-started HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-authentication:rememberMeAuthHandler
2015-09-04 16:31:52,406 DEBUG [http-nio-7990-exec-10] @1PR4N0Cx991x20x0 127.0.0.1 "GET /getting-started HTTP/1.1" c.a.s.i.i18n.PluginI18nService No values found in any valid locale for key ProviderManager.providerNotFound and locales [en_US, en]
2015-09-04 16:31:52,407 DEBUG [http-nio-7990-exec-10] @1PR4N0Cx991x20x0 127.0.0.1 "GET /getting-started HTTP/1.1" c.a.s.i.i18n.PluginI18nService No values found in any valid locale for key AbstractAccessDecisionManager.accessDenied and locales [en_US, en]
2015-09-04 16:31:52,408 DEBUG [http-nio-7990-exec-10] @1PR4N0Cx991x20x0 127.0.0.1 "GET /getting-started HTTP/1.1" c.a.s.i.s.s.StashLoginUrlAuthenticationEntryPoint Redirecting /mvc/getting-started to /login?next=/getting-started?next%3D/getting-started?next%253D/projects
2015-09-04 16:31:52,425 DEBUG [http-nio-7990-exec-8] @1PR4N0Cx991x21x0 127.0.0.1 "GET /login HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-auth-crowd-sso:crowdSsoAuthHandler
2015-09-04 16:31:52,425 DEBUG [http-nio-7990-exec-8] @1PR4N0Cx991x21x0 127.0.0.1 "GET /login HTTP/1.1" c.a.s.p.a.c.i.CrowdSsoAuthenticationHandler Skipping Crowd SSO as it is not enabled
2015-09-04 16:31:52,425 DEBUG [http-nio-7990-exec-8] @1PR4N0Cx991x21x0 127.0.0.1 "GET /login HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-authentication:crowdHttpAuthHandler
2015-09-04 16:31:52,425 DEBUG [http-nio-7990-exec-8] @1PR4N0Cx991x21x0 127.0.0.1 "GET /login HTTP/1.1" c.a.s.i.s.s.PluginAuthenticationProvider attempting authentication with authenticator com.atlassian.stash.stash-authentication:rememberMeAuthHandler
2015-09-04 16:31:52,428 DEBUG [http-nio-7990-exec-8] @1PR4N0Cx991x21x0 127.0.0.1 "GET /login HTTP/1.1" c.a.s.i.i18n.PluginI18nService No values found in any valid locale for key ProviderManager.providerNotFound and locales [en_US, en]

Please advice what i should do.

[Andrei Nastasa]

I fixed the problem by deleteing server.xml config file from the old location - <stash-install>/conf/server.xml (it seems it is not enough to create the file in <stash-home>/shared/server.xml ... you must delete the one in <stash-install>/conf/server.xml). Also make sure you have no proxy lines in server.xml if you do not have a proxy in front of it. On my setup i have a haproxy installed on the same machine and if i put:

                   proxyName="<haproxy host>"
                   proxyPort="<haproxy port>"

in server.xml the auth does not work (even if it is a local admin).

Hope this helps!

[FSC SI BTN Atos]

I follow after upgrading from 3.3.5 to 3.7.4 i can no longer in. It seens that Stash is waiting forever for the Crowd connection. Even with logn with a local admin is not possible.

[Adam Lathers]

I'd like to second this problem for attention.  I have a service using an RSA key for read authentication.  After my upgrade from 3.3.0 to 3.11.2 the OAuth key based connections no longer work.