[keycloak-user] Having trouble with Keycloak Performance Testsuite

Tomas Kyjovsky tkyjovsk at redhat.com
Wed Mar 13 19:52:18 EDT 2019


Hello Zak,

I think I can see the problem. There is a known issue with deadlocks on MariaDB (used in the perf testsuite) when concurrently adding many users who have multiple attributes. The `1r_10c_100u` dataset contains 100 users each having 3 attributes. I forgot about this bug when I was updating the README, sorry.

Please run the data generation command without the "-DnumOfWorkers=10" parameter. That should work. If not, please let me know.

  mvn verify -Pgenerate-data -Ddataset=1r_10c_100u 


CC: Marek, we spoke about this bug a while ago, is there a JIRA for it? I only found KEYCLOAK-2974 which is already closed, perhaps I should create a new one since this problem is still present.


Regards,
Tomas Kyjovsky


----- Original Message -----
> Hello,
> 
> I'm having trouble getting the test suite to work. I'm following the Getting
> started for the impatient instructions.
> 
> I am running:
> centos 7
> docker version 1.13.1, build 07f3374/1.13.1
> docker-compose version 1.18.0, build 8dd22a9
> openjdk version "1.8.0_201"
> maven 3.5.4
> 
> Going through the steps I am successful until mvn verify -Pgenerate-data
> -Ddataset=1r_10c_100u -DnumOfWorkers=10
> I have tried maven 3.1.1, 3.2.5, 3.6.0 and haven't gotten as far. Below is
> the output with maven 3.5.4.
> The first error encountered is 500, is this a permissions issue or am I
> missing some software? Any help is appreciated.
> 
> reated entities:
> Realm                1
> 
> 14:35:23 Time: +5 s
> Created entities:
> Realm                1
> RealmRole            10
> Client               10
> ClientRole           100
> 
> 14:35:24 Time: +6 s
> Created entities:
> Realm                1
> RealmRole            10
> Client               10
> ClientRole           100
> User                 3
> 
> 14:35:24 Error occured: javax.ws.rs.WebApplicationException: Create method
> returned status Internal Server Error (Code: 500); expected status: Created
> (201)
> 14:35:24 Exception thrown from executor service. Shutting down.
> Exception in thread "main" java.lang.RuntimeException:
> javax.ws.rs.WebApplicationException: Create method returned status Internal
> Server Error (Code: 500); expected status: Created (201)
>         at
>         org.keycloak.performance.dataset.DatasetLoader.processEntities(DatasetLoader.java:149)
>         at
>         org.keycloak.performance.dataset.DatasetLoader.processDataset(DatasetLoader.java:75)
>         at
>         org.keycloak.performance.dataset.DatasetLoader.main(DatasetLoader.java:35)
> Caused by: javax.ws.rs.WebApplicationException: Create method returned status
> Internal Server Error (Code: 500); expected status: Created (201)
>         at
>         org.keycloak.admin.client.CreatedResponseUtil.getCreatedId(CreatedResponseUtil.java:43)
>         at
>         org.keycloak.performance.dataset.Creatable.createCheckingForConflict(Creatable.java:51)
>         at
>         org.keycloak.performance.dataset.Creatable.createOrUpdateExisting(Creatable.java:69)
>         at
>         org.keycloak.performance.dataset.DatasetLoader.lambda$processEntities$0(DatasetLoader.java:118)
>         at
>         java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>         at
>         java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
> [ERROR] Command execution failed.
> org.apache.commons.exec.ExecuteException: Process exited with an error: 1
> (Exit value: 1)
>     at org.apache.commons.exec.DefaultExecutor.executeInternal
>     (DefaultExecutor.java:404)
>     at org.apache.commons.exec.DefaultExecutor.execute
>     (DefaultExecutor.java:166)
>     at org.codehaus.mojo.exec.ExecMojo.executeCommandLine (ExecMojo.java:804)
>     at org.codehaus.mojo.exec.ExecMojo.executeCommandLine (ExecMojo.java:751)
>     at org.codehaus.mojo.exec.ExecMojo.execute (ExecMojo.java:313)
>     at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo
>     (DefaultBuildPluginManager.java:137)
>     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
>     (MojoExecutor.java:208)
>     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
>     (MojoExecutor.java:154)
>     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
>     (MojoExecutor.java:146)
>     at
>     org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
>     (LifecycleModuleBuilder.java:117)
>     at
>     org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
>     (LifecycleModuleBuilder.java:81)
>     at
>     org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
>     (SingleThreadedBuilder.java:56)
>     at org.apache.maven.lifecycle.internal.LifecycleStarter.execute
>     (LifecycleStarter.java:128)
>     at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
>     at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
>     at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
>     at org.apache.maven.cli.MavenCli.execute (MavenCli.java:954)
>     at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:288)
>     at org.apache.maven.cli.MavenCli.main (MavenCli.java:192)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke
>     (NativeMethodAccessorImpl.java:62)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke
>     (DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke (Method.java:498)
>     at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced
>     (Launcher.java:289)
>     at org.codehaus.plexus.classworlds.launcher.Launcher.launch
>     (Launcher.java:229)
>     at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode
>     (Launcher.java:415)
>     at org.codehaus.plexus.classworlds.launcher.Launcher.main
>     (Launcher.java:356)
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Keycloak Performance TestSuite 6.0.0-SNAPSHOT ...... SUCCESS [  1.317
> s]
> [INFO] Keycloak Performance TestSuite - Keycloak Server ... SUCCESS [  2.089
> s]
> [INFO] Keycloak Performance TestSuite - Wildfly ModCluster Load Balancer
> SUCCESS [  0.873 s]
> [INFO] Keycloak Performance TestSuite - Infinispan Server . SUCCESS [  1.358
> s]
> [INFO] Keycloak Performance TestSuite - Tests 6.0.0-SNAPSHOT FAILURE [ 12.429
> s]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 18.582 s
> [INFO] Finished at: 2019-03-07T14:35:24-07:00
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.6.0:exec
> (load-data) on project performance-tests: Command execution failed.: Process
> exited with an error: 1 (Exit value: 1) -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal org.codehaus.mojo:exec-maven-plugin:1.6.0:exec (load-data) on project
> performance-tests: Command execution failed.
>     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
>     (MojoExecutor.java:213)
>     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
>     (MojoExecutor.java:154)
>     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
>     (MojoExecutor.java:146)
>     at
>     org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
>     (LifecycleModuleBuilder.java:117)
>     at
>     org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
>     (LifecycleModuleBuilder.java:81)
>     at
>     org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
>     (SingleThreadedBuilder.java:56)
>     at org.apache.maven.lifecycle.internal.LifecycleStarter.execute
>     (LifecycleStarter.java:128)
>     at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
>     at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
>     at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
>     at org.apache.maven.cli.MavenCli.execute (MavenCli.java:954)
>     at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:288)
>     at org.apache.maven.cli.MavenCli.main (MavenCli.java:192)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke
>     (NativeMethodAccessorImpl.java:62)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke
>     (DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke (Method.java:498)
>     at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced
>     (Launcher.java:289)
>     at org.codehaus.plexus.classworlds.launcher.Launcher.launch
>     (Launcher.java:229)
>     at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode
>     (Launcher.java:415)
>     at org.codehaus.plexus.classworlds.launcher.Launcher.main
>     (Launcher.java:356)
> Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution
> failed.
>     at org.codehaus.mojo.exec.ExecMojo.execute (ExecMojo.java:326)
>     at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo
>     (DefaultBuildPluginManager.java:137)
>     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
>     (MojoExecutor.java:208)
>     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
>     (MojoExecutor.java:154)
>     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
>     (MojoExecutor.java:146)
>     at
>     org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
>     (LifecycleModuleBuilder.java:117)
>     at
>     org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
>     (LifecycleModuleBuilder.java:81)
>     at
>     org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
>     (SingleThreadedBuilder.java:56)
>     at org.apache.maven.lifecycle.internal.LifecycleStarter.execute
>     (LifecycleStarter.java:128)
>     at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
>     at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
>     at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
>     at org.apache.maven.cli.MavenCli.execute (MavenCli.java:954)
>     at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:288)
>     at org.apache.maven.cli.MavenCli.main (MavenCli.java:192)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke
>     (NativeMethodAccessorImpl.java:62)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke
>     (DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke (Method.java:498)
>     at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced
>     (Launcher.java:289)
>     at org.codehaus.plexus.classworlds.launcher.Launcher.launch
>     (Launcher.java:229)
>     at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode
>     (Launcher.java:415)
>     at org.codehaus.plexus.classworlds.launcher.Launcher.main
>     (Launcher.java:356)
> Caused by: org.apache.commons.exec.ExecuteException: Process exited with an
> error: 1 (Exit value: 1)
>     at org.apache.commons.exec.DefaultExecutor.executeInternal
>     (DefaultExecutor.java:404)
>     at org.apache.commons.exec.DefaultExecutor.execute
>     (DefaultExecutor.java:166)
>     at org.codehaus.mojo.exec.ExecMojo.executeCommandLine (ExecMojo.java:804)
>     at org.codehaus.mojo.exec.ExecMojo.executeCommandLine (ExecMojo.java:751)
>     at org.codehaus.mojo.exec.ExecMojo.execute (ExecMojo.java:313)
>     at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo
>     (DefaultBuildPluginManager.java:137)
>     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
>     (MojoExecutor.java:208)
>     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
>     (MojoExecutor.java:154)
>     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
>     (MojoExecutor.java:146)
>     at
>     org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
>     (LifecycleModuleBuilder.java:117)
>     at
>     org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
>     (LifecycleModuleBuilder.java:81)
>     at
>     org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
>     (SingleThreadedBuilder.java:56)
>     at org.apache.maven.lifecycle.internal.LifecycleStarter.execute
>     (LifecycleStarter.java:128)
>     at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
>     at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
>     at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
>     at org.apache.maven.cli.MavenCli.execute (MavenCli.java:954)
>     at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:288)
>     at org.apache.maven.cli.MavenCli.main (MavenCli.java:192)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke
>     (NativeMethodAccessorImpl.java:62)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke
>     (DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke (Method.java:498)
>     at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced
>     (Launcher.java:289)
>     at org.codehaus.plexus.classworlds.launcher.Launcher.launch
>     (Launcher.java:229)
>     at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode
>     (Launcher.java:415)
>     at org.codehaus.plexus.classworlds.launcher.Launcher.main
>     (Launcher.java:356)
> [ERROR]
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]   mvn <goals> -rf :performance-tests
> 
> 
> Zak
> _______________________________________________
> keycloak-user mailing list
> keycloak-user at lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/keycloak-user
> 


More information about the keycloak-user mailing list