Camunda kubernates deployment failed

4/28/2020

We are trying to deploy Camunda in our Kubernetes cluster using a helm chart. In our dev box, we managed to install it successfully but now when we are trying to deploy in the QA environment it stops at below logs and restarts the pods.

Note: We are using Camunda 7.12.0 docker image with the External PostgreSQL database.

Configure database
Read-only file system: /camunda/conf/server.xml
Read-only file system: /camunda/conf/server.xml
Enabling debug mode, JPDA accesible under port 8000
Enabling Prometheus JMX Exporter on port 9404
wait-for-it.sh: waiting 30 seconds for glsdvlpgdb170.logistics.corp:5432
wait-for-it.sh: glsdvlpgdb170.logistics.corp:5432 is available after 0 seconds
NOTE: Picked up JDK_JAVA_OPTIONS:  --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
NOTE: Picked up JDK_JAVA_OPTIONS:  --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
Listening for transport dt_socket at address: 8000
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Server version name:   Apache Tomcat/9.0.24
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Server built:          Aug 14 2019 21:16:42 UTC
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Server version number: 9.0.24.0
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: OS Name:               Linux
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: OS Version:            4.16.18-041618-generic
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Architecture:          amd64
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Java Home:             /usr/lib/jvm/java-11-openjdk
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: JVM Version:           11.0.4+4-alpine-r1
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: JVM Vendor:            Alpine
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: CATALINA_BASE:         /camunda
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: CATALINA_HOME:         /camunda
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: --add-opens=java.base/java.lang=ALL-UNNAMED
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: --add-opens=java.base/java.io=ALL-UNNAMED
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: --add-opens=java.base/java.lang=ALL-UNNAMED
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: --add-opens=java.base/java.io=ALL-UNNAMED
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -Dnop
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -Xmx768m
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -XX:MaxMetaspaceSize=256m
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -Djdk.tls.ephemeralDHKeySize=2048
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -Djava.protocol.handler.pkgs=org.apache.catalina.webresources
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -Dorg.apache.catalina.security.SecurityListener.UMASK=0027
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -agentlib:jdwp=transport=dt_socket,address=0.0.0.0:8000,server=y,suspend=n
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -javaagent:/camunda/javaagent/jmx_prometheus_javaagent.jar=9404:/camunda/javaagent/prometheus-jmx.yml
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -Dignore.endorsed.dirs=
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -Dcatalina.base=/camunda
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -Dcatalina.home=/camunda
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.VersionLoggerListener log
INFO: Command line argument: -Djava.io.tmpdir=/camunda/temp
Apr 28, 2020 8:57:18 AM org.apache.catalina.core.AprLifecycleListener lifecycleEvent
INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: [/usr/lib/jvm/java-11-openjdk/lib/server:/usr/lib/jvm/java-11-openjdk/lib:/usr/lib/jvm/java-11-openjdk/../lib:/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib]
Apr 28, 2020 8:57:18 AM org.apache.coyote.AbstractProtocol init
INFO: Initializing ProtocolHandler ["http-nio-8080"]
Apr 28, 2020 8:57:18 AM org.apache.coyote.AbstractProtocol init
INFO: Initializing ProtocolHandler ["ajp-nio-8009"]
Apr 28, 2020 8:57:18 AM org.apache.catalina.startup.Catalina load
INFO: Server initialization in [1,002] milliseconds

Any pointers to enable tomcat to debug logs so that we can check why it fails as below logs don't give a proper reason for failure?

-- Kunal Patil
camunda
deployment
kubernetes
kubernetes-helm
tomcat

0 Answers