Kafka Connect on EKS Running into NOT_ENOUGH_REPLICAS Error

1/7/2022

I'm trying to run Kafka Connect on EKS using the Confluent image. The Kafka Connect cluster refers to an MSK cluster. When the Kubernetes pods are created, I see these logs printed over and over.

[2022-01-07 21:55:12,337] WARN [Producer clientId=producer-3] Got error produce response with correlation id 6695 on topic-partition _connect-configs-0, retrying (2147476960 attempts left). Error: NOT_ENOUGH_REPLICAS (org.apache.kafka.clients.producer.internals.Sender)

Below is my kustomize configuration:

spec:
  selector:
    matchLabels:
      app: $APP_NAME
  replicas: 3
template:
    metadata:
      labels:
        app: $APP_NAME
    spec:
      containers:
        - name: $APP_NAME
          image: $APP_NAME-image
          imagePullPolicy: Always
          ports:
            - containerPort:  8083
          resources:
            requests:
              cpu: "500m"
              memory: 1000Mi
            limits:
              cpu: "1"
              memory: 3000Mi
          env:
            - name: CONNECT_CONFIG_STORAGE_REPLICATION_FACTOR
              value: "3"
            - name: CONNECT_OFFSET_STORAGE_REPLICATION_FACTOR
              value: "3"
            - name: CONNECT_STATUS_STORAGE_REPLICATION_FACTOR
              value: "3"
...

Is there some other configuration to be updated to get rid of these warning messages?

-- code_guru
apache-kafka
apache-kafka-connect
kubernetes

0 Answers