I'm trying to run Kafka Connect on EKS using the Confluent image. The Kafka Connect cluster refers to an MSK cluster. When the Kubernetes pods are created, I see these logs printed over and over.
[2022-01-07 21:55:12,337] WARN [Producer clientId=producer-3] Got error produce response with correlation id 6695 on topic-partition _connect-configs-0, retrying (2147476960 attempts left). Error: NOT_ENOUGH_REPLICAS (org.apache.kafka.clients.producer.internals.Sender)
Below is my kustomize configuration:
spec:
selector:
matchLabels:
app: $APP_NAME
replicas: 3
template:
metadata:
labels:
app: $APP_NAME
spec:
containers:
- name: $APP_NAME
image: $APP_NAME-image
imagePullPolicy: Always
ports:
- containerPort: 8083
resources:
requests:
cpu: "500m"
memory: 1000Mi
limits:
cpu: "1"
memory: 3000Mi
env:
- name: CONNECT_CONFIG_STORAGE_REPLICATION_FACTOR
value: "3"
- name: CONNECT_OFFSET_STORAGE_REPLICATION_FACTOR
value: "3"
- name: CONNECT_STATUS_STORAGE_REPLICATION_FACTOR
value: "3"
...
Is there some other configuration to be updated to get rid of these warning messages?