I'm a complete loss. I have a kubernetes cluster running on ec2. I set it up using kops (versions 1.7.3/1.7.0 client/server). It's been working just fine for 4 months and all of the sudden I begin receiving this when creating new pods.
Failed to pull image "123456789.dkr.ecr.us-west-2.amazonaws.com/
k8s-docker-s3-to-backup:latest": rpc error: code = 2 desc =
unauthorized: authentication required
Error syncing podI'm fairly certain I made no changes to the node or master roles in AWS IAM. There are no errors in my repo urls. I can create pods using public images.
I can't find anything helpful in cloudtrail. How can I further debug what is going on?
I can now confirm that nothing was wrong with my configuration. The IAM permissions listed in here work. It does appear that either AWS was encountering an outage or perhaps I exceeded some sort of limit. I will check with my AWS rep and provide more info if I can get it. As of this morning, everything is working as usual.