cert-manager: challenge in work queue no longer exists

9/24/2019

I am using AKS and installing certmanager from istio installation options (v0.9.0). Certificate is getting issued from letsencrypt successfully but, it's not working on browsers. When I see certificate details, I still see cluster.local certificate and not letsencrypt one.

challenge in work queue no longer exists

re-queuing item due to error processing

ClusterIssuer:

Name:         letsencrypt-staging
Namespace:
Labels:       <none>
Annotations:  kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"certmanager.k8s.io/v1alpha1","kind":"ClusterIssuer","metadata":{"annotations":{},"name":"letsencrypt-staging","namespace":""},"spec":{"a...
API Version:  certmanager.k8s.io/v1alpha1
Kind:         ClusterIssuer
Metadata:
  Creation Timestamp:  2019-09-24T19:05:02Z
  Generation:          2
  Resource Version:    3761667
  Self Link:           /apis/certmanager.k8s.io/v1alpha1/clusterissuers/letsencrypt-staging
  UID:                 365ba8ae-defe-11e9-b449-56e93edfe557
Spec:
  Acme:
    Dns 01:
      Providers:
    Azuredns:
      Client ID:  75ed3710-ec32-4f15-a671-197f6fc1504e
      Client Secret Secret Ref:
        Key:                CLIENT_SECRET
        Name:               azuredns-config
      Environment:          AzurePublicCloud
      Hosted Zone Name:     example.com
      Resource Group Name:  example-dns
      Subscription ID:      xxxxx-xxxxx-xxxxx-xxxxx
      Tenant ID:            xxxxx-xxxxx-xxxxx-xxxxx
    Name:                   azuredns
    Email:                      email@example.com
    Private Key Secret Ref:
      Name:  letsencrypt-staging
    Server:  https://acme-staging-v02.api.letsencrypt.org/directory
Status:
  Acme:
    Last Registered Email:  email@example.com
    Uri:                    https://acme-staging-v02.api.letsencrypt.org/acme/acct/11121021
  Conditions:
    Last Transition Time:  2019-09-24T19:05:03Z
    Message:               The ACME account was registered with the ACME server
    Reason:                ACMEAccountRegistered
    Status:                True
    Type:                  Ready
Events:                    <none>

Certificate:

Name:         httpbin-cert
Namespace:    istio-system
Labels:       <none>
Annotations:  kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"certmanager.k8s.io/v1alpha1","kind":"Certificate","metadata":{"annotations":{},"name":"httpbin-cert","namespace":"istio-system"},"spec":...
API Version:  certmanager.k8s.io/v1alpha1
Kind:         Certificate
Metadata:
  Creation Timestamp:  2019-09-24T19:53:04Z
  Generation:          4
  Resource Version:    3766006
  Self Link:           /apis/certmanager.k8s.io/v1alpha1/namespaces/istio-system/certificates/httpbin-cert
  UID:                 ec42d145-df04-11e9-b449-56e93edfe557
Spec:
  Acme:
    Config:
      Dns 01:
    Provider:  azuredns
      Domains:
    httpbin.example.com
    *.httpbin.example.com
  Common Name:  httpbin.example.com
  Dns Names:
    httpbin.example.com
    *.httpbin.example.com
  Issuer Ref:
    Kind:       ClusterIssuer
    Name:       letsencrypt-staging
  Secret Name:  httpbin-cert
Status:
  Conditions:
    Last Transition Time:  2019-09-24T19:54:11Z
    Message:               Certificate is up to date and has not expired
    Reason:                Ready
    Status:                True
    Type:                  Ready
  Not After:               2019-12-23T18:54:10Z
Events:
  Type    Reason              Age   From          Message
  ----    ------              ----  ----          -------
  Normal  Generated           10m   cert-manager  Generated new private key
  Normal  GenerateSelfSigned  10m   cert-manager  Generated temporary self signed certificate
  Normal  OrderCreated        10m   cert-manager  Created Order resource "httpbin-cert-1622375933"
  Normal  OrderComplete       9m    cert-manager  Order "httpbin-cert-1622375933" completed successfully
  Normal  CertIssued          9m    cert-manager  Certificate issued successfully

Steps to reproduce the bug:

  1. Install Istio with certmanager option enabled.
  2. Configure ClusterIssuer with azuredns
  3. Deploy demo app httpbin with istio gateway and virtualservice
  4. Create certificate using azuredns provider

cert-manager logs:

I0924 19:53:04.835787       1 conditions.go:154] Setting lastTransitionTime for Certificate "httpbin-cert" condition "Ready" to 2019-09-24 19:53:04.835781787 +0000 UTC m=+4228.830422613
E0924 19:53:04.835891       1 pki.go:41] cert-manager/controller/certificates/certificates "msg"="failed to retrieve secret" "error"="secret \"httpbin-cert\" not found" "related_resource_kind"="Secret" "related_resource_name"="httpbin-cert" "related_resource_namespace"="istio-system"
I0924 19:53:05.141241       1 base_controller.go:193] cert-manager/controller/certificates "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert"
I0924 19:53:05.141285       1 base_controller.go:187] cert-manager/controller/certificates "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert"
I0924 19:53:05.170865       1 base_controller.go:187] cert-manager/controller/orders "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:53:05.171053       1 sync.go:89] cert-manager/controller/orders "level"=0 "msg"="creating Order with ACME server as one does not currently exist" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system"
I0924 19:53:05.171095       1 sync.go:376] cert-manager/controller/orders "level"=0 "msg"="order URL not set, submitting Order to ACME server" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system"
I0924 19:53:05.171120       1 sync.go:382] cert-manager/controller/orders "level"=0 "msg"="build set of domains for Order" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system" "domains"=["*.httpbin.example.com","httpbin.example.com"]
I0924 19:53:05.171128       1 logger.go:38] Calling CreateOrder
I0924 19:53:05.251670       1 base_controller.go:193] cert-manager/controller/certificates "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert"
I0924 19:53:05.251707       1 base_controller.go:187] cert-manager/controller/certificates "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert"
I0924 19:53:05.252137       1 issue.go:169] cert-manager/controller/certificates/certificates "level"=0 "msg"="Order is not in 'valid' state. Waiting for Order to transition before attempting to issue Certificate." "related_resource_kind"="Order" "related_resource_name"="httpbin-cert-1622375933" "related_resource_namespace"="istio-system"
I0924 19:53:05.252338       1 base_controller.go:193] cert-manager/controller/certificates "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert"
I0924 19:53:05.423062       1 sync.go:392] cert-manager/controller/orders "level"=0 "msg"="submitted Order to ACME server" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system"
I0924 19:53:05.423449       1 sync.go:395] cert-manager/controller/orders "level"=0 "msg"="computing Challenge resources to create for this Order" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system"
I0924 19:53:05.423605       1 sync.go:398] cert-manager/controller/orders "level"=0 "msg"="spec.acme field found on Order resource. Using old style ACME configuration format. For more details, read: https://docs.cert-manager.io/en/latest/tasks/upgrading/upgrading-0.7-0.8.html" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system"
I0924 19:53:05.423736       1 logger.go:73] Calling GetAuthorization
I0924 19:53:05.476061       1 sync.go:411] cert-manager/controller/orders "level"=0 "msg"="determining challenge solver to use for challenge" "domain"="httpbin.example.com" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system" "url"="https://acme-staging-v02.api.letsencrypt.org/acme/authz-v3/10143359" "wildcard"=false
I0924 19:53:05.476256       1 logger.go:98] Calling DNS01ChallengeRecord
I0924 19:53:05.476370       1 logger.go:73] Calling GetAuthorization
I0924 19:53:05.528941       1 sync.go:411] cert-manager/controller/orders "level"=0 "msg"="determining challenge solver to use for challenge" "domain"="httpbin.example.com" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system" "url"="https://acme-staging-v02.api.letsencrypt.org/acme/authz-v3/10181911" "wildcard"=true
I0924 19:53:05.528968       1 logger.go:98] Calling DNS01ChallengeRecord
I0924 19:53:05.529005       1 sync.go:68] cert-manager/controller/orders "level"=0 "msg"="updating Order resource status" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system"
I0924 19:53:05.544905       1 base_controller.go:187] cert-manager/controller/certificates "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert"
I0924 19:53:05.545841       1 issue.go:169] cert-manager/controller/certificates/certificates "level"=0 "msg"="Order is not in 'valid' state. Waiting for Order to transition before attempting to issue Certificate." "related_resource_kind"="Order" "related_resource_name"="httpbin-cert-1622375933" "related_resource_namespace"="istio-system"
I0924 19:53:05.546384       1 base_controller.go:193] cert-manager/controller/certificates "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert"
I0924 19:53:05.546910       1 base_controller.go:193] cert-manager/controller/orders "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:53:05.546943       1 base_controller.go:187] cert-manager/controller/orders "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:53:05.547424       1 sync.go:304] cert-manager/controller/orders "level"=0 "msg"="need to create challenges" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system" "number"=2
I0924 19:53:05.562864       1 base_controller.go:187] cert-manager/controller/challenges "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933-1"
I0924 19:53:05.562907       1 base_controller.go:193] cert-manager/controller/challenges "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933-1"
I0924 19:53:05.580340       1 base_controller.go:187] cert-manager/controller/challenges "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933-0"
I0924 19:53:05.580604       1 sync.go:349] cert-manager/controller/orders "level"=0 "msg"="waiting for all challenges to enter 'valid' state" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system"
I0924 19:53:05.580825       1 base_controller.go:193] cert-manager/controller/orders "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:53:05.580948       1 base_controller.go:187] cert-manager/controller/orders "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:53:05.581549       1 sync.go:304] cert-manager/controller/orders "level"=0 "msg"="need to create challenges" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system" "number"=0
I0924 19:53:05.581748       1 sync.go:349] cert-manager/controller/orders "level"=0 "msg"="waiting for all challenges to enter 'valid' state" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system"
I0924 19:53:05.581959       1 base_controller.go:193] cert-manager/controller/orders "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:53:05.581651       1 base_controller.go:193] cert-manager/controller/challenges "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933-0"
I0924 19:53:06.069066       1 base_controller.go:187] cert-manager/controller/orders "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:53:06.070479       1 sync.go:304] cert-manager/controller/orders "level"=0 "msg"="need to create challenges" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system" "number"=0
I0924 19:53:06.069922       1 base_controller.go:187] cert-manager/controller/challenges "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933-1"
I0924 19:53:06.071558       1 sync.go:349] cert-manager/controller/orders "level"=0 "msg"="waiting for all challenges to enter 'valid' state" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system"
I0924 19:53:06.072024       1 base_controller.go:193] cert-manager/controller/orders "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:53:06.072451       1 logger.go:68] Calling GetChallenge
I0924 19:53:06.147560       1 base_controller.go:187] cert-manager/controller/orders "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:53:06.147986       1 sync.go:304] cert-manager/controller/orders "level"=0 "msg"="need to create challenges" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system" "number"=0
I0924 19:53:06.148150       1 sync.go:349] cert-manager/controller/orders "level"=0 "msg"="waiting for all challenges to enter 'valid' state" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system"
I0924 19:53:06.148329       1 base_controller.go:193] cert-manager/controller/orders "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:53:06.148643       1 base_controller.go:193] cert-manager/controller/challenges "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933-1"
I0924 19:53:06.148795       1 base_controller.go:187] cert-manager/controller/challenges "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933-1"
I0924 19:53:06.149086       1 dns.go:104] cert-manager/controller/challenges/Present "level"=0 "msg"="presenting DNS01 challenge for domain" "dnsName"="httpbin.example.com" "domain"="httpbin.example.com" "resource_kind"="Challenge" "resource_name"="httpbin-cert-1622375933-1" "resource_namespace"="istio-system" "type"="dns-01"
I0924 19:53:07.151485       1 dns.go:119] cert-manager/controller/challenges/Check "level"=0 "msg"="checking DNS propagation" "dnsName"="httpbin.example.com" "domain"="httpbin.example.com" "resource_kind"="Challenge" "resource_name"="httpbin-cert-1622375933-1" "resource_namespace"="istio-system" "type"="dns-01" "nameservers"=["10.242.0.10:53"]
I0924 19:53:07.367963       1 dns.go:131] cert-manager/controller/challenges/Check "level"=0 "msg"="waiting DNS record TTL to allow the DNS01 record to propagate for domain" "dnsName"="httpbin.example.com" "domain"="httpbin.example.com" "resource_kind"="Challenge" "resource_name"="httpbin-cert-1622375933-1" "resource_namespace"="istio-system" "type"="dns-01" "fqdn"="_acme-challenge.httpbin.example.com." "ttl"=60
I0924 19:54:07.368226       1 dns.go:133] cert-manager/controller/challenges/Check "level"=0 "msg"="ACME DNS01 validation record propagated" "dnsName"="httpbin.example.com" "domain"="httpbin.example.com" "resource_kind"="Challenge" "resource_name"="httpbin-cert-1622375933-1" "resource_namespace"="istio-system" "type"="dns-01" "fqdn"="_acme-challenge.httpbin.example.com."
I0924 19:54:07.369349       1 sync.go:310] cert-manager/controller/challenges/acceptChallenge "level"=0 "msg"="accepting challenge with ACME server" "dnsName"="httpbin.example.com" "resource_kind"="Challenge" "resource_name"="httpbin-cert-1622375933-1" "resource_namespace"="istio-system" "type"="dns-01"
I0924 19:54:07.369860       1 logger.go:63] Calling AcceptChallenge
I0924 19:54:07.424343       1 sync.go:327] cert-manager/controller/challenges/acceptChallenge "level"=0 "msg"="waiting for authorization for domain" "dnsName"="httpbin.example.com" "resource_kind"="Challenge" "resource_name"="httpbin-cert-1622375933-1" "resource_namespace"="istio-system" "type"="dns-01"
I0924 19:54:07.426187       1 logger.go:78] Calling WaitAuthorization
I0924 19:54:09.015761       1 base_controller.go:193] cert-manager/controller/challenges "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933-1"
I0924 19:54:09.016054       1 base_controller.go:187] cert-manager/controller/orders "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:09.016284       1 sync.go:304] cert-manager/controller/orders "level"=0 "msg"="need to create challenges" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system" "number"=0
I0924 19:54:09.016319       1 sync.go:349] cert-manager/controller/orders "level"=0 "msg"="waiting for all challenges to enter 'valid' state" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system"
I0924 19:54:09.016350       1 base_controller.go:193] cert-manager/controller/orders "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:09.016380       1 base_controller.go:187] cert-manager/controller/challenges "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933-1"
I0924 19:54:09.756045       1 base_controller.go:187] cert-manager/controller/orders "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:09.756391       1 sync.go:304] cert-manager/controller/orders "level"=0 "msg"="need to create challenges" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system" "number"=0
I0924 19:54:09.756429       1 sync.go:349] cert-manager/controller/orders "level"=0 "msg"="waiting for all challenges to enter 'valid' state" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system"
I0924 19:54:09.756456       1 base_controller.go:193] cert-manager/controller/orders "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:09.757496       1 base_controller.go:193] cert-manager/controller/challenges "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933-1"
I0924 19:54:09.757545       1 base_controller.go:187] cert-manager/controller/challenges "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933-1"
I0924 19:54:09.757704       1 base_controller.go:193] cert-manager/controller/challenges "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933-1"
I0924 19:54:10.106847       1 base_controller.go:187] cert-manager/controller/challenges "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933-0"
I0924 19:54:10.106868       1 base_controller.go:187] cert-manager/controller/orders "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:10.107110       1 sync.go:304] cert-manager/controller/orders "level"=0 "msg"="need to create challenges" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system" "number"=0
I0924 19:54:10.107141       1 sync.go:349] cert-manager/controller/orders "level"=0 "msg"="waiting for all challenges to enter 'valid' state" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system"
I0924 19:54:10.107184       1 base_controller.go:193] cert-manager/controller/orders "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:10.107184       1 logger.go:68] Calling GetChallenge
I0924 19:54:10.175281       1 base_controller.go:187] cert-manager/controller/orders "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:10.175504       1 sync.go:304] cert-manager/controller/orders "level"=0 "msg"="need to create challenges" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system" "number"=0
I0924 19:54:10.175523       1 logger.go:43] Calling GetOrder
I0924 19:54:10.177671       1 base_controller.go:193] cert-manager/controller/challenges "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933-0"
I0924 19:54:10.177716       1 base_controller.go:187] cert-manager/controller/challenges "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933-0"
I0924 19:54:10.204550       1 base_controller.go:193] cert-manager/controller/challenges "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933-0"
I0924 19:54:10.204907       1 base_controller.go:187] cert-manager/controller/challenges "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933-0"
I0924 19:54:10.205067       1 base_controller.go:193] cert-manager/controller/challenges "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933-0"
I0924 19:54:10.232953       1 sync.go:68] cert-manager/controller/orders "level"=0 "msg"="updating Order resource status" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system"
I0924 19:54:10.254526       1 base_controller.go:187] cert-manager/controller/certificates "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert"
I0924 19:54:10.255101       1 issue.go:169] cert-manager/controller/certificates/certificates "level"=0 "msg"="Order is not in 'valid' state. Waiting for Order to transition before attempting to issue Certificate." "related_resource_kind"="Order" "related_resource_name"="httpbin-cert-1622375933" "related_resource_namespace"="istio-system"
I0924 19:54:10.255279       1 base_controller.go:193] cert-manager/controller/certificates "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert"
I0924 19:54:10.255528       1 base_controller.go:193] cert-manager/controller/orders "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:10.255560       1 base_controller.go:187] cert-manager/controller/orders "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:10.255665       1 logger.go:58] Calling FinalizeOrder
I0924 19:54:10.936889       1 logger.go:43] Calling GetOrder
I0924 19:54:10.991753       1 sync.go:68] cert-manager/controller/orders "level"=0 "msg"="updating Order resource status" "resource_kind"="Order" "resource_name"="httpbin-cert-1622375933" "resource_namespace"="istio-system"
I0924 19:54:11.020235       1 base_controller.go:187] cert-manager/controller/certificates "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert"
I0924 19:54:11.020920       1 base_controller.go:193] cert-manager/controller/orders "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:11.021328       1 base_controller.go:187] cert-manager/controller/orders "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:11.073323       1 sync.go:329] cert-manager/controller/certificates/certificates "level"=0 "msg"="certificate scheduled for renewal" "duration_until_renewal"="1438h59m58.926708953s" "related_resource_kind"="Secret" "related_resource_name"="httpbin-cert" "related_resource_namespace"="istio-system"
I0924 19:54:11.073692       1 base_controller.go:193] cert-manager/controller/certificates "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert"
I0924 19:54:11.073726       1 base_controller.go:187] cert-manager/controller/certificates "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert"
I0924 19:54:11.074268       1 conditions.go:143] Found status change for Certificate "httpbin-cert" condition "Ready": "False" -> "True"; setting lastTransitionTime to 2019-09-24 19:54:11.074254079 +0000 UTC m=+4295.068894805
I0924 19:54:11.074645       1 sync.go:329] cert-manager/controller/certificates/certificates "level"=0 "msg"="certificate scheduled for renewal" "duration_until_renewal"="1438h59m58.92539911s" "related_resource_kind"="Secret" "related_resource_name"="httpbin-cert" "related_resource_namespace"="istio-system"
I0924 19:54:11.105326       1 base_controller.go:187] cert-manager/controller/challenges "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933-1"
I0924 19:54:11.113900       1 base_controller.go:193] cert-manager/controller/certificates "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert"
I0924 19:54:11.114078       1 base_controller.go:187] cert-manager/controller/certificates "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert"
I0924 19:54:11.114908       1 sync.go:329] cert-manager/controller/certificates/certificates "level"=0 "msg"="certificate scheduled for renewal" "duration_until_renewal"="1438h59m58.885119373s" "related_resource_kind"="Secret" "related_resource_name"="httpbin-cert" "related_resource_namespace"="istio-system"
I0924 19:54:11.115389       1 base_controller.go:193] cert-manager/controller/certificates "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert"
I0924 19:54:11.130128       1 base_controller.go:187] cert-manager/controller/challenges "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933-0"
I0924 19:54:11.131606       1 base_controller.go:193] cert-manager/controller/orders "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:11.131783       1 base_controller.go:187] cert-manager/controller/orders "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:11.144448       1 base_controller.go:193] cert-manager/controller/challenges "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933-1"
I0924 19:54:11.144655       1 base_controller.go:187] cert-manager/controller/challenges "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933-1"
E0924 19:54:11.144682       1 controller.go:192] cert-manager/controller/challenges "msg"="challenge in work queue no longer exists" "error"="challenge.certmanager.k8s.io \"httpbin-cert-1622375933-1\" not found"
I0924 19:54:11.144696       1 base_controller.go:193] cert-manager/controller/challenges "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933-1"
E0924 19:54:11.145845       1 base_controller.go:189] cert-manager/controller/orders "msg"="re-queuing item  due to error processing" "error"="challenges.certmanager.k8s.io \"httpbin-cert-1622375933-1\" not found" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:11.146547       1 base_controller.go:187] cert-manager/controller/orders "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:11.159109       1 base_controller.go:193] cert-manager/controller/challenges "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933-0"
I0924 19:54:11.159378       1 base_controller.go:187] cert-manager/controller/challenges "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933-0"
E0924 19:54:11.159414       1 controller.go:192] cert-manager/controller/challenges "msg"="challenge in work queue no longer exists" "error"="challenge.certmanager.k8s.io \"httpbin-cert-1622375933-0\" not found"
I0924 19:54:11.159660       1 base_controller.go:193] cert-manager/controller/challenges "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933-0"
E0924 19:54:11.160881       1 base_controller.go:189] cert-manager/controller/orders "msg"="re-queuing item  due to error processing" "error"="challenges.certmanager.k8s.io \"httpbin-cert-1622375933-0\" not found" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:11.160921       1 base_controller.go:187] cert-manager/controller/orders "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:11.161912       1 base_controller.go:193] cert-manager/controller/orders "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:16.146078       1 base_controller.go:187] cert-manager/controller/orders "level"=0 "msg"="syncing item" "key"="istio-system/httpbin-cert-1622375933"
I0924 19:54:16.148027       1 base_controller.go:193] cert-manager/controller/orders "level"=0 "msg"="finished processing work item" "key"="istio-system/httpbin-cert-1622375933"

Environment details:: - Kubernetes version: v1.10.4 - Cloud-provider/provisioner: AKS - cert-manager version: v0.9.0 - Install method: Istio Installation Options

-- Ronak Patel
cert-manager
istio
kubernetes
lets-encrypt
ssl

0 Answers