vSphere 6.7U3
Openshift 4.6.16, 4.7.0, 4.7.60, or 4.11.9 (all have the exact same behavior)
Installer node is running CentOS 7
I ultimately want to install Watson AIOps on OpenShift running on vSphere, but after installing OpenShift, the pods in the openshift-marketplace namespace remain in a state of ImagePullBackoff. Using 'oc get pods -A | grep ImagePullBackOff' gets me a list of those pods. I can get details with 'oc describe -n openshift-marketplace pds/redhat-marketplace-jcx9n' to see the following error:
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 7m47s default-scheduler Successfully assigned openshift-marketplace/community-operators-6qx58 to ovv-rq4kn-master-0 by ovv-rq4kn-master-1
Normal AddedInterface 7m43s multus Add eth0 [10.129.0.48/23] from openshift-sdn
Normal Pulling 6m21s (x4 over 7m43s) kubelet Pulling image "registry.redhat.io/redhat/community-operator-index:v4.11"
Warning Failed 6m21s (x4 over 7m43s) kubelet Failed to pull image "registry.redhat.io/redhat/community-operator-index:v4.11": rpc error: code = Unknown desc = unable to retrieve auth token: invalid username/password: unauthorized: Please login to the Red Hat Registry using your Customer Portal credentials. Further instructions can be found here: https://access.redhat.com/articles/3399531
Warning Failed 6m21s (x4 over 7m43s) kubelet Error: ErrImagePull
Warning Failed 5m55s (x6 over 7m42s) kubelet Error: ImagePullBackOff
Normal BackOff 2m30s (x21 over 7m42s) kubelet Back-off pulling image "registry.redhat.io/redhat/community-operator-index:v4.11"
Does anyone have a pointer to fix this? I downloaded my pull secret from Red Hat, and the install completes successfully, so it sure seems like it's correct. However, Google is failing me when trying to find a way for me to test or validate my pull secret. I can use docker to login to the repository with my email and password successfully, but I can't find a way to actually test my pull secret file to verify that it's correct.
Also, some of the other pods in the same ImagePullBackOff state only have these events:
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Pulling 50m (x48 over 4h30m) kubelet Pulling image "registry.redhat.io/redhat/community-operator-index:latest"
Normal BackOff 5m7s (x1169 over 4h30m) kubelet Back-off pulling image "registry.redhat.io/redhat/community-operator-index:latest"
Warning Failed 7s (x1192 over 4h30m) kubelet Error: ImagePullBackOff
While my cluster is on a NAT network, it does have access to the Internet.
Anyone have any ideas?
Thanks,
Frank
------------------------------
Frank Tate
Gulfsoft Consulting
https://www.gulfsoft.comAIOps Experts. Contact us for implementation help.
------------------------------