Maximo

Maximo

Come for answers, stay for best practices. All we're missing is you.

 View Only
Back to discussions
Expand all | Collapse all

Error in installing MAS8.9 Using ansible palybook

  • 1.  Error in installing MAS8.9 Using ansible palybook

    Posted Fri September 29, 2023 02:59 PM

    We are installing MAS using ansible-playbook ibm.mas_devops.oneclick_core. I passed some parameters every was going fine and its create mongodb , ibm-sls and some operators but now its giving error on 



    ------------------------------
    Muhammad haris bin javaid
    ------------------------------


  • 2.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sat September 30, 2023 03:02 AM

    Hi Muhammad,

    As I can see in the log screenshot, it seems that the mongo certifcate is missing / invalid / incorrectly installed. Can you check in the MAS Core operator (IBM Maximo Application Suite Operator in the namespace / project you have created for the MAS instance) whether the MongoCfg file is created succesfully (in ready mode)?



    ------------------------------
    Jan-Willem Steur
    Manager Business Development
    ZNAPZ b.v.
    Breda
    +31 6 25639950
    Jan-Willem
    ------------------------------

    Original Message


  • 3.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sat September 30, 2023 03:07 AM

    Hi Mohammed,

    Beside that, it is hard to validate what went wrong, since an operator that is failing can have multiple causes. Please check if IBM SLS is installed correctly (and the sls license pod is running and the log is showing no error messages), alos check whether MongoDB is installed correctly (production mode 3 replicas, or non-prod mode 1 replica). Check in SLS whether it was configured for 3 or 1 mongodb pods. Most often there it already goes wrong in installing the required dependencies for MAS. Also check whether UDS or SUDS was used (don't know if you are running in a full OCP cluster or using an OCP SNO cluster. SO more information about the infra and dependencies setup would help to better understand your issue.



    ------------------------------
    Jan-Willem Steur
    Manager Business Development
    ZNAPZ b.v.
    Breda
    +31 6 25639950
    Jan-Willem
    ------------------------------

    Original Message


  • 4.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sat September 30, 2023 05:39 AM

    Hi 

    I check the configurations its seem fine only the issue is certificate how to fix it?

    Thanks and regard



    ------------------------------
    Muhammad haris bin javaid
    ------------------------------

    Original Message


  • 5.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sat September 30, 2023 08:56 AM

    Hi 

    Certificate error is fixed now its giving errro in pulling Image 

    Back-off pulling image "cp.icr.io/cp/ibm-sls/api-

    Thanks and regards



    ------------------------------
    Muhammad haris bin javaid
    ------------------------------

    Original Message


  • 6.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sat September 30, 2023 09:06 AM
    Edited by Jan-Willem Steur Sat September 30, 2023 09:07 AM

    Please check if the ibm-entitlement-key secret exists in the SLS project. Seems that this secret is not (yet) added. You can easily check to which pull secret is referred to by opening the yaml file of the pod that is not running and search for pullsecret. Check if this pullsecret exists in the project / namespace where the pod is running in.



    ------------------------------
    Jan-Willem Steur
    Manager Business Development
    ZNAPZ b.v.
    Breda
    +31 6 25639950
    Jan-Willem
    ------------------------------

    Original Message


  • 7.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sun October 01, 2023 05:22 AM

    Hi

    ibm-entitlement is there but not  ibm-entitlement-key



    ------------------------------
    Muhammad haris bin javaid
    ------------------------------

    Original Message


  • 8.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sun October 01, 2023 06:11 AM

    Hi 

    I check pod is using ibm-entitlement  secret 

    Reagrds



    ------------------------------
    Muhammad haris bin javaid
    ------------------------------

    Original Message


  • 9.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sun October 01, 2023 07:03 AM
    Edited by Jan-Willem Steur Sun October 01, 2023 07:07 AM

    Muhammad,

    Please check in the pod that is running into the imagepullbackof error to which pull secret is referred to:



    Check also whether the correct API key in the ibm-entitlement secret is entered:


    Are you sure the ibm-api-licensing-xxxxxx pod is fully running and started? (should be in Ready 1/1 status). If the pod is not yet ready (e.g. 0/1), check the logging in this pod and search for an ERROR. In some cases there is an error displayed referring to mongodb. In that case the configfile or deployment file is incomplete or is referring to the wrong mongodb svc's (3 svc's since you are running with 3 mongodb replica's).
    ------------------------------
    Jan-Willem Steur
    Manager Business Development
    ZNAPZ b.v.
    Breda
    +31 6 25639950
    Jan-Willem
    ------------------------------

    Original Message


  • 10.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sun October 01, 2023 07:14 AM

    Hi 

    All of these are correct 



    ------------------------------
    Muhammad haris bin javaid
    ------------------------------

    Original Message


  • 11.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sun October 01, 2023 07:15 AM



    ------------------------------
    Muhammad haris bin javaid
    ------------------------------

    Original Message


  • 12.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sun October 01, 2023 07:22 AM
    Edited by Muhammad haris bin javaid Sun October 01, 2023 07:28 AM

    Hi

    i have 2 pods for sls-api one is running and the other one is giving error in ibm-sls



  • 13.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sun October 01, 2023 07:27 AM

    Muhammad,

    Please share the logging from the ibm-api-licensing-xxxxx pod, so that I can have a detailed logging of the error. Only screenshots won't help in this.



    ------------------------------
    Jan-Willem Steur
    Manager Business Development
    ZNAPZ b.v.
    Breda
    +31 6 25639950
    Jan-Willem
    ------------------------------

    Original Message


  • 14.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sun October 01, 2023 07:29 AM

    The logs for the pods is empty 



    ------------------------------
    Muhammad haris bin javaid
    ------------------------------

    Original Message


  • 15.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sun October 01, 2023 07:36 AM

    Muhammad,

    Sorry, my mistake, it wasn't ibm-api-licensing-xxxxx pod but ibm-sls-controller-manager-xxxx pod. Check if there is a failure in this logging (red text), and send the red texted information so see what is causing the imagepull (has to do either with secret, bad network or too less resources.



    ------------------------------
    Jan-Willem Steur
    Manager Business Development
    ZNAPZ b.v.
    Breda
    +31 6 25639950
    Jan-Willem
    ------------------------------

    Original Message


  • 16.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sun October 01, 2023 07:40 AM

    Hi 

    Below is the error in ibm-sls-controller-manager

    fatal: [localhost]: FAILED! => {"changed": false, "msg": "NotReady: MongoDB configuration (certificates or credentials) is not valid. Ensure that mongo configuration, including certificates and credentials is correct"}



    ------------------------------
    Muhammad haris bin javaid
    ------------------------------

    Original Message


  • 17.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sun October 01, 2023 07:34 AM
    Edited by Muhammad haris bin javaid Sun October 01, 2023 07:38 AM


    ------------------------------
    Muhammad haris bin javaid
    ------------------------------



  • 18.  RE: Error in installing MAS8.9 Using ansible palybook
    Best Answer

    Posted Sun October 01, 2023 07:41 AM
    Edited by Muhammad haris bin javaid Sun October 01, 2023 08:56 AM

    Ah,  I see. Probably you have updated your license.dat file recently. I this case delete the entire project, re-install IBM-SLS (manually or via devops pipeline). I saw this error as from 8.10.4 after the license.key is updated front-end in MAS-Core or via devops ansible installer.  It is only allowed to have one (1) api-license pod. In this case remove the project and re-install again (don't forget to remove the related CRD's as well before reinstalling IBM-SLS.



    ------------------------------
    Jan-Willem Steur
    Manager Business Development
    ZNAPZ b.v.
    Breda
    +31 6 25639950
    Jan-Willem
    ------------------------------

    Original Message


  • 19.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sun October 01, 2023 08:55 AM
    Edited by Muhammad haris bin javaid Sun October 01, 2023 08:56 AM

    Hi 

    Thanks for your help

    Issue is fixed after reinstalling IBM sls

    Now i need to configure it in MAS because its not auto configured. I need to know from where i can get



    ------------------------------
    Muhammad haris bin javaid
    ------------------------------

    Original Message


  • 20.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sun October 01, 2023 09:10 AM

    One of the pod dev-licensing-mediator in mas-dev-core is giving below error 

    requests.exceptions.SSLError: HTTPSConnectionPool(host='sls.ibm-sls.apps.qhscactm.dev.openshift.sevenit.cloud', port=443): Max retries exceeded with url: /api/probes/readiness (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate in certificate chain (_ssl.c:1129)')))
    3140The above exception was the direct cause of the following exception:
    3141Traceback (most recent call last):
    3142File "/opt/ibm/licensing-mediator/licensing_mediator.py", line 113, in <module>
    3143sls_client.verify_connection()
    3144File "/usr/local/lib/python3.9/site-packages/sls/exceptions.py", line 30, in inner_function
    3145raise SLSError(ex=ex) from ex
    3146sls.exceptions.SLSError: An unhandled error was returned from SLS: HTTPSConnectionPool(host='sls.ibm-sls.apps.qhscactm.dev.openshift.sevenit.cloud', port=443): Max retries exceeded with url: /api/probes/readiness (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate in certificate chain (_ssl.c:1129)')))
    31472023-10-01 13:04:56,136 licensing_mediator INFO Initializing clients and utilities...
    31482023-10-01 13:04:56,136 sls.sls_client DEBUG Checking SLS connection
    31492023-10-01 13:04:56,139 urllib3.connectionpool DEBUG Starting new HTTPS connection (1): sls.ibm-sls.apps.qhscactm.dev.openshift.sevenit.cloud:443
    31502023-10-01 13:04:56,149 licensing_mediator ERROR Unable to initialize client and utilities: An unhandled error was returned from SLS: HTTPSConnectionPool(host='sls.ibm-sls.apps.qhscactm.dev.openshift.sevenit.cloud', port=443): Max retries exceeded with url: /api/probes/readiness (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self signed certificate in certificate chain (_ssl.c:1129)')))
    3151Traceback (most recent call last):


    ------------------------------
    Muhammad haris bin javaid
    ------------------------------

    Original Message


  • 21.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Sun October 01, 2023 09:39 AM

    Hi

    I got the key and configure the sls but it shwoing as below 

    and the SLS status 

    NAME   VERSION   STATUS   
    sls    3.8.0     Ready    Initialized   



    ------------------------------
    Muhammad haris bin javaid
    ------------------------------

    Original Message


  • 22.  RE: Error in installing MAS8.9 Using ansible palybook

    Posted Wed January 10, 2024 03:05 PM

    I am getting similar error: Not sure how to fix this

    FAILED - RETRYING: [localhost]: Wait for Suite Components to be ready (60s delay) (1 retries left).
    fatal: [localhost]: FAILED! => {"api_found": true, "attempts": 50, "changed": false, "resources": [{"apiVersion": "core.mas.ibm.com/v1", "kind": "Suite", "metadata": {"creationTimestamp": "2024-01-09T01:24:46Z", "finalizers": ["core.mas.ibm.com/finalizer"], "generation": 1, "labels": {"mas.ibm.com/instanceId": "masdemo"}, "managedFields": [{"apiVersion": "core.mas.ibm.com/v1", "fieldsType": "FieldsV1", "fieldsV1": {"f:metadata": {"f:labels": {".": {}, "f:mas.ibm.com/instanceId": {}}}, "f:spec": {".": {}, "f:certManagerNamespace": {}, "f:domain": {}, "f:license": {".": {}, "f:accept": {}}, "f:settings": {".": {}, "f:dataDictionary": {".": {}, "f:catalog": {}}, "f:icr": {".": {}, "f:cp": {}, "f:cpopen": {}}, "f:manualCertMgmt": {}}}}, "manager": "OpenAPI-Generator", "operation": "Update", "time": "2024-01-09T01:24:46Z"}, {"apiVersion": "core.mas.ibm.com/v1", "fieldsType": "FieldsV1", "fieldsV1": {"f:metadata": {"f:finalizers": {".": {}, "v:\"core.mas.ibm.com/finalizer\"": {}}}}, "manager": "ansible-operator", "operation": "Update", "time": "2024-01-09T01:25:04Z"}, {"apiVersion": "core.mas.ibm.com/v1", "fieldsType": "FieldsV1", "fieldsV1": {"f:status": {".": {}, "f:conditions": {}}}, "manager": "ansible-operator", "operation": "Update", "subresource": "status", "time": "2024-01-09T02:05:22Z"}], "name": "masdemo", "namespace": "mas-masdemo-core", "resourceVersion": "59235", "uid": "b9ab69b3-6a39-470e-8897-94d25d516343"}, "spec": {"certManagerNamespace": "", "domain": "masdemo.apps-crc.testing", "license": {"accept": true}, "settings": {"dataDictionary": {"catalog": "ibm-operator-catalog"}, "icr": {"cp": "cp.icr.io/cp", "cpopen": "icr.io/cpopen"}, "manualCertMgmt": false}}, "status": {"conditions": [{"lastTransitionTime": "2024-01-09T01:25:13Z", "message": "No components are currently installed", "reason": "InstallPending", "status": "False", "type": "Ready"}, {"lastTransitionTime": "2024-01-09T01:25:13Z", "message": "", "reason": "", "status": "False", "type": "Successful"}, {"lastTransitionTime": "2024-01-09T02:05:18Z", "message": "Running reconciliation", "reason": "Running", "status": "False", "type": "Running"}, {"ansibleResult": {"changed": 0, "completion": "2024-01-09T02:05:22.736449", "failures": 1, "ok": 16, "skipped": 9}, "lastTransitionTime": "2024-01-09T02:05:22Z", "message": "Failed to apply object: Namespace is required for cert-manager.io/v1.Issuer", "reason": "Failed", "status": "True", "type": "Failure"}]}}]}

    NO MORE HOSTS LEFT *************************************************************



    ------------------------------
    Srinivas Patlolla
    ------------------------------

    Original Message


Related Content