PowerVC

 View Only
  • 1.  PowerVC upgrade 2.0.2.1 to 2.0.3 failed: "Unable to start service mariadb"

    Posted Thu August 25, 2022 11:23 AM

    I am updating  PowerVC from 2.0.2.1 to 2.0.3, but encountered some issues.:
    (LPAR RHEL 8.5 on Power9)

     - opsmgr update : ok  
         2022-08-25T12:01:26.68+02:00 [INFO]:[VALIDATION] BASE DIRECTORY : /opt/ibm/powervc-opsmgr
           2022-08-25T12:01:26.68+02:00 [INFO]:[VALIDATION] INSTALL SCRIPT : /powervc/powervc-opsmgr-2.0.3/update_opsmgr.sh
           2022-08-25T12:01:26.69+02:00 [INFO]:[VALIDATION] LOG FILE : /opt/ibm/powervc-opsmgr/log/prep_node/prep_node_update_2022-08-25-1159.log
           2022-08-25T12:01:26.70+02:00 [INFO]:[VALIDATION] OPERATING SYSTEM: Red Hat Enterprise Linux.
           2022-08-25T12:01:26.70+02:00 [INFO]:[VALIDATION] RHEL_VERSION : 85
           2022-08-25T12:01:26.71+02:00 [INFO]:[VALIDATION] User ID : root
           2022-08-25T12:01:26.71+02:00 [INFO]:[INSTALL_ANSIBLE] Ansible already installed.
           2022-08-25T12:01:27.13+02:00 [INFO]:[INSTALL_ANSIBLE] ANSIBLE_VERSION_INSTALLED: 2.9.27.
           2022-08-25T12:01:53.30+02:00 [INFO]:[INSTALL_POWERVC_OPSMGR] POWERVC OPSMGR PACKAGES : sshpass python3-netaddr rsync python3-oslo-i18n python3-powervc-opsmgr powervc opsmgr
           2022-08-25T12:02:08.15+02:00 [INFO]:[INSTALL_POWERVC_OPSMGR] PowerVC Opsmgr packages installed successfully.


    -  But  PowerVC upgrade fails:
    FAILED - RETRYING: restart galera (1 retries left).
    fatal: [****]: FAILED! => {"attempts": 18, "changed": false, "msg": "Unable to start service mariadb: Job for mariadb.service failed because the control process exited with error code.\nSee \"systemctl status mariadb.service\" and \"journalctl -xe\" for details.\n"}

    RUNNING HANDLER [pvc_galera_new : restart galera] ******************************
    fatal: [****]: FAILED! => {"attempts": 18, "changed": false, "msg": "Unable to start service mariadb: Job for mariadb.service failed because the control process exited with error code.\nSee \"systemctl status mariadb.service\" and \"journalctl -xe\" for details.\n"}

    NO MORE HOSTS LEFT *************************************************************
    *** : ok=421 changed=148 unreachable=0 failed=1 skipped=288 rescued=0 ignored=0

    PLAY RECAP *********************************************************************
    *** : ok=421 changed=148 unreachable=0 failed=1 skipped=288 rescued=0 ignored=0

    Thursday 25 August 2022 12:22:09 +0200 (0:01:40.325) 0:16:00.202 *******
    ===============================================================================
    pvc_galera_new : restart galera --------------------------------------- 100.33s
    pvc_update : Update only the IBM rpms that are previously installed ---- 92.39s
    pvc_galera_new : Installing mariadb and galera packages ---------------- 70.90s
    pvc_update : Update all the dependency packages ------------------------ 49.94s
    pvc_ansible : Install Java package ------------------------------------- 39.63s
    {{ pvc_backup_task_names.copy_files_to_backup_folder }} ---------------- 34.06s
    {{ pvc_backup_task_names.create_file_path_in_backup }} ----------------- 29.66s
    pvc_update : Restart cinder api ---------------------------------------- 27.38s
    pvc_gnocchi : Installing Packages for ceilometer ----------------------- 25.24s
    {{ pvc_ansible_task_names.unarchive_tar_images_in_remote_node }} ------- 24.92s
    pvc_pacemaker : Configure Pacemaker resources -------------------------- 24.48s
    pvc_update : Restart nova api ------------------------------------------ 20.80s
    pvc_utils : Make sure ssl modules preset ------------------------------- 17.08s
    {{ pvc_mongodb_task_names.install_mongodb_package }} ------------------- 14.64s
    pvc_haproxy : Install Haproxy packages --------------------------------- 13.34s
    pvc_cinder : install cinder packages ----------------------------------- 12.87s
    pvc_update : Update zookeeper package ---------------------------------- 12.86s
    pvc_nova : installing powervc_nova and openstack nova packages --------- 12.78s
    pvc_glance : Installing Packages for glance ---------------------------- 12.51s
    {{ pvc_bootstrap_keystone_task_names.install_keystone_packages }} ------ 11.22s
    IBM PowerVC update failed at 2022-08-25 12:22:09.
    Refer to
    /opt/ibm/powervc-opsmgr/ansible/artifacts/powervc-opsmgr_***1_update_20220825_120608/stdout for more details.
    [root@****1 powervc-opsmgr-2.0.3]#




    Regards 



    ------------------------------
    Christophe DELAPORTE
    ------------------------------


  • 2.  RE: PowerVC upgrade 2.0.2.1 to 2.0.3 failed: "Unable to start service mariadb"

    IBM Champion
    Posted Thu August 25, 2022 03:57 PM
    Hi Christophe!

    Are you running PowerVC on single node server? 
    If yes, Check interim fix: 2.0.3-PowerVC-RHEL-SLES-NOARCH-APAR-IT41045  
    from Fix central, that should help; I had the same error on summer.

    This OpsManager iFix addresses the following issues:

    IT41045 - Single node update from 2.0.2.1 to 2.0.3 fails with MariaDB error.
    - During 2.0.2.1 to 2.0.3 backup restore operation, nova.conf file is not updated.

    Br,
    tommi

    ------------------------------
    Tommi Sihvo, Lead Service Architect
    Tietoevry, Compute Services
    email tommi.sihvo@tietoevry.com mobile +358 (0)40 5180 Finland
    ------------------------------



  • 3.  RE: PowerVC upgrade 2.0.2.1 to 2.0.3 failed: "Unable to start service mariadb"

    Posted Fri August 26, 2022 08:46 AM
    Hi Tommi,

    Yes: only one single node server for the moment.
    I'm going to try.

    Thanks for the information.

    Regards.
    Christophe


    ------------------------------
    Christophe DELAPORTE
    ------------------------------



  • 4.  RE: PowerVC upgrade 2.0.2.1 to 2.0.3 failed: "Unable to start service mariadb"

    Posted Fri August 26, 2022 12:01 PM
    Hi,   

    IT41045 solved this technical issue (mariaDB), but it was not enough:  I have another problem:

    Friday 26 August 2022 17:16:57 +0200 (0:00:00.254) 0:05:49.655 *********
    fatal: [***]: FAILED! => {"changed": false, "msg": "Failed !!!,PowerVC tar images doesn't exists in primary/Bootstrap Host (***)."}

    TASK [{{ pvc_ansible_task_names.validate_powervc_tar_image_exists }}] **********
    fatal: [***]: FAILED! => {"changed": false, "msg": "Failed !!!,PowerVC tar images doesn't exists in primary/Bootstrap Host (***)."}


    An idea ? 

    Regards,
    Christophe


    ------------------------------
    Christophe DELAPORTE
    ------------------------------