IBM TechXchange Storage Scale (GPFS) Global User Group

IBM TechXchange Storage Scale (GPFS)

This User Group is open to all who are using, interested or integrating IBM Storage Scale. We have groups across the world, from the UK to the USA and Asia Pacific.

 View Only
  • 1.  GPFS Volume Disk failure

    Posted Sat February 15, 2025 10:23 PM

    Can someone please help me determine if I can recover my home file system. I apparently have 3 disks that have failed and the volume is not mounting right now. Can you give me some ideas of what I can try to resolve this issue?

    [root@snode1 ~]# mmlsdisk gpfs_home
    disk         driver   sector     failure holds    holds                            storage
    name         type       size       group metadata data  status        availability pool
    ------------ -------- ------ ----------- -------- ----- ------------- ------------ ------------
    gd1_0        nsd         512           1 Yes      Yes   ready         up           system       
    gd1_1        nsd         512           1 Yes      Yes   ready         up           system       
    gd1_2        nsd         512           1 Yes      Yes   ready         up           system       
    gd1_6        nsd         512           1 Yes      Yes   ready         up           system       
    gd1_7        nsd         512           1 Yes      Yes   ready         up           system       
    gd1_8        nsd         512           1 Yes      Yes   ready         up           system       
    gd2_0        nsd         512           2 Yes      Yes   ready         up           system       
    gd2_1        nsd         512           2 Yes      Yes   ready         up           system       
    gd2_2        nsd         512           2 Yes      Yes   ready         up           system       
    gd2_6        nsd         512           2 Yes      Yes   ready         up           system       
    gd2_7        nsd         512           2 Yes      Yes   ready         up           system       
    gd2_8        nsd         512           2 Yes      Yes   ready         up           system       
    gd3_0        nsd         512           3 Yes      Yes   ready         up           system       
    gd3_1        nsd         512           3 Yes      Yes   ready         up           system       
    gd3_2        nsd         512           3 Yes      Yes   ready         up           system       
    gd3_6        nsd         512           3 Yes      Yes   ready         up           system       
    gd3_7        nsd         512           3 Yes      Yes   ready         up           system       
    gd3_8        nsd         512           3 Yes      Yes   ready         up           system       
    gd4_0        nsd         512           4 Yes      Yes   ready         up           system       
    gd4_1        nsd         512           4 Yes      Yes   ready         up           system       
    gd4_2        nsd         512           4 Yes      Yes   ready         up           system       
    gd4_6        nsd         512           4 Yes      Yes   ready         up           system       
    gd4_7        nsd         512           4 Yes      Yes   ready         up           system       
    gd4_8        nsd         512           4 Yes      Yes   ready         up           system       
    gd5_0        nsd         512           5 Yes      Yes   ready         up           system       
    gd5_1        nsd         512           5 Yes      Yes   ready         up           system       
    gd5_2        nsd         512           5 Yes      Yes   ready         down         system       
    gd5_6        nsd         512           5 Yes      Yes   ready         up           system       
    gd5_7        nsd         512           5 Yes      Yes   ready         up           system       
    gd5_8        nsd         512           5 Yes      Yes   ready         up           system       
    gd6_0        nsd         512           6 Yes      Yes   ready         up           system       
    gd6_1        nsd         512           6 Yes      Yes   ready         up           system       
    gd6_2        nsd         512           6 Yes      Yes   ready         down         system       
    gd6_6        nsd         512           6 Yes      Yes   ready         up           system       
    gd6_7        nsd         512           6 Yes      Yes   ready         down         system       
    gd6_8        nsd         512           6 Yes      Yes   ready         up           system   



    ------------------------------
    Joseph Koral
    ------------------------------


  • 2.  RE: GPFS Volume Disk failure

    Posted Sun February 16, 2025 01:48 AM
    Edited by renar grunenberg Sun February 16, 2025 01:49 AM

    Hallo Joseph,

    please Check at First the disk are available with lsblk and multipath -ll. Then make a mmchdisk gpfs_home start -a. Then Test the Fs can be mounted. Check the fs with mmlsdisk before mount. 



    ------------------------------
    renar Grunenberg
    HUK Coburg
    Coburg
    ------------------------------



  • 3.  RE: GPFS Volume Disk failure

    Posted Tue February 18, 2025 02:00 PM

    I think I figured out my issue. There was a bad network card for the iSCSI connections. After running mmchdisk gpfs_home start -a, it showed the progress and reached 100%, but now when I do an mmlsdisk gpfs_home, it just kind of hangs there like the process is still busy doing something. The volume is about 130TBs. Do you think it should just take some time for it to recover still after the mmchdisk? Is there anything I can run to check the status of the process? Or should I just continued to wait? Thank you.



    ------------------------------
    Joseph Koral
    ------------------------------



  • 4.  RE: GPFS Volume Disk failure

    Posted Tue February 18, 2025 02:47 PM

    Hallo Joseph,
    check follows:
    1. Are there waiters available: mmlsnode -N waiters -L
    2. make a mmlsnd -m and check if at Device column are something missing
    3. If point 2 are has - at the device column make a mmnsddiscover -a -N all

    Post the results.



    ------------------------------
    renar grunenberg
    HUK Coburg
    Coburg
    ------------------------------



  • 5.  RE: GPFS Volume Disk failure

    Posted Tue February 18, 2025 02:57 PM

    Hi Renar, it just took a little time and the volume is now mounted again. Thank you so much for your help.



    ------------------------------
    Joseph Koral
    ------------------------------