PowerVM

 View Only
Expand all | Collapse all

How to use VIOS with Nvme disks to virtualize disks for IBM i

  • 1.  How to use VIOS with Nvme disks to virtualize disks for IBM i

    Posted Wed October 02, 2024 11:50 AM

    Hi guys.
    I need to configure a partition IBM i with disks hosted by VIOS using MVMe disks. 
    I found a blog on this community called "NVMe device support in Virtual IO Server (VIOS)" posted 2020 by NINAD PALSULE, but he wrote only solution about AIX and Linux. 

    I couldn't find in the web any reference about this scenario with IBM i,  and  I need to do a similar configuration to the one described in the blog, but using the IBM i partition.
     
    Can anyone help with this question by providing some documentation or experience? 

    Thanks 

    Reinaldo



    ------------------------------
    Reinaldo Santos
    Support Engineering
    AS Tecnologia e Serviços
    Sao Paulo
    ------------------------------


  • 2.  RE: How to use VIOS with Nvme disks to virtualize disks for IBM i

    Posted Thu October 03, 2024 04:37 AM

    Hi,

    The solution will really be the same for IBMi.  Create LVs in the VIOs (I'm assuming dual VIOs) to use as VSCSI backing devices and present to the LPAR, mirror within the LPAR (IBMi level) across the VIOs for redundancy.

    Phill.



    ------------------------------
    Phill Rowbottom
    ------------------------------



  • 3.  RE: How to use VIOS with Nvme disks to virtualize disks for IBM i

    Posted Thu October 03, 2024 05:48 AM

    Dear Reinaldo

    What you asked for has very little to do, if at all, with IBM i.   The basic action steps you take in VIOS in creating all vSCSI adapter and disk units from the NVM owned by VIOS are the same regardless of what OS run in the client LPAR of that VIOS.   When you create vSCSI server adapter in VIOS, be sure to note down its Adapter ID number that you assign to it - to be later associated with vSCSI client adapter you create in IBM i LPAR definition.   When you create the IBM i client LPAR definition, add vSCSI client adapter to it and specify the name of target VIOS host LPAR and its associated  vSCSI server adapter ID number you note down previously.  Then you put Load Source Unit tagging to the vSCSI client adapter of IBM i LPAR.   After you finish preparing your IBM i install image files, start IBM i LPAR and follow standard action steps for installing IBM i.  



    ------------------------------
    Satid S
    ------------------------------



  • 4.  RE: How to use VIOS with Nvme disks to virtualize disks for IBM i

    Posted Thu October 03, 2024 05:54 AM
      |   view attached

    For configuring and tagging vSCSI client adapter in IBM i client LPAR, look at page 33-36 and 48-49 of the attached presentation for an idea. Keep in mind the GUI look may be different.

     



    ------------------------------
    Satid S
    ------------------------------

    Attachment(s)



  • 5.  RE: How to use VIOS with Nvme disks to virtualize disks for IBM i

    Posted Thu October 03, 2024 08:44 AM
    Edited by Reinaldo Santos Thu October 03, 2024 08:44 AM

    Hi Phill and Satid.

    I understood your answers. Thanks very much guys. 

    I had already done the configuration offering the NVMe disks directly to the IBM i, but never using the VIOS.

    My question comes up with the difference in disk formatting, which in VIOS is the same for AIX and Linux (512-byte sector). In the case of IBM i, it's different, 520-byte sectors.

    And since I have to deliver all the disks to VIOS, I had understood that they would inherit the VIOS formatting when I offered them to IBM i.

    Sorry for overthinking.

    Thanks Satid for the document, it will help a lot.


    ------------------------------
    Reinaldo Santos
    Support Engineering
    AS Tecnologia e Serviços
    Sao Paulo
    ------------------------------



  • 6.  RE: How to use VIOS with Nvme disks to virtualize disks for IBM i

    Posted Thu October 03, 2024 09:10 AM
      |   view attached

    Dear Relnaldo

    >>>> My question comes up with the difference in disk formatting, which in VIOS is the same for AIX and Linux (512-byte sector). In the case of IBM i, it's different, 520-byte sectors.

    And since I have to deliver all the disks to VIOS, I had understood that they would inherit the VIOS formatting when I offered them to IBM i.  Sorry for overthinking.   <<<<

    No worry here. As of IBM i 6.1, it was enhanced with the ability to handle disk units with 512-byte sector.  I attach a past article discussing this enhancement if you want to read some details. 



    ------------------------------
    Satid S
    ------------------------------

    Attachment(s)



  • 7.  RE: How to use VIOS with Nvme disks to virtualize disks for IBM i

    Posted Thu October 03, 2024 09:17 AM

    Hi Reinaldo,

    Unix systems can also access disks in character (raw/no filesystem) mode which is what is happening when using the LV as a backing device to a VSCSI disk.   From  my understanding a VSCSI device is a VSCSI device to the VIOs client, it doesn't matter what type of backing device is behind it, it presents the same to the client, it could be a SAN LUN, Logical Volume, Physical Volume - they all look the same to the client due to what is going on in the VIO/Hypervisor layer. 

    Disclaimer - I'm not an IBMi guy, but we do run IBMi on the same hardware as AIX & Linux where I work with full virtualisation.

    Phill.



    ------------------------------
    Phill Rowbottom
    ------------------------------



  • 8.  RE: How to use VIOS with Nvme disks to virtualize disks for IBM i

    Posted Thu October 03, 2024 08:50 AM

    Hi Reinaldo 

    Short hint: You need to use filebacked storage for that :) 

    Kind regards 



    ------------------------------
    Jan Henrik Radl
    ------------------------------



  • 9.  RE: How to use VIOS with Nvme disks to virtualize disks for IBM i

    Posted Thu October 03, 2024 08:50 AM

    Hi

    For that I use file backed storage locally on the vios server. 

    Kind regards 



    ------------------------------
    Jan Henrik Radl
    ------------------------------



  • 10.  RE: How to use VIOS with Nvme disks to virtualize disks for IBM i

    Posted Thu October 03, 2024 01:58 PM

    Thanks folks.

    The information you've given me is important for eliminating my doubts. I hope to have the environment described here available to configure in no more than 10 days and I'll post the results here.



    ------------------------------
    Reinaldo Santos
    Support Engineering
    AS Tecnologia e Serviços
    Sao Paulo
    ------------------------------