Power

 View Only
Expand all | Collapse all

Power 10 NVMe and V7R3.

  • 1.  Power 10 NVMe and V7R3.

    Posted Wed May 31, 2023 09:57 AM

    When trying to bring up the Power 10 on NVMe using IBM i V7R3 Rev R.
    Work with Disk Units
                                Work with Disk Units                             
                                                                                 
     Select one of the following:                                                
                                                                                 
          1. Save load source disk unit data                                     
          2. Copy load source disk unit data                                     
          3. Display/change page data                                            
          4. Analyze disk unit surface                                           
          5. Initialize and format disk unit                                     
          6. Reclaim IOA cache storage                                           
          7. Stop device parity protection                                       
          8. Update system vital product data                                    
          9. Start device parity protection - RAID 5                             
         10. Start device parity protection - RAID 6                             
         11. Start device parity protection - RAID 5 with hot spare              
         12. Start device parity protection - RAID 6 with hot spare              
         13. Start device parity protection - RAID 10                            
         14. Start device parity protection - RAID 10 with hot spare             
         15. Create unprotected logical devices - RAID 0                         
     Selection                                                                   
             

    There is no selection for work with NVMe that appears on V7R4 Rev J and V7R5 Rev C. How do you install V7R3 TR13 onto a system with NVMe?
                                                                       
                                                                                 



    ------------------------------
    Dave Chizek
    ------------------------------


  • 2.  RE: Power 10 NVMe and V7R3.

    Posted Thu June 01, 2023 01:41 AM
    Edited by Edward Camilleri Thu June 01, 2023 01:48 AM

    Hi Dave

    You need to work with macros to manage NVMe disks with v7r3 (from Advanced Analysis), and I don't think its going to be easy to boot v7r3 direct from NVMe.

    please refer to below documentation:

    Managing NVMe - IBM Documentation

    Once you create the disks on the NVMe with the macros then you can use these disks in the traditional way.

    If you can upgrade source installation to v7r4 before you migrate to new system it will make your life easier.

    We had a similar problem. In our case we could not migrate the old hardware to v7r4, so we migrated v7r3 to normall SSDs on the new hardware, then migrated from SSDs to NVMe by moving the ASPs

    Regards

    Edward



    ------------------------------
    Edward Camilleri
    ------------------------------



  • 3.  RE: Power 10 NVMe and V7R3.

    Posted Thu June 01, 2023 02:37 AM

    Dear Dave

    This IBM Technote also provides a bit more information on manually handling NVMe in IBM i 7.3 TR12 and above (in topic 1x) :  Creating NVMe namespaces and adding them to an ASP at  https://www.ibm.com/support/pages/creating-nvme-namespaces-and-adding-them-asp  



    ------------------------------
    Education is not the learning of facts but the training of the mind to think. -- Albert Einstein.
    ------------------------------
    Satid S.
    ------------------------------



  • 4.  RE: Power 10 NVMe and V7R3.

    Posted Thu June 01, 2023 07:18 AM

    What is this iVirtualization they are talking about here?  https://www.ibm.com/support/pages/ibm-i-io-support-summary



    ------------------------------
    Robert Berendt IBMChampion
    ------------------------------



  • 5.  RE: Power 10 NVMe and V7R3.

    Posted Thu June 01, 2023 07:22 AM

    Oh, based on the following https://www.ibm.com/support/pages/node/1135420?mhsrc=ibmsearch_a&mhq=what%20is%20iVirtualization is the previous website at https://www.ibm.com/support/pages/ibm-i-io-support-summary saying that 7.3 only supports this NVMe as a guest partition with the disk hosted by an lpar of IBM i at a higher release?



    ------------------------------
    Robert Berendt IBMChampion
    ------------------------------



  • 6.  RE: Power 10 NVMe and V7R3.

    Posted Thu June 01, 2023 08:52 AM

    Robert, V7R3 is supported natively with macros

    https://www.ibm.com/docs/en/i/7.4?topic=nvme-create-nvm-namespaces



    ------------------------------
    Dave Chizek
    ------------------------------



  • 7.  RE: Power 10 NVMe and V7R3.

    Posted Thu June 01, 2023 09:10 AM

    What I find interesting is that you found that in a 7.4 link but if I click on "Change Version" and try to find it in 7.3 I get the following:

    Warning

    We didn't find a matching topic in the product version you requested. Would you like to go to the 7.3 homepage?


    ------------------------------
    Robert Berendt IBMChampion
    ------------------------------



  • 8.  RE: Power 10 NVMe and V7R3.

    Posted Thu June 01, 2023 09:33 AM
    Edited by Edward Camilleri Thu June 01, 2023 09:34 AM

    I think because v7r3 did not have native support for NVMe - it was added later via macros. Therefore same article is not available in v7r3.

    The proper documentatoin for v7r3 is below:

    Managing NVMe - IBM Documentation



    ------------------------------
    Edward Camilleri
    ------------------------------



  • 9.  RE: Power 10 NVMe and V7R3.

    Posted Thu February 22, 2024 10:33 AM

    I can absolutely concur with Edward as I just had a customer hit this last month. It IS supported with R, it is NOT in the menu and it does require the macros do see/find/use them. It was an actual situation that IBM support was very helpful on and new about it right away. We should've bit the bullet and called them sooner.



    ------------------------------
    Shawn Bodily
    PowerHAguy on Youtube and Twitter
    ------------------------------



  • 10.  RE: Power 10 NVMe and V7R3.

    Posted Thu February 22, 2024 11:01 AM
    Edited by Virgile VATIN Thu February 22, 2024 11:02 AM

    Hi,Shawn

    In my case, the installation of V7R3 with TR13 or R on nvme device was a success only after upgrade the firmware of the Power s1022s. but IBM doesn't give any prerequis on firmware level. without this update, in my situation i was only able to play with macro in sst tool, display, create, remove namespace but when i start installing microcode, disk was not find...

    Best Regard



    ------------------------------
    Virgile VATIN
    ------------------------------



  • 11.  RE: Power 10 NVMe and V7R3.

    Posted Mon February 19, 2024 08:49 AM

    Hi Dave,

    I'ill try to install V7R3 with Lastest I_BASE (TR13 version).  i can play with NVMe NS ins sst tools but unable to continue with installing Microde. Installation failed to detect disk.

    I don't find any tips, and on IBM site, version of I_BASE seem to support natively nvme (no iVirt rerence) feature code are #ES3E.?

    #ES3E - Enterprise 3.2 TB SSD PCIe4 NVMe U.2 module for IBM i adds dedicated support for IBM i 7.3 Native, iVirt (see also May 2022) Base Tech Refresh 6 Tech Refresh 12 (see also May 2022)
    IBM i Licensed Internal Code 7.3.0 410 13

     OPT Unit  ASP Number          Type Model Name        Status        
                   Y8LTJJEWCWZW    6B7D  205  DD001       Non-configured
                   YYU38QRNW2YJ    6B7D  205  DD002       Non-configured

    when lauching microcode installation there is an error " no unit can be choose for ipl source".

    Any Idea, does V7R3 only work on nvme with ivirt ?

    Regards 



    ------------------------------
    Virgile VATIN
    ------------------------------



  • 12.  RE: Power 10 NVMe and V7R3.

    Posted Mon February 19, 2024 04:08 PM

    Virgile, here is the link to creating name spaces for nvme drives in V7R3

    Create namespaces on the NVMe device - IBM Documentation



    ------------------------------
    Dave Chizek
    ------------------------------



  • 13.  RE: Power 10 NVMe and V7R3.

    Posted Tue February 20, 2024 04:25 AM

    HI Dave,

    Thank you, Creating namespace is not a problem, only start microcode installation....

    Regard



    ------------------------------
    Virgile VATIN
    ------------------------------



  • 14.  RE: Power 10 NVMe and V7R3.

    Posted Mon February 19, 2024 08:33 PM
    Edited by Satid Singkorapoom Mon February 19, 2024 08:45 PM

    Dear Virgile

    I just found here  https://www.ibm.com/support/pages/ibm-i-io-support-details that ES3E is supported for IBM i 7.3 TR12 ONLY in POWER10 server.  For POWER9 server with ES3E, you must use IBM i 7.4 TR6  + PTF MF69931 or later.  

    By the way, what is "iVirt" ? 



    ------------------------------
    Chance favors only the prepared mind.
    -- Louis Pasteur
    ------------------------------
    Satid S.
    ------------------------------



  • 15.  RE: Power 10 NVMe and V7R3.

    Posted Tue February 20, 2024 04:17 AM
    Edited by Virgile VATIN Tue February 20, 2024 04:28 AM

    Hi Satid, 

    From your link and this link IBM i I/O Support Summary post by Robert, V7R3 seems to be support natively at V7R3 TR12. I use V7R3 TR13 to configure namespace. At this point no problem to display nvme device, display, create, delete, nvme namaespace.

    But When i try to install Microcode from the same I_BASE DVD-ROM, disk are not detected... Don't know what to do after and don't have extended support for V7R3 to open a ticket at IBM support.

    For iVirt, I found the term on the second link, after a search i conclude (may be it's not that) that iVirt stand for IBM i virtualisation when  IBM i is serving I/O (like Vios) to a client IBM i, AIX, or Linux partition. 

    I use this option to install V7R3 (client) with V7R5 host. 

    Regards

    Just read again your post Satid, When you say TR12 ONLY, does it mean that TR13 doesn't work ?



    ------------------------------
    Virgile VATIN
    ------------------------------



  • 16.  RE: Power 10 NVMe and V7R3.

    Posted Tue February 20, 2024 04:52 AM

    Dear Virgile

    IBM i 7.3 TR13 should be fine. How did you identify if NVMe is actually ES3E ? 



    ------------------------------
    Chance favors only the prepared mind.
    -- Louis Pasteur
    ------------------------------
    Satid S.
    ------------------------------



  • 17.  RE: Power 10 NVMe and V7R3.

    Posted Tue February 20, 2024 05:10 AM
    Edited by Virgile VATIN Tue February 20, 2024 05:12 AM

    Hi, 

    HMC return code ES3E from detail part, confirm by Packing List document send with the server,

    Power 10 is a S1022s don't find any problem for the compatibility with this type of Power. A bug with the TR13 ?

    BR



    ------------------------------
    Virgile VATIN
    ------------------------------



  • 18.  RE: Power 10 NVMe and V7R3.

    Posted Wed February 21, 2024 01:11 AM

    Dear Virgile

    What about the level of firmware of S1022?  Is it at the latest level? If not, it may be worth upgrading it and perhaps try recreating the name spaces again.



    ------------------------------
    Chance favors only the prepared mind.
    -- Louis Pasteur
    ------------------------------
    Satid S.
    ------------------------------



  • 19.  RE: Power 10 NVMe and V7R3.

    Posted Wed February 21, 2024 04:25 AM
    Edited by Virgile VATIN Wed February 21, 2024 10:25 AM

    Edit : Work 

    Hi Satid,

    Your idea  was good Update Firmware from ML1030_065_026 / FW1030.30 to ML1050_052_052 / FW1050.00 solved my problem.

    Thank you

    HI Satid, 

    Level of Firmware isn't the most recent, It's ML1030_065_026 / FW1030.30, but if i look at I/O support, this firmware release was launch after V7R3 level TR12.

    I will update it, and give a last chance...

    BR



    ------------------------------
    Virgile VATIN
    ------------------------------



  • 20.  RE: Power 10 NVMe and V7R3.

    Posted Thu February 22, 2024 07:45 AM

    Thank you for the follow up.



    ------------------------------
    Robert Berendt IBMChampion
    ------------------------------



  • 21.  RE: Power 10 NVMe and V7R3.

    Posted Mon July 29, 2024 06:19 PM

    I made sure to update my P8 7.3 system to TR12 + SI80671 for P10 hardware support.  Ready to migrate to a new S1014.
    The P10 came with recent firmware: ML1050_059 and 7.4 preloaded.
    Booting with 7.3 USB stick didn't work.
    Booting with 7.4 USB stick worked but didn't allow restore of the earlier 7.3 LIC on the tape.
    Turns out I should have checked here:
    IBM i I/O Support Summary

    Because the P10 came with ES1K NVMe drives that are NOT supported on 7.3.

    Had to go back and upgrade the P8 to 7.4.  Then I could restore to the P10 with ES1Ks.  Luckily, I had all weekend for migration, and the P10 with NVMe is nice and fast compared to the P8.  When doing upgrades and PTFs, you don't have time for a nap or a meal. Just enough time for a cuppa ;-D



    ------------------------------
    Admin Service
    Systems Engineers
    Truis
    Seventeen Mile Rocks
    +61 7 3710 5055
    ------------------------------



  • 22.  RE: Power 10 NVMe and V7R3.

    Posted Tue July 30, 2024 07:55 AM

    Reminds me of a Power 6 we wanted to upgrade one level of IBM i.  Yes that level did support Power 6, however we would have had to replace every card, drive and expansion unit.  That's when we went to Power 8.  That Power 6 had a bunch of stuff carried over from earlier generations.



    ------------------------------
    Robert Berendt IBMChampion
    ------------------------------



  • 23.  RE: Power 10 NVMe and V7R3.

    Posted Wed July 31, 2024 02:13 AM

    Hi Colleagues,

    It is good to know that after updating the firmware on Power-10, you were able to IPL the LPAR with the Last Good Save of the (V7R3) backup, install the LIC, and restore the Entire System Backup (ESB). I was struggling with the same situation for over a week but couldn't find a way out.

    Thanks to everyone who participated in resolving this issue.

    Regards,

    Nadeem



    ------------------------------
    Nadeem Ahmed Farooqui
    ------------------------------