Global Storage

Global Storage Forum

Connect, collaborate, and stay informed with insights from across Storage

 View Only
Expand all | Collapse all

How much LUN is required for an IBMi partition?

  • 1.  How much LUN is required for an IBMi partition?

    Posted Fri January 19, 2024 04:37 PM

    I have a FS7300 attaching to an IBMi lpar. A total of 100TB will be assigned to that LPAR. How much LUN should I create?

    From redbooks, it mentioned "You should not define LUNs larger than about 200 GB" for IBMi.

    A rough calculation, a total of 500 LUNs will be present at IBMi lpar. This 500 figures seems alot, is this calculation is correct? Is there any guideline?



    ------------------------------
    wong ck
    ------------------------------


  • 2.  RE: How much LUN is required for an IBMi partition?

    Posted Mon January 22, 2024 01:19 AM
    Edited by Satid Singkorapoom Mon January 22, 2024 01:28 AM

    Dear Wong

    In my long experience with IBM i disk performance, there is no hard and fast rule for an answer but the general principle is that IBM i likes many disk units/LUNs.  More units are needed for spinning disk case than SSD case.  LUN size does not matter much for IBM i.

    I agree that 500 LUNs can be overkill but if this can be done without much hassle on the part of whoever will do the set up of all the config involved, it can be fine. Otherwise, you can reduce down to around 100 LUNS or so. 

    How many CPU cores are allocated to IBM i LPAR?  I would suggest some 15 disk units/LUNs per Power10 core for SSD case for a case of heavy workload and your case may exceed this by a lot already. 

    By the way, which IBM redbook did you refer to?  I guess its quite an old one because IBM i also has spinning disk units larger than 200GB (even TB-size one) for many years already before the arrival of SSD. 



    ------------------------------
    Chance favors only the prepared mind.
    -- Louis Pasteur
    ------------------------------
    Satid S.
    ------------------------------



  • 3.  RE: How much LUN is required for an IBMi partition?

    Posted Mon January 22, 2024 05:41 AM

    Dear Satid and Martin,

    Very grateful on the valuable feedbacks.

    Are my assumptions correct if an IBMi lpar running on an external storage with full of NVMe disks.
    1. We should care total of LUNs to create instead the size of the LUN.
    2. IOPs is leverages on the storage instead of server. Server mainly control the bandwidth of FC cards.

    Does the rule of thumb still the same if the IBMi machine running multiple LPARs?

    I was reading below Redbooks.
    Performance and Best Practices Guide for IBM Storage FlashSystem and IBM SAN Volume Controller
    Updated for IBM Storage Virtualize Version 8.6 - 2023

    Defining LUNs for IBM i



    ------------------------------
    wong ck
    ------------------------------



  • 4.  RE: How much LUN is required for an IBMi partition?

    Posted Tue January 23, 2024 01:43 AM
    Edited by Satid Singkorapoom Tue January 23, 2024 02:24 AM

    Dear Wong

    >>>> Are my assumptions correct if an IBMi lpar running on an external storage with full of NVMe disks.
    1. We should care total of LUNs to create instead the size of the LUN.
    2. IOPs is leverages on the storage instead of server. Server mainly control the bandwidth of FC cards.<<<<

    Peak IOPS is also determined by the total number of disk units IBM i has because it determine the number of disk IO queues IBM i has.  Too few and it serves as peak IOPS bottleneck.  Too many and it can overwhelm the backend disk HW if IBM i happens to have extra huge disk IO workload (but this is rare in my experience).   Bandwidth is also determined by how you share fibre cards if you happen to have very many LPARs.   

    >>>> Does the rule of thumb still the same if the IBMi machine running multiple LPARs? <<<<

    What I mentioned in my post applies to EACH IBM i LPAR.   I forgot to mention that I also assume you use either NPIV or fully allocated fibre card(s) to connect IBM i LPAR to FS7K.  Please also notice that IBM FS SAN server family uses 4 multipaths, rather than 2, to connect to each IBM i LPAR.



    ------------------------------
    Chance favors only the prepared mind.
    -- Louis Pasteur
    ------------------------------
    Satid S.
    ------------------------------



  • 5.  RE: How much LUN is required for an IBMi partition?

    Posted Wed January 24, 2024 08:08 AM

    I'm a little confused by "Does the rule of thumb still the same if the IBMi machine running multiple LPARs?"

    I'm not being petty on semantics but there is no such thing as an "IBM i machine".  It would be a Power system running multiple LPARs of IBM i.  The reason I'm saying that this is not just semantics is that I want to be sure that you are not planning on having all these luns go to one lpar of IBM i and then hosting the other partitions of IBM i off of that lpar.

    For internal disk we did host all the drives from one lpar of IBM i to the other lpars of IBM i (and AIX).  When we went to SAN we eliminated that hosting partition of IBM i.

    Now each lpar of IBM i has their own luns (hosted through vios) from the SAN.

    I did pull down that redbook.  I found the section you mentioned.  I think you have a rather unique scenario and I wonder what the authors would do if it was presented.  100TB is quite large.  The redbook mentions "...and up to a few hundreds for large partitions."  If you take 150GB luns, which only appear as 143GB drives on the lpar of IBM i, and divide 100TB by 143GB you get 699 luns.  Let's just say 700.  I think that qualifies as more than "a few hundreds".

    That 100TB, was that just for one lpar of IBM i, or was it for all lpars of IBM i?  Big difference.



    ------------------------------
    Robert Berendt IBMChampion
    ------------------------------



  • 6.  RE: How much LUN is required for an IBMi partition?

    Posted Thu January 25, 2024 08:36 PM

    Yes it is 100TB for a single LPAR of IBM i. If using internal disks which is not achievable for this kind of size. The only option is to use external storage.

    I did a run test on different total of LUNs, the more LUNs the better performance on bandwidths and IOPs.



    ------------------------------
    wong ck
    ------------------------------



  • 7.  RE: How much LUN is required for an IBMi partition?

    Posted Mon January 22, 2024 02:30 AM

    Dear Wong ck

    There are two points of view with Storage.

    First from a storage Point of view : There you should have at leaste so many LUNs, as the Controller has Cores. A FS7300 has two nodes with 2x 10Core CPU, so you should have 40+ LUNs defined on the storage.

    Second the Host : IBM i has a limited Queue depth per storage device and the performance is getting better with more Drives/LUNs, because mor data can be written to the queues. As of the time using HDDs a 300GB HDD with 15k was often used bevore the SSDs come familiar.

    That´s theory : without any performance infos from the existing machine it is hard to give an advice. Have a look at the date, when your redbook was published. Things will change and i think that 500 LUNs will be too much, but it depends on the workload. 100TB of IBM i Storage is also very high.



    ------------------------------
    Martin Haussmann
    SE
    TD SYNNEX
    ------------------------------



  • 8.  RE: How much LUN is required for an IBMi partition?

    Posted Mon January 22, 2024 07:30 AM

    A FS7300 with NVMe was our first SAN for our Power systems.  Now we have two Power 10s on this FS7300.  Prior to this we had two Power 9's, both with their own internal SSD drives.  SAN was all set up by our BP.

    9105-42A
    IBM i - 1: 11.4GB, 80 150GB luns
    IBM i - 2: 8.3TB, 58 150GB luns
    IBM i - 3: 2.6TB, 18 150GB luns
    IBM 1 - 4: 576GB, 4 150GB luns
    AIX lpar: 10 150GB luns, 1 200GB lun
     
    9105-41A
    IBM i - 1: 572GB 4 150GB luns
    IBM i - 2: 2.6TB, 18 150GB luns
    IBM i - 3: 2.3TB, 16 150GB luns
    ibm i - 4: 7.4TB, 52 150GB luns


    ------------------------------
    Robert Berendt IBMChampion
    ------------------------------



  • 9.  RE: How much LUN is required for an IBMi partition?

    Posted Mon January 22, 2024 07:32 AM

    BTW, this is how a 150GB LUN looks like on the IBM i:

                   Size
    Unit  Type      (G)
       1  2145      143

    ...



    ------------------------------
    Robert Berendt IBMChampion
    ------------------------------



  • 10.  RE: How much LUN is required for an IBMi partition?

    Posted Mon January 22, 2024 02:50 PM

    Hi Wong,

    It's really depends how you provide luns to IBM i lpar. Check these links :

    https://www.ibm.com/support/pages/ibm-i-functional-enhancements-details

    https://www.ibm.com/docs/en/i/7.5?topic=capacities-miscellaneous-limits



    ------------------------------
    Jacek Bednarek
    ------------------------------