PowerVM

 View Only
Expand all | Collapse all

iSCSI disk inside VIOS assigned to IBM i client LPAR using vscsi

  • 1.  iSCSI disk inside VIOS assigned to IBM i client LPAR using vscsi

    Posted Wed December 27, 2023 10:50 AM

    Anyone tried or has experience of a scenario like the following?

    Could it work?



    ------------------------------
    Stefano Ricca
    ------------------------------


  • 2.  RE: iSCSI disk inside VIOS assigned to IBM i client LPAR using vscsi

    Posted Thu December 28, 2023 08:21 PM

    Dear Stefano

    I find relevant information from this IBM URL :  iSCSI disk support for VIOS at  https://www.ibm.com/docs/en/power9?topic=overview-iscsi-disk-support-vios but it contains the following statement :

    VIOS version 3.1 enables Multipath I/O (MPIO) support for the iSCSI initiator. With MPIO support, you can configure and create multiple paths to an iSCSI disk, similar to other protocols. The client logical partition can run either an AIX® or Linux® operating system.

    If this information URL is totally accurate, then it implies that your case is NOT supported. 

    This blog post on iSCSI support for PowerVM does not mention IBM i at all either :  https://community.ibm.com/community/user/power/blogs/veena-ganti1/2020/06/23/iscsi-support-on-powervm.   



    ------------------------------
    Chance favors only the prepared mind.
    -- Louis Pasteur
    ------------------------------
    Satid S.
    ------------------------------

    Original Message


  • 3.  RE: iSCSI disk inside VIOS assigned to IBM i client LPAR using vscsi

    Posted Fri December 29, 2023 07:54 AM

    Thank you for your contribution. I am fully aware of the URLs you mention. Also I have submitted a SCORE, but it has been rejected. I didn't find explanation on why this is not supported. Is it a matter of performance or of missing drivers or what? This is the reason why I am asking if anyone has never had experience with this kind of scenario.



    ------------------------------
    Stefano Ricca
    ------------------------------

    Original Message


  • 4.  RE: iSCSI disk inside VIOS assigned to IBM i client LPAR using vscsi

    Posted Mon January 01, 2024 05:06 AM

    Dear Stefano

    IBM i used to support iSCSI hosting in the distant past to be used by MS Windows Server OS (IBM i hosts its virtual disk resource to Windows server as its client). My guess that IBM i does not support your scenario may be because no one develops iSCSI client part for IBM i.   But I also have a guess that you should be able to create  vSCSI disk units over iSCSI hdisk and let IBM i client LPAR use it but this is just an uneducated guess.  If this works (with or without any usage issue), it is likely that IBM does not support it.  In my past professional experience, I knew of a few IBM i customers with adventurous spirits who implemented some functions that were not support by vendors (IBM, SAP, Mocrosoft, etc.) but they work fine.   There was a reason why there were not so many of them, though.



    ------------------------------
    Chance favors only the prepared mind.
    -- Louis Pasteur
    ------------------------------
    Satid S.
    ------------------------------

    Original Message


  • 5.  RE: iSCSI disk inside VIOS assigned to IBM i client LPAR using vscsi

    Posted Tue January 02, 2024 07:42 AM

    Thanks again Satid, yes, in fact, I wonder why it was supported in the past and now that technology and performance evolved it is not.



    ------------------------------
    Stefano Ricca
    ------------------------------

    Original Message


  • 6.  RE: iSCSI disk inside VIOS assigned to IBM i client LPAR using vscsi

    Posted Wed January 03, 2024 12:01 PM

    To be clear, what Satid had described is the opposite of what you are planning on doing.  That was IBM i acting as a storage host to a Windows OS.  Most likely that was to support the embedded Intel on a Power adapter devices (I cannot remember what they were called).  Those where Intel processors on a adapter card that installed in a Power systems slot and connected to the IBM i via the Power system bus.  The idea was that you could run an Intel server with Windows or Linux  and leverage the storage from your IBM i hosting virtual disk.  

    FWIW, I never actually saw one of those used as anything but a glorified ethernet adapter.

    I feel I should also echo what others have said about the performance of the iSCSI solution you are proposing.  In the absence of a dedicated iSCSI specific adapter all of that TCP/IP overhead is going to be handled by the processor in your VIOS.  In addition, your VIOS processor will also need to handle the vSCSI processing.  That means you will not get anywhere near the 25Gb bandwidth you are expecting.  Not just a little less - a LOT less.  Closer to 1G than 25G, and that will be with very high VIOS processor utilization.

    For IBM i performance, that will be catastrophic.  IBM i needs high performance I/O to perform, and you will be giving it something that performs worse than a spinning disk.  Don't forget that you will also be choking its processor as well since you will be using it for VIOS instead.

    Do yourself a favor and get a couple of Fiber Channel cards and justify it by the savings of not having to pay for more Power processors.  



    ------------------------------
    Vincent Greene
    IT Consultant
    Technology Expert labs
    IBM
    Vincent.Greene@ibm.com


    The postings on this site are my own and don't necessarily represent IBM's positions, strategies or opinions.
    ------------------------------

    Original Message


  • 7.  RE: iSCSI disk inside VIOS assigned to IBM i client LPAR using vscsi

    Posted Wed January 03, 2024 08:52 AM
    Edited by José Pina Coelho Thu January 04, 2024 06:30 AM

    In the past, I've had problems with iSCSI (AIX initiatior to Linux target), the case was "rejected" with "AIX initiators are only supported with AIX targets". (Edit:  fixed initiator/target mixup)

    Until IBM decides to support any standards-compliant combination, you're left with SCORE-based implementations.  Talk to your service representative, he's your key to get your SCORE-request re-evaluated (or at least get a reasoned answer).

    Ignoring the "supported" angles, yes, it "should" work, and in my case it did (initially), but you don't want to be the one that proposed a solution that IBM support won't support.

    Note: I'm a firm believer in standards-based work, but we need an equal commitment from *all* our suppliers.



    ------------------------------
    José Pina Coelho
    IT Specialist at Kyndryl
    ------------------------------

    Original Message


  • 8.  RE: iSCSI disk inside VIOS assigned to IBM i client LPAR using vscsi

    Posted Tue January 02, 2024 05:43 AM

    Hi Stefano,

    From my experience "presenting" iSCSI hdisk device from VIOS to IBMi, via vSCSI client works, but I don't recommend it for any real production workload, especially if you will be pushing high IO and expect low response time.
    I have done such a config only for PoC purposes and it works. Keep in mind that if you have any issues with that non-standard configuration for IBMi you will get very hard time getting help from IBM.

    Keep in mind that even though you have 2x 25Gb ETH connectivity, compared to let's say standard 16Gb FC HBA, you will still have better performance using FCP protocol(for IBMi). iSCSI protocol is slower than FCP since it encapsulates the SCSI commands via TCP/IP(Layer 3 network) and it will cause much higher CPU utilization on the VIOS(I assume dual VIOS config). 
    This is of course assuming that the Power server hosting IBMi is in the same DC/infra as the FS5045. If the FS5045 is in different DC then performance will be even worse, but at least you will be able to use the storage over TCP/IP.

    PS

    If you decide to give it a try, be sure to use latest VIOS4.1 that is based on AIX 7.3 and contains all the latest performance features and improvements for iSCSI.

    Regards,
    Tsvetan



    ------------------------------
    Tsvetan Marinov
    ------------------------------

    Original Message


  • 9.  RE: iSCSI disk inside VIOS assigned to IBM i client LPAR using vscsi

    Posted Tue January 02, 2024 07:40 AM

    Thanks Tsvetan, your experience is very precious. The idea is to have a direct connection from 25Gb adapters in the server to the ports of the FS5045. So, no switch in the middle. Surely, I take your suggestion to use the latest version of VIOS for iSCSI improvements. Thanks a lot.



    ------------------------------
    Stefano Ricca
    ------------------------------

    Original Message


  • 10.  RE: iSCSI disk inside VIOS assigned to IBM i client LPAR using vscsi

    Posted Wed January 17, 2024 04:48 AM

    Good information Tsvetan,

    I need to test it as well. I'm very happy about iSCSI support (I think it was part one of the latest TRs). I'm not looking for iSCSI to support heavy production workload, but it can be very attractive to send backups to public Clouds or cloning/deploying IBMi LPARs. 



    ------------------------------
    Bartlomiej Grabowski
    ------------------------------

    Original Message


  • 11.  RE: iSCSI disk inside VIOS assigned to IBM i client LPAR using vscsi

    Posted Wed January 17, 2024 05:24 AM

    Hi Bart,

    This article shows the configuration steps on each VIOS, how to get the iSCSI hdisk devices configured. For good performance ideally large_send and Jumbo frames(MTU=9000) should be enabled. https://www.ibm.com/docs/en/aix/7.2?topic=considerations-iscsi-performance

    https://community.ibm.com/community/user/power/blogs/veena-ganti1/2020/06/23/iscsi-support-on-powervm

    Tsvetan



    ------------------------------
    Tsvetan Marinov
    ------------------------------

    Original Message