PowerVM

 View Only

  • 1.  VIOS traffic on 10GbE RoCE card?

    Posted Wed May 15, 2024 05:19 AM

    Does anyone know if one port on an EC72-PCIe4 2-port 25/10/1 GbE RoCE SFP28 Adapter can be used by the VIOS itself?  I mean for my ordinary admin traffic as an administrator.  Does it have support for this ethernet card?

    I know it is a waste of resources, but it is only 5 PCI slots in a one socket POWER10 S1024.  I need 3 FC adapters so I have only 2 slots available for ethernet adapters (with 2 VIO servers). 

    The ethernet traffic from the IBM i partitions needs one 10Gb SFP port, so I have one free Ethernet port on this adapter.  I know there is an EN0W-PCIe2 2-port 10/1GbE adapter available, but it is PCIe2 with RJ45 not FC.



    ------------------------------
    Helle Koppang
    ------------------------------


  • 2.  RE: VIOS traffic on 10GbE RoCE card?
    Best Answer

    Posted Thu May 16, 2024 04:50 AM

    Yes you can use this card with VIOS.

     

    See

     

    https://www.ibm.com/docs/en/announcements/power-s1024-9105-42a

     

    Searching for EC72

     

    Note: Assignment to the VIOS requires:

    • VIOS 3.1.4.30, or later
    • VIOS 4.1.0.10, or later

     


    i. A.  Harald Stürner I Senior Consultant 

    PROFI Engineering Systems AG I Breitwiesenstraße 19 I 70565 Stuttgart

    Tel:      +49 711 72819-7123  
    Mobil:   +49 151 57690974  
    Fax:     +49 711 72819-7120 
    E-Mail:     H.Stuerner@profi-ag.de


    40 Jahre PROFI Logo.png  LinkedIn.jpg   Youtube.jpg   Webseite.jpg


    PR    OFI Engineering Systems AG, Otto-Röhm-Str. 18, 64293 Darmstadt, Amtsgericht Darmstadt HRB 7833.
    Vorstand: Lutz Hohmann (Vors.), Piotr Staczek
    Aufsichtsratsvorsitzender: Dr.-Ing. Udo Hamm.




    Original Message


  • 3.  RE: VIOS traffic on 10GbE RoCE card?

    Posted Fri May 24, 2024 09:41 AM

    Thank you for your answer and the clarification.  I hope you received my first response via email, the reply button didn't work here.



    ------------------------------
    Helle Koppang
    ------------------------------

    Original Message


  • 4.  RE: VIOS traffic on 10GbE RoCE card?

    Posted Thu May 16, 2024 10:27 AM

    EC72 is an SR-IOV card.  You can (and should) put it in SR-IOV mode and share ports between multiple partitions, which not only allows you to split the ports on a card between partitions, but also allows you to share the same port for  multiple partitions.

     

    You can also use vNIC to create a failover configuration between multiple ports that your IBM i lpars will see as a single CMNxx resource.

     

    Sharing a port between VIOS management interfaces and IBM i lpars is a common configuration.

     

    There are some things to consider:

     

    • SR-IOV cards need to reserve server memory to operate, so make sure you get enough memory to allow for that.
    • You cannot run the card in SR-IOV mode with a 1G connection on either port
    • You cannot mix 1G and 10/25G on a single card

     

     

     

    Vincent Greene

    Advisory Delivery Consultant – IBM i

    Technology Expert Labs

     

    IBM

     




    Original Message


  • 5.  RE: VIOS traffic on 10GbE RoCE card?

    Posted Fri May 24, 2024 09:38 AM

    Sorry for my late response and thank you for the clarification.



    ------------------------------
    Helle Koppang
    ------------------------------

    Original Message


  • 6.  RE: VIOS traffic on 10GbE RoCE card?

    Posted Fri May 17, 2024 02:38 AM

    Hi!

    But don't you need one of the PCI slot for the local disks?

    Best regards,

      Alexander



    ------------------------------
    Alexander Reichle-Schmehl
    ------------------------------

    Original Message


  • 7.  RE: VIOS traffic on 10GbE RoCE card?

    Posted Fri May 24, 2024 09:43 AM

    Sorry for my late response. No, we use fiber channel to external storage.



    ------------------------------
    Helle Koppang
    ------------------------------

    Original Message