Hello,

I'm starting this thread for educational purposes and to deepen my understanding of NVMe over Fabrics (NVMeoF) technology in the context of an IBM Power Server setup. The environment includes dual VIOS (Virtual I/O Servers) and AIX client LPARs that consume SAN-based NVMeoF volumes.

My proof of concept (PoC) includes the following setup:

• IBM Power10 Server

• 4 × dual-port 64Gb Fibre Channel (FC) HBAs

• Dual VIOS configuration, each VIOS has 2 × 2-port FC adapters

• For NVMeoF, only 2 FC HBAs are used - one from each VIOS

• CISCO MDS SAN Fabrics
• Pure Storage

PoC Phased Approach:

1. Compatibility Validation
   Verified that the storage system, HBA firmware, multipathing software, and VIOS versions are certified for NVMeoF.

2. Storage Configuration
   On the Pure Storage SAN, specific controller ports are enabled for NVMe-FC. (Note: not all ports are NVMe-enabled - some are still serving SCSI-FC.)

3. AIX Client LPAR Setup
   Created AIX LPAR profiles with vfchost adapters configured on the VIOS to use NVMe.

Zoning and Configuration Questions

At this stage, I need clarity on the correct zoning configuration, particularly:

• The client VFC host adapters have both WWPNs and NQNs.

• The AIX client LPAR itself also has an NQN (viewable via the SMS menu).

Questions:

1. At a high level, which NQN should be used for zoning and storage host definitions - the one from the VFC adapter or the one from the AIX LPAR?

2. For zoning on Cisco MDS:

   • Should I include the primary and secondary WWPNs of the client VFC adapters?

   • How should these be mapped to the NVMe-enabled SAN controller ports?

3. For defining hosts on the storage array:

   • Should I use both the WWPNs (primary/secondary) and their corresponding SAN port mappings for NVMe-FC?

Any guidance on aligning zoning with NVMe-FC best practices in a dual-VIOS, IBM Power environment would be appreciated.

Warm Regards,

Sasi Chand

------------------------------
Sasi Chand
Humble - Engineer
Freelance
Wellington
New Zealand
------------------------------

This is more about looking at the Pure Storage documentation. For zoning use wwpn's, for host definition use nqn's. If you zone the correct wwpn's, your host will be online.

------------------------------
Nezih Boyacioglu

Original Message:
Sent: Fri June 06, 2025 07:14 PM
From: Sasi Chand
Subject: NVMeoF with IBM Power Server – Zoning and Configuration Clarification

Hello,

I'm starting this thread for educational purposes and to deepen my understanding of NVMe over Fabrics (NVMeoF) technology in the context of an IBM Power Server setup. The environment includes dual VIOS (Virtual I/O Servers) and AIX client LPARs that consume SAN-based NVMeoF volumes.

My proof of concept (PoC) includes the following setup:

• IBM Power10 Server

• 4 × dual-port 64Gb Fibre Channel (FC) HBAs

• Dual VIOS configuration, each VIOS has 2 × 2-port FC adapters

• For NVMeoF, only 2 FC HBAs are used - one from each VIOS

• CISCO MDS SAN Fabrics
• Pure Storage

PoC Phased Approach:

1. Compatibility Validation
   Verified that the storage system, HBA firmware, multipathing software, and VIOS versions are certified for NVMeoF.

2. Storage Configuration
   On the Pure Storage SAN, specific controller ports are enabled for NVMe-FC. (Note: not all ports are NVMe-enabled - some are still serving SCSI-FC.)

3. AIX Client LPAR Setup
   Created AIX LPAR profiles with vfchost adapters configured on the VIOS to use NVMe.

Zoning and Configuration Questions

At this stage, I need clarity on the correct zoning configuration, particularly:

• The client VFC host adapters have both WWPNs and NQNs.

• The AIX client LPAR itself also has an NQN (viewable via the SMS menu).

Questions:

1. At a high level, which NQN should be used for zoning and storage host definitions - the one from the VFC adapter or the one from the AIX LPAR?

2. For zoning on Cisco MDS:

   • Should I include the primary and secondary WWPNs of the client VFC adapters?

   • How should these be mapped to the NVMe-enabled SAN controller ports?

3. For defining hosts on the storage array:

   • Should I use both the WWPNs (primary/secondary) and their corresponding SAN port mappings for NVMe-FC?

Any guidance on aligning zoning with NVMe-FC best practices in a dual-VIOS, IBM Power environment would be appreciated.

Warm Regards,

Sasi Chand

------------------------------
Sasi Chand
Humble - Engineer
Freelance
Wellington
New Zealand
------------------------------

Hello,

Works fine.

Any documentation on how this works in terms of redundancy and failover's. That when we take on vio out? I am new to nqn's...

Cheers

Sasi

This is more about looking at the Pure Storage documentation. For zoning use wwpn's, for host definition use nqn's. If you zone the correct wwpn's, your host will be online.

------------------------------
Nezih Boyacioglu

Original Message:
Sent: Fri June 06, 2025 07:14 PM
From: Sasi Chand
Subject: NVMeoF with IBM Power Server – Zoning and Configuration Clarification

Hello,

I'm starting this thread for educational purposes and to deepen my understanding of NVMe over Fabrics (NVMeoF) technology in the context of an IBM Power Server setup. The environment includes dual VIOS (Virtual I/O Servers) and AIX client LPARs that consume SAN-based NVMeoF volumes.

My proof of concept (PoC) includes the following setup:

• IBM Power10 Server

• 4 × dual-port 64Gb Fibre Channel (FC) HBAs

• Dual VIOS configuration, each VIOS has 2 × 2-port FC adapters

• For NVMeoF, only 2 FC HBAs are used - one from each VIOS

• CISCO MDS SAN Fabrics
• Pure Storage

PoC Phased Approach:

1. Compatibility Validation
   Verified that the storage system, HBA firmware, multipathing software, and VIOS versions are certified for NVMeoF.

2. Storage Configuration
   On the Pure Storage SAN, specific controller ports are enabled for NVMe-FC. (Note: not all ports are NVMe-enabled - some are still serving SCSI-FC.)

3. AIX Client LPAR Setup
   Created AIX LPAR profiles with vfchost adapters configured on the VIOS to use NVMe.

Zoning and Configuration Questions

At this stage, I need clarity on the correct zoning configuration, particularly:

• The client VFC host adapters have both WWPNs and NQNs.

• The AIX client LPAR itself also has an NQN (viewable via the SMS menu).

Questions:

1. At a high level, which NQN should be used for zoning and storage host definitions - the one from the VFC adapter or the one from the AIX LPAR?

2. For zoning on Cisco MDS:

   • Should I include the primary and secondary WWPNs of the client VFC adapters?

   • How should these be mapped to the NVMe-enabled SAN controller ports?

3. For defining hosts on the storage array:

   • Should I use both the WWPNs (primary/secondary) and their corresponding SAN port mappings for NVMe-FC?

Any guidance on aligning zoning with NVMe-FC best practices in a dual-VIOS, IBM Power environment would be appreciated.

Warm Regards,

Sasi Chand

------------------------------
Sasi Chand
Humble - Engineer
Freelance
Wellington
New Zealand
------------------------------

Hello,

I'm starting this thread for educational purposes and to deepen my understanding of NVMe over Fabrics (NVMeoF) technology in the context of an IBM Power Server setup. The environment includes dual VIOS (Virtual I/O Servers) and AIX client LPARs that consume SAN-based NVMeoF volumes.

My proof of concept (PoC) includes the following setup:

• IBM Power10 Server

• 4 × dual-port 64Gb Fibre Channel (FC) HBAs

• Dual VIOS configuration, each VIOS has 2 × 2-port FC adapters

• For NVMeoF, only 2 FC HBAs are used - one from each VIOS

• CISCO MDS SAN Fabrics
• Pure Storage

PoC Phased Approach:

1. Compatibility Validation
   Verified that the storage system, HBA firmware, multipathing software, and VIOS versions are certified for NVMeoF.

2. Storage Configuration
   On the Pure Storage SAN, specific controller ports are enabled for NVMe-FC. (Note: not all ports are NVMe-enabled - some are still serving SCSI-FC.)

3. AIX Client LPAR Setup
   Created AIX LPAR profiles with vfchost adapters configured on the VIOS to use NVMe.

Zoning and Configuration Questions

At this stage, I need clarity on the correct zoning configuration, particularly:

• The client VFC host adapters have both WWPNs and NQNs.

• The AIX client LPAR itself also has an NQN (viewable via the SMS menu).

Questions:

1. At a high level, which NQN should be used for zoning and storage host definitions - the one from the VFC adapter or the one from the AIX LPAR?

2. For zoning on Cisco MDS:

   • Should I include the primary and secondary WWPNs of the client VFC adapters?

   • How should these be mapped to the NVMe-enabled SAN controller ports?

3. For defining hosts on the storage array:

   • Should I use both the WWPNs (primary/secondary) and their corresponding SAN port mappings for NVMe-FC?

Any guidance on aligning zoning with NVMe-FC best practices in a dual-VIOS, IBM Power environment would be appreciated.

Warm Regards,

Sasi Chand

I would have though that utilising 2 ports per VIO, one for each fabric, would be a more resilient configuration?  As I haven't used NVMe-FC, is there a limitation with it that precludes 4 ports per LPAR?

Phill.

Hello,

I'm starting this thread for educational purposes and to deepen my understanding of NVMe over Fabrics (NVMeoF) technology in the context of an IBM Power Server setup. The environment includes dual VIOS (Virtual I/O Servers) and AIX client LPARs that consume SAN-based NVMeoF volumes.

My proof of concept (PoC) includes the following setup:

• IBM Power10 Server

• 4 × dual-port 64Gb Fibre Channel (FC) HBAs

• Dual VIOS configuration, each VIOS has 2 × 2-port FC adapters

• For NVMeoF, only 2 FC HBAs are used - one from each VIOS

• CISCO MDS SAN Fabrics
• Pure Storage

PoC Phased Approach:

1. Compatibility Validation
   Verified that the storage system, HBA firmware, multipathing software, and VIOS versions are certified for NVMeoF.

2. Storage Configuration
   On the Pure Storage SAN, specific controller ports are enabled for NVMe-FC. (Note: not all ports are NVMe-enabled - some are still serving SCSI-FC.)

3. AIX Client LPAR Setup
   Created AIX LPAR profiles with vfchost adapters configured on the VIOS to use NVMe.

Zoning and Configuration Questions

At this stage, I need clarity on the correct zoning configuration, particularly:

• The client VFC host adapters have both WWPNs and NQNs.

• The AIX client LPAR itself also has an NQN (viewable via the SMS menu).

Questions:

1. At a high level, which NQN should be used for zoning and storage host definitions - the one from the VFC adapter or the one from the AIX LPAR?

2. For zoning on Cisco MDS:

   • Should I include the primary and secondary WWPNs of the client VFC adapters?

   • How should these be mapped to the NVMe-enabled SAN controller ports?

3. For defining hosts on the storage array:

   • Should I use both the WWPNs (primary/secondary) and their corresponding SAN port mappings for NVMe-FC?

Any guidance on aligning zoning with NVMe-FC best practices in a dual-VIOS, IBM Power environment would be appreciated.

Warm Regards,

Sasi Chand

Hello,

I'm starting this thread for educational purposes and to deepen my understanding of NVMe over Fabrics (NVMeoF) technology in the context of an IBM Power Server setup. The environment includes dual VIOS (Virtual I/O Servers) and AIX client LPARs that consume SAN-based NVMeoF volumes.

My proof of concept (PoC) includes the following setup:

• IBM Power10 Server

• 4 × dual-port 64Gb Fibre Channel (FC) HBAs

• Dual VIOS configuration, each VIOS has 2 × 2-port FC adapters

• For NVMeoF, only 2 FC HBAs are used - one from each VIOS

• CISCO MDS SAN Fabrics
• Pure Storage

PoC Phased Approach:

1. Compatibility Validation
   Verified that the storage system, HBA firmware, multipathing software, and VIOS versions are certified for NVMeoF.

2. Storage Configuration
   On the Pure Storage SAN, specific controller ports are enabled for NVMe-FC. (Note: not all ports are NVMe-enabled - some are still serving SCSI-FC.)

3. AIX Client LPAR Setup
   Created AIX LPAR profiles with vfchost adapters configured on the VIOS to use NVMe.

Zoning and Configuration Questions

At this stage, I need clarity on the correct zoning configuration, particularly:

• The client VFC host adapters have both WWPNs and NQNs.

• The AIX client LPAR itself also has an NQN (viewable via the SMS menu).

Questions:

1. At a high level, which NQN should be used for zoning and storage host definitions - the one from the VFC adapter or the one from the AIX LPAR?

2. For zoning on Cisco MDS:

   • Should I include the primary and secondary WWPNs of the client VFC adapters?

   • How should these be mapped to the NVMe-enabled SAN controller ports?

3. For defining hosts on the storage array:

   • Should I use both the WWPNs (primary/secondary) and their corresponding SAN port mappings for NVMe-FC?

Any guidance on aligning zoning with NVMe-FC best practices in a dual-VIOS, IBM Power environment would be appreciated.

Warm Regards,

Sasi Chand