Original Message:
Sent: Thu March 14, 2024 05:06 AM
From: Pascal Louis
Subject: How to config HyperSwap with 2 SAN FS5035
Hello,
I hope you are well.
We had the same problem as you when we tried to implement Hyperswap.
We opened a IBM support case (TS012709380) and Olshanskiy.Denis1 (IBM) helped us.
Here's what he told us:
You do not need two clusters for Hyperswap, and should not make two clusters. Hyperswap topology is the topology for one cluster with two sites (geographically separated) that is fully redundant and resilient.
In order to configure your cluster with Hyperswap topology, you need two IOgrps.
That means in your case you should have one cluster, for example FS5200_MAIN. Then you have to destroy and remove cluster from the other control enclosure (FS5200_DRC), reset its enclosure cluster id and add it to the existing cluster FS5200_MAIN as second IO group. Then you have to assign the site to this IO group nodes, and switch to Hyperswap topology.
In order to reset the enclosure id after removal of unneeded cluster, you have to ssh to the service IP of one of the candidate nodes and run command: satask chvpd -resetclusterid
After this you will be/should be able to see this control enclosure as candidate for existing cluster second IO group (usually iogrp 1)
Also please note that practically with Hyperswap and Stretched cluster topology you do not have really main site and DR site, you have the redundant configuration which is geographically resilient and each site contains same data copy so if one site goes down and hosts have access to another site, for the host it would be totaly transparent and it will not notice that one site is gone. Though to accommodate the usual Main/DR approach you can set which site should always stay online in case of specific disasters/site intercommunication failure, independent on quorum race results.
Also I hope those pictures might be helpful for you:
To remove/destroy cluster from control enclosure(nodes) you have to run rmnode command for each node.
As you have currently 2 nodes in FS5200_DRC, you would be able to remove one node with rmnode command and to remover the last node in the cluster you will have to use rmnode command with -force flag. Please note that this will destroy the cluster, thus you will loose access to all the data you had on this cluster - but so far I see you do not have any configured arrays on the cluster.
After removing/destroying the cluster, nodes should get into candidate state - please double check it (via service IP ssh or Service Assistant GUI (https(via internet browser) to service IP of any of the candidate nodes).
Then ssh to service IP of candidate node (any) and run command satask chvpd -resetclusterid - this command will release the old cluster id that is registered on the enclosure.
Now your control enclosure is ready to be added to the existing cluster.
To add this control enclosure to the existing cluster you have to connect to FS5200_MAIN cluster management GUI and then you are interested in instructions starting from point 6:
Link to instructions:
https://www.ibm.com/docs/en/flashsystem-5x00/8.5.x?topic=isvh-adding-control-enclosure-existing-system
If you want to to do the same via cli (command line interface) ssh to the cluster management IP and use following commands:
https://www.ibm.com/docs/en/flashsystem-5x00/8.5.x?topic=ec-lscontrolenclosurecandidate
https://www.ibm.com/docs/en/flashsystem-5x00/8.5.x?topic=commands-addcontrolenclosure
To change the topology, after adding the control enclosure, you will be able to modify the System topology via cluster management GUI as you tried to do when you captured the error message screenshot, in this case you should be able to see the other site iogrp 1 there and no error message.
Q : After Hyperswap is implemented the encryption key is the same for the two FSs?
The encryption key/s are same for the cluster, as both control enclosures are in the same cluster the encryption keys that were set for the initial cluster should be/will be same for the enclosures/nodes.
You can find more information about encryption here: https://www.redbooks.ibm.com/redbooks/pdfs/sg248520.pdf
Check chapter 12 and specifically chapter 12.5-12.7. Chapter 12.7 has some important information about encryption usage.
I hope this helps, if not open a IBM support case maybe.
Best regards,
------------------------------
Pascal Louis
Consultant
Inetum Luxembourg
Original Message:
Sent: Thu March 14, 2024 03:57 AM
From: Nezih Boyacioglu
Subject: How to config HyperSwap with 2 SAN FS5035
lol :) how can you connect the 2nd 5035, if it's have an management ip address, this means it's an independent 5035. this is not a cluster (hyperswap) configuration. you must delete the configuration on 2nd. You should have 1 management address for both systems and 4 service ip address for each node. And you can configure your cluster. If there is two independent 5035's you can only create partnership for Metro Mirror.
now go to service screen and delete configuration on 2nd 5035 (if there is some defined volumes and pools all will be destroyed) and after that you'll see as a candidate on 1st one.
------------------------------
Nezih Boyacioglu
Original Message:
Sent: Thu March 14, 2024 03:45 AM
From: Cuong nguyen
Subject: How to config HyperSwap with 2 SAN FS5035
I send you the output of lstargetportfc command on 2 devices SAN-01 and SAN-02
SAN-SF5035-01
SAN-SF5035-02
------------------------------
Cuong nguyen
Original Message:
Sent: Thu March 14, 2024 03:19 AM
From: Nezih Boyacioglu
Subject: How to config HyperSwap with 2 SAN FS5035
also send me the lstargetportfc command output from flashsystem
------------------------------
Nezih Boyacioglu
Original Message:
Sent: Wed March 13, 2024 10:43 PM
From: Cuong nguyen
Subject: How to config HyperSwap with 2 SAN FS5035
I use wwpn for all connections, for both hosts and storages
image below is config alias in a SAN SWITCH
------------------------------
Cuong nguyen
Original Message:
Sent: Wed March 13, 2024 11:57 AM
From: Nezih Boyacioglu
Subject: How to config HyperSwap with 2 SAN FS5035
Hi Nguyen
which definition you are using on your aliases, port index, wwnn or wwpn? for storage connectivity, you must use storage wwpns instead of host wwpns on each port.
------------------------------
Nezih Boyacioglu
Original Message:
Sent: Wed March 13, 2024 10:30 AM
From: Cuong nguyen
Subject: How to config HyperSwap with 2 SAN FS5035
I send you my zone configuration and my topo
Zone config
------------------------------
Cuong nguyen
Original Message:
Sent: Wed March 13, 2024 08:30 AM
From: Nezih Boyacioglu
Subject: How to config HyperSwap with 2 SAN FS5035
Can I have a look at your zones?
------------------------------
Nezih Boyacioglu
Original Message:
Sent: Wed March 13, 2024 08:05 AM
From: Cuong nguyen
Subject: How to config HyperSwap with 2 SAN FS5035
The two images below are the Menu of the enclosure action and the system action, however I don't see which one is used to add a second device.
Can you guide me?
------------------------------
Cuong nguyen
Original Message:
Sent: Wed March 13, 2024 03:06 AM
From: Nezih Boyacioglu
Subject: How to config HyperSwap with 2 SAN FS5035
yes it's old gui :)
you can use "enclosure actions" to add your 2nd 5035 to your system
------------------------------
Nezih Boyacioglu
Original Message:
Sent: Tue March 12, 2024 09:32 PM
From: Cuong nguyen
Subject: How to config HyperSwap with 2 SAN FS5035
Thanks for your reply,
the last image is from blog, not in my dashboard.
What I mean is how do I get the dashboard look like that image
My dashboard is the images below, I can't find button to add the second 5035
Please help me...
Thanks so much
------------------------------
Cuong nguyen
Original Message:
Sent: Tue March 12, 2024 02:04 PM
From: Nezih Boyacioglu
Subject: How to config HyperSwap with 2 SAN FS5035
Hi Cuong.
The blog post you are using as a guide is from 2018 and a bit outdated. First of all, you need to zone your storage ports. If your 5035 is using NPIV (it's enabled by default), each port on the 5035 provides two wwpns. One for host connection and one for storage-to-storage communication. You can use the lstargetportfc command to see which wwpn's have host access permission and which do not. Use host permitted (you will see "yes yes scsi" on host io permitted wwpn's for host zones. And use others (no no scsi) for connecting two 5035s.
Once the zones are properly configured on both SAN switches, you can easily add the second 5035 via this "Click to Add" button on your last screenshot. You don't need to create a partnership, partnership is only for Metro Mirror or Global Mirror (active/passive replication configuration). In hyperswap you don't need to create partnership, just add second io group and change topology to hyperswap.
------------------------------
Nezih Boyacioglu
Original Message:
Sent: Tue March 12, 2024 11:49 AM
From: Cuong nguyen
Subject: How to config HyperSwap with 2 SAN FS5035
Hi everybody
Can anyone help me with this case?
I have 2 FS5035 SAN devices, running version 8.6.0.3,
with licensed licenses: Easy Tier, FlashCopy Update, Remote Copy
Both are connected via 2 SAN Switches with the topology as image attatch, with red cable for SRV connect to Storage, and black cable for 2 SAN connect
------------------------------
Cuong nguyen
------------------------------