Originally posted by: badthe

I have just newly install AIX 5.3 oslevel 5300-08-01-0819 which have 2 HBA connected to 2 san switch and connected to DS4800 storage.

The RDAC driver was installed by default, but then i only see the disk from the storage from one controller, and also i manage to get 1 Disk Array Router.

1. lspv

hdisk0 00056232e891ecd9 rootvg active
hdisk1 00056232127b8930 rootvg active
hdisk2 0005622211d6ddb7 data1_vg
hdisk3 00056232125cacb4 data1_vg
hdisk4 00056232125cad18 data1_vg
hdisk5 00056232125cad78 data1_vg
hdisk6 00056222273d075e log5_vg
hdisk7 00056222273e96ad log6_vg
hdisk8 0005622211d511b9 heartbeat_vg

1. fget_config -Av

---dar0---

User array name = 'XXXX'
dac0 ACTIVE dac1 ACTIVE

Disk DAC LUN Logical Drive
utm 127
hdisk2 dac0 2 sap_a1_lun2
hdisk3 dac0 5 sap_a2_lun2
hdisk4 dac0 16 sap_a7_lun2
hdisk5 dac0 19 sap_a8_lun2
hdisk6 dac0 32 sap_a12_lun2
hdisk7 dac0 34 sa_a13_lun2
hdisk8 dac0 36 heartbeat2

1. lsdev | grep disk

hdisk0 Available 03-08-00 SAS Disk Drive
hdisk1 Available 03-08-00 SAS Disk Drive
hdisk2 Available 06-09-02 1815 DS4800 Disk Array Device
hdisk3 Available 06-09-02 1815 DS4800 Disk Array Device
hdisk4 Available 06-09-02 1815 DS4800 Disk Array Device
hdisk5 Available 06-09-02 1815 DS4800 Disk Array Device
hdisk6 Available 06-09-02 1815 DS4800 Disk Array Device
hdisk7 Available 06-09-02 1815 DS4800 Disk Array Device
hdisk8 Available 06-09-02 1815 DS4800 Disk Array Device

1. lsdev -Ccadapter

fcs0 Available 06-08 FC Adapter
fcs1 Available 06-09 FC Adapter
fcs2 Available 07-08 FC Adapter
fcs3 Available 07-09 FC Adapter

There is no zoning at the switch cause the 2 hba card connected to different san switch and i do map the host on the DS4800 storage. Anyone knows whats wrong with the setup ? thanks..
#AIX-Forum

Originally posted by: hdkutz

Hello badthe,
your shown config looks good to me. 2 DACs (both active) and one dar0.
Are there maybe other dar devices?
What does

1. lsdev -C |grep 06-08
2. lsdev -C |grep 06-09
3. lsdev -C |grep 07-08
4. lsdev -C |grep 07-09

say?
Execute

1. fcstat fcs? ## substitue ? to the number of your fc-adapter (e.g. fcs0, ...)

for all of your Fiberchannel Adapters to see more information about the Status of those. Maybe one Adapter is configured and shown with fget_config, but not used.

Cheers,
ku
#AIX-Forum

Originally posted by: hdkutz

One more suggestion:
Are your LUN's spreaded/mapped over both Adapters in your DS4800?
If they all go over Adapter A then you will see no LUN's over Adapter B.
My Experience from a DS4300. Do not know if it is similar in a DS4800.

Cheers,
ku
#AIX-Forum

Originally posted by: badthe

Thanks for the reply..

Yes i do map the 2 fibre channel card WWN to the SAN storage.

These setting only half working. the dac0 and dac1 are come from 1 fibre channel. If i pull the one of the fire connection, it will lost the san storage connection. That's not called redundant. It seems that the 2 dac only come from one of the fibre channel card. If i am not wrong, i should able to see 2 dar and 4 dac which 2 dac from each fibre channel connection.
#AIX-Forum

Originally posted by: hdkutz

Hello,
you're right.
You should see:
2 dar-Devices dar0-1
and
4 dac-Devices dac0-3

What does the fcstat output say?
Are the fcs connected and have the right speed?
Just my 2 Cents:

• umount all SAN-Filesystems
• exportvg all SAN-VG
• rmdev all 4800-hdisks
• rmdev all dar-devices
• rmdev -Rdl all fcs-Adapter (to get rid of fcnet, fscsi, ...)
• cfgmgr

The config should now be as described above.
If not - remove it all again and try to connect only 2 fcs-adapter from the machine to your SAN and run cfgmgr again.
The solution must be the one described above (exept that you oonly see 1 dar and 2 dacs)
Hth,
ku
#AIX-Forum

Originally posted by: waynek

Just a note. With 2 HBAs connected to the same storage system you will only see 1 dar with 2 dacs. You should not see 2 dars.
#AIX-Forum

Originally posted by: SystemAdmin

Hi

in a configuration with one DS4000-series storage with two controllers and an AIX with two HBAs, I wouldn't trust anything but ONE dar- and TWO dac-devices.
As hdkutz states, I would rmdev the actual devices, then I would make sure that there are only two paths/connections from the AIX to the DS4000 storage (First HBA through SAN Switch 1 to Controller A, second through Switch 2 to Controller B, or something similar) and finally do the cfgmgr. Further, I would consider Zoning if you have other devices in your SAN.

The output of the lspv might help you to re-import the VGs with the "old" names.

Hope this helps
#AIX-Forum

Originally posted by: waynek

Make sure both HBAs are assigned to the Host in Storage Manager and that the Host Type is AIX for both HBAs. Double check the WWN in Storage Manager for the HBA that is not working. Are the two switches connected via ISL? If so then the will be part of the same Fabric and you really should use zoning. With two cards each zone should have 1 hba and 1 controller WWN.
#AIX-Forum

Originally posted by: badthe

Actually the redundant link is working, but it takes 10-15 secs to switch to the next link. Yes, i do need to create zoning at the SAN switch.

But there is some issue, the first san switch is connect to san storage controller A, and the second san switch connected to controller B. If my server with 1 hba that connected to the first san switch, then from my fget_config command, i see the second controller in dacNONE status. And those lun that assign to this server will all use only controller A to the server. Is this normal ?
#AIX-Forum

Originally posted by: CRM

dacnone is not good - usually indicated a cabling/zoning issue, can you supply a diagram of how this is cabled/zoned?

Make sure that if you have multiple HBA adapters fast_fail is also set on the AIX HBA adapters for fastest failover.

regards

Chris
#AIX-Forum

Originally posted by: waynek

If you have only 1 hba connected to controller A you will see the dacNONE for controller B. If you have a second HBA connected to another switch which is connected to controller B you should not see dacNONE. A dacNONE status means the HBA cannot see the controller. In your case this would be Controller B. This could be caused by a number of issues. Are your two switches connected together with an ISL connection? If it is than it's possible that the second HBA ( that should be going to controller B ) is actually connecting to controller A back through the first switch.
#AIX-Forum