Originally posted by: SystemAdmin

Hi everyone,

I'm getting a confusing error from clver using HACMP 5.2 that i dont have any clue about it. Cluster is stable, up and running according to clstat. The message that i'm getting is:

Verification to be performed on the following:
Cluster Topology
Cluster Resources

Retrieving data from available cluster nodes. This could take a few minutes.....
Could not open file
WARNING:
Verifying that all service IP labels are configured correctly
WARNING:
Verifying that all service IP labels are configured correctly
Nodes not in same realm
is in realm Segmentation fault(coredump)

cl1:/>ls -la core
-rw------- 1 root system 6572460 Mar 10 09:58 core

I'm able to shutdown the cluster and force the synchronization of it using Extended configurations... But i get that error everytime.

The HACMP was just migrated from 5.1. I could not find anywhere a clue about that error that i'm getting. Here are the list of softwares:

cl1:/>oslevel -s
5200-09-CSP
cl1:/>lslpp -l|grep -i cluster
cluster.adt.es.client.demos
cluster.adt.es.client.include
cluster.adt.es.client.samples.demos
cluster.adt.es.server.demos
cluster.adt.es.server.samples.demos
cluster.adt.es.server.samples.images
cluster.doc.en_US.es.html 5.2.0.2 COMMITTED HAES Web-based HTML
cluster.doc.en_US.es.pdf 5.2.0.2 COMMITTED HAES PDF Documentation - U.S.
cluster.es.cfs.rte 5.2.0.7 COMMITTED ES Cluster File System Support
cluster.es.client.lib 5.2.0.9 COMMITTED ES Client Libraries
cluster.es.client.rte 5.2.0.9 COMMITTED ES Client Runtime
cluster.es.client.utils 5.2.0.6 COMMITTED ES Client Utilities
cluster.es.clvm.rte 5.2.0.2 COMMITTED ES for AIX Concurrent Access
cluster.es.cspoc.cmds 5.2.0.8 COMMITTED ES CSPOC Commands
cluster.es.cspoc.dsh 5.2.0.2 COMMITTED ES CSPOC dsh
cluster.es.cspoc.rte 5.2.0.7 COMMITTED ES CSPOC Runtime Commands
cluster.es.plugins.dhcp 5.2.0.0 COMMITTED ES Plugins - dhcp
cluster.es.plugins.dns 5.2.0.0 COMMITTED ES Plugins - Name Server
cluster.es.plugins.printserver
cluster.es.server.diag 5.2.0.9 COMMITTED ES Server Diags
cluster.es.server.events 5.2.0.8 COMMITTED ES Server Events
cluster.es.server.rte 5.2.0.10 COMMITTED ES Base Server Runtime
cluster.es.server.utils 5.2.0.9 COMMITTED ES Server Utilities
cluster.es.worksheets 5.2.0.9 COMMITTED Online Planning Worksheets
cluster.license 5.2.0.0 COMMITTED HACMP Electronic License
cluster.msg.En_US.cspoc 5.2.0.0 COMMITTED HACMP CSPOC Messages - U.S.
cluster.msg.En_US.es.client
cluster.msg.En_US.es.server
cluster.msg.en_US.cspoc 5.1.0.0 COMMITTED HACMP CSPOC Messages - U.S.
cluster.msg.en_US.es.client
cluster.msg.en_US.es.server
csm.client 1.5.1.0 COMMITTED Cluster Systems Management
csm.core 1.5.1.1 COMMITTED Cluster Systems Management
csm.dsh 1.5.1.1 COMMITTED Cluster Systems Management Dsh
cluster.es.client.rte 5.2.0.0 COMMITTED ES Client Runtime
cluster.es.clvm.rte 5.2.0.0 COMMITTED ES for AIX Concurrent Access
cluster.es.cspoc.rte 5.2.0.0 COMMITTED ES CSPOC Runtime Commands
cluster.es.server.diag 5.2.0.0 COMMITTED ES Server Diags
cluster.es.server.events 5.2.0.0 COMMITTED ES Server Events
cluster.es.server.rte 5.2.0.10 COMMITTED ES Base Server Runtime
cluster.es.server.utils 5.2.0.0 COMMITTED ES Server Utilities
csm.client 1.5.1.0 COMMITTED Cluster Systems Management
csm.core 1.5.1.1 COMMITTED Cluster Systems Management
csm.dsh 1.5.0.0 COMMITTED Cluster Systems Management Dsh
cluster.man.en_US.es.data 5.2.0.3 COMMITTED ES Man Pages - U.S. English
cl1:/>lslpp -l|grep -i hacmp
cluster.license 5.2.0.0 COMMITTED HACMP Electronic License
cluster.msg.En_US.cspoc 5.2.0.0 COMMITTED HACMP CSPOC Messages - U.S.
cluster.msg.en_US.cspoc 5.1.0.0 COMMITTED HACMP CSPOC Messages - U.S.
rsct.basic.hacmp 2.3.9.0 COMMITTED RSCT Basic Function (HACMP/ES
rsct.compat.basic.hacmp 2.3.9.0 COMMITTED RSCT Event Management Basic
Function (HACMP/ES Support)
rsct.compat.clients.hacmp 2.3.9.0 COMMITTED RSCT Event Management Client
Function (HACMP/ES Support)

On all nodes(2 nodes only) the version of softwares are the same.
cl1:/usr/es/sbin/cluster/diag>./clverify software lpp -R HACMP_INST
Could not find working or valid IP address for Node ''.

To return to previous menu, type:

cl1:/usr/es/sbin/cluster/diag>./clverify cluster topology check
HACMPnode ODM on node cl2 verified.

HACMPnetwork ODM on node cl2 verified.

HACMPcluster ODM on node cl2 verified.

HACMPsite ODM on node cl2 verified.

HACMPnim ODM on node cl2 verified.

HACMPadapter ODM on node cl2 verified.

HACMPtopsvcs ODM on node cl2 verified.

Verification to be performed on the following:
Cluster Topology

Retrieving data from available cluster nodes. This could take a few minutes...
Could not open file
WARNING:
Verifying that all service IP labels are configured correctly
WARNING:
Verifying that all service IP labels are configured correctly

Remember to redo automatic error notification if configuration has changed.

Verification has completed normally.
Could not find working or valid IP address for Node ''.

To return to previous menu, type:

Originally posted by: alethad

Have you double checked that all of you IP's are pingable between the 2 nodes? Including the hearbeats? It seems strange that the verification error doesn't tell you the node name. HA is really good about that usually when it comes to errors & warnings.
You don't have any typo's in you /etc/hosts file do you? Or your clhosts file?

Originally posted by: SystemAdmin

by now.. i double checked the clhosts, /etc/hosts, interfaces, and they're all pinging each other, resolving..... you know.. if you try doing a clstat it says that cluster is stable.