AIX

AIX

Connect with fellow AIX users and experts to gain knowledge, share insights, and solve problems.


#Power
 View Only
Expand all | Collapse all

Increasing number of clcomd and mping processes

  • 1.  Increasing number of clcomd and mping processes

    Posted Mon October 01, 2012 04:51 AM

    Originally posted by: victorkwan


    Hi gurus,

    I'm new to p7 and AIX 7.1 with powerHA 7.
    I'm observing that the number of clcomd and mping process on one of the LPAR is growing for the past 2 weeks.

    
    server_in_question:/:>ps -aef | grep clcomd root  5767364  3932220   0   Sep 14      -  5:20 /usr/sbin/clcomd -d root 25100332  5767364   0   Sep 17      -  0:00 /usr/sbin/clcomd -d root 32243766  5767364   0   Sep 28      -  0:00 /usr/sbin/clcomd -d root 35455096  5767364   0   Sep 24      -  0:00 /usr/sbin/clcomd -d root 37290144  5767364   0   Sep 19      -  0:00 /usr/sbin/clcomd -d root 45088898  5767364   0   Sep 21      -  0:00 /usr/sbin/clcomd -d root 53018850  5767364   0   Sep 25      -  0:00 /usr/sbin/clcomd -d root 55050480  5767364   0 00:00:26      -  0:00 /usr/sbin/clcomd -d root 58720464  5767364   0   Sep 27      -  0:00 /usr/sbin/clcomd -d root 58851414  5767364   0   Sep 22      -  0:00 /usr/sbin/clcomd -d root 60358732  5767364   0   Sep 23      -  0:00 /usr/sbin/clcomd -d root 63307920  5767364   0   Sep 20      -  0:00 /usr/sbin/clcomd -d root 63635524  5767364   0   Sep 18      -  0:00 /usr/sbin/clcomd -d root 65405026  5767364   0   Sep 29      -  0:00 /usr/sbin/clcomd -d root 66715738  5767364   0   Sep 30      -  0:00 /usr/sbin/clcomd -d root  9961980  5767364   0   Sep 26      -  0:00 /usr/sbin/clcomd -d
    

    
    server_in_question:/:>ps -aef | grep clcomd | wc -l 17
    

    
    server_in_question:/:>ps -aef | grep mping root 21037286 58720464   0   Sep 27      -  0:00 /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 32440548 45088898   0   Sep 21      -  0:00 /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 40435836 65405026   0   Sep 29      -  0:00 /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 44040222 25100332   0   Sep 17      -  0:00 /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 44171518 32243766   0   Sep 28      -  0:00 /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 44892340 60358732   0   Sep 23      -  0:00 /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 49807536  9961980   0   Sep 26      -  0:00 /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 52363394 35455096   0   Sep 24      -  0:00 /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 54526036 63635524   0   Sep 18      -  0:00 /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 54853796 66715738   0   Sep 30      -  0:00 /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 56295480 58851414   0   Sep 22      -  0:00 /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 59244652 55050480   0 00:00:26      -  0:00 /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 62849152 53018850   0   Sep 25      -  0:00 /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 63897790 37290144   0   Sep 19      -  0:00 /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root  4522434 63307920   0   Sep 20      -  0:00 /usr/sbin/mping -v -r -c 5 -a 228.168.101.43
    

    
    server_in_question:/:>ps -aef | grep mping | wc -l 15
    


    I'm trying to figure out if this is normal for BOTH the mping and clcomd? However, on the peer LPAR (since this is a cluster), i do not see this growth.

    
    peer_server:/:>ps -aef | grep clcomd root  6291666  4325576   0   Sep 14      -  6:16 /usr/sbin/clcomd -d
    

    
    peer_server:/:>ps -aef | grep clcomd | wc -l 2
    


    
    peer_server:/:>ps -aef | grep mping | grep cluster root  7077918        1   0   Sep 30      -  0:00 /bin/ksh93 /usr/es/sbin/cluster/utilities/cl_rsh -n server_in_question /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root  9240794        1   0   Sep 26      -  0:00 /bin/ksh93 /usr/es/sbin/cluster/utilities/cl_rsh -n server_in_question /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 38469636        1   0 00:00:26      -  0:00 /bin/ksh93 /usr/es/sbin/cluster/utilities/cl_rsh -n server_in_question /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 38731896        1   0   Sep 21      -  0:00 /bin/ksh93 /usr/es/sbin/cluster/utilities/cl_rsh -n server_in_question /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 42467364        1   0   Sep 27      -  0:00 /bin/ksh93 /usr/es/sbin/cluster/utilities/cl_rsh -n server_in_question /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 44302472        1   0   Sep 18      -  0:00 /bin/ksh93 /usr/es/sbin/cluster/utilities/cl_rsh -n server_in_question /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 49348656        1   0   Sep 24      -  0:00 /bin/ksh93 /usr/es/sbin/cluster/utilities/cl_rsh -n server_in_question /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 58786034        1   0   Sep 17      -  0:00 /bin/ksh93 /usr/es/sbin/cluster/utilities/cl_rsh -n server_in_question /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root  3473848        1   0   Sep 23      -  0:00 /bin/ksh93 /usr/es/sbin/cluster/utilities/cl_rsh -n server_in_question /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root  7799250        1   0   Sep 25      -  0:00 /bin/ksh93 /usr/es/sbin/cluster/utilities/cl_rsh -n server_in_question /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 11338208        1   0   Sep 19      -  0:00 /bin/ksh93 /usr/es/sbin/cluster/utilities/cl_rsh -n server_in_question /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 13566426        1   0   Sep 29      -  0:00 /bin/ksh93 /usr/es/sbin/cluster/utilities/cl_rsh -n server_in_question /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 29295004        1   0   Sep 20      -  0:00 /bin/ksh93 /usr/es/sbin/cluster/utilities/cl_rsh -n server_in_question /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 31719734        1   0   Sep 28      -  0:00 /bin/ksh93 /usr/es/sbin/cluster/utilities/cl_rsh -n server_in_question /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 33554834        1   0   Sep 22      -  0:00 /bin/ksh93 /usr/es/sbin/cluster/utilities/cl_rsh -n server_in_question /usr/sbin/mping -v -r -c 5 -a 228.168.101.43
    


    
    peer_server:/:>ps -aef | grep mping | grep clrsh root 11665446 49348656   0   Sep 24      -  0:00 /usr/sbin/clrsh server_in_question -n /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 22806628 58786034   0   Sep 17      -  0:00 /usr/sbin/clrsh server_in_question -n /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 23199952 44302472   0   Sep 18      -  0:00 /usr/sbin/clrsh server_in_question -n /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 25886886 31719734   0   Sep 28      -  0:00 /usr/sbin/clrsh server_in_question -n /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 56426544 29295004   0   Sep 20      -  0:00 /usr/sbin/clrsh server_in_question -n /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 64028714 38731896   0   Sep 21      -  0:00 /usr/sbin/clrsh server_in_question -n /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 17826246 11338208   0   Sep 19      -  0:00 /usr/sbin/clrsh server_in_question -n /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 20316420  7799250   0   Sep 25      -  0:00 /usr/sbin/clrsh server_in_question -n /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 21365180  3473848   0   Sep 23      -  0:00 /usr/sbin/clrsh server_in_question -n /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 23069056  7077918   0   Sep 30      -  0:00 /usr/sbin/clrsh server_in_question -n /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 23200106 33554834   0   Sep 22      -  0:00 /usr/sbin/clrsh server_in_question -n /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 24051970 38469636   0 00:00:26      -  0:00 /usr/sbin/clrsh server_in_question -n /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 26411400 13566426   0   Sep 29      -  0:00 /usr/sbin/clrsh server_in_question -n /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 39190904  9240794   0   Sep 26      -  0:00 /usr/sbin/clrsh server_in_question -n /usr/sbin/mping -v -r -c 5 -a 228.168.101.43 root 46727578 42467364   0   Sep 27      -  0:00 /usr/sbin/clrsh server_in_question -n /usr/sbin/mping -v -r -c 5 -a 228.168.101.43
    

    Would this be a case where peer_server is unable to reach server_in_question using mping and caused clcomd to respawn?

    
    peer_server:/:>ping server_in_question PING server_in_question: (10.10.10.3): 56 data bytes 64 bytes from 10.10.10.3: icmp_seq=0 ttl=255 time=0 ms 64 bytes from 10.10.10.3: icmp_seq=1 ttl=255 time=0 ms ^C --- server_in_question ping statistics --- 2 packets transmitted, 2 packets received, 0% packet loss round-trip min/avg/max = 0/0/0 ms
    


    Thanks in advance for the help.
    #AIX-Forum


  • 2.  Re: Increasing number of clcomd and mping processes

    Posted Mon October 01, 2012 04:53 AM

    Originally posted by: victorkwan


    Apology if i'm posting to the wrong forum.

    If mod is around, may this thread be shifted powerHA forum? Thanks.
    #AIX-Forum