AIOps

 View Only
Expand all | Collapse all

ICP4MCM - Multiple IBM cloud App Management Installation on Different Worker nodes

  • 1.  ICP4MCM - Multiple IBM cloud App Management Installation on Different Worker nodes

    Posted Mon February 15, 2021 09:03 PM
    Hi, I have a great question or concern. I have some data centers in different locations where they plan to install IBM Cloud Pak for Multicloud Management, but the data centers have some latency issues so I have thought about installing a cluster with ICP4MCM (each cluster on OCP using 3 master nodes and 3 workers nodes) in each data center to monitor the infrastructure using IBM Cloud App Management or can I install a single OCP using 3 master nodes and in each location deploy 3 worker nodes and create different instances or installations of ICP4MCM with ICAM in different mamespaces?

    Thanks in advance


    ------------------------------
    Fabian Andres Burgos Rojas
    ------------------------------


  • 2.  RE: ICP4MCM - Multiple IBM cloud App Management Installation on Different Worker nodes

    IBM TechXchange Speaker
    Posted Wed February 17, 2021 03:27 PM
    You have two options, but it depends on latency.  With high latency, you have to deploy two separate clusters...one in each data center.  Agents can be configured to point to a VIP or Load Balancer which will redirect traffic to the "Active" Cluster.  Both Cluster will actually be running, but you'll only be using one for Management.  You'll need to develop a strategy for copying configuration data from the primary to the secondary cluster.

    The other option is to use Availability Zones.   This requires 3 zone where each zone needs enough capacity to run the workload.  You only need 1 master node in each zone.  If Monitoring is included, latency needs to be less than 2 ms.   If Monitoring is not included it still needs to be low latency, but not quite as low.

    ------------------------------
    Ben Stern
    Executive IT Specialist / Monitoring and Analytics Best Practices and Technical Evangelist
    IBM
    Durham NC
    919-224-1593
    ------------------------------



  • 3.  RE: ICP4MCM - Multiple IBM cloud App Management Installation on Different Worker nodes

    Posted Mon March 01, 2021 01:09 PM
    Hi Ben, thank you for the answer and the ideas about hoe can we install ICP4MCM. When we talk about latency, is about the latency between the Openshift's Nodes or Between the ICP4MCM and the infrastructure to be monitoring? Less than 2 ms is so demanding.

    another question i have, if can we install multiple instances of monitoring's component (IBM cloud app management) on different node using different namespace by selecting the nodes where the instances will be run?

    Again, thank you.

    Regards

    ------------------------------
    Fabian Andres Burgos Rojas
    ------------------------------



  • 4.  RE: ICP4MCM - Multiple IBM cloud App Management Installation on Different Worker nodes

    Posted Wed February 17, 2021 05:48 PM
    Hi,
    Do you mean high latency between the 2 data centers or latency within the data center? If there is high latency between the data centers, you will definitely want to deploy a separate CP4MCM cluster in each location. You cannot spread a single kubernetes cluster over a high latency connection. Generally we only recommend spreading a cluster over multiple datacenters if the latency between them is very low, like between public cloud availability zones.

    thanks,
    -Cross

    ------------------------------
    Cross Ganaway
    IBM
    Greenville SC
    ------------------------------



  • 5.  RE: ICP4MCM - Multiple IBM cloud App Management Installation on Different Worker nodes

    Posted Mon March 01, 2021 01:14 PM
    Hi Cross, Thank you for your answer. When we talk about latency, is about the latency between the Openshift's Nodes or Between the ICP4MCM and the infrastructure to be monitoring? Less than 2 ms is so demanding. Is there any literature where the latency that should exist between the nodes of a Kubernetes cluster is recommended?

    another question i have, if can we install multiple instances of monitoring's component (IBM cloud app management) on different node using different namespace by selecting the nodes where the instances will be run?

    Again, thank you.

    Regards

    ------------------------------
    Fabian Andres Burgos Rojas
    ------------------------------



  • 6.  RE: ICP4MCM - Multiple IBM cloud App Management Installation on Different Worker nodes

    Posted Mon February 22, 2021 06:47 AM
    Edited by Stephanie Wilkerson Tue February 23, 2021 08:39 AM
    The other option is to use Availability Zones.   This requires 3 zone where each zone needs enough capacity to run the workload.  You only need 1 master node in each zone.  If Monitoring is included, latency needs to be less than 2 ms.   If Monitoring is not included it still needs to be low latency, but not quite as low.


    ------------------------------
    Ralph Henderson
    ------------------------------



  • 7.  RE: ICP4MCM - Multiple IBM cloud App Management Installation on Different Worker nodes

    Posted Mon February 22, 2021 06:47 AM
    in each location deploy 3 worker nodes and create different instances or installations of ICP4MCM with ICAM in different mamespaces?
    https://et20slam.net/crichd/


    ------------------------------
    Ralph Henderson
    ------------------------------



  • 8.  RE: ICP4MCM - Multiple IBM cloud App Management Installation on Different Worker nodes

    Posted Mon March 01, 2021 01:16 PM
    Hi Ralph thank your for your help.
    Is there any literature where show how we can install multiple instances of monitoring's component (IBM cloud app management) on different node using different namespace by selecting the nodes where the instances will be run?

    Again, thank you.

    ------------------------------
    Fabian Andres Burgos Rojas
    ------------------------------



  • 9.  RE: ICP4MCM - Multiple IBM cloud App Management Installation on Different Worker nodes

    IBM TechXchange Speaker
    Posted Mon March 01, 2021 02:05 PM
    IF you want to use Availability Zones (with Monitoring), then you need very low latency between the 3 data center.   It is not a hard requirement, but roughly 2 ms latency is recommended.  If you were to ping from a worker node in DC1 to a worker node in DC2, expect 2 ms or less.

    I'm not sure I understand your 2nd question.  Are you trying to install multiple copies of CP4MCM into the same cluster?  If so, I don't understand why.

    ------------------------------
    Ben Stern
    Executive IT Specialist / Monitoring and Analytics Best Practices and Technical Evangelist
    IBM
    Durham NC
    919-224-1593
    ------------------------------



  • 10.  RE: ICP4MCM - Multiple IBM cloud App Management Installation on Different Worker nodes

    Posted Mon March 01, 2021 04:18 PM
    Hi Ben, Thank you. Answer your question, I attached some pics(Is more easy explain with images):

    1. Our customer have some datacenters.
    2. They have some licenses and want to monitoring the Infrastructure and applications

    The first images show the first approach when we install IBM Cloud Pak for Multicloud Management(ICP4MCM) and all Event report to it.
    First Approach

    There are some problems related to latency from some datacenter to the datacenter where ICP4MCM is install, so there are 2 options:

    1. Install ICP4MCM on every datacenters and collect the data from the agents.(so many vm to install an open shift cluster on every dc)
    2. Install ICP4MCM and deploy workers nodes on every datacenter and on the workers nodes install an instance of the monitoring component. I don't know if it if possible?

    Second Approach

    Thank you in advance.


    ------------------------------
    Fabian Andres Burgos Rojas
    ------------------------------



  • 11.  RE: ICP4MCM - Multiple IBM cloud App Management Installation on Different Worker nodes

    IBM TechXchange Speaker
    Posted Mon March 01, 2021 07:57 PM
    The pictures help.  Thanks.   For Monitoring, I don't think you'll find that Latency will be an issue with option 1.  The Agents post their data to the CP4MCM server once per minute.   Once the data is on the CP4MCM server, all of the rest of the processing takes place.  This solution is much less sensitive to latency than ITM v6 where latency could cause slow performance in the UI.

    The second option won't work when there is latency.   You are showing a deployment with what are called "Availability Zones".   The idea is that you run 1 or more instances of each service in 3 different availability zones.  In that case you would have 1 Master Node in each zone.  But, Availability Zones don't really work when you have high latency.  etcd is faily sensitive to latency.  It must establisy a quarum to determine who is the leader and it has problems when there is latency.   The Monitoring component within CP4MCM is also very sensitive to latency and gets VERY slow if some microservices are running in one data center and other microservices are running in a different data center with high latency.   So, option 2 won't work.

    ------------------------------
    Ben Stern
    Executive IT Specialist / Monitoring and Analytics Best Practices and Technical Evangelist
    IBM
    Durham NC
    919-224-1593
    ------------------------------