IBM Verify

IBM Verify

Join this online user group to communicate across Security product users and IBM experts by sharing advice and best practices with peers and staying up to date regarding product enhancements.

 View Only
  • 1.  What is the Best approach to replicate 4 Master IBM SDS in 2 regions?

    Posted 01/23/20 12:56 PM
    Hi IBM SDS team,
    At present one of our client has master-master 2 ISDS servers with peer-to-peer replication topology.
    My client is looking for upgrading these 2 regions results in 4 ISDS servers.
    The aim is to setup replication between them.
     a) What is the Best approach to replicate 4 Master ISDS  in 2 regions?

     b) Is there need to set up replication queues across all 4 ISDS as per below configuration?
    https://www.ibm.com/support/knowledgecenter/SS3Q78_8.0.0/com.ibm.IBMDS.doc_8.0.0/ds_ag_srv_adm_repl_peer_topology.html
     c) Can below solution works or has any known issues?
    2 regions 4 ISDS servers replication topology - does this work?


    ------------------------------
    Thanks
    Latha Balne
    Software Engineer
    ------------------------------


  • 2.  RE: What is the Best approach to replicate 4 Master IBM SDS in 2 regions?

    Posted 01/24/20 11:02 AM

    Hello Latha,

    Here are the answers to your questions:

    a) Depends on the ldap client application's needs: 1. If the client application(s) need data consistency and immediate data availability its better to go for 4 way peer (or master) topology. In this case updates made onto any master will reach any consumer in 1 hop. 2. If network bandwidth savings is the goal then the choice would be to use 1 master and 1 gateway per site, the gateway servers on both sites will replicate to each others. In this case the updates made directly to any gateway may take 1 hop to reach its peer gate way and onsite master, and 2 hops to the other site's master. In addition updates made directly to a master will take 1 hop to reach its onsite gateway, 2 hops to reach other site's gateway and 3 hops to reach other site's master.

    b) If you consider case 1 of having all masters then you'll need to set up 3 replication agreements (each agreement represents a replication queue) from each master going to other 3 masters. If you consider case 2, then you'll have 2 replication agreements on each gateway server going to its onsite master and other site's gateway, and 1 replication agreement going from a master to its onsite gateway.

    c) According to the picture presented, you need to configure the servers replicating across sites as gateway servers. Gateway configuration is a well supported configuration. The advantage is network bandwidth savings. Disadvantages include it may take more hops which may affect critical applications that may look for data consistency across sites and downtime on any gateway affects cross site replication.

    Now a days, the network bandwidth is cheaper, so most of our customers prefer to use multi master setup as explained in case 1.

    I hope this answers your questions.

    Thanks,

    Ram.



    ------------------------------
    Ramamohan Reddy
    ------------------------------



  • 3.  RE: What is the Best approach to replicate 4 Master IBM SDS in 2 regions?

    Posted 01/27/20 07:52 AM
    Thanks for your reply with clear explanation.

    ------------------------------
    Latha Balne
    ------------------------------



  • 4.  RE: What is the Best approach to replicate 4 Master IBM SDS in 2 regions?

    Posted 01/27/20 08:35 AM

    Interesting Discussion !

     

    If you don't mind, let me expand the complexity just a tiny bit. Would like to address some other associated themes as well and share some concerns / trade-off discussion.

     

    My scenario is a requirement to support a second but also a 3rd replicated site.

     

    At all cost, we want only onsite LDAP clients to consume LDAP services available in that replicated site. Each site would be running a master to master LDAP server pair for onsite local HA support. Overall, we do not want any LDAP clients within a site to connect to LDAP services available of other 2 (n) sites.

     

    With a 3rd site, without a Gateway server configuration within each site, I am concerned that the number of replicated agreements overall (between masters within each site and between them and each other masters in other sites) will just become unmanageable. Although the replication agreement will connect directly to every other master, thus lowering number of hops, we will have more replication queues processing in parallel. This could (or not) offset the benefit of less hops in the case that more parallel queue processing somewhat adds latency. Comments ?

     

    Although it is true that a Gateway server configuration within each site adds an extra hop for data replication, the extra cost hop does not increase anymore beyond that 2nd site with gateway replication in each site.

     

    But as you pointed out, the local Gateway server configuration in each site introduces a single point of failure for data replication across sites but given that we opt to only have onsite LDAP clients consume LDAP services within a site, I'm less concerned with data consistency issues latency that could arise if they last a (couple) minute or so for small data updates (not large bulk upload) to be replicated between all sites.

     

    One of the reasons I am trying to exclude onsite LDAP clients to reach services within other sites is to try reducing spaghetti infrastructure. Also, an LDAP client often will use some form of DNS resolution caching so should the IP address for reaching global LDAP services would be updated (as a result of onsite service unavailability), because of the cached dns entries in the LDAP client process (JVM for instance), this will likely prevent that client from picking up the updated IP  address (maintaining the unavailability condition). A manual intervention is then required to restart LDAP clients so that they can pick up the updated LDAP connect information. Although some LDAP clients can support numerous LDAP server entries (such as ISAM in ldap.conf), most other generic LDAP clients will feature only one configuration entry for connecting to LDAP services. Comments ?

     

    I'm curious to know how IBM or other clients are dealing with the single point of failure possibility around the Gateway replication setup in each site (easy to restore backup VM image of that ISDS Suite image, quick monitoring/alerting, …) to compensate for that possibility of unavailability.

     

    Glad to hear to Gateway replication is well support configuration.

     

     



    ------------------------------
    Sylvain Gilbert
    ------------------------------



  • 5.  RE: What is the Best approach to replicate 4 Master IBM SDS in 2 regions?

    Posted 01/29/20 12:48 PM

    Hi Sylvain,

    Agreed with your statement "At all cost, we want only onsite LDAP clients to consume LDAP services available in that replicated site.".
    A client side confiugration or a load balancer/VIP confiugration would be required to have this control, and definitely this is a good practice.

    Now with more than 2 sites, and with multi-master(peer) topology, the replication agreement will increase for sure. Its definitely an administation overhead. But its possible to overcome this with necessary scripts that do help in administering replication tasks. I have seen multiple customers using approach to take advantage of a faster/quicker data availability across sites.

    Finally as you've pointed out it depends on the env/application's requirements and trade-offs.

    One of the solutions that addresses the single point of failure concern with Gateway server is to use TSA (Tivoli System Automation) to have a backup node for a gateway. Alternatively I've also seen customers exploiting the operating system's high availability clustering features (such as AIX's HACMP or Linux's HA). 

    Thanks,
    Ram.



    ------------------------------
    Ramamohan Reddy
    ------------------------------