Content Management and Capture

 View Only
Expand all | Collapse all

Stovepipe Configuration for Content Navigator and CPE

  • 1.  Stovepipe Configuration for Content Navigator and CPE

    Posted Mon August 01, 2022 11:05 AM

    Hi everyone,

    I am wondering if someone, successfully implemented the Stovepipe architecture for ICN-CPE, and runs problem-free in a production environment. I need to implement an ICN-CPE stovepipe solution.

    I have a few questions regarding installation/configuration which are is not covered in detail in the IBM's technote.

    Ok. First the two general questions.

    1. Is there a more detailed guide for this implementation, than the 8-page white paper?
    2. Does IBM support this configuration? That is, provides assistance to configure and technical support on issues that may rise on production?

    Install/Config questions.

    1. In section "Using Hosts Files to Identify Servers" says, A generic virtual host name is used for each application in the IBM ECM solution. Does this imply that all CPE servers share the same Virtual hostname and IP, having "local" actual names and IPs?
    2. In Load Balancers configuration, needs monitor checks for servers. How these checks are configured? Is this done by checking URL:Port ?
    3. In Installation/Configuration, paper says, all CPE servers must be deployed using the same EAR file. Does this mean to deploy on the first CPE server and then copy the .ear file on Deploy directory on the rest of the servers and configure WAS and deploy?
    4. How each CPE server is aware of the other CPE server's documents? I understand Filestores must be on a highly available file share.
    5. We have one FileNet Domain and all CPE servers share the same GCD database?
    6. When do we use the Virtual name and when the actual host name? e.g. When creating a Repository on Navigator we use the actual CPE host name?
    Thank you.

    ------------------------------
    Christos Chorattides
    Datatech
    ------------------------------


  • 2.  RE: Stovepipe Configuration for Content Navigator and CPE

    IBM Champion
    Posted Tue August 02, 2022 06:08 AM
    Hi,

    someone? sucessfully? This is probably the most popular configuration for customers that want load balancing/high availabilty without incurring the cost of WAS ND. We only have such customers and (for the smaller ones without LB needs) windows servers with VMware vmotion.

    General: Answer to 1 is no and to 2 is yes.

    Config:

    1. Does this imply that all CPE servers share the same Virtual hostname and IP, having "local" actual names and IPs?Correct,but this concept is not specific to FileNet, it is a general concept and the servers must act stateless for this to work (as you do not know if the second part of a request gets routed to another server)
    2. LBs do a good job themselves discovering if a service is down, but if you want you can utilize the health pages
    3. Does this mean to deploy on the first CPE server and then copy the .ear file on Deploy directory on the rest of the servers and configure WAS and deploy?Yes unless you have WAS ND and a deployment node (most likely you would have WAS Application Server no ND)
    4. How each CPE server is aware of the other CPE server's documents? An entry in the shared db (table docversion)....
    5. We have one FileNet Domain and all CPE servers share the same GCD database? Yes, and the same object stores and the same ressources and.... everything
    6. You are actually touching a good point here. I have made it a habit to use an actual hostname when configuring things, otherwise funny errors are on their way. Lets assume you create a property and then add it to a docclass using virtual ip. Creating the property goes to server 1. When you update the docclass soon after that this MIGHT go to server 2 which (until it refreshes its cache) has no idea of that property.... -> error property does not exist.

    So using an LB is harmless unless you make config changes where I recommend a real host. Certain updates (those that do not change the database) you can do during production hours. Take service 1 down, do the IFix, bring service 1 up, bring service 2 down,.... and so on.

    Hope this helps,

    /Gerold


    PS: Note that fronting ICN with a LB wasn't possible as it needed EJB transport (which DOES NOT work over LB) , but in recent versions (probably for containerization) they support WSI transport.

    ------------------------------
    Gerold Krommer
    ------------------------------



  • 3.  RE: Stovepipe Configuration for Content Navigator and CPE

    Posted Tue August 02, 2022 08:59 AM
    Hi, Gerold,

    so, this thing is popular ! :) 

    Thank you for posting (and sharing with the community sound advice since Image Services!!)  

    The last sentence, is a bit confusing, do you say, we cannot use Stovepipe for an ICN-CPE on prem typical solution? The White paper shows the ICN-CPE as the Basic Configuration for Stovepipe. The EBJ transport limitation, comes from the Load Balancer?  Is there any other way, you are aware of, to Load balance ICN?

    BR



    ------------------------------
    Christos Chorattides
    Datatech
    ------------------------------



  • 4.  RE: Stovepipe Configuration for Content Navigator and CPE

    IBM Champion
    Posted Tue August 02, 2022 09:10 AM
    What I meant was that until a few years ago the only transport between ICN and CPE that was supported was EJB. EJB has its own LB/HA thing within WAS and is not stateless (quite the opposite). Therefore EJB is not suited for LBs and I have ancient versions of your document, where ICN was outside the stovepipe.

    I venture a guess and say that for containerization IBM added WSI support a few years ago and now all is fine. We have a large bank fronting 2 ICN on WAS AS on RHEL with a BIGIP F5 LB and no problems....

    Sorry for the confusion.

    /Gerold

    ------------------------------
    Gerold Krommer
    ------------------------------



  • 5.  RE: Stovepipe Configuration for Content Navigator and CPE

    Posted Wed August 03, 2022 05:50 AM
    Ah, ok. You mean the ICN-CPE protocol. Right. That's why, we have to change to another ICN-CPE pair, in case of a CPE failure. We cannot load balance the EJB transport.

    So we only load balance the ICN servers and each ICN knows where to find its corresponding CPE.

    I will write down the procedure for ICN,CPE installation/configuration, as I understand it and post it here. Hopefully you can find a few minutes to verify it. 

    BR

    ------------------------------
    Christos Chorattides
    Datatech
    ------------------------------



  • 6.  RE: Stovepipe Configuration for Content Navigator and CPE

    IBM Champion
    Posted Wed August 03, 2022 07:11 AM
    Christos,

    I mixed it all up. Nothing what I said was wrong, but you wouldn't do stovepipes nowadays... no need. Think of cloud where such a configuration would be condemned.

    Configure 2 (or more) CPEs and front them with a LB and a virtual hostname/ip. 
    Configure 2 (or more) ICNs and front them with (possibly the same) LB and configure the repositories with WSI transport using the CPEs virtual hostname.

    That's it.

    Now I remember why they had to support WSI with ICN because WebSphere Liberty does not support EJB!

    Hope that helps,

    Gerold



    ------------------------------
    Gerold Krommer
    ------------------------------



  • 7.  RE: Stovepipe Configuration for Content Navigator and CPE

    Posted Thu August 04, 2022 02:56 AM
    Edited by Christos Chorattides Thu August 04, 2022 02:56 AM
    Hi Gerold,

    Great news!

    Just verified that WSI is supported from version 3.0.8.

    I will do some testing and go ahead with the implementation.

    Thank you!

    ------------------------------
    Christos Chorattides
    Datatech
    ------------------------------



  • 8.  RE: Stovepipe Configuration for Content Navigator and CPE

    Posted Thu August 04, 2022 04:01 AM
    Edited by Christos Chorattides Thu August 04, 2022 11:36 AM
    And a question on installation:

    What do you usually do, install CPE software on all "nodes" or on just the first? In theory, by changing the Server settings, inside FileNet Config Mgr., on first server, you can perform WAS configuration on all of the subsequent servers.
    And by copying the .ear file, to the other servers, I suppose you could also deploy (but never tried it).

    BR

    ------------------------------
    Christos Chorattides
    Datatech
    ------------------------------



  • 9.  RE: Stovepipe Configuration for Content Navigator and CPE

    Posted Thu August 04, 2022 09:43 PM
    If you are using WAS ND, then deploying to the deployment manager node will cascade to to the other nodes.  If you are deploying individual WAS servers, then you should use FileNet Config Mgr to deploy to each one.

    BTW, you might be interested in this blog that shows how to setup WAS ND with a load balancer to CPE, ICN, and GraphQL.  If you're not using an external Identity Provider, then just follow the LTPA instructions.
    • How to Configure LTPA/OAuth/OIDC SSO with FileNet ICN, CS GraphQL, and CPE on WebSphere ND Application Server
    • https://community.ibm.com/community/user/automation/blogs/roger-bacalzo1/2021/05/28/how-to-configure-sso-with-fncm-on-websphere-nd
    Here is a similar blog for setting up standalone WebSphere Application Server
    • How to Configure LTPA/OAuth/OIDC SSO with FileNet ICN, CS GraphQL, and CPE on WebSphere traditional application server
    • https://community.ibm.com/community/user/automation/blogs/roger-bacalzo1/2020/12/17/how-to-configure-sso-between-icn-and-cpe


    ------------------------------
    ROGER Bacalzo
    ------------------------------



  • 10.  RE: Stovepipe Configuration for Content Navigator and CPE

    Posted Fri August 05, 2022 02:42 AM
    Thank you Roger,

    this discussion started about the Stovepipe configuration and it is a traditional on-premises WAS Base installation.

    Then after Gerold pointed out that, now WSI transport is also supported things got simpler and there was no need for a stovepipe configuration.

    The question was, whether a FileNet CPE software installation is required on all CPE servers, or if configuration and deployment can be done from the first server installed/configured

    Now a new question on having multiple Load-balanced ICNs connected to multiple Load-balanced CPEs, what happens with LTPA keys? Which CPE exports and which ICN imports the keys. I thing we cannot import multiple LTPA keys in a WAS server so how can we authenticate users on CPE coming from ICN?

    BR

    ------------------------------
    Christos Chorattides
    Datatech
    ------------------------------



  • 11.  RE: Stovepipe Configuration for Content Navigator and CPE

    IBM Champion
    Posted Fri August 05, 2022 04:34 AM
    First I omitted to mention that ICN is of course not stateless , so the sessions from browser to ICN must be 'sticky' (session affinity).

    I spoke with our infrastructure guru and he thinks that one would export the LPTA token from one CPE and import it to all other CPEs and ICNs.

    One never stops learning....

    ------------------------------
    Gerold Krommer
    ------------------------------



  • 12.  RE: Stovepipe Configuration for Content Navigator and CPE

    Posted Fri August 05, 2022 08:00 AM
    Thank you again Gerold!

    My sandbox environment is almost ready, I will start working on this real soon.

    BR

    ------------------------------
    Christos Chorattides
    Datatech
    ------------------------------



  • 13.  RE: Stovepipe Configuration for Content Navigator and CPE

    Posted Tue August 09, 2022 05:17 AM
    Hi Gerold,

    I load balanced CE, seems to work fine, just a couple of quick questions.
    - When installing WAS I chose to use server1 on all servers as the WebSphere server name. Although this should be ok, is it a better idea to name server1, server2…etc. like we do with ND?
    - On the ICN side, I just created a repository using WSI with URL http://ce-vip: <port> /wsi/FNCEWS40MTOM/
    Any other setting required on ICN side?


    ------------------------------
    Christos Chorattides
    Datatech
    ------------------------------



  • 14.  RE: Stovepipe Configuration for Content Navigator and CPE

    Posted Tue August 09, 2022 11:29 AM
    Hope you referred this IBM technote on Stove pipe implementation.

    https://www.ibm.com/support/pages/sites/default/files/inline-files/$FILE/Stove%20Pipe%20White%20Paper%20v4_0.pdf



    Thanks & Regards,
    Sathish A Rajan

    ------------------------------
    Sathish Rajan
    ------------------------------



  • 15.  RE: Stovepipe Configuration for Content Navigator and CPE

    Posted Tue August 09, 2022 11:50 AM
    Thank you Sathish,

    That document initiated this discussion, but in the process, a great tip from @Gerold Krommer , shifted the discussion to a pure HA solution, using WSI transport for ICN.

    BR​

    ------------------------------
    Christos Chorattides
    Datatech
    ------------------------------



  • 16.  RE: Stovepipe Configuration for Content Navigator and CPE

    IBM Champion
    Posted Tue August 09, 2022 12:17 PM
    Not that I would remember, but do not forget the session affinity on the LB and that you should do any configuration work on a 'physical' server.

    let us know how it is going ...

    /Gerold

    ------------------------------
    Gerold Krommer
    ------------------------------



  • 17.  RE: Stovepipe Configuration for Content Navigator and CPE

    Posted Wed August 17, 2022 04:16 PM
    With regard to this question: - When installing WAS I chose to use server1 on all servers as the WebSphere server name. Although this should be ok, is it a better idea to name server1, server2…etc. like we do with ND?

    Yes, it is better if each server has a unique name. Among other issues, if the names are not unique, you might see odd display errors in ACCE. See the following topic in the documentation for more information on this uniqueness requirement: https://www.ibm.com/docs/en/filenet-p8-platform/5.5.x?topic=sites-server-instance-addition-site

    ------------------------------
    RUTH Hildebrand-Lund
    ------------------------------



  • 18.  RE: Stovepipe Configuration for Content Navigator and CPE

    Posted Thu August 18, 2022 06:13 AM
    Thank you Ruth,

    I will go ahead and change the server names. 

    BR

    ------------------------------
    Christos Chorattides
    Datatech
    ------------------------------