Message Image  

Explore the new features in App Connect Enterprise version

 View Only
Mon July 06, 2020 11:55 AM

We’re thrilled to announce the availability of IBM App Connect Enterprise v11.0.0.1. This is the first fix pack released for App Connect Enterprise software. We intend to provide fix packs on a regular cadence, approximately once per quarter. In fact we’re currently expecting to provide a further two fix packs this calendar year. Fix packs are intended to provide both regular maintenance for the product, and also new functional content. This blog post summarises all the latest and greatest capabilities:

  • Introducing App Connect Enterprise integration nodes
  • A Web UI for viewing multiple nodes and servers
  • Administrative REST APIv2 for controlling App Connect Enterprise v11
  • Policy Enhancements and Overrides
  • In memory aggregation using the new Group nodes

Expand the sections below to find out more!

Introducing App Connect Enterprise integration nodes

Existing users of IBM Integration Bus may already be familiar with the concept of an integration node. Architecturally speaking, an integration node is a parent process which is responsible for looking after one or more associated integration server processes. An Integration Server is used to provide an isolated runtime environment for a set of deployed message flows and resources. Each Integration Server runs as a unique operating system process in a separate address space. App Connect Enterprise v11.0.0.0 was the first time that Integration Server processes could be defined independently from an Integration Node. An Integration Node provides a higher level operating system process, as part of a wider process hierarchy, which is designed to look after the servers which are owned by it. If you are planning to run the App Connect Enterprise software in conjunction with a container framework such as Kubernetes or IBM Cloud Private, then it is the responsibility of this framework to ensure that the servers remain running (or are restarted appropriately) so in this situation using independent Integration Servers would be the preferred architectural choice.

However, many people will be planning to run the App Connect Enterprise software directly on a physical machine without any wider container orchestration framework. In this situation you are advised to define Integration Servers under an Integration Node. The Integration Node capability of the product and the node-wide HTTP Listener, are delivered in ACEv11.0.0.1 as Technology Preview Code for customers to use in non-production environments. This early access is provided for internal use for evaluation purposes and to allow customers to provide feedback and functionality suggestions to IBM before the Integration Node becomes fully supported.

At first glance, integration nodes will be very familiar to existing IBM Integration Bus users. You can create and start an integration node and its integration servers using some existing commands that have been with the product for a very long time, which should help existing users who are keen to reuse administrative scripts from earlier product versions. To create an integration node and an associated integration server, launch an App Connect Enterprise command console and use the following commands:

  • mqsicreatebroker TESTNODE_ACE
  • mqsistart TESTNODE_ACE
  • mqsicreateexecutiongroup TESTNODE_ACE -e server1

You can connect your App Connect Enterprise Toolkit to both independent integration servers, and also those which are owned by an integration node:

App Connect Enterprise Web UI for viewing multiple nodes and servers

App Connect Enterprise v11 introduced a fresh new look for the administrative web user interface. The IBM Integration Bus v10 web UI was heavily dependent on a tree layout (in the left side panel) for navigating up and down the hierarchy of integration nodes, servers, applications and message flows. In a significant enhancement, to make the most of screen real estate, the App Connect Enterprise web UI design uses tiles to represent these hierarchical elements of the product, and breadcrumb navigation trails to swiftly navigate. ACEv11.0.0.1 provides further enhancements for the Web UI:
  • You can connect your web browser to a specific independent integration server (the same as in ACEv11.0.0.0)
  • You can connect your web browser to an integration node to administer all of the servers which it owns
  • You can define an integration server to be used for the specific purpose of hosting an admin dashboard which can be used to view multiple integration nodes and integration servers which can be distributed throughout your network across multiple physical machines, virtual machine images or containers.

The animated screen show below demonstrates each of these three types of administrative web user interface options:

Administrative REST APIv2 for controlling App Connect Enterprise v11

IBM App Connect Enterprise v11 provides an administrative REST API, which you can use to control integration nodes and integration servers. This REST API is utilised by both the App Connect Enterprise Toolkit and the administrative Web User Interface. You can also investigate this API for yourself directly using an HTTP client such as cURL. With the delivery of ACEv11.0.0.1, another excellent option to help you become familiar with this API, is a new interactive documentation page which is served directly from both nodes and servers. The REST API classes and methods are described in the App Connect Enterprise REST API V2 specification, which you can view in a browser by specifying the address of your integration node or integration server, and the administration REST API port, followed by /apidocs. For example, to display the REST API specification for an integration node, you might use a URL such as https://localhost:4414/apidocs.

The animated screen show below demonstrates how to locate the REST API documentation which is being served both from an independent integration server (in this example, through port 7600), and also from an integration node (in this example, through port 4422):

Policy Enhancements and Overrides

IBM Integration Bus v10 provided the concept known as configurable services in order to control the runtime behaviour of the product in a particular environment. Configurable services could be used to define properties relating to connections with external services such as an external JDBC or JMS provider, or operational properties such as in order to configure activity logging. App Connect Enterprise v11 evolves this idea into the concept of a Policy. Policies are used to provide the product runtime with equivalent information to configurable services, however in ACEv11 a policy can be created in the App Connect Enterprise Toolkit inside a policy project. These artifacts can be checked into version control, and also deployed to the product runtime using a Broker Archive file. Fix pack 1 allows policies to be overidden using policies which are placed directly onto the filesystem of the runtime installation and which take precedence over policies which are deployed through a BAR file. This enables an administrator to assert control over artifacts deployed to the runtime by a developer.

The animated screen show below provides a quick tour of creating policies in the App Connect Enterprise toolkit:

In memory aggregation using the new Group nodes

Fix pack 1 of App Connect Enterprise provides a new set of three message flow nodes known as the Group nodes. These nodes provide a new stateless alternative to the Aggregation nodes which have been a part of the IBM Integration Bus product for many years. We have deliberately chosen not to deprecate the Aggregation nodes, as we feel that the two sets of nodes are complementary and provide distinctly different qualities of service which each bring unique value to the product. The three Group nodes are as follows:

  • The Group Scatter node marks the beginning of a Group
  • The Group Gather node matches up reply messages to Groups based on Reply identifiers / Message identifiers
  • The Group Complete node behaves like a new “input” node and deals with the propagation of completed groups, timed-out groups and timed-out unknown messages downstream to other nodes in the message flow.

The Group nodes are non-transactional in their approach. The data on which their behaviours are based, is stored in memory of the integration server, in contrast to the approach used by the Aggregation nodes which utilises the storage of messages on MQ queues. IBM has not yet published results of formal performance and load tests with these nodes, but our internal testing has yielded very positive results in terms of non-functional requirements compared to the Aggregation nodes. When using the Group nodes compared to the Aggregation nodes we have observed the potential for significantly higher throughput, lower mean response times and smaller CPU cost per message. These aspects suggest that the group nodes will be particularly helpful for users dealing with low-latency, rapid response scenarios.

6 comments on"Explore the new features in App Connect Enterprise version"

  1. Ron Peereboom August 23, 2018

    I’ve installed this fixpack with the intention of investigating the new group nodes. They are indeed available in the toolkit but there seems to be no help available. Can you please let me know when the help system will be updated? Just using trial and error is too time consuming.

    Reply (Edit)
    • Ian_Larner August 28, 2018

      @Ron Peereboom Hi,
      I have published some initial docs about the group nodes in IBM Knowledge Center. I am looking to add an example/tutorial perhaps along with other updates when the assigned writer is back from absence.
      For example, see the following pages:

      Group nodes and aggregation nodes
      GroupScatter node


      Reply (Edit)
      • Ivo Salkovic November 16, 2018

        Hi Ian,

        are these nodes supported/ backported to v10 runtime?

        Any way to use them in IIB?


        Reply (Edit)
        • BenThompsonIBM November 19, 2018

          The Group nodes have been provided in both ACEv11.0.0.1 and IIBv10.0.0.14

          Reply (Edit)
      • Debjit June 21, 2019

        Hi Ian,
        Are any samples/examples made available for these Group Nodes which would be compatible for both II v10.0.0.14 and ACEv11.0.0.1? If yes could you please point to those links/samples.

        Reply (Edit)
        • Ian_Larner June 21, 2019

          @Debjit Hi,
          The blog post IBM App Connect Enterprise now supports Group nodes describes an example and provides a project interchange file that you can import into your toolkit. The post was written based on App Connect Enterprise V11 and running the demo in App Connect on IBM Cloud. I have also imported the project interchange file into an IIB V10.0.0.16 toolkit on Windows 10 and successfully run the demo in a local integration server (default).

          Regards, Ian

          Reply (Edit)