App Connect

 View Only

  • 1.  Standalone integration server gives warning on schema/map after optimze

    IBM Champion
    Posted Fri April 14, 2023 05:53 AM
    Edited by Matthias Blomme Fri April 14, 2023 05:55 AM

    So I'm trying to run an optimzed standalone integration server and I am getting the following warnings on startup

    BIP1977W: Created compiled 'XMLNSC' schema file 'PackageTest_App/RecordMRMIssue.bir'. Integration server 'KIM2' has been optimized. Schema resources should be compiled before the server is started.
    BIP1978W: The map file 'com.id.pack/:flow2_Mapping' has been compiled in 'PackageTest_App\com\id\pack'. Integration server 'KIM2' has been optimized. Map files should be compiled before the server is started.

    However, I should not get this warning in my opinion. What I'm doing

    1) Create sis via toolkit
    2) Deploy sources into sis with ibmint 

    ibmint deploy --input-path C:\temp\workspace --output-work-directory C:\Users\blommma\IBM\ACET12\workspace\KIM2 --project PackageTest_Lib --project PackageTest_App --compile-maps-and-schemas
BIP15233I: Generating BAR file 'C:\Users\blommma\AppData\Local\Temp\ibmint_deploy_generated_2023041409-46-33.bar' for deploy.

    3) run optimize

    ibmint optimize server  --work-directory C:\Users\blommma\IBM\ACET12\workspace\KIM2

    4) start SIS via toolkit

    This gives me the above warnings.
    I have tried building a bar file with ibmint and --compile-maps-and-schemas, but that gives the same warnings.

    Any ideas here or is this a bug in the startup of the SIS?



    ------------------------------
    Regards
    Matthias Blomme
    ------------------------------



  • 2.  RE: Standalone integration server gives warning on schema/map after optimze

    IBM Champion
    Posted Fri April 14, 2023 05:55 AM

    Btw, if the SIS actually re-compiles schemas/maps this would lead to a longer startup time.

    I have run this on 12.0.7.0



    ------------------------------
    Regards
    Matthias Blomme
    ------------------------------

    Original Message


  • 3.  RE: Standalone integration server gives warning on schema/map after optimze

    Posted Fri October 20, 2023 10:08 AM

    I have also encountered a same case where, despite compiling the mapping and schema in the barfile, when running the IS container, the IS still recompiles it. Please let me know if you have succeeded. Thank you.



    ------------------------------
    Nguyễn Bá Hoàng Anh
    ------------------------------

    Original Message


  • 4.  RE: Standalone integration server gives warning on schema/map after optimze

    IBM Champion
    Posted Wed October 25, 2023 01:36 AM

    I think it has to do with this

    IT44493: IBMINT DEPLOY COMMAND IGNORING THE PRESENCE OF --COMPILE-MAPS-AND-SCHEMAS FLAG

    https://www.ibm.com/support/pages/apar/IT44493?myns=swgother&mynp=OCSSDR5J&mync=E&cm_sp=swgother-_-OCSSDR5J-_-E

    I repeated the above steps with ACE 12.0.10.0 but I am still getting the same



    ------------------------------
    Regards
    Matthias Blomme
    ------------------------------

    Original Message


  • 5.  RE: Standalone integration server gives warning on schema/map after optimze

    IBM Champion
    Posted Tue December 19, 2023 08:15 AM

    Hi all

    I've retested this on ACE 12.0.11.0, but I get the same issue.

    To Recap:

    I have 2 projects, an application and library.

    I package and deploy via ibmint with the --compile-maps-and-schemas flag set.

    C:\Program Files\IBM\ACE\12.0.11.0>ibmint deploy --input-path C:\temp\workspace --output-work-directory C:\Users\blommma\IBM\ACET12\workspace\KIM2 --project PackageTest_Lib --project PackageTest_App --compile-maps-and-schemas
BIP15233I: Generating BAR file 'C:\Users\blommma\AppData\Local\Temp\ibmint_deploy_generated_2023121913-02-12.bar' for deploy.
Generating runtime objects: '[PackageTest_App, PackageTest_App, PackageTest_App, PackageTest_App, PackageTest_App]' @ 'C:\temp\workspace' ...

Generated runtime objects.

BIP1859I: Successfully added file 'application.descriptor' to the BAR file.
BIP1859I: Successfully added file 'com\id\pack\flow1.msgflow' to the BAR file.
BIP1859I: Successfully added file 'com\id\pack\flow2.msgflow' to the BAR file.
BIP1859I: Successfully added file 'com\id\pack\flow2_Mapping.map' to the BAR file.
BIP1859I: Successfully added file 'com\id\pack\flow3.msgflow' to the BAR file.
BIP1859I: Successfully added file 'com\id\pack\xmap_com.id.pack__flow2_Mapping.ser' to the BAR file.
BIP1859I: Successfully added file 'RecordMRMIssue.bir' to the BAR file.
BIP1859I: Successfully added file 'RecordMRMIssue.bir_inf' to the BAR file.
BIP1859I: Successfully added file 'xmap_com\id\pack__flow2_Mapping717a404ac283aa0a.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_com\id\pack__flow2_Mapping717a404ac283aa0a_Common$ConvertToXCIState.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_com\id\pack__flow2_Mapping717a404ac283aa0a_Common$decimalformat_t.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_com\id\pack__flow2_Mapping717a404ac283aa0a_Common$InitParam.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_com\id\pack__flow2_Mapping717a404ac283aa0a_Common$KeyTable.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_com\id\pack__flow2_Mapping717a404ac283aa0a_Common$NodeKind.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_com\id\pack__flow2_Mapping717a404ac283aa0a_Common$subText.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_com\id\pack__flow2_Mapping717a404ac283aa0a_Common$TunnelParam.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_com\id\pack__flow2_Mapping717a404ac283aa0a_Common$tuple_XDMSequence_XDMSequence.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_com\id\pack__flow2_Mapping717a404ac283aa0a_Common$XPath20TimeZone.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_com\id\pack__flow2_Mapping717a404ac283aa0a_Common$XSLT20ContextInfo.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_com\id\pack__flow2_Mapping717a404ac283aa0a_Common.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_com\id\pack__flow2_Mapping717a404ac283aa0a_Common_Partition0.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_com\id\pack__flow2_Mapping717a404ac283aa0a_Common_Partition1.class' to the BAR file.
BIP1859I: Successfully added file 'RecordMRMIssue\messageSet.mset' to the BAR file.
BIP1859I: Successfully added file 'RecordMRMIssue\MRMIssue.mxsd' to the BAR file.
BIP1859I: Successfully added file 'RecordMRMIssue.dictionary' to the BAR file.
BIP1859I: Successfully added file 'RecordMRMIssue.xsdzip' to the BAR file.
BIP1859I: Successfully added file 'service.log' to the BAR file.
BIP1859I: Successfully added file 'user.log' to the BAR file.
BIP1853I: Application file 'PackageTest_App.appzip' successfully added to the BAR file.
BIP1859I: Successfully added file '$mqsiLibrary.bir' to the BAR file.
BIP1859I: Successfully added file '$mqsiLibrary.bir_inf' to the BAR file.
BIP1859I: Successfully added file '$mqsiLibrary.dpif' to the BAR file.
BIP1859I: Successfully added file '$mqsiLibrary.dpif_inf' to the BAR file.
BIP1859I: Successfully added file 'dfdlSchema.xsd' to the BAR file.
BIP1859I: Successfully added file 'IBMdefined\CommaSeparatedFormat.xsd' to the BAR file.
BIP1859I: Successfully added file 'IBMdefined\RecordSeparatedFieldFormat.xsd' to the BAR file.
BIP1859I: Successfully added file 'input.xsd' to the BAR file.
BIP1859I: Successfully added file 'library.descriptor' to the BAR file.
BIP1859I: Successfully added file 'maps\xmap_maps__XMLMapping.ser' to the BAR file.
BIP1859I: Successfully added file 'maps\XMLMapping.map' to the BAR file.
BIP1859I: Successfully added file 'MessageModel\dfdlSchema2.xsd' to the BAR file.
BIP1859I: Successfully added file 'MessageModel\schema.xsd' to the BAR file.
BIP1859I: Successfully added file 'output.xsd' to the BAR file.
BIP1859I: Successfully added file 'PackageTest_Lib\subflow1.subflow' to the BAR file.
BIP1859I: Successfully added file 'PackageTest_Lib\subflow1_Compute.esql' to the BAR file.
BIP1859I: Successfully added file 'PackageTest_Lib\xml_map.subflow' to the BAR file.
BIP1859I: Successfully added file 'xmap_maps__XMLMapping543878ee7d506d52.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_maps__XMLMapping543878ee7d506d52_Common$ConvertToXCIState.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_maps__XMLMapping543878ee7d506d52_Common$decimalformat_t.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_maps__XMLMapping543878ee7d506d52_Common$InitParam.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_maps__XMLMapping543878ee7d506d52_Common$KeyTable.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_maps__XMLMapping543878ee7d506d52_Common$NodeKind.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_maps__XMLMapping543878ee7d506d52_Common$subText.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_maps__XMLMapping543878ee7d506d52_Common$TunnelParam.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_maps__XMLMapping543878ee7d506d52_Common$tuple_XDMSequence_XDMSequence.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_maps__XMLMapping543878ee7d506d52_Common$XPath20TimeZone.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_maps__XMLMapping543878ee7d506d52_Common$XSLT20ContextInfo.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_maps__XMLMapping543878ee7d506d52_Common.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_maps__XMLMapping543878ee7d506d52_Common_Partition0.class' to the BAR file.
BIP1859I: Successfully added file 'xmap_maps__XMLMapping543878ee7d506d52_Common_Partition1.class' to the BAR file.
BIP1859I: Successfully added file 'bin\com\id\pack\Flow1_JavaCompute.class' to the BAR file.
BIP1859I: Successfully added file 'bin\PackageTest_Lib_Java.jar' to the BAR file.
BIP1859I: Successfully added file 'com\id\pack\Flow1_JavaCompute.java' to the BAR file.
File PackageTest_Lib_Java.jar is not added to the BAR. Reason: duplicate entry: PackageTest_Lib_Java.jar
BIP1871I: Shared library file 'PackageTest_Lib.shlibzip' successfully added to the BAR file.
BIP8148I: Unpacking BAR file...
BIP8071I: Successful command completion.

    I then run ibmint optimize

    C:\Program Files\IBM\ACE\12.0.11.0>ibmint optimize server  --work-directory C:\Users\blommma\IBM\ACET12\workspace\KIM2
BIP15237I: The components file 'C:\Users\blommma\IBM\ACET12\workspace\KIM2\server.components.yaml' was created. It may be further edited if required.
BIP8071I: Successful command completion.

    So far so good. However, upon starting the integration server I get the following output

    ...
2023-12-19 14:12:35.183520: BIP2155I: About to 'Initialize' the deployed resource 'PackageTest_Lib' of type 'SharedLibrary'. 
2023-12-19 14:12:38.722636: BIP1977W: Created compiled 'XMLNSC' schema file 'PackageTest_App/RecordMRMIssue.bir'. Integration server 'KIM2' has been optimized. Schema resources should be compiled before the server is started. 
2023-12-19 14:12:38.729840: BIP9332I: SharedLibrary 'PackageTest_Lib' has been reloaded successfully. 
...
2023-12-19 14:12:38.803564: BIP2866I: IBM App Connect Enterprise administration security is inactive. 
2023-12-19 14:12:38.830048: BIP3132I: The HTTP Listener has started listening on port '7601' for 'RestAdmin http' connections. 
2023-12-19 14:12:38.830792: BIP1991I: Integration server has finished initialization. 
2023-12-19 14:12:39.094240: BIP1978W: The map file 'com.id.pack/:flow2_Mapping' has been compiled in 'PackageTest_App\com\id\pack'. Integration server 'KIM2' has been optimized. Map files should be compiled before the server is started. 
2023-12-19 14:12:39.399472: BIP1978W: The map file 'maps/:XMLMapping' has been compiled in 'PackageTest_Lib\maps'. Integration server 'KIM2' has been optimized. Map files should be compiled before the server is started. 
...

    So it seems that either the output is wrong, the integration server is not recognizing the compiled schema's or they are just not compiled by ibmint.

    In the ibmint deploy output I do see "BIP1859I: Successfully added file 'RecordMRMIssue.bir' to the BAR file.", but somehow that doesn't make it to the integration server?

    Anyone got a solution for this?

    @Ben Thompson any idea on this?



    ------------------------------
    Regards
    Matthias Blomme
    ------------------------------

    Original Message


  • 6.  RE: Standalone integration server gives warning on schema/map after optimze

    Posted Tue December 19, 2023 08:38 AM

    Hi Matthias ,

    I have resolved this issue. Let me clarify the meaning of the two commands: ibmint optimize and --compile-maps-and-schemas:

    1. ibmint optimize: This command will calculate the ACE (App Connect Enterprise) project and generate a server.components.yaml file with the components used in your project. From there, you can enable or disable these components, allowing your Integration Server to start up more quickly.

    2. --compile-maps-and-schemas: Using this option can help compile the maps and schemas in your BAR (Broker Archive) file or deployment file in advance. This is done once.

    However, here's the issue: when you compile and then deploy to the Integration Server, the IS will check if your BAR file matches the XMLs. The IS will perform a validation check and compile further if needed.

    To address this issue in a simple way:

    • Build the BAR file.
    • Run the command with the BAR file using --compile-maps-and-schemas.
    • Deploy it to the Integration Server.
    • Zip the folder that was just deployed to the Integration Server (let's temporarily call this zipped BAR file finalbar.zip).

    => finalbar.zip: This BAR file can be redeployed to the Integration Server without any warnings or additional compilation steps. It can be said that you have optimized the startup time of the Integration Server.

    (Forget about ibmint optimize in this context.)



    ------------------------------
    Nguyễn Bá Hoàng Anh
    ------------------------------

    Original Message


  • 7.  RE: Standalone integration server gives warning on schema/map after optimze

    IBM Champion
    Posted Thu December 21, 2023 02:57 AM

    Hi Nguyen

    That is not really a solve in my book. It's more of a workaround. Creating a bar file, deploying it and then using the result to build a new bar would indeed work, but then why create a bar file in the first place :) 

    In my opinion the IS shouldn't have to compile anymore if you already compiled during your bar build. Even if you use ibmint optimze.



    ------------------------------
    Regards
    Matthias Blomme
    ------------------------------

    Original Message


  • 8.  RE: Standalone integration server gives warning on schema/map after optimze

    IBM Champion
    Posted 2 days ago

    I'm still having the same issue in 12.0.12.2. Even with operators on OpenShift.

    Why is --compile-maps-and-schemas not resolving these startup warnings? I guess this also means the startup takes longer then it should?

    Any one have an answer or a solve for this?



    ------------------------------
    Regards
    Matthias Blomme
    ------------------------------

    Original Message