MQ

MQ

Join this online group to communicate across IBM product users and experts by sharing advice and best practices with peers and staying up to date regarding product enhancements.

 View Only
  • 1.  IBM MQ 9.3 in AWS with EFS as storage - Delay in writing message to queue with Multi instance Queue manager setup.

    Posted Mon July 22, 2024 02:39 PM

    Hi All,

    We have set up IBM MQ 9.3 in AWS EC2 with EFS (NFS 4.1) as the shared file system. We have configured it as a multi-instance queue manager for high availability.

    When we start the queue manager as a multi-instance queue manager using the "strmqm -x QMGRNAME" command, we observe a delay/latency when data is written to MQ. It takes 20 minutes for 60K messages to be placed in the MQ with the multi-instance queue manager.


    However, when the same queue manager is started using "strmqm QMGRNAME" without the multi-instance setup, we do not observe this delay/latency while writing data to MQ. It takes less than 3 minutes for 60K messages to be placed in the MQ without the multi-instance queue manager.

    Can anyone help us understand why there is such a significant delay when using the multi-instance setup and suggest any possible solutions to resolve this issue?



    ------------------------------
    Kishore S
    ------------------------------


  • 2.  RE: IBM MQ 9.3 in AWS with EFS as storage - Delay in writing message to queue with Multi instance Queue manager setup.

    Posted Tue July 23, 2024 05:17 AM

    Hi,

    This is issue with NFS file system only . 

    We had the similar experience where we found Queue Manager server in one DC and NFS in another DC.

    Now coming to your issue you need to reach your storage system about this latency these latency usually observed in ORACLE NFS but not on NetApps.

    In your case it is AWS EC2 with EFS where we did not had this type of environment. 



    ------------------------------
    VijayaBhaskar p
    ------------------------------



  • 3.  RE: IBM MQ 9.3 in AWS with EFS as storage - Delay in writing message to queue with Multi instance Queue manager setup.

    Posted Tue July 23, 2024 09:29 AM

    Hi Kishore,
    we had this issue with long transactions. 
    Feedback from IBM is that it is related to file locking. Transactions in multi-instance mode do more file locking. This was a surprise to us because we expected that multi-instance mode would only add locks on "active", "master" and "standby", and all other locks would be the same as with a normal start.
    IBM told us that it is expected behavior and recommended shorter transactions. No fix is planned.
    If your application or test is putting messages in transactions, especially long ones, this might be the explanation. I suggest testing without transacitions to confirm.



    ------------------------------
    YVES MOYROUD
    ------------------------------



  • 4.  RE: IBM MQ 9.3 in AWS with EFS as storage - Delay in writing message to queue with Multi instance Queue manager setup.

    Posted Tue July 23, 2024 09:30 AM

    Hi Kishore,
    we had this issue with long transactions. 
    Feedback from IBM is that it is related to file locking. Transactions in multi-instance mode do more file locking. This was a surprise to us because we expected that multi-instance mode would only add locks on "active", "master" and "standby", and all other locks would be the same as with a normal start.
    IBM told us that it is expected behavior and recommended shorter transactions. No fix is planned.
    If your application or test is putting messages in transactions, especially long ones, this might be the explanation. I suggest testing without transacitions to confirm.



    ------------------------------
    YVES MOYROUD
    ------------------------------



  • 5.  RE: IBM MQ 9.3 in AWS with EFS as storage - Delay in writing message to queue with Multi instance Queue manager setup.

    Posted Wed July 24, 2024 08:36 AM

    FYI, this is also worth reviewing if you haven't already seen it: https://www.ibm.com/support/pages/ibm-mq-considerations-efs-aws



    ------------------------------
    Arthur Barr
    Container Architect, IBM MQ
    IBM
    ------------------------------



  • 6.  RE: IBM MQ 9.3 in AWS with EFS as storage - Delay in writing message to queue with Multi instance Queue manager setup.

    Posted Tue August 13, 2024 04:34 AM

    Hi,

    I might be worth comparing other NFS options on AWS, NetApp recently did their own testing following our guidelines, see,

    https://www.netapp.com/blog/ibm-mq-in-aws-built-on-amazon-fsx-for-netapp-ontap/



    ------------------------------
    Regards,

    Martin Evans
    IBM MQ Technical Product Manager
    ------------------------------