MQ

MQ

Join this online group to communicate across IBM product users and experts by sharing advice and best practices with peers and staying up to date regarding product enhancements.

 View Only
  • 1.  AMQ6729W

    Posted 04/29/26 06:31 AM
    Hi All,
    We have a Multi instance QMGR setup on EC2 with our Qeue files residing on and NFS mounted EFS.
    We see quite alot of the below messages in the eror log and it restards meeages being sent to a remote QMGR.
    Any one else experienced someting similar?
    AMQ6729W: Log I/O operation (W) exceeded threshold (1000000 microseconds).
     
    EXPLANATION:
    A Read (R) or Write (W) of 4096 bytes took longer than expected to complete.
    This might indicate a problem with your O/S or storage system. If this occurs
    frequently, queue manager performance is likely to be severely impacted.
    ACTION:
    Investigate cause of long I/O times in your storage provision.  If these delays
    are expected in your environment, the warning threshold can be increased by
    modifying the AMQ_IODELAY environment variable.



    ------------------------------
    Emile Kearns
    ------------------------------


  • 2.  RE: AMQ6729W

    Posted 04/30/26 04:02 AM

    Hi Emile,
    I take it the amqmfsck tests run ok? 
    Regards,

    Rab. 



    ------------------------------
    Rab McGill
    ------------------------------



  • 3.  RE: AMQ6729W

    Posted 04/30/26 06:29 AM

    Hi Rab,

    I have never used this before, but thanks, I will look into it.

    If you have pointers, it would be greatly appreciated.

    Emile



    ------------------------------
    Emile Kearns
    ------------------------------



  • 4.  RE: AMQ6729W

    Posted 04/30/26 06:54 AM

    The IBM documentation that I think you should look at is 
    https://www.ibm.com/docs/en/ibm-mq/9.4.x?topic=multiplatforms-verifying-shared-file-system-behavior#q005820_
    and
    https://www.ibm.com/support/pages/testing-shared-file-system-compatibility-ibm-mq-multi-instance-queue-managers?view=full

    EFS should pass ok. If not maybe  raise it with AWS. 

    For the various tests  you should get output similar to  -

     
    ######################################################################
     
    [mqm@mq-01 ~]$ /opt/mqm/bin/amqmfsck /MQHA
    The tests on the directory completed successfully.
     
     
     
    [mqm@mq-02 ~]$ /opt/mqm/bin/amqmfsck /MQHA
    The tests on the directory completed successfully.
     
    ##########################################################################
     
     
    [mqm@mq-01 ~]$ /opt/mqm/bin/amqmfsck -c /MQHA
    Start a second copy of this program with the same parameters on another server.
    Writing to test file. This will normally complete within about 60 seconds.
    ...................
     
    The tests on the directory completed successfully.
     
     
     
    [mqm@mq-02 ~]$ /opt/mqm/bin/amqmfsck -c /MQHA
    Writing to test file. This will normally complete within about 60 seconds.
    ...............................................
    The tests on the directory completed successfully.
     
     
    ##################################################################################
    run /opt/mqm/bin/amqmfsck -w /MQHA on both servers
     
    01 gets the lock, 02 waits, on 01 hit enter to stop the process, 02 should get the lock.
     
     
     
    [mqm@mq-01 ~]$ /opt/mqm/bin/amqmfsck -w /MQHA
    File lock acquired.
    AMQ5667E: Error executing system call 'fcntl(fd,F_SETLK)' on file
    '/MQHA/amqmfsck.lkw', errno 11 ('EAGAIN (11) - Resource temporarily
    unavailable').
    AMQ5667E: Error executing system call 'fcntl(fd,F_SETLK)' on file
    '/MQHA/amqmfsck.lkw', errno 11 ('EAGAIN (11) - Resource temporarily
    unavailable').
    Start a second copy of this program with the same parameters on another server.
    Press Enter or terminate this process to release the lock.
     
    File lock released.
    The tests on the directory completed successfully.
     
     
     
     
     
    [mqm@mq-02 ~]$ /opt/mqm/bin/amqmfsck -w /MQHA
    AMQ5667E: Error executing system call 'fcntl(fd,F_SETLK)' on file
    '/MQHA/amqmfsck.lkw', errno 11 ('EAGAIN (11) - Resource temporarily
    unavailable').
    Waiting for the file lock.
    AMQ5667E: Error executing system call 'fcntl(fd,F_SETLK)' on file
    '/MQHA/amqmfsck.lkw', errno 11 ('EAGAIN (11) - Resource temporarily
    unavailable').
    Waiting for the file lock.
    AMQ5667E: Error executing system call 'fcntl(fd,F_SETLK)' on file
    '/MQHA/amqmfsck.lkw', errno 11 ('EAGAIN (11) - Resource temporarily
    unavailable').
    Waiting for the file lock.
    AMQ5667E: Error executing system call 'fcntl(fd,F_SETLK)' on file
    '/MQHA/amqmfsck.lkw', errno 11 ('EAGAIN (11) - Resource temporarily
    unavailable').
    Waiting for the file lock.
    File lock acquired.
    AMQ5667E: Error executing system call 'fcntl(fd,F_SETLK)' on file
    '/MQHA/amqmfsck.lkw', errno 11 ('EAGAIN (11) - Resource temporarily
    unavailable').
    AMQ5667E: Error executing system call 'fcntl(fd,F_SETLK)' on file
    '/MQHA/amqmfsck.lkw', errno 11 ('EAGAIN (11) - Resource temporarily
    unavailable').
    Press Enter or terminate this process to release the lock.
     
     
     
    this shows the lock is acquired
     
    #########################################################################################################
     
    [mqm@mq-01 ~]$ /opt/mqm/bin/amqmfsck -f /MQHA
    Formatting test file for data integrity test.
    Test file formatted with 262144 pages of data.
     
     
    [mqm@mq-02 ~]$ /opt/mqm/bin/amqmfsck -f /MQHA
    AMQ5693E: Test file already exists.
     
    use the -x option of amqmfsck to delete the test file
    [mqm@mq-02 ~]$ /opt/mqm/bin/amqmfsck -x /MQHA
    Test files deleted.
     
     
    [mqm@mq-02 ~]$ /opt/mqm/bin/amqmfsck -f /MQHA
    Formatting test file for data integrity test.
    Test file formatted with 262144 pages of data.
     
    [mqm@mq-01 ~]$ /opt/mqm/bin/amqmfsck -x /MQHA
    Test files deleted.
     
     
    ########################################################################################################
    create test file 
    [mqm@mq-01 ~]$ /opt/mqm/bin/amqmfsck -f /MQHA
    Formatting test file for data integrity test.
    Test file formatted with 262144 pages of data.
     
    [mqm@mq-01 ~]$ /opt/mqm/bin/amqmfsck -a /MQHA
    File lock acquired.
    Start a second copy of this program with the same parameters on another server.
    Writing data into test file. Once the other copy of the program has begun
    waiting on the file lock, interrupt this program by ending the process,
    temporarily breaking the network connection to the networked storage, rebooting
    the server or turning off the power.
     
     
    [mqm@mq-02 ~]$ /opt/mqm/bin/amqmfsck -a /MQHA
    Waiting for the file lock.
    Waiting for the file lock.
    Waiting for the file lock.
     
     
    Reboot 1 
     
     
    Waiting for the file lock.
    Waiting for the file lock.
    Waiting for the file lock.
    File lock acquired.
    Reading test file checking the integrity of the data read.
    Appending data into the test file after data already found.
     
    The test file is full of data. It is ready to be inspected for data integrity.
     
     
    80+ mins 
     
     
    [mqm@mq-02 ~]$ /opt/mqm/bin/amqmfsck -i /MQHA
    Reading test file checking the integrity of the data read.
    The data read was consistent.
    The tests on the directory completed successfully.
     
     
     
    [mqm@mq-02 ~]$ /opt/mqm/bin/amqmfsck -x /MQHA
    Test files deleted.



     Then run amqsfhac tests. 

    Regards,

    Rab. 



    ------------------------------
    Rab McGill
    ------------------------------



  • 5.  RE: AMQ6729W

    Posted 04/30/26 07:00 AM

    Also make sure your EFS is configured as 

    Throughput mode
    Elastic

    and not Bursting. 

    It might be you are reaching an EFS limit. 


    ------------------------------
    Rab McGill
    ------------------------------