MQ

MQ

Join this online group to communicate across IBM product users and experts by sharing advice and best practices with peers and staying up to date regarding product enhancements.

 View Only

  • 1.  Max File size on MQ v8 and above

    Posted Thu April 01, 2021 03:42 AM
    Hi All,

    Is there any limit on file size that can transferred on MQ v8 and above? We have an use case to transfer files up to 50 GB to SAP, thinking of using MQ. Any ideas would be great.

    ------------------------------
    Rajasekhar Muthamsetty
    ------------------------------


  • 2.  RE: Max File size on MQ v8 and above

    Posted Thu April 01, 2021 03:46 AM

    I assume when you say you are thinking of using MQ, you mean that you are thinking of using Managed File Transfer over MQ? If so, MFT breaks files up into a number of messages so that you are not actually using really big messages. The efficiency sweet spot for MQ is much lower than it's message size maximum of 100MB (which is clearly very much lower than your requirement of 50 GB) and so MFT ensures that it is a well behaved MQ application by breaking up files into smaller chunks for transmission.

    Cheers,
    Morag



    ------------------------------
    Morag Hughson
    MQ Technical Education Specialist
    MQGem Software Limited
    Website: https://www.mqgem.com
    ------------------------------

    Original Message


  • 3.  RE: Max File size on MQ v8 and above

    Posted Thu April 01, 2021 04:02 AM
    Thanks Morag,

    Actually I meant MQ alone. Yeah, we do have MFT on MQ. If MQ suits well for messages 100MB or less, I think MFT should be considered as an option.

    ------------------------------
    Rajasekhar Muthamsetty
    ------------------------------

    Original Message


  • 4.  RE: Max File size on MQ v8 and above

    Posted Fri April 02, 2021 04:12 AM
    Rajasekhar,
    It is certainly worth investigating MFT to see what it can do and whether it would fit your requirements.

    If you think about the issues involved in sending a 50GB file as lots of MQ messages from A to B, then you have to consider how you want the transfer to be initiated (some sort of trigger ? a file directory change, a scheduled task), what happens at the target end if, say, the file already exists, how you deal with any errors in the middle of transmission, how you optimise the transmission for speed and yet provide the ability to restart the transmission "mid-stream" if necessary.

    In short, you need to write an MQ application which will be as sophisticated as you need it to be.

    Best regards,
    Dermot Flaherty
    IBM has already written such an application with MFT !



    Original Message


  • 5.  RE: Max File size on MQ v8 and above

    Posted Fri April 02, 2021 12:05 PM
    You may also wish to consider Aspera for large file transfers.

    ------------------------------
    Valerie Lampkin
    IBM Technical Specialist
    ------------------------------

    Original Message


Related Content