IBM webMethods Hybrid Integration

IBM webMethods Hybrid Integration

Join this online group to communicate across IBM product users and experts by sharing advice and best practices with peers and staying up to date regarding product enhancements.

 View Only
Expand all | Collapse all

Large Document recognition Issue using wm.tn.doc.xml:routeXml

  • 1.  Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Mon May 03, 2010 11:32 AM

    Dear wmusers,

    Our partner is submitting a compressed large file to wm.tn:receive on HTTP protocol and TN recognizes the content
    as largepart and invokes processing service.In processing service I decompress the content and then resubmit the uncompressed XML
    content back to TN for further processing but this time TN is not recognizing the content as large.
    I am using wm.tn.doc.xml:routeXml to route the xml back to TN.I have set my TN large file config setting correctly as it works when content is submitted first time using HTTP.

    Can someone suggest why would wm.tn.doc.xml:routeXml would not recognize my doc as large? Node I supply to routeXml
    service is being contructed via stream input to pub.xml:xmlStringToXMLNode.

    I tried using wm.tn:receive for internal submit but it’s behavior is same as routeXml.

    IS: 7-1-2_Core_Fix14

    Thanks,
    PD


    #B2B-Integration
    #Integration-Server-and-ESB
    #webMethods


  • 2.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Mon May 03, 2010 04:15 PM

    It is the HTTP handler that determines if a doc is large, not routeXml. Submit the doc using pub.client:http being sure to set the content-size header.


    #webMethods
    #B2B-Integration
    #Integration-Server-and-ESB


  • 3.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Mon May 03, 2010 04:49 PM

    As Rob suggested above,yes use the pub.client:http (method=post) and invoke the wm.tn:receive with header/content-size setting.

    HTH,
    RMg


    #Integration-Server-and-ESB
    #webMethods
    #B2B-Integration


  • 4.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Tue May 04, 2010 08:11 AM

    It is unfortunate that in order to submit to local server, I have to use HTTP.Don’t you expect it to have performance implications? A work around I have figured out is If I construct a $reservation object before calling routeXML then the document is being recognized as large.


    #Integration-Server-and-ESB
    #webMethods
    #B2B-Integration


  • 5.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Tue May 04, 2010 05:08 PM

    “Don’t you expect it to have performance implications?”

    No.


    #Integration-Server-and-ESB
    #webMethods
    #B2B-Integration


  • 6.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Wed May 05, 2010 07:50 PM

    rob/rmg,

    are you saying that TN will never recognize the document as large if document is sent using routeXML ?

    i have successfully set up TN large document handling for documents which were routed using routeXML inbuilt service.

    Once document is routed to TN, tn.BigDocThreshold is the factor which would decide whether the document would be considered as large or not, irrespective of routing mechanism.

    puneet,
    can you try setting bigDocThreshold value to 0 which would mean that all document routed to TN would be considered as large.


    #Integration-Server-and-ESB
    #B2B-Integration
    #webMethods


  • 7.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Wed May 05, 2010 09:32 PM

    That’s been my experience. But it has been a while since I’ve tried it.


    #webMethods
    #Integration-Server-and-ESB
    #B2B-Integration


  • 8.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Wed August 18, 2010 08:20 AM

    Hi everyone,

    I have tried doing that but its not working.I am sending a 3MB document to TN but Tn is not recognizing that document as large.
    I have used the following settings:-

    tn.BigDocThreshold = 0
    tn.xml.xqlThreshold = 5000
    watt.server.tspace.location=D:\LargeDocTemp
    watt.server.tspace.max=52428800

    To send the document to Tn i am using Following services:-

    documentToXmlString
    XmlStringToXmlNode
    client:http

    Plz help its urgent

    Thanks in advance,

    Chinmaya Nanda


    #Integration-Server-and-ESB
    #webMethods
    #B2B-Integration


  • 9.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Wed August 18, 2010 04:38 PM

    You should try using receive or routeXML (prefferred) service for routing doc to TN and not http for internal processings.

    documentToXmlString
    XmlStringToXmlNode
    wm.tn.doc.xml:routeXml

    First try with smaller chunks data and if recognition works then use large file.You can also test xml submission via WmTN Home page

    HTH,
    RMG


    #B2B-Integration
    #webMethods
    #Integration-Server-and-ESB


  • 10.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Wed August 18, 2010 06:16 PM

    chinmaya, I believe the content-size header must be set for large doc handling to kick in.

    But it appears that your steps are already loading the entire document into memory so there is no point in trying to get large doc handling of TN used until you restructure things.


    #Integration-Server-and-ESB
    #B2B-Integration
    #webMethods


  • 11.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Thu August 19, 2010 08:11 AM

    Hi rmg/reamon,
    I have tried using routeXML also but that is also not working.As i was going through the documentation i found that we cannot send a large document by $xmlData.Therefore i was using client:http but that is also not working.
    Can u guys plz send me the code how to route a large document to TN???My email id is chinmayaj.nanda@lntinfotech.com.

    Thanks in advance,

    Chinmaya Nanda


    #B2B-Integration
    #webMethods
    #Integration-Server-and-ESB


  • 12.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Thu August 19, 2010 03:05 PM

    Did you also tried thru [URL]http://yourIShost:5555/WmTNWeb/[/URL] from DocumentSubmission page?

    Did you also see Rob’s comments?

    HTH,
    RMG


    #Integration-Server-and-ESB
    #B2B-Integration
    #webMethods


  • 13.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Thu August 19, 2010 03:59 PM

    Can you post the service steps along with parameter details? Perhaps we can see what is amiss.

    But I want to emphasize again that if you’ve already loaded the document into memory (you mentioned using a couple of services that will only work when the document is completely in memory) then trying to get large doc handling for TN is pointless.


    #Integration-Server-and-ESB
    #webMethods
    #B2B-Integration


  • 14.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Fri August 20, 2010 06:40 AM

    Hi rob/rmg,

    Thanx for your prevoius replies :).

    I have used following services.I m sending u the screenshots.

    I have used the following settings:-

    tn.BigDocThreshold = 0
    tn.xml.xqlThreshold = 5000
    watt.server.tspace.location=D:\LargeDocTemp
    watt.server.tspace.max=52428800.

    Please tell me what i am doing wrong.

    Thanks in advance,

    Chinmaya Nanda


    #Integration-Server-and-ESB
    #webMethods
    #B2B-Integration


  • 15.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Fri August 20, 2010 06:49 AM

    Hi guys,

    These are all the screenshots :slight_smile:

    Regards,

    Chinmaya Nanda


    #B2B-Integration
    #webMethods
    #Integration-Server-and-ESB


  • 16.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Fri August 20, 2010 04:38 PM

    I’ve mentioned it before in this thread–routeXml will not cause large document handling to be used.

    If the screenshot of the call to routeXml is for the service that is intended for real use (instead of just a “test things out” service) then the documentToXMLString and xmlStringToXMLNode are also a problem–those services expect the entire document to be in memory.

    If you want large doc handling:

    1. Don’t load the entire document into memory at any point of the integration. Use node iteration if necessary.

    2. Use http to post the document to TN. Be sure to set the content-size header and pass a stream to the http call, not bytes nor a string.


    #B2B-Integration
    #Integration-Server-and-ESB
    #webMethods


  • 17.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Fri August 20, 2010 09:13 PM

    I’ve mentioned it before in this thread–routeXml will not cause large document handling to be used. → My intention is not use routeXML (only to test stuff or internal routings).For large document handling purpose always Node iteration/http call and configure IS/TN LargeDoc handling is preferred way.

    HTH,
    RMG


    #Integration-Server-and-ESB
    #webMethods
    #B2B-Integration


  • 18.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Wed October 13, 2010 06:30 AM

    Hi rob/rmg,

               Sorry for late reply.finally I am able to do the large document handling.Thank you guyzzz for your support and answers.I will upload a document regarding what i have done  soon.
    

    Thanks again Guys.

    Thanks and Regards,

    Chinmaya Nanda


    #B2B-Integration
    #webMethods
    #Integration-Server-and-ESB


  • 19.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Wed October 13, 2010 05:00 PM


  • 20.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Tue November 16, 2010 02:37 PM

    HI puneet,

    i have set following configuration values in TN

    tn.BigDocThreshold=5120000
    [SIZE=1]tn.xml.xqlThreshold=3000000

    Now i tried to check whether Large document handling is working or not by invoking these steps

    stringToBytes
    bytesToStream
    handleLargeDoc
    then routeXML to route it to TN

    while i m seeing the document has been sent to TN but in the pipeline out of the handleLargeDoc step
    i m seeing under the bizDoc section LargeDocument is false i.e it is not recognised as large document…Can u please share steps that u have taken to send large document to TN
    [/SIZE]


    #Integration-Server-and-ESB
    #webMethods
    #B2B-Integration


  • 21.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Tue November 16, 2010 04:43 PM

    Hi Dendo,

    For large document handling you need to use http/ftp to send the document to Tn rather than using the service routeXml.

    Plz explain wat is "handleLargeDoc"

    Thanks and Regards

    Chinmaya nanda


    #B2B-Integration
    #webMethods
    #Integration-Server-and-ESB


  • 22.  RE: Large Document recognition Issue using wm.tn.doc.xml:routeXml

    Posted Tue November 16, 2010 10:13 PM

    I agree with Chinmaya’s suggestion…


    #webMethods
    #Integration-Server-and-ESB
    #B2B-Integration