IBM webMethods Hybrid Integration

IBM webMethods Hybrid Integration

Join this online group to communicate across IBM product users and experts by sharing advice and best practices with peers and staying up to date regarding product enhancements.

 View Only
Expand all | Collapse all

problem receiving XML via HTTP Post in webMethods 8.2.2

  • 1.  problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Wed August 01, 2012 11:40 AM

    We have recently upgraded our server from version 6.2 to version 8.2.2 and after that there are problems with one of our customers posting xml data to our servers.

    The service exposed customer is a wrapper to wm.tn.doc.xml:routeXml; receives an XML via http post and routes the document to TN. in 6.5 it was working perfectly and in 8.2 it stopped working (only for this specific customer and customer confirmed no changes at their end; the same request routed to 6.5 server works fine).

    When we checked the pipeline in 6.5; we can see the below list of variables placed in pipeline of the service for the http request

    1. $xmldata ------> String with the complete XML string
    2. $xmldataList —> StringList with complete XML string in position 0
    3. node ------> XML node (Our service processes the node and ignores the rest)

    In 8.2 there is no data available in pipeline most of the time. or sometimes a httpContentStream which when we try to restore it does not work.

    Have any one faced this kind of issue with 8.2.2.
    Any changes to http request handling behaviour in 8.2 vs 6.5?

    Thanks!
    Deepan


    #Integration-Server-and-ESB
    #webMethods
    #webmethods-Protocol-and-Transport


  • 2.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Wed August 01, 2012 12:15 PM

    Hi Deepan,
    It can either be “$xmldata” or “string” in 8.2 as well… No difference has happened with the signatures…

    But remember, $xmldata will have the data as xml node format… which means, you will have to use xmlNodeToDocument service to convert it to IS doc… I think this node object acts as a stream hence u r not able to save it in pipeline… Map $xmldata to node input in above service and try converting it to IS document.

    -Senthil


    #webMethods
    #webmethods-Protocol-and-Transport
    #Integration-Server-and-ESB


  • 3.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Wed August 01, 2012 12:22 PM

    Hi Senthil,
    Thanks for your reply; however as i mentioned in 6.5 we can see the below placed in pipeline by the server
    1. $xmldata ------> String with the complete XML string
    2. $xmldataList —> StringList with complete XML string in position 0
    3. node ------> XML node (Our service processes the node and ignores the rest)

    however we do not see any data being placed into pipeline in 8.2.2

    I suppose we can save the pipeline containing streams using pub.flow.savePipeline (in memory).

    Thanks
    Deepan


    #webMethods
    #webmethods-Protocol-and-Transport
    #Integration-Server-and-ESB


  • 4.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Wed August 01, 2012 12:32 PM

    No… You cannot save this stream in file or in memory… If you still want to see the content, use streamToString service, and then invoke savePipelineToFile service… Later disable all the steps, and keep restorePipelineFromFile service, or directly check the file in the filesystem.

    -Senthil


    #webMethods
    #webmethods-Protocol-and-Transport
    #Integration-Server-and-ESB


  • 5.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Wed August 01, 2012 12:42 PM

    ok. the problem is not with saving pipeline (it could be posted as stream/bytes). this what my pipeline looks if restore in 6.5.
    [ATTACH=CONFIG]872[/ATTACH]

    however i do not see any data being placed in pipeline for the same service in 8.2.2. so document gets routed to TN. I suspect a change in behaviour with respect to http request handling in 8.2.2; any pointers would be helpful.
    pipeline.png


    #Integration-Server-and-ESB
    #webMethods
    #webmethods-Protocol-and-Transport


  • 6.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Wed August 01, 2012 03:03 PM

    You may want to read the section “Submitting and Receiving XML via HTTP” in the Developer Users Guide and the documentation of the server parameter watt.server.http.xmlFormat in the Adminstering Integration Server document. Watch out for the new xmlFormat argument you can put into the URL. The way I understand it, is that at least as of version 8.2SP1, you can get only one of the three: node, xmlStream or xmlBytes.


    #webmethods-Protocol-and-Transport
    #webMethods
    #Integration-Server-and-ESB


  • 7.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Wed August 01, 2012 03:15 PM

    Also did you set the Content-Type=text/xml while posting it and what is the input type you are using?

    HTH,
    RMG


    #webMethods
    #Integration-Server-and-ESB
    #webmethods-Protocol-and-Transport


  • 8.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Wed August 01, 2012 04:05 PM

    Hi RMG, We receive this xml from one of our customer; content-type is set to text/xml. At this moment i’m not sure of input type or the program being used to post. we are waiting for some additional information from customer.


    #Integration-Server-and-ESB
    #webmethods-Protocol-and-Transport
    #webMethods


  • 9.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Wed August 01, 2012 04:12 PM


  • 10.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Wed August 01, 2012 04:13 PM

    Are they sending direct to TN receive or invoking a customer service in turn routes to TN?

    OK keep the forum posted:


    #webmethods-Protocol-and-Transport
    #webMethods
    #Integration-Server-and-ESB


  • 11.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Wed August 01, 2012 04:27 PM

    They send to a wrapper service which in turn invokes TN service to route the document to TN.
    Also the other thing i have noted just before; when we receive the request from the customer the pipeline has variable contentStream with com.wm.net.HttpInputStream as value (in MWS monitor).
    Though i have reason to suspect customer might not have set Content-Type to text/xml; the same requests works very well in 6.5 server which gets node in pipeline.
    If the request works in 6.5 i would expect it to get processed in 8.2.2 as well. Am i overlooking something here?

    I have verified the server setting as suggested by Thomas earlier, it is set to node (watt.server.http.xmlFormat=node) and all other customer requests are processed well.


    #webMethods
    #Integration-Server-and-ESB
    #webmethods-Protocol-and-Transport


  • 12.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Wed August 01, 2012 04:29 PM

    Though i have reason to suspect customer might not have set Content-Type to text/xml

    Yes it could please check with the customer on this and determine next:

    822 vars should work same as 6.5 posting…


    #webmethods-Protocol-and-Transport
    #webMethods
    #Integration-Server-and-ESB


  • 13.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Thu August 02, 2012 12:00 AM

    Hi Deepan,

    Looks like you should get out a http sniffer. TCPMON from apache.org is the Tool of Choice. To use ist, you must either convince the Client to send requests to a different port or to tell the server to release it’s port and use a different one. TCPMON will then work as plumbing between the two ports and will nicely display whats being sent and received. You even have the chance to edit a recorded request and to resend it. I always have this one in my toolbox. Please keep us posted how this resolves.

    mit freundlichen Grüßen / with kind regards

    Thomas


    #Integration-Server-and-ESB
    #webmethods-Protocol-and-Transport
    #webMethods


  • 14.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Thu August 02, 2012 12:10 AM

    I think you cannot expect compatibility of buggy behaviour.

    Nothing that comes to my mind. But i would expect some porting effort going from 6.5 to 8.2.2 and skipping 2 major releases: 7 and 8.0. It’s my personal opinion that 8.2 should have been called 9.0.

    Thomas


    #Integration-Server-and-ESB
    #webMethods
    #webmethods-Protocol-and-Transport


  • 15.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Thu August 02, 2012 03:45 PM

    9.0 will be coming in FY13…and you will say 10 :slight_smile:


    #Integration-Server-and-ESB
    #webMethods
    #webmethods-Protocol-and-Transport


  • 16.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Thu August 02, 2012 06:00 PM

    If not 11…


    #webmethods-Protocol-and-Transport
    #webMethods
    #Integration-Server-and-ESB


  • 17.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Thu August 02, 2012 08:19 PM


  • 18.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2



  • 19.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Mon August 06, 2012 01:26 PM

    at this moment we chose to fall back to 6.5, not because of this issue but for other stability issues around terracotta clustering…
    we plan to do some more tests and will update the forum in some point with solution / root cause.
    thanks for all your support and information :slight_smile:


    #webmethods-Protocol-and-Transport
    #Integration-Server-and-ESB
    #webMethods


  • 20.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Mon August 06, 2012 01:35 PM

    I am sure you brought this to the attention of product support?


    #webMethods
    #webmethods-Protocol-and-Transport
    #Integration-Server-and-ESB


  • 21.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Mon August 06, 2012 02:38 PM

    Are you not satisfied with Coherence default clustering?..Do you have terracotta licensing?

    Just curious:

    HTH,
    RMG


    #webMethods
    #Integration-Server-and-ESB
    #webmethods-Protocol-and-Transport


  • 22.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Mon August 06, 2012 03:02 PM

    coherence is not supported on VM I believe, one of the reasons SAG support recommended Terracotta; yes we do have license for Terracotta for IS clustering.

    Regards
    Deepan


    #webMethods
    #Integration-Server-and-ESB
    #webmethods-Protocol-and-Transport


  • 23.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Mon August 06, 2012 03:21 PM


  • 24.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Tue September 04, 2012 09:47 AM

    -update for the issue with http requests–
    customer was sending XML as URL encoded which was not recognised by 82 IS, customer agreed to change in their side to remove the url encoding and test went ok.
    other way we could resolve this is write a custom content handling service, extract the xml string from contentStream then decode the url encoding to get the xml string.

    Strange, that same request was accepted in 65 but not in 82, may be we missed some server settings or parameters??


    #webmethods-Protocol-and-Transport
    #webMethods
    #Integration-Server-and-ESB


  • 25.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Tue September 04, 2012 02:34 PM

    Nope…but they shouldn’t be changing simple/standard stuff:


    #webMethods
    #webmethods-Protocol-and-Transport
    #Integration-Server-and-ESB


  • 26.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Tue September 04, 2012 02:35 PM

    Nope…but they shouldn’t be changing simple/standard stuff:

    What URL encoding?


    #webmethods-Protocol-and-Transport
    #Integration-Server-and-ESB
    #webMethods


  • 27.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Tue September 04, 2012 02:52 PM

    I have no chance to look at how customer is sending data. however this is my observation

    1. The xml sent by customer is URL encoded - %3C for <, %3E for < etc…
    2. This request when sent to 65 server it is recognised and IS places “node” in the service pipeline
    3. When sent to 82 server, this is not recognised and we get “contentStream” in pipeline; when converted to string, we get the URL encoded XML.

    I wish nothing changed in the standard stuff; still wondering any settings or other parameters causing this.


    #webmethods-Protocol-and-Transport
    #webMethods
    #Integration-Server-and-ESB


  • 28.  RE: problem receiving XML via HTTP Post in webMethods 8.2.2

    Posted Tue September 04, 2012 03:59 PM

    Make sure they set the content-type=text/xml while sending HTTP post string data…If not ask for more details on their methods:

    As far I know no standard settings changed the receiving style:


    #webmethods-Protocol-and-Transport
    #Integration-Server-and-ESB
    #webMethods