IBM Sterling Transformation Extender

Sterling Transformation Extender

Come for answers, stay for best practices. All we're missing is you.


#Sterling
#Supplychain
 View Only
  • 1.  File SourceEvent polling?

    Posted 12/10/07 07:49 AM

    Originally posted by: SystemAdmin


    Does anyone know how SourceEvent on a file input card works internally?

    How often does the EventServer look for matching files to trigger the map?
    How many IOs are generated?

    Are there any settings to tweak this behaviour. Only found FileListenCount and ListenSleepTime, but I am not 100% sure what they do...

    Thanks all.

    Message was edited by: Semiel
    #IBMSterlingTransformationExtender
    #IBM-Websphere-Transformation-Extender
    #DataExchange


  • 2.  Re: File SourceEvent polling?

    Posted 12/10/07 08:25 AM

    Originally posted by: TarunB


    It is possible on Unix to configure the directory scan interval parameter, but not the same on Windows as far as I know.

    In the dstx.ini file look for the parameter named DirScanWaitTime. The default is a trigger directory scan every 50ms. It is recommended to increase this interval if your CPU utilisation is running too high.

    If you want to further control your map executions then you could create a time trigger rather than an event trigger. This would allow you to check directories at your chosen intervals, say, every 5 minutes.
    #DataExchange
    #IBM-Websphere-Transformation-Extender
    #IBMSterlingTransformationExtender


  • 3.  Re: File SourceEvent polling?

    Posted 12/10/07 08:30 AM

    Originally posted by: LaurentB


    Hi Semiel,

    the ways to tweak the behaviour are via the provided settings in the dtx.ini :

    - filelistencount to limit the number of files in a same directory that could be taken into account at once
    - listensleeptime to determine how long the scanning loop sleeps between two pollings.
    - dirscanwaittime to define the sleep time between two repetitve dir scans. the dtx.ini says it works at lower level than listensleeptime, I'm not sure to exactly understand what it means.

    I don't know the internals, but basically the file event detection works on a loop that scans the directories for new or updated files. I also know for sure that, if the above parameters are not properly set, you may encounter either very high CPU usage when idle, or very limited performances if set too high.

    Laurent
    #IBMSterlingTransformationExtender
    #DataExchange
    #IBM-Websphere-Transformation-Extender


  • 4.  Re: File SourceEvent polling?

    Posted 12/12/07 04:50 AM

    Originally posted by: SystemAdmin


    Thanks all.

    Im an on Windows, so looking into the ListenSleepTime parameter.

    Do you know whether this is the time between single directory processing (going from one single dir to another), or all directory processing (does all folders every X milliseconds)?
    I suppose it is the first as it makes the most sense...

    Message was edited by: Semiel
    #IBMSterlingTransformationExtender
    #DataExchange
    #IBM-Websphere-Transformation-Extender