Originally posted by: SystemAdmin

The way that I've always swept FTP locations for multiple files, by using "Type=D" in the input card, then passing each retrieved filename to a functional map which does a run map, overriding the input as FTP will that specific filename and output to a file. Whether there were 0 or 20 files on the FTP site, it all worked fine.

In my new shop, it just doesn't work anymore. Only the first file gets down. I've already had to work around this for one system, but I need to know what's happening.

I went into the config file and saw this:
;use the following to define the max number of RUN maps to be cached in the memory
;default value is 300, minimum value is 10
;set this value to -1 to disable RUN map caching
RunMapCacheMaxNum=-1
Now, there's not an overly abundant info on exactly what that means, but could it mean that event server is restricted to running more then one instance of the FTP RUn map at a time? Someone here changed it to "-1".

ANy help would be great. Our event server used to be on Windows, now I'm Unix based for the first time, so I don't know if it something to do with this OS.

thanks!

Message was edited by: rep
#IBMSterlingTransformationExtender
#IBM-Websphere-Transformation-Extender
#DataExchange

Originally posted by: SystemAdmin

I just changed event server to a local ini and removed the "-1" and didn't get the results I wanted.

Any other suggestion, whether successful or not, automaticly trigger a holiday card.
#IBM-Websphere-Transformation-Extender
#IBMSterlingTransformationExtender
#DataExchange

Originally posted by: SystemAdmin

I have a bit more info on what I’ve tried and exactly what’s happening.

I have an input of 7 entries, each of which have an FTP site. I pass each one, one by one to a functional map that does a run map for each entry in the input, and it's supposed to sweep all 7 area's.

I set the audit log of the RUN map to append, and the FTP trace file name as the entry that’s running, so it should be different for every of the 7's runs.

So all in all, I should get 7 trace files, and 7 runs in the audit log on the run map.

I get the 7 runs in the audit log, showing the command line as having the trace file for each entry, but only one trace file is created, only the first one, everytime.
Here's 2 of the 7 the audit entries where you can see the trace file name being different, but I only ever get one trace file. The audit log show's it's running 7 times, but it's only running for the first entry and I do not know why.

<Platform>RUN Function for HP-UX(TM) - Version 7.5(119)</Platform>

<ExecutionSummary MapStatus="Valid" mapreturn="0" ElapsedSec="2.171" BurstRestartCount="0">
<Message>Map completed successfully</Message>
<CommandLine>/opt/DataStageTX/Ascential/Communication/Maps/Move_Blob.mmc -IAFTP1X ' -T+ bnsfrr1.mtr -URL FTP://XXXX:XXXXX@XXXXX.com/bnsfrr1/inbound/*;type=D '</CommandLine>

<MapAudit StartTime="17:23:02 December 4, 2007">

<Platform>RUN Function for HP-UX(TM) - Version 7.5(119)</Platform>

<ExecutionSummary MapStatus="Valid" mapreturn="0" ElapsedSec="0.004" BurstRestartCount="0">
<Message>Map completed successfully</Message>
<CommandLine>/opt/DataStageTX/Ascential/Communication/Maps/Move_Blob.mmc -IAFTP1X ' -T+ fecrr01.mtr -URL FTP://XXXX:XXXXX@XXXXX.com/fecrr01/inbound/*;type=D '</CommandLine>
#IBM-Websphere-Transformation-Extender
#DataExchange
#IBMSterlingTransformationExtender

Originally posted by: TarunB

Have you tried specifying the complete path for the trace file location?

Also, have you tried just using -T instead of -T+ to see if that makes a difference to the trace file creation?

Or even just giving the Trace file a fixed name and using T+ to see if you get 7 traces appended?

And the more basic question: your output type tree field range is (0:s) isn't it?

Message was edited by: TarunB
#DataExchange
#IBMSterlingTransformationExtender
#IBM-Websphere-Transformation-Extender

Originally posted by: SystemAdmin

Thanks for reading it through.

Here's the thing;

I have 7 FTP site's I'm sweeping, which create 7 of the entires in the audit log such as this one, the first one;
<ExecutionSummary MapStatus="Valid" mapreturn="0" ElapsedSec="2.171" BurstRestartCount="0">
<Message>Map completed successfully</Message>
<CommandLine>/opt/DataStageTX/Ascential/Communication/Maps/Move_Blob.mmc -IAFTP1X ' -T+ bnsfrr1.mtr -URL FTP://XXXX:XXXXX@XXXXX.com/bnsfrr1/inbound/*;type=D '</CommandLine>
I get bnsfrr1.mtr created. Now even though the next entry in the audit log shows the same exact info as the one above:

<ExecutionSummary MapStatus="Valid" mapreturn="0" ElapsedSec="0.004" BurstRestartCount="0">
<Message>Map completed successfully</Message>
<CommandLine>/opt/DataStageTX/Ascential/Communication/Maps/Move_Blob.mmc -IAFTP1X ' -T+ fecrr01.mtr -URL FTP://XXXX:XXXXX@XXXXX.com/fecrr01/inbound/*;type=D '</CommandLine>
fecrr01.mtr does not get created. Everything past the first RUN map says it ran, but there are no results.

I even put an extra field right before the RUN map statement, with a text string saying "Running: varible", varible = which ever mailbox I'm hitting, which will also name the trace file "varible.mtr" and they all are listed, though only the first one shows any results.

Running:bnsfrr1/inbound/,0 <only one I get mtr on. 0 = run map results.
Running:fecrr01/inbound/,0
Running:nsrr001/inbound/,0
Running:uprr001/inbound/,0
Running:csxrr01/inbound/,0
Running:cnrr001/inbound/,0
Running:kcsrr01/inbound/,0
I'm waiting for IBM support to get back to me. I'll post the results.

Message was edited by: rep
#IBMSterlingTransformationExtender
#DataExchange
#IBM-Websphere-Transformation-Extender

Originally posted by: janhess

Shouldn't you be specifying the file name rather than * in the URL?

Message was edited by: janhess
#DataExchange
#IBMSterlingTransformationExtender
#IBM-Websphere-Transformation-Extender

Originally posted by: SystemAdmin

Hi Janhess.
In this case, I was trying to just pass the file names for 7 different locations. Meaning, instead of sweeping one site with the type=D, and grabbing each file in the functional map, I'm was trying to sweep each of the folders and pass the file names in the functional map. It was working the way it should, but only for the first of the 7 locations. I just didn’t get output for the test.
either way, support said it's a known issue. The info’s in the other thread with “type=D” in the name.
#DataExchange
#IBMSterlingTransformationExtender
#IBM-Websphere-Transformation-Extender