Originally posted by: SystemAdmin
The best way to do this is to have the main map do an FTP GET using the type=D option to get a list of the files on the server.
Output card would have a functional map, that has the file names passed as data. The functional map would have a PUT file rule to create files with the file name needed as part of the file name and in the data.
This would trigger a map to do an FTP GET of the specific file.
There is a potential problem with using FTP in a RUN map. The connection is opened when the map starts and if there are a number of files or a few large files, the commit does not happen until all files are processed and the FTP server could time out to inactivity while the data is being proecessed.
The method above does not have this problem and can handle files of any size. It also does not error when there are no files available, since there will always be something in the type=D return.
You will need to create fairly simple trees for this. The tree for parsing the actual data will need to be created or imported based on the data itself.
#IBMSterlingTransformationExtender#IBM-Websphere-Transformation-Extender#DataExchange