Originally posted by: Kepa_Screen

Hi:

We are thinking of using WSTX in order to treat files, and load them after transformation to a Oracle DB.

Source files are dispersed over several machines, so we need to get them from other systems, possibly via FTP.

We would like to mount this system on an EventServer, and our question is if its possible for EventServer to listen to remote machines for get the event that triggers the maps. Could FTP Adapter trigger events in eventServer ¿?

code

remote-machine <<<----ftp adapter ---->>> EventServer -> Map()
^ ^

__________trigger___________________

[/code]

Thank you.
#DataExchange
#IBMSterlingTransformationExtender
#IBM-Websphere-Transformation-Extender

Originally posted by: paul.brett

No, the FTP adapter cannot be used for triggering, and a time-based event would be required to retrieve a list of files, and then (if any are available) retrieve the files themselves.

Paul.
#IBM-Websphere-Transformation-Extender
#DataExchange
#IBMSterlingTransformationExtender

Originally posted by: SystemAdmin

Exactly what Paul said.

In all the hundreds of FTP sites I've swept from, they were all on a timed event.

In an example, looking at the attached pic, below the rule is the input file for the map, containing two fields; the place I should sweep from and the place I should put the files.

So for functional map, I grab each record, put the FTP folder in the FTP run map command, and sweep the folder. The map will sweep each folder that I have a record for in the input file. My example is using different folders for the same FTP site, but you could include the FTP information such as IP, user and password, and sweep multiple FTP locations in one map run (with multiple run maps). It is timed to execute every 5 minutes.

This may not be what you're asking, but I hope it helps.
#IBMSterlingTransformationExtender
#IBM-Websphere-Transformation-Extender
#DataExchange

Originally posted by: janhess

If you have permission to map the other servers to your environment for the user that the event server is running under then you can use the file adapter with the trigger set.
#IBMSterlingTransformationExtender
#DataExchange
#IBM-Websphere-Transformation-Extender

Originally posted by: Kepa_Screen

Hi, thank you very much to both.

Jahness, what do you mean about "if you can map" ? I understand that you mean something about using some kind of nfs, or samba use ?

We have several problems. I'll try to explain all the problem, but could be a little hard to understand:

• I have lot of sources and of several kind of systems. Some ones are unix ( aix ) systems, some other AS400, also GCOS ( DPS7000 ).
• At my enterprise, we use a propietary tool for dispatching all kind of works, on all our systems, is an scheduler. Also use a propietary tool for transfer of files between systems ( based on ftp protocol, but with lot of controls and other utilitys called GTF). Always use theese tools in our projects.

But, this time, my boss wants to give some relevance to WSTX at the enterprise, so, GTF shouldn't be used.

I'd like to know( we are doing a little prototype...but thinking about this now...) if we could retrieve files via ftp, only giving a pattern of the name of the files to be retrieved, or if, using ftp adapter, the name of files must be specific and complete.

We could use an Oracle db containing the structure of all systems involved to parametrize initial map ( hostname/user/passwd/incoming path/pattern of file/ destiny location on E/S machine ...) ...recolector of files, and scheduled ( time triggered ) by eventserver.

Then other maps ( each one listening to a different directory, depending on system type ) would be triggered to do their job ( basically write on a DB ).

But at this moment have not enoug info to say to you if we need to use patterns at file names, or not.Only estimating if this kind of project could be done using WSTX

Thank you very much for your replys. ( Jahness, very happy to see you again here...)
#IBMSterlingTransformationExtender
#IBM-Websphere-Transformation-Extender
#DataExchange

Originally posted by: SystemAdmin

What I think Jahness is saying, if I'm reading it correctly, was that if you had permission to the folder where the files are, you could map a network drive and to that folder and use the file adapter, not FTP....if that's what he's saying.
I'm confused on what you mean by "pattern of file". Actually, I'm confused about a bunch of stuff you mention.
Can you give a specific example of what you mean?

Like, you have 10 files named "xxxx.txt" and you want to grab all of them, or 5 of them.

I have used wildcards in the past, like:

-URL FTP://username:password@ftpsite.com\\folder\M*.*;type=D

In case you don't know, type=D tells the WSTX FTP adapter to pass back the filenames in the FTP folder that it's pointing to.

So that URL command would pass back a list of the all the files that start with "M".
I don't think there's ever been a situation that I could not overcome by programming in WSTX. It may take a bit of planning, but I've always been able to accomodate just about every single challange.
PS: good word ---> Parameterize. I like that.
#DataExchange
#IBM-Websphere-Transformation-Extender
#IBMSterlingTransformationExtender

Originally posted by: SystemAdmin

Jan is referring to using something like NFS to mount the various directories so they appear as local directories on your server. Then you can use the WTX file adapter and the Launcher will trigger when a file appears in the remote but locally mounted directories. In a pure Windows environment, this is the functional equivalent of mapping remote drives and directories.
#IBM-Websphere-Transformation-Extender
#IBMSterlingTransformationExtender
#DataExchange

Originally posted by: janhess

Jim that's what I was thinking of. FTP can be a problem even when you know the file names. You can't tell on some systems when the file has been completely written and so there is a risk of picking up a partial file. We had a standard where any file that was to be FTP'd somewhere also had a dummy empty file sent afterwards so that this could be used as a trigger. Also, when looking at a remote location for an FTP it would check for the dummy file. The other option is to create the file with a temporary name and rename it when it has finished being written to (as WTX does) or use the FTP rename facility.
#DataExchange
#IBM-Websphere-Transformation-Extender
#IBMSterlingTransformationExtender

Originally posted by: Kepa_Screen

Thank you very much to all.

when you say :
code
I'm confused on what you mean by "pattern of file". Actually, I'm confused about a bunch of stuff you mention.
[/code]

i wanted to say "wildcards". Sorry for my bad english. I can understand it well but have not so much vocabulary...Think you all could understand me well.

Thanks again.
We are now investagating if nfs its avalaible for all sources.
Will update with feedback.
#DataExchange
#IBM-Websphere-Transformation-Extender
#IBMSterlingTransformationExtender