Originally posted by: gooster

Hi

I need some advice from other members.

I have million of text encrypted files in AIX 5.3 with size 900 to 1024KB size each which I need to transfer once a month into WIndows webserver which later will be access by the public.

Unfortunately the FTP stop with error after it transfered 30k files.Was there a limitation on FTP or AIX which not allow many files to be transfer.

If somebody had similar issue, what kind of solution that you have took.
Regards
-Gooster-
#AIX-Forum

Originally posted by: gooster

For additional information: this error I got after the FTP tranferred 30+k files.

No control connection for command: Error 0
Following was the FTP script :-

cd $SOURCECP
echo "ftp Lejer LCP E Files"
ftp -n << EOF
open winftpserver
user administrator password
cd $TARGETCP
lcd $TARGETCP
binary
mput *.gpg
bye
EOF
#AIX-Forum

Originally posted by: Kosala

Looking at the error, I think one possible problem would be your control connection timed out either by the OS or one of the network devices (during the transfer the the control connection is idling).

One thing I can suggest is to switch to passive mode. Your new script should look like:

cd $SOURCECP
echo "ftp Lejer LCP E Files"
ftp -n << EOF
open winftpserver
user administrator password
passive
cd $TARGETCP
lcd $TARGETCP
binary
mput *.gpg
bye
EOF

BUT... I would really like you to give a try to .netrc feature for FTP and telnet (man ftp will tell you more). The approach will be much neater. I hate to suggest things for windows, but you might want to look at CIFS capabilities of AIX (5.3 onwards I guess), so you can copy to a windows share directly.

HTH,
Kosala
#AIX-Forum

Originally posted by: gooster

Thanks for the ideas.

I'm also loooking another option to install SAMBA in AIX server and shared with windows server. Logically SAMBA had been introduced quite sometimes ago in Red Hat Linux but i saw it was still new in AIX.

Anybody has experience using it as an alternative for huge FTP , please let me know.
Regards
#AIX-Forum

Originally posted by: SystemAdmin

We've used Samba under AIX for development purposes here without any obvious problems - though we were dealing with a much smaller number of files.

If it is the same million or so files that are being transferred every month and they don't all change, then using rsync might be a viable alternative.

rsync only transfers the portions of files that have changed. I've successfully used it to transfer many gigabytes over fairly slow WAN connections. If the connection drops, it can be restarted and it will pretty much just carry on where it left off.

See: http://samba.anu.edu.au/rsync/
#AIX-Forum

Originally posted by: SystemAdmin

Hi,

You may find the problem is the mget line. In ksh the filelist can only expand to about 4000 characters, so any files over this limit will be missed.

You could check where the command fails and compare this with the output from say:

ls *.gpg ftplist
#AIX-Forum