Originally posted by: aixworker

Hello,

we have to rsync data from EMC Isilon OneFS storage.

The 32-bit rsync runs into problems with the 64-bit pointers used by OneFS.

Can you please build rsync with 64-bit support?

Thanks in advanve for your assistance.

Best regards

Joerg

Originally posted by: sanket

Thanks for pointing the issue.

Sure we will look into it.

Thanks

Sanket

Originally posted by: DaveMarquardt

So do you need 64-bit or just large files support? We can also provide large file support with a 32-bit application.

Originally posted by: aixworker

Hello Dave,

i need 64-bit support.

Thank you very much for your assistance.

Best regards

Joerg

Originally posted by: DaveMarquardt

What do you mean by 64-bit pointers in your first post? 64-bit file pointers? AIX handles that with large file support, not necessarily 64-bit executables.

Originally posted by: aixworker

Hello Dave,

first at all sorry about my english. I am not so familiar in explaining technical details in english.

I dont  need support of large files.

The isilon storage uses 64-bit file IDs and send this file IDs to rsync, but rsync can't process  this IDs.

Maybe that this article is helpful to understand the need for the rsync_64

https://www.kickflop.net/blog/2014/12/18/64-bits-is-too-many-bits/

I know that Michael Perzl had build an 64-bit rsync and distributes it at perzl.org, but i prefer to have all RPMs from the IBM distribution.

Best regards

Joerg

Originally posted by: DaveMarquardt

Note this in that article:

Turns out Isilon OneFS serves up 64-bit file IDs by default. Unless 32-bit applications allow for compilation with "largefile" support, and are compiled with it, they don't know how to properly handle stat()/lstat() calls against 64-bit file-id-having files.

Note the "largefile" support comment. Applications like rsync can be compiled with largefile support and 32-bit or 64-bit. We probably need to consult with an AIX filesystems person to completely understand this.

Originally posted by: aixworker

Hello Dave,

i had build an test environment to reproduce the issue.

Isilon OneFS serves 64-bit file IDs, IBM Freeware rsync installed.

rsync from isilon OneFS to AIX filesystem Fails immediately (see below).

# rpm -qi rsync
Name        : rsync
Version     : 3.1.2
Release     : 1
Architecture: ppc
Install Date: Wed Jun  7 16:53:32 DFT 2017
Group       : Applications/Internet
Size        : 902935
License     : GPLv3+
Signature   : (none)
Source RPM  : rsync-3.1.2-1.src.rpm
Build Date  : Thu Apr 14 12:30:28 DFT 2016
Build Host  : green52.in.ibm.com
Relocations : (not relocatable)
URL         : http://rsync.samba.org
Summary     : A program for synchronizing files over a network.
Description :
...
#
# rsync --log-file=/tmp/syn2.log --log-file-format='%o %i %f' -v --itemize-changes --exclude='.snapshot' -a /mnt /tmpdir/
sending incremental file list
rsync: opendir "/mnt/." failed: Value too large to be stored in data type (127)

sent 42 bytes  received 12 bytes  108.00 bytes/sec
total size is 0  speedup is 0.00
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1178) [sender=3.1.2]

Best regards

Joerg

Originally posted by: DaveMarquardt

Thanks for the data point. Sanket and his team should get a large files enabled filesystem set up for testing.

I took a look at the source for rsync 3.1.2, and it definitely has support for large files on AIX and other platforms. So it may be a matter of using the right options when running rsync's configure script before building rsync.

Originally posted by: sanket

We have compiled and published 64bit version of rsync on toolbox.

Please give it a try if it resolves your issue.

https://public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/rsync/rsync-3.1.2-2.aix6.1.ppc.rpm

Thanks

Sanket

Originally posted by: aixworker

Problem solved  !!!

I have installed rsync-3.1.2-2.aix6.1.ppc.rpm and it resolves the issue.

Thank you very much !

Best regards

Joerg