AIX Open Source

 View Only

  • 1.  rsync 3.2.3 failing with memory error messages

    Posted Mon March 28, 2022 11:38 AM
    Installed the latest version of rsync available from the Linux toolbox. Here are the particulars:

    deenim001 # rpm -qa |grep rsync
    rsync-3.2.3-1.ppc

    deenim001 # ls -l /opt/freeware/bin/rsync
    lrwxrwxrwx 1 root system 8 Mar 28 14:42 /opt/freeware/bin/rsync -> rsync_64
    deenim001 #

    Command execution:

    deenim001 # /opt/freeware/bin/rsync --delete -av -H /net/users/o* /net/users2/
    sending incremental file list
    [sender] out of memory: my_alloc caller (file=flist.c, line=306)
    rsync error: error allocating core memory buffers (code 22) at util2.c(123) [sender=3.2.3]
    rsync error: received SIGUSR1 (code 19) at main.c(1592) [generator=3.2.3]
    deenim001 #


    Any thoughts?








    ------------------------------
    Dale Hirchert
    ------------------------------


  • 2.  RE: rsync 3.2.3 failing with memory error messages

    Posted Tue March 29, 2022 05:42 AM
    Hi Dale

    I remember I had the same issue a while a go. For me it worked using the rsync_32 executable on both sides.

    ------------------------------
    Marcel Mages-Veidt
    ------------------------------

    Original Message


  • 3.  RE: rsync 3.2.3 failing with memory error messages

    Posted Tue March 29, 2022 09:10 AM
    I've tried using rsync_32 but that fails too.

    I'm migrating data from an older NAS appliance to a newer NAS appliance, doing so over NFS. I'm using 1 host to do the migration, so it has NFS mounts to both appliances. The older NAS uses 32bit inodes whereas the newer NAS is using 64bit inodes. The problem is that you have to use 64bit executables to handle the 64bit inodes on the newer NAS. This is a known issue with NFS.

    When I try to use rsync_32 here is the error I get:

    rsync: [generator] opendir "/net/users2/yquemba" failed: Value too large to be stored in data type (127)

    The "Value too large" is in reference to the 64bit inode that 32bit executable doesn't know how to handle.

    So I have to use the rsync_64 but it fails with the memory errors.

    I'm stumped at this point.

    ------------------------------
    Dale Hirchert
    ------------------------------

    Original Message


  • 4.  RE: rsync 3.2.3 failing with memory error messages

    Posted Wed March 30, 2022 09:32 AM
    Can you please check ulimit for user ?
    If the data ulimit is less then process can not allocated memory more than set by ulimit.
    Can you try running command after setting "ulimit data" to unlimited.

    ------------------------------
    SANKET RATHI
    ------------------------------

    Original Message


  • 5.  RE: rsync 3.2.3 failing with memory error messages

    Posted Wed March 30, 2022 11:38 AM
    Funny you mention the ulimit settings....

    Someone suggested I take a look at the /etc/security/limits file. The default settings are:

    default:
    fsize = -1
    core = -1
    cpu = -1
    data = 262144
    rss = 65536
    stack = 65536
    nofiles = 2000


    But I changed them to:

    default:
    fsize = -1
    core = -1
    cpu = -1
    data = -1
    rss = -1
    stack = -1
    nofiles = -1

    A bit of a sledge hammer approach but it did correct my problem. With that  being said, the host I did this on is only used for administrative functions such as rsyncs and backups, with no access given to standard users.




    ------------------------------
    Dale Hirchert
    ------------------------------

    Original Message