Open Source Development

Power Open Source Development

Explore the open source tools and capabilities for building and deploying modern applications on IBM Power platforms including AIX, IBM i, and Linux.


#Power


#Power


#Servers
#Opensource
 View Only
  • 1.  Is "rsync" AIX_Toolbox Repository Mirroring Enabled?

    Posted 12/12/16 09:18 AM

    Originally posted by: CS5D_Jesse_Harmon


    AIX Toolbox Representatives,
     
    My company is in the process of setting up a local AIX Toolbox repository mirror.  Is the AIX_Toolbox repository capable of being cloned via a command like this:
     
    rsync -avz rsync://public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ /fix/aixtoolbox_RPMS/
     
    Thanks,
    Jesse

    #AIX-Open-Source-Software
    #AIXOpenSource


  • 2.  Re: Is "rsync" AIX_Toolbox Repository Mirroring Enabled?

    Posted 12/14/16 03:54 AM

    Originally posted by: sangameshm


    Hi Jesse,

     

    ftp server doesn't support rsync, we need to use ftp/http/https.

     

    Thanks,

    Sangamesh

     


    #AIX-Open-Source-Software
    #AIXOpenSource


  • 3.  Re: Is "rsync" AIX_Toolbox Repository Mirroring Enabled?

    Posted 12/19/16 03:45 PM

    Originally posted by: CS5D_Jesse_Harmon


    AIX Toolbox Representatives,

     

    Here is the procedure we used to create a local AIX Toolbox repository.

     

    Thanks,

    Jesse

     

    1) Create a mount point "/repo_aix" on our existing Red Hat Repository Server to hold the AIX repositories.  Since the mirror seems to be about 4.3 GB in size currently, we made this a 6 GB mount for growth.

     

    2) Run the following command(s) to pull down the initial mirror, and run it again to ensure it actually only updates on the delta (if a file changed, pull it down.)  Note, this process usually runs for about 2 hours and 45 minutes.

     

    cd /repo_aix; TMOUT=0; export TMOUT=0

    sudo wget -r -np -nH -e robots=off --reject "robots.txt" -N --wait 1 --cut-dirs=4 --no-check-certificate https://public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/

     

    The wget arguments do the following:

    -r                    Recursively download

    -np                   Do not ascend to the parent directory when retrieving recursively

    -nH                   Disable generation of host-prefixed directories.  By default, invoking wget with '-r https://public.dhe.ibm.com' will create a structure of directories beginning with public.dhe.ibm.com. This option disables such behavior.

    -e robots=off         Ignore this directive so that a recursive download can take place

    --reject "robots.txt" Exclude downloading the file robots.txt

    -N                    Turn on timestamping.  This will compare the timestamp of the file on the local server and on the source server.  If they are the same and the file size is the same, it will not download the file.  If the timestamp or size are different it will download the file.

    --wait 1              Throttle 1 second between wget requests

    --cut-dirs=4          Along with the -nH argument, wget would create the directories aix/freeSoftware/aixtoolbox/RPMS/.  This gets rid of them so the data is downloaded directly into the directory you're in.

    --no-check-certificate

     

    3) Update the HTTP service configuration to add the new repository entries pointing "/aixrepo" to "/repo_aix."

     

    4) Update the yum.conf file on the AIX endpoint to use the following configuration in place of the existing "point to external toolbox."

     

    [main]

    cachedir=/var/cache/yum

    keepcache=1

    debuglevel=2

    logfile=/var/log/yum.log

    exactarch=1

    obsoletes=1

     

    [AIX_Toolbox]

    name=AIX generic repository

    baseurl=http://REPOSERVER/aixrepo/ppc/

    enabled=1

    gpgcheck=0

     

    [AIX_Toolbox_noarch]

    name=AIX noarch repository

    baseurl=http://REPOSERVER/aixrepo/noarch/

    enabled=1

    gpgcheck=0


     

    [AIX_Toolbox_71]

    name=AIX 7.1 specific repository

    baseurl=http://REPOSERVER/aixrepo/ppc-7.1/

    enabled=1

    gpgcheck=0


    #AIXOpenSource
    #AIX-Open-Source-Software


  • 4.  Re: Is "rsync" AIX_Toolbox Repository Mirroring Enabled?

    Posted 03/08/17 03:09 AM

    Originally posted by: Morten_Torstensen


    If you ported reposync to AIX and included it in the yum package, that could be a faster and more bandwidth efficient method...


    #AIX-Open-Source-Software
    #AIXOpenSource


  • 5.  Re: Is "rsync" AIX_Toolbox Repository Mirroring Enabled?

    Posted 03/08/17 03:44 AM

    Originally posted by: sangameshm


    Hi Morten,

     

    We are working on porting yum-utils to AIX and reposync will be part of that.

     

    Thanks,

    Sangamesh


    #AIX-Open-Source-Software
    #AIXOpenSource