AIX Open Source

AIX Open Source

Share your experiences and connect with fellow developers to discover how to build and manage open source software for the AIX operating system

 View Only
Expand all | Collapse all

gzip performance issue (perzl vs toolbox - now 2.5 times slower)

  • 1.  gzip performance issue (perzl vs toolbox - now 2.5 times slower)

    Posted Mon July 09, 2018 11:10 AM

    Originally posted by: ruxi002


    Hi, we have an issue with gzip compression performance after exchange of all rpm packages from perzl with those from the AIX toolbox

    We use BMC software with a backup script for the PostrgeSQL database in which the following command is used:

     

      tar cvf $HOME_DIR/pgsql | gzip -2 > $BACKUP_DIR/pgsql.tar.gz

     

    => the compression parameter is "2" and is set by the BMC script - so we should leave it as it is

     

    Here a comparison of the gzip versions regarding run time:

    Backup with gzip from perzl : 10:30 - 20:36
    Analyzing (about 0,5 h)
    backup with gzip : about 9,5h
    Filesize archive900.tar.gz: 217.506.920.273 

     

    Backup with gzip from AIX Toolbox : 23.6. 10:30 - 24.6. 11:42
    Analyzing (about 0,5 h)
    backup with gzip : about 24,5h
    Filesize archive900.tar.gz: 218.022.288.665

     

    => Compressing the PostrgeSQL Dump (about 200GB) needs 2.5x more time and exceeds the backup window because a day has only 24 hours Oops

     

    Version from perzl.org:

    # rpm -qi gzip-1.5-1
    Name        : gzip                         Relocations: (not relocateable)
    Version     : 1.5                               Vendor: (none)
    Release     : 1                             Build Date: Thu Apr  4 01:50:31 MSZ 2013
    Install date: Tue Jun 28 17:42:04 MSZ 2016      Build Host: aix51.perzl.org
    Group       : Applications/File             Source RPM: gzip-1.5-1.src.rpm
    Size        : 299993                           License: GPLv3+ and GFDL
    URL         : http://www.gzip.org/
    Summary     : The GNU data compression program
    Description :
    The gzip package contains the popular GNU gzip data compression
    program. Gzipped files have a .gz extension.

    Gzip should be installed on your system, because it is a
    very commonly used data compression program.

     

    Version from AIX Toolbox:

    # rpm -qi gzip-1.8-1.ppc
    Name        : gzip
    Version     : 1.8
    Release     : 1
    Architecture: ppc
    Install Date: Fri May  4 08:52:29 MSZ 2018
    Group       : Applications/File
    Size        : 556318
    License     : GPL
    Signature   : (none)
    Source RPM  : gzip-1.8-1.src.rpm
    Build Date  : Thu Feb  8 12:32:50 MEZ 2018
    Build Host  : pokndd5.pok.stglabs.ibm.com
    Relocations : (not relocatable)
    Summary     : The GNU data compression program.
    Description :
    The gzip package contains the popular GNU gzip data compression
    program.  Gzipped files have a .gz extension.

    Gzip should be installed on your Red Hat Linux system, because it is a      Laughing roll
    very commonly used data compression program.

     

    Maybe someone has a hint about those big differences? And maybe someone has made the same experiences and can confirm our observations?!

    Optimization parameters shouldn't make such a difference, could they?!

     

    Thanks in advance

    Martin



  • 2.  Re: gzip performance issue (perzl vs toolbox - now 2.5 times slower)

    Posted Tue July 10, 2018 06:40 AM

    Originally posted by: sanket


     

    Hi Martin,

    We will look into this. 

     



  • 3.  Re: gzip performance issue (perzl vs toolbox - now 2.5 times slower)

    Posted Fri July 13, 2018 05:45 AM

    Originally posted by: sanket


    Hi Martin,

     

    First thanks for reporting the issue.

    We found the reason for performance.

    The gzip from toolbox was not compiled with optimisation hence it was not giving the expected performance.

    We have tested newly built gzip and it is matching the performance. We will upload it soon on toolbox and update here.



  • 4.  Re: gzip performance issue (perzl vs toolbox - now 2.5 times slower)

    Posted Wed July 18, 2018 03:57 AM

    Originally posted by: ruxi002


    Hi,

     

    Thanks in advance. Yes

     

    Martin



  • 5.  Re: gzip performance issue (perzl vs toolbox - now 2.5 times slower)

    Posted Wed July 18, 2018 02:28 PM

    Originally posted by: sanket


     

    We have published fixed gzip with optimization. 

    This should give you greater perfromance.

    Please download the latest gzip from following location or use yum to update it.

    https://public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/gzip/gzip-1.8-2.aix6.1.ppc.rpm

     

    Thanks