Originally posted by: nivko

Hello,

After updating the AIX from 7.1.3.3 to 7.1.5.2 I started getting error "/usr/sbin/rpm_share[470]: 9437378 Segmentation fault(coredump)" during various commands execution (oslevel, lslpp, rpm, ...).

it is caused by the new version of the rpm.rte (3.13.0.3) installed with the update.

Following the advises of the support (TS001369114):

+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Please attempt below steps:

1) Reinstall 3.0.5.n # very important
# installp -qaXFY -d rpm.rte

2) Run 'rpm -qa' to ensure expected output

2.1) SPECIAL STEPS for this case:
Since you already had an update, I would like to remove the previous rpm.rte V4 databases before trying the update again:
# mkdir /opt/freeware/0907packages
# mv /opt/freeware/packages/__db* /opt/freeware/0907packages

3) Install 4.13.0.3 (or 4.13.0.4 now) using below steps:

-CD to directory of rpm 4.13.0.3/,04
 
#smitty install_all
* SOFTWARE to install                                 [] +   << (needed fileset)
  AUTOMATICALLY install requisite software?           no+    << (make sure it is no)
  OVERWRITE same or newer versions?                   yes +  << (make sure it is yes)
  ACCEPT new license agreements?                      yes +  << (make sure it is yes)
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

... did not help. On top, trying to install directly version 4.13.0.4 resulted in many errors during the deployment and completely not-working rpm command:

# rpm -qa
exec(): 0509-036 Cannot load program /usr/opt/freeware/bin/rpm because of the following errors:
        0509-150   Dependent module /usr/lib/libintl.a(libintl.so.8) could not be loaded.
        0509-152   Member libintl.so.8 is not found in archive

 

Please advise how to resolve this issue.

Thanks in advance,

BR,

Nikolay.

Originally posted by: AyappanP

Even after following the steps, "it did not help". What do you mean by that ?

Reinstalling 4.13.0.4 is not successful ?

Originally posted by: nivko

Thanks for the reply ...

Here is the console screen:

[root@NVKrack01 ~ ]# lslpp -Lcq rpm.rte
rpm.rte:rpm.rte:3.0.5.54: : :C: :RPM Package Manager: : : : : : :0:0:/:

[root@NVKrack01 toto ]# installp -acYX -d . all
+-----------------------------------------------------------------------------+
                    Pre-installation Verification...
+-----------------------------------------------------------------------------+
Verifying selections...done
Verifying requisites...done
Results...

SUCCESSES
---------
  Filesets listed in this section passed pre-installation verification
  and will be installed.

  Selected Filesets
  -----------------
  rpm.rte 4.13.0.4                            # RPM Package Manager

  << End of Success Section >>

+-----------------------------------------------------------------------------+
                   BUILDDATE Verification ...
+-----------------------------------------------------------------------------+
Verifying build dates...done
FILESET STATISTICS
------------------
    1  Selected to be installed, of which:
        1  Passed pre-installation verification
  ----
    1  Total to be installed

+-----------------------------------------------------------------------------+
                         Installing Software...
+-----------------------------------------------------------------------------+

installp:  APPLYING software for:
        rpm.rte 4.13.0.4

2367 blocks
cp: /opt/freeware/lib/rpm/rpm: A file or directory in the path name does not exist.

. . . . . << Copyright notice for rpm.rte >> . . . . . . .
 Licensed Materials - Property of IBM

 5765H4000
   Copyright International Business Machines Corp. 2000, 2018.
   Copyright The Regents of the University of California, 1990, 1993, 1994.
   Copyright Tom Dyas <tdyas@eden.rutgers.edu>, 1998.
   Copyright W. L. Estes <wlestes@uncg.edu>, 1998.
   Copyright Free Software Foundation, Inc., 1999-2014.
   Copyright The Internet Society (1998).
   Copyright Red Hat, Inc., 1998-2003, 2005, 2007, 2009-2011.
   Copyright Red Hat Software, 1995-2002.
   Copyright Enrico Scholz <enrico.scholz@informatik.tu-chemnitz.de>, 2004.
   Copyright System Design and Research, 2003.

 All rights reserved.
 US Government Users Restricted Rights - Use, duplication or disclosure
 restricted by GSA ADP Schedule Contract with IBM Corp.
. . . . . << End of copyright notice for rpm.rte >>. . . .

##################################################################
  This version of rpm installs files under the path /usr/opt/rpm.
  More detailed information on new changes can be found in
  /usr/opt/rpm/README file.
##################################################################

exec(): 0509-036 Cannot load program /usr/opt/freeware/bin/rpm because of the following errors:
        0509-150   Dependent module /usr/lib/libintl.a(libintl.so.8) could not be loaded.
        0509-152   Member libintl.so.8 is not found in archive
Converting old database format db1 to new  database format db3.

Successfully converted old database format to new format.

exec(): 0509-036 Cannot load program /usr/opt/freeware/bin/rpm because of the following errors:
        0509-150   Dependent module /usr/lib/libintl.a(libintl.so.8) could not be loaded.
        0509-152   Member libintl.so.8 is not found in archive
rpm_share: 0645-007 ATTENTION: set_time_token() returned an unexpected result.
Please wait...Could not load program /usr/opt/freeware/bin/rpm:
        Dependent module /usr/lib/libintl.a(libintl.so.8) could not be loaded.
        Member libintl.so.8 is not found in archive
Could not load program /usr/opt/freeware/bin/rpm:
        Dependent module /usr/lib/libintl.a(libintl.so.8) could not be loaded.
        Member libintl.so.8 is not found in archive
Could not load program /usr/opt/freeware/bin/rpm:
        Dependent module /usr/lib/libintl.a(libintl.so.8) could not be loaded.
        Member libintl.so.8 is not found in archive
Could not load program /usr/bin/rpmbuild:
        Dependent module /usr/lib/libintl.a(libintl.so.8) could not be loaded.
        Member libintl.so.8 is not found in archive

Could not load program /usr/opt/freeware/bin/rpm:
        Dependent module /usr/lib/libintl.a(libintl.so.8) could not be loaded.
        Member libintl.so.8 is not found in archive
Successfully updated the Kernel Authorization Table.
Successfully updated the Kernel Role Table.
Successfully updated the Kernel Command Table.
Successfully updated the Kernel Device Table.
Successfully updated the Kernel Object Domain Table.
Successfully updated the Kernel Domains Table.
Successfully updated the Kernel RBAC log level.
Finished processing all filesets.  (Total time:  1 mins 8 secs).

+-----------------------------------------------------------------------------+
                                Summaries:
+-----------------------------------------------------------------------------+

Installation Summary
--------------------
Name                        Level           Part        Event       Result
-------------------------------------------------------------------------------
rpm.rte                     4.13.0.4        USR         APPLY       SUCCESS
rpm.rte                     4.13.0.4        ROOT        APPLY       SUCCESS

[root@NVKrack01 toto ]# rpm -qa
exec(): 0509-036 Cannot load program /usr/opt/freeware/bin/rpm because of the following errors:
        0509-150   Dependent module /usr/lib/libintl.a(libintl.so.8) could not be loaded.
        0509-152   Member libintl.so.8 is not found in archive
[root@NVKrack01 toto ]#

 

BR.

Originally posted by: AyappanP

I hope you are not exporting any LIBPATH.

Can you paste the output of the following commands ?

1) ldd  /usr/opt/freeware/bin/rpm

2) ls -l /usr/opt/rpm/lib/libintl.a

Originally posted by: nivko

Here it is:

[root@NVKrack01 toto ]# env |grep LIB
LD_LIBRARY_PATH=/usr/lib

[root@NVKrack01 toto ]# ldd  /usr/opt/freeware/bin/rpm
/usr/opt/freeware/bin/rpm needs:
         /usr/opt/rpm/lib/librpm.so
         /usr/opt/rpm/lib/libdb.so
         /usr/opt/rpm/lib/librpmio.so
         /usr/opt/rpm/lib/libnss3.so
         /usr/opt/rpm/lib/libpopt.so
         /usr/opt/rpm/lib/libintl.a(libintl.so.8)
         /lib/libc.a(shr.o)
         /lib/libpthread.a(shr_xpg5.o)
         /lib/librtl.a(shr.o)
         /usr/opt/rpm/lib/liblua.a(liblua-5.1.so)
         /usr/opt/rpm/lib/libbz2.a(libbz2.so.1)
         /usr/opt/rpm/lib/libz.a(libz.so.1)
         /usr/opt/rpm/lib/libnssutil3.so
         /usr/opt/rpm/lib/libplc4.so
         /usr/opt/rpm/lib/libplds4.so
         /usr/opt/rpm/lib/libnspr4.so
         /lib/libpthreads.a(shr_xpg5.o)
         /lib/libiconv.a(shr4.o)
         /unix
         /lib/libcrypt.a(shr.o)
         /lib/libpthreads.a(shr_comm.o)
         /lib/libodm.a(shr.o)
         /lib/libcfg.a(shr.o)
[root@NVKrack01 toto ]#  ls -l /usr/opt/rpm/lib/libintl.a
-rwxr-xr-x    1 root     system       441267 Jun 09 14:44 /usr/opt/rpm/lib/libintl.a
[root@NVKrack01 toto ]#

 

 

Originally posted by: AyappanP

It's not a good idea to export LIBPATH or LD_LIBRARY_PATH to /usr/lib. 

If it is really needed for other local applications to work , then you have make sure the similar lbraries in /usr/lib & /usr/opt/rpm/lib should be the same.

In this case, libintl.a is present in both /usr/lib and /usr/opt/rpm/lib. The new rpm will link to /usr/opt/rpm/lib/libintl.a but since you have exported LD_LIBRARY_PATH to /usr/lib , it is picking the one from /usr/lib which don't have the libintl.so.8 member. 

So either unset the export or copy /usr/opt/rpm/lib/libintl.a to /usr/lib (not a good fix).

Originally posted by: nivko

Unsetting LD_LIBRARY_PATH eliminates the "cannot access" errors during the deployment, but it is not solving the coredumps:

Name                        Level           Part        Event       Result
-------------------------------------------------------------------------------
rpm.rte                     4.13.0.4        USR         APPLY       SUCCESS
rpm.rte                     4.13.0.4        ROOT        APPLY       SUCCESS

[root@NVKrack01 toto ]# while true; do echo $(date): $(rpm -qa > /dev/null && echo OK); sleep 2; done

 

Fri Sep 14 16:54:07 DFT 2018: OK
/usr/sbin/rpm_share[483]: 11075736 Segmentation fault(coredump)
Fri Sep 14 16:54:09 DFT 2018:
Fri Sep 14 16:54:12 DFT 2018: OK
Fri Sep 14 16:54:14 DFT 2018: OK
/usr/sbin/rpm_share[483]: 9240740 Segmentation fault(coredump)
Fri Sep 14 16:54:17 DFT 2018:
Fri Sep 14 16:54:19 DFT 2018: OK
Fri Sep 14 16:54:22 DFT 2018: OK
Fri Sep 14 16:54:24 DFT 2018: OK

 

As the version rpm.rte.4.13.0.3, which is part of the AIX 7.1.5.2 anyways does not suffer the "LD_LIBRARY_PATH" issue, but only the coredump:

Name                        Level           Part        Event       Result
-------------------------------------------------------------------------------
rpm.rte                     4.13.0.3        USR         APPLY       SUCCESS
rpm.rte                     4.13.0.3        ROOT        APPLY       SUCCESS
[root@NVKrack01 toto3 ]# while true; do echo $(date): $(rpm -qa > /dev/null && echo OK); sleep 2; done
Fri Sep 14 17:02:49 DFT 2018: OK
Fri Sep 14 17:02:52 DFT 2018: OK
Fri Sep 14 17:02:54 DFT 2018: OK
Fri Sep 14 17:02:57 DFT 2018: OK
Fri Sep 14 17:02:59 DFT 2018: OK
/usr/sbin/rpm_share[470]: 11075752 Segmentation fault(coredump)
Fri Sep 14 17:03:01 DFT 2018:
/usr/sbin/rpm_share[470]: 11075642 Segmentation fault(coredump)
Fri Sep 14 17:03:04 DFT 2018:
Fri Sep 14 17:03:06 DFT 2018: OK

... could you advise what could cause (respectively how we could resolve) this one ?

Thanks in advance,

BR.

Originally posted by: nivko

Hello,

Could you please advise on the above question ...?

Some more info:

 

root@nvkaixsrc:/home/root# rpm -qa
grep-2.5.1-1.ppc
tar-1.14-1.ppc
zlib-1.2.8-1.ppc
gzip-1.2.4a-7.ppc
bash-3.0-22.ppc
ncurses-5.9-1.ppc
rsync-3.0.7-1.ppc
make-3.80-1.ppc
zip-2.3-3.ppc
gettext-0.10.40-1.ppc
popt-1.7-1.ppc
/usr/sbin/rpm_share[470]: 10551482 Segmentation fault(coredump)
root@nvkaixsrc:/home/root# rpm -qa
Freeing read locks for locker 0x85: 10551482/1
Freeing read locks for locker 0x86: 10551482/1
Freeing read locks for locker 0x87: 10551482/1
grep-2.5.1-1.ppc
tar-1.14-1.ppc
zlib-1.2.8-1.ppc
gzip-1.2.4a-7.ppc
bash-3.0-22.ppc
ncurses-5.9-1.ppc
rsync-3.0.7-1.ppc
make-3.80-1.ppc
zip-2.3-3.ppc
gettext-0.10.40-1.ppc
popt-1.7-1.ppc
/usr/sbin/rpm_share[470]: 9765060 Segmentation fault(coredump)
root@nvkaixsrc:/home/root# rpm -qa
Freeing read locks for locker 0x88: 9765060/1
Freeing read locks for locker 0x89: 9765060/1
Freeing read locks for locker 0x8a: 9765060/1
grep-2.5.1-1.ppc
tar-1.14-1.ppc
zlib-1.2.8-1.ppc
gzip-1.2.4a-7.ppc
bash-3.0-22.ppc
ncurses-5.9-1.ppc
rsync-3.0.7-1.ppc
make-3.80-1.ppc
zip-2.3-3.ppc
gettext-0.10.40-1.ppc
popt-1.7-1.ppc
/usr/sbin/rpm_share[470]: 10551374 Segmentation fault(coredump)
root@nvkaixsrc:/home/root# rpm -qa
Freeing read locks for locker 0x8b: 10551374/1
Freeing read locks for locker 0x8c: 10551374/1
Freeing read locks for locker 0x8d: 10551374/1
grep-2.5.1-1.ppc
tar-1.14-1.ppc
zlib-1.2.8-1.ppc
gzip-1.2.4a-7.ppc
bash-3.0-22.ppc
ncurses-5.9-1.ppc
rsync-3.0.7-1.ppc
make-3.80-1.ppc
zip-2.3-3.ppc
gettext-0.10.40-1.ppc
popt-1.7-1.ppc
/usr/sbin/rpm_share[470]: 9633862 Segmentation fault(coredump)
root@nvkaixsrc:/home/root# rpm -qa
Freeing read locks for locker 0x8e: 9633862/1
Freeing read locks for locker 0x8f: 9633862/1
Freeing read locks for locker 0x90: 9633862/1
grep-2.5.1-1.ppc
tar-1.14-1.ppc
zlib-1.2.8-1.ppc
gzip-1.2.4a-7.ppc
bash-3.0-22.ppc
ncurses-5.9-1.ppc
rsync-3.0.7-1.ppc
make-3.80-1.ppc
zip-2.3-3.ppc
gettext-0.10.40-1.ppc
popt-1.7-1.ppc
AIX-rpm-7.1.3.15-7.ppc
rpm-build-3.0.5-52.ppc
info-4.6-1.ppc
unzip-5.51-1.ppc
coreutils-5.2.1-2.ppc
ncftp-3.1.1-3.ppc
logrotate-3.7.9-1.ppc
bzip2-1.0.5-3.ppc
less-382-1.ppc
tcsh-6.11-3.ppc
glib-1.2.10-3.ppc
patch-2.5.4-4.ppc
gtk+-1.2.10-6.ppc
rpm-3.0.5-52.ppc
root@nvkaixsrc:/home/root# rpm -qa
grep-2.5.1-1.ppc
tar-1.14-1.ppc
zlib-1.2.8-1.ppc
gzip-1.2.4a-7.ppc
bash-3.0-22.ppc
ncurses-5.9-1.ppc
rsync-3.0.7-1.ppc
make-3.80-1.ppc
zip-2.3-3.ppc
gettext-0.10.40-1.ppc
popt-1.7-1.ppc
AIX-rpm-7.1.3.15-7.ppc
rpm-build-3.0.5-52.ppc
info-4.6-1.ppc
unzip-5.51-1.ppc
coreutils-5.2.1-2.ppc
ncftp-3.1.1-3.ppc
logrotate-3.7.9-1.ppc
bzip2-1.0.5-3.ppc
less-382-1.ppc
tcsh-6.11-3.ppc
glib-1.2.10-3.ppc
patch-2.5.4-4.ppc
gtk+-1.2.10-6.ppc
rpm-3.0.5-52.ppc
root@nvkaixsrc:/home/root# rpm -qa
grep-2.5.1-1.ppc
tar-1.14-1.ppc
zlib-1.2.8-1.ppc
gzip-1.2.4a-7.ppc
bash-3.0-22.ppc
ncurses-5.9-1.ppc
rsync-3.0.7-1.ppc
make-3.80-1.ppc
zip-2.3-3.ppc
gettext-0.10.40-1.ppc
popt-1.7-1.ppc
/usr/sbin/rpm_share[470]: 9633800 Segmentation fault(coredump)

 

And the error in the errorlog:

LABEL:          CORE_DUMP
IDENTIFIER:     A924A5FC

Date/Time:       Wed Sep 19 06:28:15 DFT 2018
Sequence Number: 353
Machine Id:      0003EADCD400
Node Id:         nvkaixsrc
Class:           S
Type:            PERM
WPAR:            Global
Resource Name:   SYSPROC

Description
SOFTWARE PROGRAM ABNORMALLY TERMINATED

Probable Causes
SOFTWARE PROGRAM

User Causes
USER GENERATED SIGNAL

        Recommended Actions
        CORRECT THEN RETRY

Failure Causes
SOFTWARE PROGRAM

        Recommended Actions
        RERUN THE APPLICATION PROGRAM
        IF PROBLEM PERSISTS THEN DO THE FOLLOWING
        CONTACT APPROPRIATE SERVICE REPRESENTATIVE

Detail Data
SIGNAL NUMBER
          11
USER'S PROCESS ID:
               9633800
FILE SYSTEM SERIAL NUMBER
           8
INODE NUMBER
                    44
CORE FILE NAME
/home/root/core
PROGRAM NAME
rpm
STACK EXECUTION DISABLED
           0
COME FROM ADDRESS REGISTER
pthread_m 17C

PROCESSOR ID
  hw_fru_id: 0
  hw_cpu_id: 1

ADDITIONAL INFORMATION
??
pthread_m 180
PR_Destro 18
sftk_Dest B4
sftk_Free A4
NSC_Close 344
pk11_Clos 6C
PK11_Dest 38
HASH_Dest 40
??
??
??
??
??
??
??
??
??
??
??
??
__start 6C

Symptom Data
REPORTABLE
1
INTERNAL ERROR
0
SYMPTOM CODE
PCSS/SPI2 FLDS/rpm SIG/4 FLDS/pthread_m VALU/180

 

After:

-- removing all the RPMs

-- removing rpm.rte and the dependent cdrtools.base

-- renaming the /opt/freeware to /opt/freeware.save

then

-- reinstalling only the rpm.rte fileset,

... and here is the result:

Installation Summary
--------------------
Name                        Level           Part        Event       Result
-------------------------------------------------------------------------------
rpm.rte                     4.13.0.3        USR         APPLY       SUCCESS
rpm.rte                     4.13.0.3        ROOT        APPLY       SUCCESS
root@nvkaixsrc:/data/bffs# rpm -qa
AIX-rpm-7.1.5.15-1.ppc
root@nvkaixsrc:/data/bffs# rpm -qa
AIX-rpm-7.1.5.15-1.ppc
root@nvkaixsrc:/data/bffs# rpm -qa
AIX-rpm-7.1.5.15-1.ppc
root@nvkaixsrc:/data/bffs# rpm -qa
AIX-rpm-7.1.5.15-1.ppc
root@nvkaixsrc:/data/bffs# rpm -qa
AIX-rpm-7.1.5.15-1.ppc
root@nvkaixsrc:/data/bffs# rpm -qa
/usr/sbin/rpm_share[470]: 10551510 Segmentation fault(coredump)   <<<<
root@nvkaixsrc:/data/bffs# oslevel -s
7100-05-02-1832

I can provide any information required to troubleshoot.

Please advise.

BR.

 

Originally posted by: AyappanP

I think you can open a PMR for this as it looks like you are facing problem with AIX base rpm. 

Originally posted by: nivko

Hello,

I did that first thing (mentioned yet in the beginning).

Case number: TS001369114

The response: >> If issue remains, kindly involve developerworks, you need to log in the website and click on "open a thread: in main page to open a thread (which is equivalent of ticket) with developersworks team
https://www.ibm.com/developerworks/community/forums/html/forum?id=2eb0f36d-9534-471b-8b27-c21e6c5b9b2b
Please let us know if you require further assistance and if we can go ahead and close this ticket
Thanks
Hany