Hi folks!
I have been installing DNF on my AIX systems for a few months now. I have most of 130 completed and functioning.
All systems had Perzl's Openssl and ganglia previously in stalled. Systems are a mix of 7.1 7.2 and 7.3.
This week I was installing on the VIO servers, I have 10 all at the following OS level and patch sets
# ioscli ioslevel 3.1.3.21
oslevel -s 7200-05-04-2220
# emgr -l
ID STATE LABEL INSTALL TIME UPDATED BY ABSTRACT
=== ===== ========== ================= ========== ======================================
1 S 1111201a 11/03/22 15:59:34 Ifix for CVE-2022-2068, CVE-2022-2097
2 S IJ40952s4a 11/03/22 16:00:27 Fix for IJ40952
3 S IJ39876s3a 11/03/22 16:00:49 IJ39876 POTENTIAL SECURITY ISSUE
4 S IJ42379s4a 11/03/22 16:01:01 IJ42379 POTENTIAL SECURITY ISSUE
5 S IJ40615m4b 11/03/22 16:01:17 IJ40615 for AIX 7.2 TL5 SP2 SP4
6 S IJ41685s4a 11/03/22 16:01:42 IJ41685 POTENTIAL SECURITY ISSUE
9 of them worked as expected and function normally. One had issues at the end of the process when I installed ganglia. When gmond was installed it failed with a with a llegal instruction(coredump)
DNF then core dumps with any options passed.. run dnf and you get usage, run dnf list and you get llegal instruction(coredump)
I did a lot of stuff to try and fix this including waking the altboot and restoring /opt/freeware from prior to installing dnf and rerunning the process. After that I got most of ganglia installed but one final fileset produces the same results. To get things working I run rm -f /opt/freeware/packages/__* and /usr/bin/rpm --rebuilddb After that all dnf works. I have installed and removed other packages without issue but always hoses the db when I do dnf install ganglia-mod_ibmrperf (not prior to the restore it was gmond that was causing the failure)
All the vio servers were loaded from the same image so this is really weird.
I have the core but can not attach it.
The errpt is as follows and looks to be python related
LABEL: CORE_DUMP
IDENTIFIER: A924A5FC
Date/Time: Wed Dec 7 10:12:18 EST 2022
Sequence Number: 20614
Machine Id: 00FBE9D44C00
Node Id: 78e9d4xvio1
Class: S
Type: PERM
WPAR: Global
Resource Name: SYSPROC
Description
SOFTWARE PROGRAM ABNORMALLY TERMINATED
Probable Causes
SOFTWARE PROGRAM
User Causes
USER GENERATED SIGNAL
Recommended Actions
CORRECT THEN RETRY
Failure Causes
SOFTWARE PROGRAM
Recommended Actions
RERUN THE APPLICATION PROGRAM
IF PROBLEM PERSISTS THEN DO THE FOLLOWING
CONTACT APPROPRIATE SERVICE REPRESENTATIVE
Detail Data
SIGNAL NUMBER
4
USER'S PROCESS ID:
42009076
FILE SYSTEM SERIAL NUMBER
10
INODE NUMBER
209044
CORE FILE NAME
/home/ios/logs/core.42009076.07151218
PROGRAM NAME
python3_32
STACK EXECUTION DISABLED
0
COME FROM ADDRESS REGISTER
??
PROCESSOR ID
hw_fru_id: 1
hw_cpu_id: 15
ADDITIONAL INFORMATION
??
rpmlogLev 50
rpmlogDef 1A8
dolog 1D0
rpmlog 148
??
??
??
??
??
??
??
??
??
??
??
??
??
??
PyCFuncti 164
_PyEval_E 8D70
PyEval_Ev 34
_PyEval_E B44
_PyFuncti AC
_PyEval_E 830C
PyEval_Ev 34
function_ A4
_PyEval_E 9F98
PyEval_Ev 34
function_ A4
_PyEval_E 830C
PyEval_Ev 34
function_ A4
_PyEval_E 9F98
PyEval_Ev 34
_PyEval_E B44
_PyFuncti AC
_PyEval_E 9F98
PyEval_Ev 34
function_ A4
_PyEval_E 7638
PyEval_Ev 34
_PyEval_E B44
_PyFuncti AC
_PyEval_E 7638
PyEval_Ev 34
_PyEval_E B44
_PyFuncti AC
_PyEval_E 7B30
PyEval_Ev 34
_PyEval_E B44
PyEval_Ev 58
PyEval_Ev 30
run_mod 48
PyRun_Fil C8
PyRun_Sim 11C
PyRun_Any A4
pymain_ma 498
_Py_UnixM 48
main 10
__start 6C
Symptom Data
REPORTABLE
1
INTERNAL ERROR
0
SYMPTOM CODE
PCSS/SPI2 FLDS/python3_3 SIG/4 FLDS/rpmlogLev VALU/50
dnf list
Illegal instruction(coredump)
Log has this
2022-12-07T15:26:58Z INFO --- logging initialized ---
2022-12-07T15:26:58Z DDEBUG timer: config: 2 ms
2022-12-07T15:26:58Z DEBUG DNF version: 4.2.17
2022-12-07T15:26:58Z DDEBUG Command: dnf list
2022-12-07T15:26:58Z DDEBUG Installroot: /
2022-12-07T15:26:58Z DDEBUG Releasever: 7.2.5.103
2022-12-07T15:26:58Z DEBUG cachedir: /var/cache/dnf
2022-12-07T15:26:58Z DDEBUG Base command: list
2022-12-07T15:26:58Z DDEBUG Extra commands: ['list']
2022-12-07T15:26:58Z DEBUG os-release file not found
2022-12-07T15:26:58Z DEBUG os-release: falling back to basic User-Agent: missing NAME or VERSION_ID
If I then
rm -f /opt/freeware/packages/__*
/usr/bin/rpm --rebuilddb
dnf list
.... works fine log has
2022-12-07T15:29:59Z INFO --- logging initialized ---
2022-12-07T15:29:59Z DDEBUG timer: config: 2 ms
2022-12-07T15:29:59Z DEBUG DNF version: 4.2.17
2022-12-07T15:29:59Z DDEBUG Command: dnf list
2022-12-07T15:29:59Z DDEBUG Installroot: /
2022-12-07T15:29:59Z DDEBUG Releasever: 7.2.5.103
2022-12-07T15:29:59Z DEBUG cachedir: /var/cache/dnf
2022-12-07T15:29:59Z DDEBUG Base command: list
2022-12-07T15:29:59Z DDEBUG Extra commands: ['list']
2022-12-07T15:29:59Z DEBUG os-release file not found
2022-12-07T15:29:59Z DEBUG os-release: falling back to basic User-Agent: missing NAME or VERSION_ID
2022-12-07T15:29:59Z DEBUG repo: using cache for: AIX_Toolbox
2022-12-07T15:29:59Z DEBUG AIX_Toolbox: using metadata from Thu Dec 1 06:26:52 EST 2022.
2022-12-07T15:29:59Z DEBUG repo: using cache for: AIX_Toolbox_noarch
2022-12-07T15:29:59Z DEBUG AIX_Toolbox_noarch: using metadata from Thu Sep 29 01:40:55 EDT 2022.
2022-12-07T15:29:59Z DEBUG repo: using cache for: AIX_Toolbox_72
2022-12-07T15:29:59Z DEBUG AIX_Toolbox_72: using metadata from Wed Sep 7 08:42:05 EDT 2022.
2022-12-07T15:29:59Z INFO Last metadata expiration check: 1:22:56 ago on Wed Dec 7 09:07:03 EST 2022.
2022-12-07T15:29:59Z DEBUG No module defaults found
2022-12-07T15:29:59Z DDEBUG timer: sack setup: 187 ms
2022-12-07T15:29:59Z DDEBUG Cleaning up.
Installed RPMs are
gdbm-1.23-1.ppc
flex-2.6.4-1.ppc
gettext-0.21-2.ppc
unzip-64bit-6.0-4.ppc
openldap-2.4.58-4.ppc
libgcc-8-1.ppc
libsmartcols-2.34-100.ppc
lz4-1.9.3-1.ppc
pinentry-1.0.0-1.ppc
dnf-4.2.17-32_50.ppc
libffi-3.4.2-1.ppc
gpgme-1.13.1-100.ppc
libtasn1-4.16.0-1.ppc
gnutls-3.7.2-1.ppc
json-c-0.15-2.ppc
libconfuse-3.2.2-2.ppc
libgomp-8-1.ppc
cyrus-sasl-2.1.28-1.ppc
libgcc8-8.3.0-6.ppc
libyaml-0.2.5-1.ppc
libzstd-1.5.2-1.ppc
libunistring-0.9.10-1.ppc
ganglia-mod_aixdisk-3.7.2-1.ppc
readline-8.1-1.ppc
gnupg2-2.2.35-1.ppc
libgpg-error-1.45-1.ppc
libjpeg-9e-1.ppc
libcomps-0.1.11-101.ppc
python3-gpg-1.13.1-100.ppc
libgomp8-8.3.0-6.ppc
python3-librepo-1.11.0-100.ppc
libiconv-1.17-1.ppc
libksba-1.6.0-1.ppc
osinstall-1.6-1.noarch
python3-libcomps-0.1.11-101.ppc
ganglia-gmond-3.7.2-2.ppc
python3-3.7.15-1.ppc
AIX-rpm-7.2.5.103-15.ppc
libnghttp2-1.46.0-1.ppc
libstdc++8-8.3.0-6.ppc
p11-kit-0.23.22-1.ppc
rsync-3.2.3-1.ppc
nettle-3.7.3-1.ppc
libsolv-0.7.9-32_51.ppc
ncurses-6.3-1.ppc
libdnf-0.39.1-32_50.ppc
check-0.13.0-1.ppc
librepo-1.11.0-100.ppc
xz-libs-5.2.5-1.ppc
python3-dnf-4.2.17-32_50.ppc
glib2-2.56.1-3.ppc
libssh2-1.10.0-1.ppc
zlib-1.2.12-1.ppc
npth-1.5-1.ppc
ganglia-lib-3.7.2-2.ppc
bash-5.1.16-1.ppc
ganglia-mod_ibmpower-3.7.2-1.ppc
libassuan-2.5.5-1.ppc
ganglia-mod_ibmnet-3.7.2-1.ppc
sqlite-3.39.3-1.ppc
wget-1.21.2-1.ppc
ca-certificates-2021.2.52-3.ppc
dnf-data-4.2.17-32_50.ppc
libxml2-2.10.2-1.ppc
pkg-config-0.29.2-2.ppc
expat-2.4.9-1.ppc
pcre-8.44-2.ppc
lpar2rrd-agent-7.20-1.ppc
apr-1.7.0-1.ppc
db-5.3.28-1.ppc
krb5-libs-1.18.5-2.ppc
rpm-python3-4.15.1-32_1.ppc
zchunk-libs-1.1.4-101.ppc
libstdc++-8-1.ppc
p11-kit-tools-0.23.22-1.ppc
tightvnc-server-1.3.10-2.ppc
info-6.7-1.ppc
libmodulemd-1.5.2-100.ppc
bzip2-1.0.8-2.ppc
python3-hawkey-0.39.1-32_50.ppc
libgcrypt-1.9.4-1.ppc
python3-libdnf-0.39.1-32_50.ppc
gmp-6.2.1-1.ppc
dnf-automatic-4.2.17-32_50.ppc
libtextstyle-0.21-2.ppc
curl-7.85.0-1.ppc
I have no idea what you need but googled dbx and ran it against the core
dbx -p /=./ /opt/freeware/bin/python3_32 /home/ios/logs/core.47710588.07152825
...thousands of lines skipped
internal error: assertion failed at line 6704 in file object.c
internal error: assertion failed at line 6704 in file object.c
internal error: assertion failed at line 6704 in file object.c
internal error: assertion failed at line 6685 in file object.c
Illegal instruction (illegal opcode) in . at 0x0 ($t1)
warning: Unable to access address 0x0 from core
(dbx)
corefileProcess Name: /opt/freeware/bin/python3_32
Version: 430
Flags: FULL_CORE | CORE_VERSION_1 | CORE_BIGDATA | UBLOCK_VALID | USTACK_VALID | LE_VALID
Signal: ILL
Process Mode: 32 bit
(dbx)
where.() at 0x0
rpmlogLevelPrefix(0x3) at 0xd1b214ec
rpmlogDefault(0x0, 0x2ff20398) at 0xd1b21844
dolog(0x2ff20398, 0x1) at 0xd1b21bcc
rpmlog(0x3, 0xd1917ee0, 0xd19179a0, 0x2ff20830, 0x2, 0x72790049, 0x65, 0xd1f23c14) at 0xd1b21d84
errlog() at 0xd18fc000
__db_errcall() at 0xd1d83fa8
__db_errx() at 0xd1d840ac
__db_failed() at 0xd1d83424
__env_in_api@AF17_2() at 0xd1d935f4
__env_failchk_int() at 0xd1d927c0
__env_failchk_pp() at 0xd1d92a7c
IPRA.$db_init() at 0xd18faf0c
db3_dbiOpen() at 0xd18f9cbc
dbiOpen() at 0xd1888970
IPRA.$pkgdbOpen() at 0xd188be80
openDatabase@AF130_22() at 0xd1891b68
rpmtsOpenDB@AF99_67() at 0xd18aa9e4
opendbenv(0x2ff2165c) at 0xd62ffc40
repo_add_rpmdb(0x303e0b48, 0x0, 0x8021) at 0xd63018c4
repo_add_rpmdb_reffp(0x303e0b48, 0x0, 0x8021) at 0xd63026cc
dnf_sack_load_system_repo(0x303b8088, 0x0, 0x0, 0x2ff217f8) at 0xd685fd68
_ZL16load_system_repoP11_SackObjectP7_objectS2_(0xb06695a4, 0xb000002c, 0xb066c59c) at 0xd8265b3c
_PyMethodDef_RawFastCallKeywords(??, ??, ??, ??, ??) at 0xd5e2c2ec
_PyCFunction_FastCallKeywords(??, ??, ??, ??) at 0xd5e2c6d0
_PyEval_EvalFrameDefault(??, ??) at 0xd5fecc70
PyEval_EvalFrameEx(??, ??) at 0xd5e8c840
_PyEval_EvalCodeWithName(??, ??, ??, ??, ??, ??, ??, ??) at 0xd5e8d410
_PyFunction_FastCallKeywords(??, ??, ??, ??) at 0xd5e2bc60
_PyEval_EvalFrameDefault(??, ??) at 0xd5febe0c
PyEval_EvalFrameEx(??, ??) at 0xd5e8c840
function_code_fastcall(??, ??, ??, ??) at 0xd5fdbb14
_PyEval_EvalFrameDefault(??, ??) at 0xd5fee274
PyEval_EvalFrameEx(??, ??) at 0xd5e8c840
function_code_fastcall(??, ??, ??, ??) at 0xd5fdbb14
_PyEval_EvalFrameDefault(??, ??) at 0xd5fee274
PyEval_EvalFrameEx(??, ??) at 0xd5e8c840
function_code_fastcall(??, ??, ??, ??) at 0xd5fdbb14
_PyEval_EvalFrameDefault(??, ??) at 0xd5feb914
PyEval_EvalFrameEx(??, ??) at 0xd5e8c840
function_code_fastcall(??, ??, ??, ??) at 0xd5fdbb14
_PyEval_EvalFrameDefault(??, ??) at 0xd5feb914
PyEval_EvalFrameEx(??, ??) at 0xd5e8c840
_PyEval_EvalCodeWithName(??, ??, ??, ??, ??, ??, ??, ??) at 0xd5e8d410
_PyFunction_FastCallKeywords(??, ??, ??, ??) at 0xd5e2bc60
_PyEval_EvalFrameDefault(??, ??) at 0xd5feb914
PyEval_EvalFrameEx(??, ??) at 0xd5e8c840
_PyEval_EvalCodeWithName(??, ??, ??, ??, ??, ??, ??, ??) at 0xd5e8d410
_PyFunction_FastCallKeywords(??, ??, ??, ??) at 0xd5e2bc60
_PyEval_EvalFrameDefault(??, ??) at 0xd5febe0c
PyEval_EvalFrameEx(??, ??) at 0xd5e8c840
_PyEval_EvalCodeWithName(??, ??, ??, ??, ??, ??, ??, ??) at 0xd5e8d410
PyEval_EvalCodeEx(??, ??, ??, ??, ??, ??, ??, ??) at 0xd5e8d724
PyEval_EvalCode(??, ??, ??) at 0xd5e8d79c
run_mod(??, ??, ??, ??, ??, ??) at 0xd5ed3330
PyRun_FileExFlags(??, ??, ??, ??, ??, ??, ??) at 0xd5ed6fd0
PyRun_SimpleFileExFlags(??, ??, ??, ??) at 0xd5ed7234
PyRun_AnyFileExFlags(??, ??, ??, ??) at 0xd5ed794c
pymain_main(??) at 0xd5fd6778
_Py_UnixMain(??, ??) at 0xd5fd6de8
python.main(??, ??) at 0x10000434
(dbx)
Please let me know how to upload the core file and any other data you need.
Thanks,
Doug
------------------------------
Douglas Probst
------------------------------