Open Source Development

 View Only

 dnf update fails

Philip Krab's profile image
Philip Krab posted Thu January 15, 2026 05:09 AM

Hello Team,

Since the 8th of Januari 2026, dnf fails to update at several of our customers and ends with the messages below.
For the record, AIX is at 7200-05-10-2520, openssl is at level 3.0.16.1000, including the efix from December last year.
There are no python3.9 packages installed. Anyone a solution?

root@SVR-NIM01:/opt/freeware/etc/dnf> # dnf update
AIX generic repository                                                                                                               0.0  B/s |   0  B     02:00
Traceback (most recent call last):
  File "/opt/freeware/bin/dnf", line 57, in <module>
    main.user_main(sys.argv[1:], exit_code=True)
  File "/opt/freeware/lib/python3.12/site-packages/dnf/cli/main.py", line 208, in user_main
    errcode = main(args)
              ^^^^^^^^^^
  File "/opt/freeware/lib/python3.12/site-packages/dnf/cli/main.py", line 67, in main
    return _main(base, args, cli_class, option_parser_class)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/freeware/lib/python3.12/site-packages/dnf/cli/main.py", line 106, in _main
    return cli_run(cli, base)
           ^^^^^^^^^^^^^^^^^^
  File "/opt/freeware/lib/python3.12/site-packages/dnf/cli/main.py", line 122, in cli_run
    cli.run()
  File "/opt/freeware/lib/python3.12/site-packages/dnf/cli/cli.py", line 1098, in run
    self._process_demands()
  File "/opt/freeware/lib/python3.12/site-packages/dnf/cli/cli.py", line 787, in _process_demands
    self.base.fill_sack(
  File "/opt/freeware/lib/python3.12/site-packages/dnf/base.py", line 413, in fill_sack
    self._add_repo_to_sack(r)
  File "/opt/freeware/lib/python3.12/site-packages/dnf/base.py", line 141, in _add_repo_to_sack
    repo.load()
  File "/opt/freeware/lib/python3.12/site-packages/dnf/repo.py", line 574, in load
    ret = self._repo.load()
          ^^^^^^^^^^^^^^^^^
  File "/opt/freeware/lib/python3.12/site-packages/libdnf/repo.py", line 467, in load
    return _repo.Repo_load(self)
           ^^^^^^^^^^^^^^^^^^^^^
libdnf._error.Error: Failed to download metadata for repo 'AIX_Toolbox': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried

Regards,

Philip

SANGAMESH MALLAYYA's profile image
SANGAMESH MALLAYYA

Hi Philip,

Looks like no data transfer is happening.

Can you check if you are able to connect public.dhe.ibm.com without any issue or having some DNS related issues ?

Philip Krab's profile image
Philip Krab

I have the issue with three totally different customers in the country on totally different locations (read datacenters). Nothing changed at their side, except for the install of the openssl fix.

root@SVR-NIM01:/root> # emgr -l
 
ID  STATE LABEL      INSTALL TIME      UPDATED BY ABSTRACT
=== ===== ========== ================= ========== ======================================
1    S    301610sa   01/15/26 11:35:31            ifix for openssl CVEs
I deinstalled the fix on one location just to rule that out, but no luck.

wget gives me this:
root@SVR-NIM01:/root> # wget https://public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/ansible-core/ansible-core-2.19.3-1.aix7.2.noarch.rpm
--2026-01-16 14:49:53--  https://public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/ansible-core/ansible-core-2.19.3-1.aix7.2.noarch.rpm
Resolving public.dhe.ibm.com... 170.225.119.151
Connecting to public.dhe.ibm.com|170.225.119.151|:443... failed: A remote host did not respond within the timeout period..
Retrying.

curl gives me this:
root@SVR-NIM01:/root> # curl https://public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc
curl: (28) getsockname() failed with errno 22: A system call received a parameter that is not valid.

Steve Munday's profile image
Steve Munday IBM Champion

Philip,

Hi, good day to you.

Here's what I see on my NIM:

# oslevel -s
7300-03-00-2446
# openssl version
OpenSSL 3.0.16 11 Feb 2025 (Library: OpenSSL 3.0.16 11 Feb 2025)
# emgr -l | grep CVE
1    S    2466ma               03/28/25 05:27:58            ifix for libcurl CVE
2    S    301610sa             01/20/26 04:13:42            ifix for openssl CVEs
# curl https://public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>301 Moved Permanently</title>
</head><body>
<h1>Moved Permanently</h1>
<p>The document has moved <a href="https://public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/">here</a>.</p>
</body></html>

Hope it might shed some light on things for you.

All the best, Steve

Philip Krab's profile image
Philip Krab

Hi Steve,

Thanks for the input. Here's what I see on another NIM. I'm still in the dark ;-)
# oslevel -s
7200-05-10-2520
# openssl version
OpenSSL 3.0.16 11 Feb 2025 (Library: OpenSSL 3.0.16 11 Feb 2025)
# emgr -l | grep CVE
4    S    301610sa   12/18/25 07:51:41            ifix for openssl CVEs
5    S    61985sa    01/08/26 14:20:44            ifix for OpenSSH CVEs
# curl https://public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc
curl: (28) getsockname() failed with errno 22: Invalid argument


Steve Munday's profile image
Steve Munday IBM Champion

Philip,

Hi, here's my "curl" info on the NIM:

# curl --version
curl 8.18.0 (powerpc-ibm-aix7.1.5.0) libcurl/8.18.0 OpenSSL/3.0.16 zlib/1.3.1 libssh2/1.11.1 nghttp2/1.62.1 mit-krb5/1.21.3 OpenLDAP/2.5.16
Release-Date: 2026-01-07
Protocols: dict file ftp ftps gopher gophers http https imap imaps ipfs ipns ldap ldaps mqtt pop3 pop3s rtsp scp sftp smb smbs smtp smtps telnet tftp ws wss
Features: alt-svc AsynchDNS GSS-API HSTS HTTP2 HTTPS-proxy IPv6 Kerberos Largefile libz NTLM SPNEGO SSL threadsafe UnixSockets
# 

Regards, Steve

Philip Krab's profile image
Philip Krab

Hi Steve. Comparing notes.
# curl --version
curl 8.14.1 (powerpc-ibm-aix7.1.5.0) libcurl/8.14.1 OpenSSL/3.0.16 zlib/1.3.1 libssh2/1.11.1 nghttp2/1.62.1 OpenLDAP/2.5.16
Release-Date: 2025-06-04
Protocols: dict file ftp ftps gopher gophers http https imap imaps ipfs ipns ldap ldaps mqtt pop3 pop3s rtsp scp sftp smb smbs smtp smtps telnet tftp ws wss
Features: alt-svc AsynchDNS GSS-API HSTS HTTP2 HTTPS-proxy IPv6 Kerberos Largefile libz NTLM SPNEGO SSL threadsafe UnixSockets

Steve Munday's profile image
Steve Munday IBM Champion

Philip,

Are you able/allowed to update "curl" to see if that helps / resolves things?

Regards, Steve

Philip Krab's profile image
Philip Krab

Hi Steve,
I think the problem is not solely with curl.
As I said earlier, from one day to the next everything (dnf, wget, curl) stopped working regarding public.dhe.ibm.com at three totally different customers. They have nothing in common, except that they are using AIX (7.1 and 7.2) with aixtoolbox.

Steve Munday's profile image
Steve Munday IBM Champion

Philip,

Hi, you might like to take a look at

https://stackoverflow.com/questions/59857492/dnf-broken-all-mirrors-were-tried

Just in case it offers up some possible avenues for you.

Regards, Steve

Ayappan P's profile image
Ayappan P

Does this setup use https_proxy ? If so, make sure it is set up properly and the proxy is up and running. 

Philip Krab's profile image
Philip Krab

Many thanks for thinking with me Steve and Ayappan. No proxy is involved.


Jaqui Lynch's profile image
Jaqui Lynch IBM Champion

I just got past this as follows;

rpm --rebuilddb
dnf clean all

dnf update

That downloaded the files to /ar/cache/dnf

cd /var/cache/dnf
ls
Find the one with dnf in it - mine was:

cd /var/cache/dnf/AIX_Toolbox_72-4f972c24490d78f0/packages
ls
#
dnf-4.23.0-32_51.aix7.2.ppc.rpm
dnf-automatic-4.23.0-32_51.aix7.2.ppc.rpm
dnf-data-4.23.0-32_51.aix7.2.ppc.rpm
libdnf-0.74.0-32_52.aix7.2.ppc.rpm
python3-dnf-4.23.0-32_51.aix7.2.ppc.rpm
python3-hawkey-0.74.0-32_52.aix7.2.ppc.rpm
python3-libdnf-0.74.0-32_52.aix7.2.ppc.rpm
python3.12-dnf-4.23.0-32_51.aix7.2.ppc.rpm
python3.12-hawkey-0.74.0-32_52.aix7.2.ppc.rpm
python3.12-libdnf-0.74.0-32_52.aix7.2.ppc.rpm

rpm -Uvh *.rpm

Above uses rpm to update dnf and python

dnf update now works

Hope this works for you

Philip Krab's profile image
Philip Krab

Hi Jaqui,

Thank you for your input.

I did the rebuildrpm, dnf clean all and dnf update. Below the result in /var/cache/dnf. No rpms there.
I'm debugging with the firewall managers, but so far no solution from there.

root@SVR-NIM01:/root> # ls -latR /var/cache/dnf
total 16
-rw-r--r--    1 root     system            2 Feb 12 08:32 expired_repos.json
drwxr-xr-x   10 root     system         4096 Feb 12 08:32 .
drwxr-xr-x    4 root     system          256 Feb 12 08:32 AIX_Toolbox-65d76c2c8658fdd3
drwxr-x---    3 root     system          256 Jan 21 07:49 AIX_Toolbox_71-9ba963d3fa040d18
drwxr-x---    3 root     system          256 Jan 21 07:47 AIX_Toolbox_noarch-912964c75bc2e981
drwxr-x---    3 root     system          256 Jan 21 07:43 AIX_Toolbox-8fe7499a38060e27
drwxr-xr-x    4 root     system          256 Nov 19 07:51 AIX_Toolbox_71-7bce46270a086c90
drwxr-xr-x    3 root     system          256 Nov 19 07:51 AIX_Toolbox_noarch-11090ede3ab5319e
-rw-r-----    1 root     system            0 Jun 11 2025  .gpgkeyschecked.yum
drwxr-xr-x    3 root     system          256 Nov 19 2024  AIX_Toolbox_73-b17eb6828deb371c
drwxr-xr-x    3 root     system          256 Nov 19 2024  AIX_Toolbox_72-4f972c24490d78f0
drwxr-xr-x    3 root     system          256 Nov 15 2024  ..
/var/cache/dnf/AIX_Toolbox-65d76c2c8658fdd3:
total 8
drwxr-xr-x   10 root     system         4096 Feb 12 08:32 ..
drwxr-xr-x    4 root     system          256 Feb 12 08:32 .
drwxr-xr-x    2 root     system          256 Jan 15 10:13 packages
drwxr-x---    2 root     system          256 Jan 15 10:13 repodata
 
/var/cache/dnf/AIX_Toolbox-65d76c2c8658fdd3/packages:
total 0
drwxr-xr-x    4 root     system          256 Feb 12 08:32 ..
drwxr-xr-x    2 root     system          256 Jan 15 10:13 .
 
/var/cache/dnf/AIX_Toolbox-65d76c2c8658fdd3/repodata:
total 0
drwxr-xr-x    4 root     system          256 Feb 12 08:32 ..
drwxr-x---    2 root     system          256 Jan 15 10:13 .
 
/var/cache/dnf/AIX_Toolbox_71-9ba963d3fa040d18:
total 8
drwxr-xr-x   10 root     system         4096 Feb 12 08:32 ..
drwxr-x---    2 root     system          256 Jan 21 08:03 repodata
drwxr-x---    3 root     system          256 Jan 21 07:49 .
 
/var/cache/dnf/AIX_Toolbox_71-9ba963d3fa040d18/repodata:
total 0
drwxr-x---    2 root     system          256 Jan 21 08:03 .
drwxr-x---    3 root     system          256 Jan 21 07:49 ..
 
/var/cache/dnf/AIX_Toolbox_noarch-912964c75bc2e981:
total 8
drwxr-xr-x   10 root     system         4096 Feb 12 08:32 ..
drwxr-x---    2 root     system          256 Jan 21 08:03 repodata
drwxr-x---    3 root     system          256 Jan 21 07:47 .
 
/var/cache/dnf/AIX_Toolbox_noarch-912964c75bc2e981/repodata:
total 0
drwxr-x---    2 root     system          256 Jan 21 08:03 .
drwxr-x---    3 root     system          256 Jan 21 07:47 ..
 
/var/cache/dnf/AIX_Toolbox-8fe7499a38060e27:
total 8
drwxr-xr-x   10 root     system         4096 Feb 12 08:32 ..
drwxr-x---    2 root     system          256 Jan 21 08:03 repodata
drwxr-x---    3 root     system          256 Jan 21 07:43 .
 
/var/cache/dnf/AIX_Toolbox-8fe7499a38060e27/repodata:
total 0
drwxr-x---    2 root     system          256 Jan 21 08:03 .
drwxr-x---    3 root     system          256 Jan 21 07:43 ..
 
/var/cache/dnf/AIX_Toolbox_71-7bce46270a086c90:
total 8
drwxr-xr-x   10 root     system         4096 Feb 12 08:32 ..
drwxr-x---    2 root     system          256 Jan 15 10:13 repodata
drwxr-xr-x    2 root     system          256 Jan 15 10:13 packages
drwxr-xr-x    4 root     system          256 Nov 19 07:51 .
 
/var/cache/dnf/AIX_Toolbox_71-7bce46270a086c90/repodata:
total 0
drwxr-x---    2 root     system          256 Jan 15 10:13 .
drwxr-xr-x    4 root     system          256 Nov 19 07:51 ..
 
/var/cache/dnf/AIX_Toolbox_71-7bce46270a086c90/packages:
total 0
drwxr-xr-x    2 root     system          256 Jan 15 10:13 .
drwxr-xr-x    4 root     system          256 Nov 19 07:51 ..
 
/var/cache/dnf/AIX_Toolbox_noarch-11090ede3ab5319e:
total 8
drwxr-xr-x   10 root     system         4096 Feb 12 08:32 ..
drwxr-x---    2 root     system          256 Jan 15 10:13 repodata
drwxr-xr-x    3 root     system          256 Nov 19 07:51 .
 
/var/cache/dnf/AIX_Toolbox_noarch-11090ede3ab5319e/repodata:
total 0
drwxr-x---    2 root     system          256 Jan 15 10:13 .
drwxr-xr-x    3 root     system          256 Nov 19 07:51 ..
 
/var/cache/dnf/AIX_Toolbox_73-b17eb6828deb371c:
total 8
drwxr-xr-x   10 root     system         4096 Feb 12 08:32 ..
drwxr-xr-x    2 root     system          256 Nov 19 2024  repodata
drwxr-xr-x    3 root     system          256 Nov 19 2024  .
 
/var/cache/dnf/AIX_Toolbox_73-b17eb6828deb371c/repodata:
total 0
drwxr-xr-x    2 root     system          256 Nov 19 2024  .
drwxr-xr-x    3 root     system          256 Nov 19 2024  ..
 
/var/cache/dnf/AIX_Toolbox_72-4f972c24490d78f0:
total 8
drwxr-xr-x   10 root     system         4096 Feb 12 08:32 ..
drwxr-xr-x    2 root     system          256 Nov 19 2024  repodata
drwxr-xr-x    3 root     system          256 Nov 19 2024  .
 
/var/cache/dnf/AIX_Toolbox_72-4f972c24490d78f0/repodata:
total 0
drwxr-xr-x    2 root     system          256 Nov 19 2024  .
drwxr-xr-x    3 root     system          256 Nov 19 2024  ..
Regards,
Philip.
Philip Krab's profile image
Philip Krab

From the log files.
root@SVR-NIM01:/var/log> # cat dnf.rpm.log
2026-02-12T10:20:00NFT INFO --- logging initialized ---
root@SVR-NIM01:/var/log> # cat hawkey.log
2026-02-12T10:20:00NFT INFO === Started libdnf-0.74.0 ===
root@SVR-NIM01:/var/log> # cat dnf.log
2026-02-12T10:20:00NFT INFO --- logging initialized ---
2026-02-12T10:20:00NFT DDEBUG timer: config: 11 ms
2026-02-12T10:20:00NFT DEBUG DNF version: 4.23.0
2026-02-12T10:20:00NFT DDEBUG Command: dnf update
2026-02-12T10:20:00NFT DDEBUG Installroot: /
2026-02-12T10:20:00NFT DDEBUG Releasever: 7.1.5.0
2026-02-12T10:20:00NFT DEBUG cachedir: /var/cache/dnf
2026-02-12T10:20:00NFT DDEBUG Base command: update
2026-02-12T10:20:00NFT DDEBUG Extra commands: ['update']
2026-02-12T10:20:00NFT DEBUG os-release file not found
2026-02-12T10:20:00NFT DEBUG User-Agent: falling back to 'libdnf': missing NAME or VERSION_ID
2026-02-12T10:20:00NFT DEBUG repo: downloading from remote: AIX_Toolbox
2026-02-12T10:20:30NFT DEBUG error: Curl error (28): Timeout was reached for https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml [Connection timed out after 30000 milliseconds] (https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml).
2026-02-12T10:21:00NFT DEBUG error: Curl error (28): Timeout was reached for https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml [Connection timed out after 30001 milliseconds] (https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml).
2026-02-12T10:21:30NFT DEBUG error: Curl error (28): Timeout was reached for https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml [Connection timed out after 30000 milliseconds] (https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml).
2026-02-12T10:22:00NFT DEBUG error: Curl error (28): Timeout was reached for https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml [Connection timed out after 30000 milliseconds] (https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml).
2026-02-12T10:22:00NFT DDEBUG Cleaning up.
2026-02-12T10:22:00NFT DDEBUG Plugins were unloaded.
root@SVR-NIM01:/var/log> # cat dnf.librepo.log
2026-02-12T10:20:00NFT INFO Librepo version: 1.20.0 with CURL_GLOBAL_ACK_EINTR support (libcurl/8.18.0 OpenSSL/3.0.16 zlib/1.2.13 libssh2/1.11.1 nghttp2/1.62.1 mit-krb5/1.21.3 OpenLDAP/2.5.16)
2026-02-12T10:20:00NFT INFO Librepo version: 1.20.0 with CURL_GLOBAL_ACK_EINTR support (libcurl/8.18.0 OpenSSL/3.0.16 zlib/1.2.13 libssh2/1.11.1 nghttp2/1.62.1 mit-krb5/1.21.3 OpenLDAP/2.5.16)
2026-02-12T10:20:00NFT INFO Downloading: https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml
2026-02-12T10:20:30NFT INFO Serious error - Curl code (28): Timeout was reached for https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml [Connection timed out after 30000 milliseconds]
2026-02-12T10:20:30NFT INFO Error during transfer: Curl error (28): Timeout was reached for https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml [Connection timed out after 30000 milliseconds]
2026-02-12T10:20:30NFT INFO Downloading: https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml
2026-02-12T10:21:00NFT INFO Serious error - Curl code (28): Timeout was reached for https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml [Connection timed out after 30001 milliseconds]
2026-02-12T10:21:00NFT INFO Error during transfer: Curl error (28): Timeout was reached for https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml [Connection timed out after 30001 milliseconds]
2026-02-12T10:21:00NFT INFO Downloading: https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml
2026-02-12T10:21:30NFT INFO Serious error - Curl code (28): Timeout was reached for https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml [Connection timed out after 30000 milliseconds]
2026-02-12T10:21:30NFT INFO Error during transfer: Curl error (28): Timeout was reached for https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml [Connection timed out after 30000 milliseconds]
2026-02-12T10:21:30NFT INFO Downloading: https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml
2026-02-12T10:22:00NFT INFO Serious error - Curl code (28): Timeout was reached for https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml [Connection timed out after 30000 milliseconds]
2026-02-12T10:22:00NFT INFO Error during transfer: Curl error (28): Timeout was reached for https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/ppc/repodata/repomd.xml [Connection timed out after 30000 milliseconds]
2026-02-12T10:22:00NFT INFO Error while downloading: Cannot download repodata/repomd.xml: All mirrors were tried