AIX Open Source

AIX Open Source

Share your experiences and connect with fellow developers to discover how to build and manage open source software for the AIX operating system

 View Only

  • 1.  /opt/freeware/bin/dnf reposync -p /yumrepo --repo AIX_Toolbox_noarch aborts with Status 404

    Posted Fri June 16, 2023 09:29 AM

    Hi,

    I just migrated my yum server to dnf. I successfully synced my repositories but I have a problem with the AIX_Toolbox_noarch

    /opt/freeware/etc/dnf/dnf.conf

    ...

    [AIX_Toolbox_noarch]
    name=AIX noarch repository
    baseurl=https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/
    enabled=1
    gpgcheck=0

    ...

    /opt/freeware/bin/dnf reposync -p /yumrepo --repo AIX_Toolbox_noarch

    ...

    (225/580): python3-certifi-2019.9.11-2.aix7.1.noarch.rpm                                                                                                                                                163 kB/s | 5.9 kB     00:00
    (226/580): python3-chardet-3.0.4-1.aix6.1.noarch.rpm                                                                                                                                                    1.5 MB/s | 217 kB     00:00
    (227/580): python3-chardet-3.0.4-2.aix7.1.noarch.rpm                                                                                                                                                    159 kB/s | 5.7 kB     00:00
    [MIRROR] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: Status code: 404 for anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm">https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm (IP: 129.35.224.112)
    [MIRROR] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: Status code: 404 for anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm">https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm (IP: 129.35.224.112)
    [MIRROR] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: Status code: 404 for anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm">https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm (IP: 129.35.224.112)
    [MIRROR] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: Status code: 404 for anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm">https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm (IP: 129.35.224.112)
    [FAILED] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: No more mirrors to try - All mirrors were already tried without success
    root@sbsb-vasp-yum-01:/yumrepo# 1.13.46-1.aix6.1.noarch.rpm                                      77% [==========================================================================                      ] 5.9 MB/s | 739 MB     00:35 ETA

    Is there any problem on anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/">https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/ ?

    Thanks for your help.

    Jean-Luc



    ------------------------------
    Jean-Luc Westermann
    ------------------------------


  • 2.  RE: /opt/freeware/bin/dnf reposync -p /yumrepo --repo AIX_Toolbox_noarch aborts with Status 404

    Posted Fri June 16, 2023 10:42 AM
    Edited by Jean-Luc Westermann Fri June 16, 2023 11:07 AM

    When I run "dnf reposync" with -u options we get these URLs:

    root@sbsb-vasp-yum-01:/yumrepo/AIX_Toolbox_noarch/python3-charset-normalizer# /opt/freeware/bin/dnf reposync -p /yumrepo --repo AIX_Toolbox_noarch -u|grep charset-normalizer
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3-charset-normalizer/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3-charset-normalizer/python3-charset-normalizer-2.0.12-2.aix7.1.noarch.rpm
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3-charset-normalizer/python3.9-charset-normalizer-2.0.12-2.aix7.1.noarch.rpm

    When you compare with the links shown previously, you can see that the 3 last URLs are different:

    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm equal
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3-charset-normalizer/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm not equal
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3-charset-normalizer/python3-charset-normalizer-2.0.12-2.aix7.1.noarch.rpm not equal
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3-charset-normalizer/python3.9-charset-normalizer-2.0.12-2.aix7.1.noarch.rpm

    not equal

    Who can fix this?

    ------------------------------
    Jean-Luc Westermann
    ------------------------------

    Original Message


  • 3.  RE: /opt/freeware/bin/dnf reposync -p /yumrepo --repo AIX_Toolbox_noarch aborts with Status 404

    Posted Mon June 19, 2023 07:50 AM
    Edited by Jean-Luc Westermann Mon June 19, 2023 08:28 AM

    I found a way to download the whole repository except the failing "python3-charset-normalizer" package using:

    /opt/freeware/bin/dnf reposync -p /yumrepo --repo AIX_Toolbox_noarch --exclude python3-charset-normalizer

    In /var/log/dnf.log we can also see that the package can't be downloaded

    2023-06-19T12:25:56Z INFO --- logging initialized ---
    2023-06-19T12:25:56Z DDEBUG timer: config: 2 ms
    2023-06-19T12:25:56Z DEBUG Loaded plugins: changelog, config-manager, debug, generate_completion_cache, migrate, repoclosure, repodiff, repograph, repomanage, reposync
    2023-06-19T12:25:56Z DEBUG DNF version: 4.2.17
    2023-06-19T12:25:56Z DDEBUG Command: dnf reposync -p /yumrepo --repo AIX_Toolbox_noarch
    2023-06-19T12:25:56Z DDEBUG Installroot: /
    2023-06-19T12:25:56Z DDEBUG Releasever: 7.2.5.201
    2023-06-19T12:25:56Z DEBUG cachedir: /var/cache/dnf
    2023-06-19T12:25:56Z DDEBUG Base command: reposync
    2023-06-19T12:25:56Z DDEBUG Extra commands: ['reposync', '-p', '/yumrepo', '--repo', 'AIX_Toolbox_noarch']
    2023-06-19T12:25:56Z DEBUG os-release file not found
    2023-06-19T12:25:56Z DEBUG os-release: falling back to basic User-Agent: missing NAME or VERSION_ID
    2023-06-19T12:25:56Z DEBUG reviving: 'AIX_Toolbox_noarch' can be revived - repomd matches.
    2023-06-19T12:25:56Z DEBUG AIX_Toolbox_noarch: using metadata from Fri Jun 16 15:19:07 2023.
    2023-06-19T12:25:56Z DEBUG No module defaults found
    2023-06-19T12:25:56Z DDEBUG timer: sack setup: 225 ms
    2023-06-19T12:25:56Z DEBUG Completion plugin: Generating completion cache...
    2023-06-19T12:26:06Z DDEBUG Cleaning up.
    2023-06-19T12:26:06Z SUBDEBUG
    Traceback (most recent call last):
      File "/opt/freeware/lib/python3.9/site-packages/dnf/cli/main.py", line 65, in main
        return _main(base, args, cli_class, option_parser_class)
      File "/opt/freeware/lib/python3.9/site-packages/dnf/cli/main.py", line 98, in _main
        return cli_run(cli, base)
      File "/opt/freeware/lib/python3.9/site-packages/dnf/cli/main.py", line 114, in cli_run
        cli.run()
      File "/opt/freeware/lib/python3.9/site-packages/dnf/cli/cli.py", line 1162, in run
        return self.command.run()
      File "/opt/freeware/lib/python3.9/site-packages/dnf-plugins/reposync.py", line 152, in run
        self.download_packages(pkglist)
      File "/opt/freeware/lib/python3.9/site-packages/dnf-plugins/reposync.py", line 252, in download_packages
        base._download_remote_payloads(payloads, drpm, progress, None)
      File "/opt/freeware/lib/python3.9/site-packages/dnf/base.py", line 1079, in _download_remote_payloads
        raise dnf.exceptions.DownloadError(errors._irrecoverable)
    dnf.exceptions.DownloadError: Cannot download python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: All mirrors were tried


    ------------------------------
    Jean-Luc Westermann
    ------------------------------

    Original Message


  • 4.  RE: /opt/freeware/bin/dnf reposync -p /yumrepo --repo AIX_Toolbox_noarch aborts with Status 404

    Posted Tue June 20, 2023 03:57 AM

    Hi,

    Seem to be an inconsistency between the repo metadata and the repo content. I am getting the following error when running my dnf reposync script (worked like a charm since last year until few days ago):

    [SKIPPED] yum-plugin-versionlock-1.1.31-2.aix6.1.noarch.rpm: Already downloaded
    [SKIPPED] yum-utils-1.1.31-1.aix6.1.noarch.rpm: Already downloaded
    [SKIPPED] yum-utils-1.1.31-2.aix6.1.noarch.rpm: Already downloaded
    [MIRROR] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: Interrupted by header callback: Server reports Content-Length: 274 but expected size is: 84625
    (445/585): python3-paramiko-2.11.0-2.aix7.1.noarch.rpm                                              45 kB/s | 6.2 kB     00:00
    (446/585): python3-passlib-1.7.1-2.aix7.1.noarch.rpm                                               196 kB/s | 5.8 kB     00:00
    (447/585): python3-pbr-5.11.1-1.aix7.1.noarch.rpm                                                  215 kB/s | 6.4 kB     00:00
    [MIRROR] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: Interrupted by header callback: Server reports Content-Length: 274 but expected size is: 84625
    (448/585): python3-pip-22.2.2-1.aix7.1.noarch.rpm                                                  239 kB/s | 6.9 kB     00:00
    (449/585): python3-pluggy-0.13.0-2.aix7.1.noarch.rpm                                               205 kB/s | 6.0 kB     00:00
    (450/585): python3-portend-2.6-2.aix7.1.noarch.rpm                                                 200 kB/s | 5.8 kB     00:00
    [MIRROR] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: Interrupted by header callback: Server reports Content-Length: 274 but expected size is: 84625
    (451/585): python3-prettytable-0.7.2-2.aix7.1.noarch.rpm                                           213 kB/s | 6.1 kB     00:00
    (452/585): python3-py-1.8.0-2.aix7.1.noarch.rpm                                                    194 kB/s | 5.8 kB     00:00
    (453/585): python3-pyasn1-0.4.8-2.aix7.1.noarch.rpm                                                211 kB/s | 6.0 kB     00:00
    [MIRROR] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: Interrupted by header callback: Server reports Content-Length: 274 but expected size is: 84625
    [FAILED] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: No more mirrors to try - All mirrors were already tried without success



    ------------------------------
    Lionel Widmer
    ------------------------------

    Original Message


  • 5.  RE: /opt/freeware/bin/dnf reposync -p /yumrepo --repo AIX_Toolbox_noarch aborts with Status 404

    Posted Thu June 22, 2023 04:47 AM

    Hi,

    The repository has been corrected.

    The downloads are working now.

    Many thanks to the involved persons.

    Best regards

    Jean-Luc



    ------------------------------
    Jean-Luc Westermann
    ------------------------------

    Original Message