Open Source Development

Power Open Source Development

Connect, learn, share, and engage with IBM Power.


#Power


#Power
 View Only
  • 1.  /opt/freeware/bin/dnf reposync -p /yumrepo --repo AIX_Toolbox_noarch aborts with Status 404

    Posted Fri June 16, 2023 09:29 AM

    Hi,

    I just migrated my yum server to dnf. I successfully synced my repositories but I have a problem with the AIX_Toolbox_noarch

    /opt/freeware/etc/dnf/dnf.conf

    ...

    [AIX_Toolbox_noarch]
    name=AIX noarch repository
    baseurl=https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/
    enabled=1
    gpgcheck=0

    ...

    /opt/freeware/bin/dnf reposync -p /yumrepo --repo AIX_Toolbox_noarch

    ...

    (225/580): python3-certifi-2019.9.11-2.aix7.1.noarch.rpm                                                                                                                                                163 kB/s | 5.9 kB     00:00
    (226/580): python3-chardet-3.0.4-1.aix6.1.noarch.rpm                                                                                                                                                    1.5 MB/s | 217 kB     00:00
    (227/580): python3-chardet-3.0.4-2.aix7.1.noarch.rpm                                                                                                                                                    159 kB/s | 5.7 kB     00:00
    [MIRROR] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: Status code: 404 for anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm">https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm (IP: 129.35.224.112)
    [MIRROR] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: Status code: 404 for anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm">https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm (IP: 129.35.224.112)
    [MIRROR] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: Status code: 404 for anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm">https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm (IP: 129.35.224.112)
    [MIRROR] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: Status code: 404 for anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm">https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm (IP: 129.35.224.112)
    [FAILED] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: No more mirrors to try - All mirrors were already tried without success
    root@sbsb-vasp-yum-01:/yumrepo# 1.13.46-1.aix6.1.noarch.rpm                                      77% [==========================================================================                      ] 5.9 MB/s | 739 MB     00:35 ETA

    Is there any problem on anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/">https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/ ?

    Thanks for your help.

    Jean-Luc



    ------------------------------
    Jean-Luc Westermann
    ------------------------------

    #AIXOpenSource


  • 2.  RE: /opt/freeware/bin/dnf reposync -p /yumrepo --repo AIX_Toolbox_noarch aborts with Status 404

    Posted Fri June 16, 2023 10:42 AM
    Edited by Jean-Luc Westermann Fri June 16, 2023 11:07 AM

    When I run "dnf reposync" with -u options we get these URLs:

    root@sbsb-vasp-yum-01:/yumrepo/AIX_Toolbox_noarch/python3-charset-normalizer# /opt/freeware/bin/dnf reposync -p /yumrepo --repo AIX_Toolbox_noarch -u|grep charset-normalizer
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3-charset-normalizer/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3-charset-normalizer/python3-charset-normalizer-2.0.12-2.aix7.1.noarch.rpm
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3-charset-normalizer/python3.9-charset-normalizer-2.0.12-2.aix7.1.noarch.rpm

    When you compare with the links shown previously, you can see that the 3 last URLs are different:

    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm equal
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3-charset-normalizer/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm not equal
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3-charset-normalizer/python3-charset-normalizer-2.0.12-2.aix7.1.noarch.rpm not equal
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm
    https://anonymous:anonymous@public.dhe.ibm.com/aix/freeSoftware/aixtoolbox/RPMS/noarch/python3-charset-normalizer/python3.9-charset-normalizer-2.0.12-2.aix7.1.noarch.rpm

    not equal

    Who can fix this?

    ------------------------------
    Jean-Luc Westermann
    ------------------------------



  • 3.  RE: /opt/freeware/bin/dnf reposync -p /yumrepo --repo AIX_Toolbox_noarch aborts with Status 404

    Posted Mon June 19, 2023 07:50 AM
    Edited by Jean-Luc Westermann Mon June 19, 2023 08:28 AM

    I found a way to download the whole repository except the failing "python3-charset-normalizer" package using:

    /opt/freeware/bin/dnf reposync -p /yumrepo --repo AIX_Toolbox_noarch --exclude python3-charset-normalizer

    In /var/log/dnf.log we can also see that the package can't be downloaded

    2023-06-19T12:25:56Z INFO --- logging initialized ---
    2023-06-19T12:25:56Z DDEBUG timer: config: 2 ms
    2023-06-19T12:25:56Z DEBUG Loaded plugins: changelog, config-manager, debug, generate_completion_cache, migrate, repoclosure, repodiff, repograph, repomanage, reposync
    2023-06-19T12:25:56Z DEBUG DNF version: 4.2.17
    2023-06-19T12:25:56Z DDEBUG Command: dnf reposync -p /yumrepo --repo AIX_Toolbox_noarch
    2023-06-19T12:25:56Z DDEBUG Installroot: /
    2023-06-19T12:25:56Z DDEBUG Releasever: 7.2.5.201
    2023-06-19T12:25:56Z DEBUG cachedir: /var/cache/dnf
    2023-06-19T12:25:56Z DDEBUG Base command: reposync
    2023-06-19T12:25:56Z DDEBUG Extra commands: ['reposync', '-p', '/yumrepo', '--repo', 'AIX_Toolbox_noarch']
    2023-06-19T12:25:56Z DEBUG os-release file not found
    2023-06-19T12:25:56Z DEBUG os-release: falling back to basic User-Agent: missing NAME or VERSION_ID
    2023-06-19T12:25:56Z DEBUG reviving: 'AIX_Toolbox_noarch' can be revived - repomd matches.
    2023-06-19T12:25:56Z DEBUG AIX_Toolbox_noarch: using metadata from Fri Jun 16 15:19:07 2023.
    2023-06-19T12:25:56Z DEBUG No module defaults found
    2023-06-19T12:25:56Z DDEBUG timer: sack setup: 225 ms
    2023-06-19T12:25:56Z DEBUG Completion plugin: Generating completion cache...
    2023-06-19T12:26:06Z DDEBUG Cleaning up.
    2023-06-19T12:26:06Z SUBDEBUG
    Traceback (most recent call last):
      File "/opt/freeware/lib/python3.9/site-packages/dnf/cli/main.py", line 65, in main
        return _main(base, args, cli_class, option_parser_class)
      File "/opt/freeware/lib/python3.9/site-packages/dnf/cli/main.py", line 98, in _main
        return cli_run(cli, base)
      File "/opt/freeware/lib/python3.9/site-packages/dnf/cli/main.py", line 114, in cli_run
        cli.run()
      File "/opt/freeware/lib/python3.9/site-packages/dnf/cli/cli.py", line 1162, in run
        return self.command.run()
      File "/opt/freeware/lib/python3.9/site-packages/dnf-plugins/reposync.py", line 152, in run
        self.download_packages(pkglist)
      File "/opt/freeware/lib/python3.9/site-packages/dnf-plugins/reposync.py", line 252, in download_packages
        base._download_remote_payloads(payloads, drpm, progress, None)
      File "/opt/freeware/lib/python3.9/site-packages/dnf/base.py", line 1079, in _download_remote_payloads
        raise dnf.exceptions.DownloadError(errors._irrecoverable)
    dnf.exceptions.DownloadError: Cannot download python3/python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: All mirrors were tried


    ------------------------------
    Jean-Luc Westermann
    ------------------------------



  • 4.  RE: /opt/freeware/bin/dnf reposync -p /yumrepo --repo AIX_Toolbox_noarch aborts with Status 404

    Posted Tue June 20, 2023 03:57 AM

    Hi,

    Seem to be an inconsistency between the repo metadata and the repo content. I am getting the following error when running my dnf reposync script (worked like a charm since last year until few days ago):

    [SKIPPED] yum-plugin-versionlock-1.1.31-2.aix6.1.noarch.rpm: Already downloaded
    [SKIPPED] yum-utils-1.1.31-1.aix6.1.noarch.rpm: Already downloaded
    [SKIPPED] yum-utils-1.1.31-2.aix6.1.noarch.rpm: Already downloaded
    [MIRROR] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: Interrupted by header callback: Server reports Content-Length: 274 but expected size is: 84625
    (445/585): python3-paramiko-2.11.0-2.aix7.1.noarch.rpm                                              45 kB/s | 6.2 kB     00:00
    (446/585): python3-passlib-1.7.1-2.aix7.1.noarch.rpm                                               196 kB/s | 5.8 kB     00:00
    (447/585): python3-pbr-5.11.1-1.aix7.1.noarch.rpm                                                  215 kB/s | 6.4 kB     00:00
    [MIRROR] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: Interrupted by header callback: Server reports Content-Length: 274 but expected size is: 84625
    (448/585): python3-pip-22.2.2-1.aix7.1.noarch.rpm                                                  239 kB/s | 6.9 kB     00:00
    (449/585): python3-pluggy-0.13.0-2.aix7.1.noarch.rpm                                               205 kB/s | 6.0 kB     00:00
    (450/585): python3-portend-2.6-2.aix7.1.noarch.rpm                                                 200 kB/s | 5.8 kB     00:00
    [MIRROR] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: Interrupted by header callback: Server reports Content-Length: 274 but expected size is: 84625
    (451/585): python3-prettytable-0.7.2-2.aix7.1.noarch.rpm                                           213 kB/s | 6.1 kB     00:00
    (452/585): python3-py-1.8.0-2.aix7.1.noarch.rpm                                                    194 kB/s | 5.8 kB     00:00
    (453/585): python3-pyasn1-0.4.8-2.aix7.1.noarch.rpm                                                211 kB/s | 6.0 kB     00:00
    [MIRROR] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: Interrupted by header callback: Server reports Content-Length: 274 but expected size is: 84625
    [FAILED] python3-charset-normalizer-2.0.12-1.aix7.1.noarch.rpm: No more mirrors to try - All mirrors were already tried without success



    ------------------------------
    Lionel Widmer
    ------------------------------



  • 5.  RE: /opt/freeware/bin/dnf reposync -p /yumrepo --repo AIX_Toolbox_noarch aborts with Status 404

    Posted Thu June 22, 2023 04:47 AM

    Hi,

    The repository has been corrected.

    The downloads are working now.

    Many thanks to the involved persons.

    Best regards

    Jean-Luc



    ------------------------------
    Jean-Luc Westermann
    ------------------------------