IBM i Global

IBM i Global

Connect, learn, share, and engage with IBM Power.

 View Only
  • 1.  Pandas upgrade

    Posted Wed February 14, 2024 11:59 AM

    Hello

    currently we're using pre-compiled Pandas 1.3.4 available via yum repo.

    If we try to install via pip a new version we receive below error:

    Requirement already satisfied: pandas in /QOpenSys/pkgs/lib/python3.9/site-packages (1.3.4)
    Collecting pandas
      Downloading pandas-2.2.0.tar.gz (4.4 MB)
         ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.4/4.4 MB 29.1 MB/s eta 0:00:00
      Installing build dependencies ... error
      error: subprocess-exited-with-error
     
      × pip subprocess to install build dependencies did not run successfully.
      │ exit code: 1
      ╰─> [106 lines of output]
          Collecting meson-python==0.13.1
            Downloading meson_python-0.13.1-py3-none-any.whl (79 kB)
               ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 79.5/79.5 kB 2.2 MB/s eta 0:00:00
          Collecting meson==1.2.1
            Downloading meson-1.2.1-py3-none-any.whl.metadata (1.7 kB)
          Collecting wheel
            Using cached wheel-0.42.0-py3-none-any.whl.metadata (2.2 kB)
          Collecting Cython==3.0.5
            Downloading Cython-3.0.5-py2.py3-none-any.whl.metadata (3.2 kB)
          Collecting numpy<=2.0.0.dev0,>1.22.4
            Using cached numpy-1.26.4.tar.gz (15.8 MB)
            Installing build dependencies: started
            Installing build dependencies: finished with status 'done'
            Getting requirements to build wheel: started
            Getting requirements to build wheel: finished with status 'done'
            Installing backend dependencies: started
            Installing backend dependencies: finished with status 'error'
            error: subprocess-exited-with-error
     
            × pip subprocess to install backend dependencies did not run successfully.
            │ exit code: 1
            ╰─> [74 lines of output]
                Collecting ninja>=1.8.2
                  Using cached ninja-1.11.1.1.tar.gz (132 kB)
                  Installing build dependencies: started
                  Installing build dependencies: finished with status 'done'
                  Getting requirements to build wheel: started
                  Getting requirements to build wheel: finished with status 'done'
                  Preparing metadata (pyproject.toml): started
                  Preparing metadata (pyproject.toml): finished with status 'done'
                Building wheels for collected packages: ninja
                  Building wheel for ninja (pyproject.toml): started
                  Building wheel for ninja (pyproject.toml): finished with status 'error'
                  error: subprocess-exited-with-error
     
                  × Building wheel for ninja (pyproject.toml) did not run successfully.
                  │ exit code: 1
                  ╰─> [52 lines of output]
                      /tmp/pip-build-env-cux4cr6v/overlay/lib/python3.9/site-packages/setuptools_scm/git.py:308: UserWarning: git archive did not support describe output
                        warnings.warn("git archive did not support describe output")
                      /tmp/pip-build-env-cux4cr6v/overlay/lib/python3.9/site-packages/setuptools_scm/git.py:327: UserWarning: unprocessed git archival found (no export subst applied)
                        warnings.warn("unprocessed git archival found (no export subst applied)")
     
     
                      --------------------------------------------------------------------------------
                      -- Trying 'Ninja' generator
                      --------------------------------
                      ---------------------------
                      ----------------------
                      -----------------
                      ------------
                      -------
                      --
                      Not searching for unused variables given on the command line.
                      CMake Error: CMake was unable to find a build program corresponding to "Ninja".  CMAKE_MAKE_PROGRAM is not set.  You probably need to select a different build tool.
                      -- Configuring incomplete, errors occurred!
                      See also "/tmp/pip-install-55utic49/ninja_fa4de3bd38af4523a574d858f15f3937/_cmake_test_compile/build/CMakeFiles/CMakeOutput.log".
                      --
                      -------
                      ------------
                      -----------------
                      ----------------------
                      ---------------------------
                      --------------------------------
                      -- Trying 'Ninja' generator - failure
                      --------------------------------------------------------------------------------
     
                      Traceback (most recent call last):
                        File "/QOpenSys/pkgs/lib/python3.9/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
                          main()
                        File "/QOpenSys/pkgs/lib/python3.9/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
                          json_out['return_val'] = hook(**hook_input['kwargs'])
                        File "/QOpenSys/pkgs/lib/python3.9/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 251, in build_wheel
                          return _build_backend().build_wheel(wheel_directory, config_settings,
                        File "/tmp/pip-build-env-cux4cr6v/overlay/lib/python3.9/site-packages/setuptools/build_meta.py", line 404, in build_wheel
                          return self._build_with_temp_dir(
                        File "/tmp/pip-build-env-cux4cr6v/overlay/lib/python3.9/site-packages/setuptools/build_meta.py", line 389, in _build_with_temp_dir
                          self.run_setup()
                        File "/tmp/pip-build-env-cux4cr6v/overlay/lib/python3.9/site-packages/setuptools/build_meta.py", line 311, in run_setup
                          exec(code, locals())
                        File "<string>", line 32, in <module>
                        File "/tmp/pip-build-env-cux4cr6v/overlay/lib/python3.9/site-packages/skbuild/setuptools_wrap.py", line 666, in setup
                          env = cmkr.configure(
                        File "/tmp/pip-build-env-cux4cr6v/overlay/lib/python3.9/site-packages/skbuild/cmaker.py", line 238, in configure
                          generator = self.platform.get_best_generator(
                        File "/tmp/pip-build-env-cux4cr6v/overlay/lib/python3.9/site-packages/skbuild/platform_specifics/abstract.py", line 173, in get_best_generator
                          installation_help = self.generator_installation_help
                        File "/tmp/pip-build-env-cux4cr6v/overlay/lib/python3.9/site-packages/skbuild/platform_specifics/abstract.py", line 44, in generator_installation_help
                          raise NotImplementedError()  # pragma: no cover
                      NotImplementedError
                      [end of output]
     
                  note: This error originates from a subprocess, and is likely not a problem with pip.
                  ERROR: Failed building wheel for ninja
                Failed to build ninja
                ERROR: Could not build wheels for ninja, which is required to install pyproject.toml-based projects
                [end of output]
     
            note: This error originates from a subprocess, and is likely not a problem with pip.
          error: subprocess-exited-with-error
     
          × pip subprocess to install backend dependencies did not run successfully.
          │ exit code: 1
          ╰─> See above for output.
     
          note: This error originates from a subprocess, and is likely not a problem with pip.
          [end of output]
     
      note: This error originates from a subprocess, and is likely not a problem with pip.
    error: subprocess-exited-with-error
     
    × pip subprocess to install build dependencies did not run successfully.
    │ exit code: 1
    ╰─> See above for output.
     
    note: This error originates from a subprocess, and is likely not a problem with pip.
    Is there the possibility to use update version of python packages not available on ibmi-repo?
    thank you 

     



    ------------------------------
    Luca Pasquini
    ------------------------------


  • 2.  RE: Pandas upgrade

    Posted Wed February 14, 2024 09:21 PM

    That's why it's in the yum repo: it doesn't build easily as delivered by pip.

    Try yum update and see if pandas has been updated to the version you want.

    If not, you have 2 choices:

    1. Wait for IBM to update pandas.
    2. Figure out how to build it yourself.


    ------------------------------
    Jack Woehr
    IBM Champion 2021 - 2024
    IBM Qiskit Advocate
    ------------------------------



  • 3.  RE: Pandas upgrade

    Posted Fri February 16, 2024 02:00 AM

    Hello

    It's not clear to me IBM strategy.

    yum repo are not updated. Most of packages are 2022 old. 
    if IBMi could resist depends on availability of updates and new technologies.

    spending time to build every time a package that un Linux is installed in few seconds is not winning.

    Why yum repo are not properly updated?

    thank you 



    ------------------------------
    Luca Pasquini
    ------------------------------



  • 4.  RE: Pandas upgrade

    Posted Wed March 13, 2024 01:29 PM

    Hi Jack

    what are the latest IBMi repo?

    Why python packages are old May 2022?

    thank you 



    ------------------------------
    Luca Pasquini
    ------------------------------