Hello, thanks for that info.
I can install through dnf, and there is no reason except that is what came up in a pip search for the installable.
I have this requirements from IBM
k#The commands given in the script install python and required modules for machine learning on AIX machine.
#IT is recommended to run the script with root access.
# Install packages
yum install gcc xz python3 gcc-c++ gcc-gfortran freetype2-devel libpng-devel zeromq zeromq-devel lapack blas python3-devel
yum install unzip
# The process resource limits need to be increased for successful installation
# of NumPy. We set it to 'unlimited'
ulimit -d unlimited
# Specify space requirements by chfs.
# The file system space should be at least 1 GB in /tmp and /opt to install
# ML packages without any error.
chfs -a size=+1G /tmp
chfs -a size=+1G /opt
export PATH=$PATH:/opt/freeware/bin
export PATH=$PATH:/opt/freeware/bin
# install all libraries for ML
python3 -m pip install pandas scipy scikit-learn matplotlib flask dill
python3 -m pip install bloom-filter hazelcast pymongo json nltk psutil
# install gensim
python3.6 -m pip install gensim
# install pytorch
python3.6 -m pip install torch==1.4.0+cpu torchvision==0.5.0+cpu -f https://download.pytorch.org/whl/torch_stable.html
#install #Install torchtext
python3.6 -m pip install torchtext
#install #Install excel module
python3.6 -m pip install xlrd
If I try to install for example pandas, I get the same error messages. And it looks like it tries to install numpy into the site-packages.
root@cor089ya61:/# python3 -m pip install pandas
Collecting pandas
Using cached pandas-2.1.0.tar.gz (4.3 MB)
Installing build dependencies ... error
error: subprocess-exited-with-error
× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> [277 lines of output]
Ignoring numpy: markers 'python_version >= "3.12"' don't match your environment
Collecting meson-python==0.13.1
Using cached meson_python-0.13.1-py3-none-any.whl (79 kB)
Collecting meson==1.0.1
Using cached meson-1.0.1-py3-none-any.whl (904 kB)
Collecting wheel
Using cached wheel-0.41.2-py3-none-any.whl (64 kB)
Collecting Cython<3,>=0.29.33
Using cached Cython-0.29.36-py2.py3-none-any.whl (988 kB)
Collecting oldest-supported-numpy>=2022.8.16
Using cached oldest_supported_numpy-2023.8.3-py3-none-any.whl (4.8 kB)
Collecting versioneer[toml]
Using cached versioneer-0.29-py3-none-any.whl (46 kB)
Collecting pyproject-metadata>=0.7.1
Using cached pyproject_metadata-0.7.1-py3-none-any.whl (7.4 kB)
Collecting tomli>=1.0.0
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting numpy==1.19.3
Using cached numpy-1.19.3.zip (7.3 MB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'error'
error: subprocess-exited-with-error
× Preparing metadata (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [235 lines of output]
Running from numpy source directory.
setup.py:480: UserWarning: Unrecognized setuptools command, proceeding with generating Cython sources and expanding templates
run_build = parse_setuppy_commands()
Processing numpy/random/_bounded_integers.pxd.in
Processing numpy/random/_bounded_integers.pyx.in
Processing numpy/random/_common.pyx
Processing numpy/random/_generator.pyx
Processing numpy/random/_mt19937.pyx
Processing numpy/random/_pcg64.pyx
Processing numpy/random/_philox.pyx
Processing numpy/random/_sfc64.pyx
Processing numpy/random/bit_generator.pyx
Processing numpy/random/mtrand.pyx
Cythonizing sources
blas_opt_info:
blas_mkl_info:
customize UnixCCompiler
C compiler: xlc_r -q64 -qPIC -DNDEBUG -O2 -qmaxmem=-1 -I/usr/opt/python3/include -I/usr/include -D_ALL_SOURCE -D_LINUX_SOURCE_COMPAT -qbitfields=signed -qalloca -O2 -qmaxmem=-1 -I/usr/opt/python3/include -I/usr/include -D_ALL_SOURCE -D_LINUX_SOURCE_COMPAT -qbitfields=signed -qalloca -O2 -qmaxmem=-1
creating /tmp/tmpn896v31v/tmp
creating /tmp/tmpn896v31v/tmp/tmpn896v31v
compile options: '-MMD -MF /tmp/tmpn896v31v/file.c.d -c'
xlc_r: /tmp/tmpn896v31v/file.c
libraries mkl_rt not found in ['/usr/opt/python3/lib', '/opt/lib', '/usr/lib64', '/usr/lib']
NOT AVAILABLE
blis_info:
libraries blis not found in ['/usr/opt/python3/lib', '/opt/lib', '/usr/lib64', '/usr/lib']
NOT AVAILABLE
openblas_info:
libraries openblas not found in ['/usr/opt/python3/lib', '/opt/lib', '/usr/lib64', '/usr/lib']
NOT AVAILABLE
atlas_3_10_blas_threads_info:
Setting PTATLAS=ATLAS
libraries tatlas not found in ['/usr/opt/python3/lib', '/opt/lib', '/usr/lib64', '/usr/lib']
NOT AVAILABLE
atlas_3_10_blas_info:
libraries satlas not found in ['/usr/opt/python3/lib', '/opt/lib', '/usr/lib64', '/usr/lib']
NOT AVAILABLE
atlas_blas_threads_info:
Setting PTATLAS=ATLAS
libraries ptf77blas,ptcblas,atlas not found in ['/usr/opt/python3/lib', '/opt/lib', '/usr/lib64', '/usr/lib']
NOT AVAILABLE
atlas_blas_info:
libraries f77blas,cblas,atlas not found in ['/usr/opt/python3/lib', '/opt/lib', '/usr/lib64', '/usr/lib']
NOT AVAILABLE
accelerate_info:
NOT AVAILABLE
/tmp/pip-install-fv4snolg/numpy_ff47ca4c3596488d9a13200c791886c4/numpy/distutils/system_info.py:1914: UserWarning:
Optimized (vendor) Blas libraries are not found.
Falls back to netlib Blas library which has worse performance.
A better performance should be easily gained by switching
Blas library.
if self._calc_info(blas):
blas_info:
C compiler: xlc_r -q64 -qPIC -DNDEBUG -O2 -qmaxmem=-1 -I/usr/opt/python3/include -I/usr/include -D_ALL_SOURCE -D_LINUX_SOURCE_COMPAT -qbitfields=signed -qalloca -O2 -qmaxmem=-1 -I/usr/opt/python3/include -I/usr/include -D_ALL_SOURCE -D_LINUX_SOURCE_COMPAT -qbitfields=signed -qalloca -O2 -qmaxmem=-1
creating /tmp/tmpnevg9n8u/tmp
creating /tmp/tmpnevg9n8u/tmp/tmpnevg9n8u
compile options: '-I/opt/include -I/usr/include -I/usr/opt/python3/include -c'
xlc_r: /tmp/tmpnevg9n8u/source.c
FOUND:
libraries = ['blas', 'blas']
library_dirs = ['/usr/lib']
include_dirs = ['/opt/include', '/usr/include', '/usr/opt/python3/include']
FOUND:
define_macros = [('NO_ATLAS_INFO', 1)]
libraries = ['blas', 'blas']
library_dirs = ['/usr/lib']
include_dirs = ['/opt/include', '/usr/include', '/usr/opt/python3/include']
non-existing path in 'numpy/distutils': 'site.cfg'
lapack_opt_info:
lapack_mkl_info:
libraries mkl_rt not found in ['/usr/opt/python3/lib', '/opt/lib', '/usr/lib64', '/usr/lib']
NOT AVAILABLE
openblas_lapack_info:
libraries openblas not found in ['/usr/opt/python3/lib', '/opt/lib', '/usr/lib64', '/usr/lib']
NOT AVAILABLE
openblas_clapack_info:
libraries openblas,lapack not found in ['/usr/opt/python3/lib', '/opt/lib', '/usr/lib64', '/usr/lib']
NOT AVAILABLE
flame_info:
libraries flame not found in ['/usr/opt/python3/lib', '/opt/lib', '/usr/lib64', '/usr/lib']
NOT AVAILABLE
atlas_3_10_threads_info:
Setting PTATLAS=ATLAS
libraries lapack_atlas not found in /usr/opt/python3/lib
libraries tatlas,tatlas not found in /usr/opt/python3/lib
libraries lapack_atlas not found in /opt/lib
libraries tatlas,tatlas not found in /opt/lib
libraries lapack_atlas not found in /usr/lib64
libraries tatlas,tatlas not found in /usr/lib64
libraries lapack_atlas not found in /usr/lib
libraries tatlas,tatlas not found in /usr/lib
<class 'numpy.distutils.system_info.atlas_3_10_threads_info'>
NOT AVAILABLE
atlas_3_10_info:
libraries lapack_atlas not found in /usr/opt/python3/lib
libraries satlas,satlas not found in /usr/opt/python3/lib
libraries lapack_atlas not found in /opt/lib
libraries satlas,satlas not found in /opt/lib
libraries lapack_atlas not found in /usr/lib64
libraries satlas,satlas not found in /usr/lib64
libraries lapack_atlas not found in /usr/lib
libraries satlas,satlas not found in /usr/lib
<class 'numpy.distutils.system_info.atlas_3_10_info'>
NOT AVAILABLE
atlas_threads_info:
Setting PTATLAS=ATLAS
libraries lapack_atlas not found in /usr/opt/python3/lib
libraries ptf77blas,ptcblas,atlas not found in /usr/opt/python3/lib
libraries lapack_atlas not found in /opt/lib
libraries ptf77blas,ptcblas,atlas not found in /opt/lib
libraries lapack_atlas not found in /usr/lib64
libraries ptf77blas,ptcblas,atlas not found in /usr/lib64
libraries lapack_atlas not found in /usr/lib
libraries ptf77blas,ptcblas,atlas not found in /usr/lib
<class 'numpy.distutils.system_info.atlas_threads_info'>
NOT AVAILABLE
atlas_info:
libraries lapack_atlas not found in /usr/opt/python3/lib
libraries f77blas,cblas,atlas not found in /usr/opt/python3/lib
libraries lapack_atlas not found in /opt/lib
libraries f77blas,cblas,atlas not found in /opt/lib
libraries lapack_atlas not found in /usr/lib64
libraries f77blas,cblas,atlas not found in /usr/lib64
libraries lapack_atlas not found in /usr/lib
libraries f77blas,cblas,atlas not found in /usr/lib
<class 'numpy.distutils.system_info.atlas_info'>
NOT AVAILABLE
lapack_info:
libraries lapack not found in ['/usr/opt/python3/lib', '/opt/lib', '/usr/lib64', '/usr/lib']
NOT AVAILABLE
/tmp/pip-install-fv4snolg/numpy_ff47ca4c3596488d9a13200c791886c4/numpy/distutils/system_info.py:1748: UserWarning:
Lapack (http://www.netlib.org/lapack/) libraries not found.
Directories to search for the libraries can be specified in the
numpy/distutils/site.cfg file (section [lapack]) or by setting
the LAPACK environment variable.
return getattr(self, '_calc_info_{}'.format(name))()
lapack_src_info:
NOT AVAILABLE
/tmp/pip-install-fv4snolg/numpy_ff47ca4c3596488d9a13200c791886c4/numpy/distutils/system_info.py:1748: UserWarning:
Lapack (http://www.netlib.org/lapack/) sources not found.
Directories to search for the sources can be specified in the
numpy/distutils/site.cfg file (section [lapack_src]) or by setting
the LAPACK_SRC environment variable.
return getattr(self, '_calc_info_{}'.format(name))()
NOT AVAILABLE
numpy_linalg_lapack_lite:
FOUND:
language = c
define_macros = [('HAVE_BLAS_ILP64', None), ('BLAS_SYMBOL_SUFFIX', '64_')]
/tmp/pip-build-env-6s9obptd/overlay/lib/python3.9/site-packages/setuptools/_distutils/dist.py:275: UserWarning: Unknown distribution option: 'define_macros'
warnings.warn(msg)
running dist_info
running build_src
build_src
building py_modules sources
creating build
creating build/src.aix-7301-2245-64-3.9
creating build/src.aix-7301-2245-64-3.9/numpy
creating build/src.aix-7301-2245-64-3.9/numpy/distutils
building library "npymath" sources
Could not locate executable xlf90
Could not locate executable xlf
Could not locate executable g77
Could not locate executable f77
don't know how to compile Fortran code on platform 'posix'
Traceback (most recent call last):
File "/tmp/tmpnob4xyal_in_process.py", line 363, in <module>
main()
File "/tmp/tmpnob4xyal_in_process.py", line 345, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
File "/tmp/tmpnob4xyal_in_process.py", line 164, in prepare_metadata_for_build_wheel
return hook(metadata_directory, config_settings)
File "/tmp/pip-build-env-6s9obptd/overlay/lib/python3.9/site-packages/setuptools/build_meta.py", line 157, in prepare_metadata_for_build_wheel
self.run_setup()
File "/tmp/pip-build-env-6s9obptd/overlay/lib/python3.9/site-packages/setuptools/build_meta.py", line 248, in run_setup
super(_BuildMetaLegacyBackend,
File "/tmp/pip-build-env-6s9obptd/overlay/lib/python3.9/site-packages/setuptools/build_meta.py", line 142, in run_setup
exec(compile(code, __file__, 'exec'), locals())
File "setup.py", line 508, in <module>
setup_package()
File "setup.py", line 500, in setup_package
setup(**metadata)
File "/tmp/pip-install-fv4snolg/numpy_ff47ca4c3596488d9a13200c791886c4/numpy/distutils/core.py", line 169, in setup
return old_setup(**new_attr)
File "/tmp/pip-build-env-6s9obptd/overlay/lib/python3.9/site-packages/setuptools/__init__.py", line 165, in setup
return distutils.core.setup(**attrs)
File "/tmp/pip-build-env-6s9obptd/overlay/lib/python3.9/site-packages/setuptools/_distutils/core.py", line 148, in setup
dist.run_commands()
File "/tmp/pip-build-env-6s9obptd/overlay/lib/python3.9/site-packages/setuptools/_distutils/dist.py", line 967, in run_commands
self.run_command(cmd)
File "/tmp/pip-build-env-6s9obptd/overlay/lib/python3.9/site-packages/setuptools/_distutils/dist.py", line 986, in run_command
cmd_obj.run()
File "/tmp/pip-build-env-6s9obptd/overlay/lib/python3.9/site-packages/setuptools/command/dist_info.py", line 31, in run
egg_info.run()
File "/tmp/pip-install-fv4snolg/numpy_ff47ca4c3596488d9a13200c791886c4/numpy/distutils/command/egg_info.py", line 24, in run
self.run_command("build_src")
File "/tmp/pip-build-env-6s9obptd/overlay/lib/python3.9/site-packages/setuptools/_distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/tmp/pip-build-env-6s9obptd/overlay/lib/python3.9/site-packages/setuptools/_distutils/dist.py", line 986, in run_command
cmd_obj.run()
File "/tmp/pip-install-fv4snolg/numpy_ff47ca4c3596488d9a13200c791886c4/numpy/distutils/command/build_src.py", line 144, in run
self.build_sources()
File "/tmp/pip-install-fv4snolg/numpy_ff47ca4c3596488d9a13200c791886c4/numpy/distutils/command/build_src.py", line 155, in build_sources
self.build_library_sources(*libname_info)
File "/tmp/pip-install-fv4snolg/numpy_ff47ca4c3596488d9a13200c791886c4/numpy/distutils/command/build_src.py", line 288, in build_library_sources
sources = self.generate_sources(sources, (lib_name, build_info))
File "/tmp/pip-install-fv4snolg/numpy_ff47ca4c3596488d9a13200c791886c4/numpy/distutils/command/build_src.py", line 378, in generate_sources
source = func(extension, build_dir)
File "numpy/core/setup.py", line 663, in get_mathlib_info
raise RuntimeError("Broken toolchain: cannot link a simple C program")
RuntimeError: Broken toolchain: cannot link a simple C program
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
WARNING: You are using pip version 22.0.4; however, version 23.2.1 is available.
You should consider upgrading via the '/usr/bin/python3 -m pip install --upgrade pip' command.
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error
× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.
Steve Hansell
Digital & IT Technical Specialist
Infrastructure Engineer
Parker Hannifin Corporation
Midrange Team
stevenhansell@parker.com