Hi,

This is a follow up of installing pgvectorscale on AIX 7.2 and from the upstreaming problems discussed in thread Rust cargo and openssl on AIX, respectively.

Because this problem does not belong to rust and openssl I've started a new thread.

What I've done so far to install pgvectorscale:

# openssl version
OpenSSL 3.0.15 3 Sep 2024 (Library: OpenSSL 3.0.15 3 Sep 2024)
# git clone --branch 0.7.1 https://github.com/timescale/pgvectorscale
# cd pgvectorscale/pgvectorscale
# export PKG_CONFIG_PATH=/usr/lib/pkgconfig
# export OPENSSL_DIR=/usr
# export CC=ibm-clang

# cargo install --locked cargo-pgrx --version $(cargo metadata --format-version 1 | jq -r '.packages[] | select(.name == "pgrx") | .version')
# cargo pgrx init --pg15 pg_config

With following step I get the libclang error:

# cargo pgrx install --release

       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling syn v2.0.102
   Compiling petgraph v0.6.5
...<truncated for clarity>...
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.a'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
warning: build failed, waiting for other jobs to finish...

With RUST_BACKTRACE=1 set:

       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`
note: To improve backtraces for build dependencies, set the CARGO_PROFILE_RELEASE_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation.

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.a'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"
  stack backtrace:
     0: rust_begin_unwind
     1: core::panicking::panic_fmt
     2: core::result::unwrap_failed
     3: core::result::Result<T,E>::expect
     4: bindgen::ensure_libclang_is_loaded::{{closure}}
     5: std::sync::once_lock::OnceLock<T>::get_or_init::{{closure}}
     6: std::sync::once_lock::OnceLock<T>::initialize::{{closure}}
     7: std::sync::poison::once::Once::call_once_force::{{closure}}
     8: std::sys::sync::once::queue::Once::call
     9: std::sync::poison::once::Once::call_once_force
    10: std::sync::once_lock::OnceLock<T>::initialize
    11: std::sync::once_lock::OnceLock<T>::get_or_try_init
    12: std::sync::once_lock::OnceLock<T>::get_or_init
    13: bindgen::ensure_libclang_is_loaded
    14: bindgen::clang_version
    15: pgrx_bindgen::build::clang::detect_include_paths_for
    16: pgrx_bindgen::build::run_bindgen
    17: pgrx_bindgen::build::get_bindings
    18: pgrx_bindgen::build::generate_bindings
    19: pgrx_bindgen::build::main::{{closure}}::{{closure}}::{{closure}}
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
  stack backtrace:
     0: rust_begin_unwind
     1: core::panicking::panic_fmt
     2: core::result::unwrap_failed
     3: core::result::Result<T,E>::expect
     4: pgrx_bindgen::build::main::{{closure}}::{{closure}}
     5: core::iter::adapters::map::map_try_fold::{{closure}}
     6: <alloc::vec::into_iter::IntoIter<T,A> as core::iter::traits::iterator::Iterator>::try_fold
     7: <core::iter::adapters::map::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
     8: <I as alloc::vec::in_place_collect::SpecInPlaceCollect<T,I>>::collect_in_place
     9: alloc::vec::in_place_collect::from_iter_in_place
    10: alloc::vec::in_place_collect::from_iter_in_place{{reify.shim}}
    11: alloc::vec::in_place_collect::<impl alloc::vec::spec_from_iter::SpecFromIter<T,I> for alloc::vec::Vec<T>>::from_iter
    12: <alloc::vec::Vec<T> as core::iter::traits::collect::FromIterator<T>>::from_iter
    13: core::iter::traits::iterator::Iterator::collect
    14: pgrx_bindgen::build::main::{{closure}}
    15: std::thread::scoped::scope::{{closure}}
    16: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
    17: std::panicking::try::do_call
    18: __rust_try
    19: std::thread::scoped::scope
    20: pgrx_bindgen::build::main
    21: core::ops::function::FnOnce::call_once
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

Ok, it searches for libclang.a but cannot find it.

I cannot find libclang.a either. I've searched in /opt/freeware, /opt/lib, /usr/lib, /opt/IBM (where openxlC is installed) and some other directories. As I can see IBM Open XL C/C++ runtime environment filesets does not include such a library.

What's the error?

Hi, 

Let me check with openxl team . 


Thanks
Ranjit

Hi,

This is a follow up of installing pgvectorscale on AIX 7.2 and from the upstreaming problems discussed in thread Rust cargo and openssl on AIX, respectively.

Because this problem does not belong to rust and openssl I've started a new thread.

What I've done so far to install pgvectorscale:

# openssl version
OpenSSL 3.0.15 3 Sep 2024 (Library: OpenSSL 3.0.15 3 Sep 2024)
# git clone --branch 0.7.1 https://github.com/timescale/pgvectorscale
# cd pgvectorscale/pgvectorscale
# export PKG_CONFIG_PATH=/usr/lib/pkgconfig
# export OPENSSL_DIR=/usr
# export CC=ibm-clang

# cargo install --locked cargo-pgrx --version $(cargo metadata --format-version 1 | jq -r '.packages[] | select(.name == "pgrx") | .version')
# cargo pgrx init --pg15 pg_config

With following step I get the libclang error:

# cargo pgrx install --release

       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling syn v2.0.102
   Compiling petgraph v0.6.5
...<truncated for clarity>...
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.a'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
warning: build failed, waiting for other jobs to finish...

With RUST_BACKTRACE=1 set:

       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`
note: To improve backtraces for build dependencies, set the CARGO_PROFILE_RELEASE_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation.

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.a'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"
  stack backtrace:
     0: rust_begin_unwind
     1: core::panicking::panic_fmt
     2: core::result::unwrap_failed
     3: core::result::Result<T,E>::expect
     4: bindgen::ensure_libclang_is_loaded::{{closure}}
     5: std::sync::once_lock::OnceLock<T>::get_or_init::{{closure}}
     6: std::sync::once_lock::OnceLock<T>::initialize::{{closure}}
     7: std::sync::poison::once::Once::call_once_force::{{closure}}
     8: std::sys::sync::once::queue::Once::call
     9: std::sync::poison::once::Once::call_once_force
    10: std::sync::once_lock::OnceLock<T>::initialize
    11: std::sync::once_lock::OnceLock<T>::get_or_try_init
    12: std::sync::once_lock::OnceLock<T>::get_or_init
    13: bindgen::ensure_libclang_is_loaded
    14: bindgen::clang_version
    15: pgrx_bindgen::build::clang::detect_include_paths_for
    16: pgrx_bindgen::build::run_bindgen
    17: pgrx_bindgen::build::get_bindings
    18: pgrx_bindgen::build::generate_bindings
    19: pgrx_bindgen::build::main::{{closure}}::{{closure}}::{{closure}}
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
  stack backtrace:
     0: rust_begin_unwind
     1: core::panicking::panic_fmt
     2: core::result::unwrap_failed
     3: core::result::Result<T,E>::expect
     4: pgrx_bindgen::build::main::{{closure}}::{{closure}}
     5: core::iter::adapters::map::map_try_fold::{{closure}}
     6: <alloc::vec::into_iter::IntoIter<T,A> as core::iter::traits::iterator::Iterator>::try_fold
     7: <core::iter::adapters::map::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
     8: <I as alloc::vec::in_place_collect::SpecInPlaceCollect<T,I>>::collect_in_place
     9: alloc::vec::in_place_collect::from_iter_in_place
    10: alloc::vec::in_place_collect::from_iter_in_place{{reify.shim}}
    11: alloc::vec::in_place_collect::<impl alloc::vec::spec_from_iter::SpecFromIter<T,I> for alloc::vec::Vec<T>>::from_iter
    12: <alloc::vec::Vec<T> as core::iter::traits::collect::FromIterator<T>>::from_iter
    13: core::iter::traits::iterator::Iterator::collect
    14: pgrx_bindgen::build::main::{{closure}}
    15: std::thread::scoped::scope::{{closure}}
    16: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
    17: std::panicking::try::do_call
    18: __rust_try
    19: std::thread::scoped::scope
    20: pgrx_bindgen::build::main
    21: core::ops::function::FnOnce::call_once
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

Ok, it searches for libclang.a but cannot find it.

I cannot find libclang.a either. I've searched in /opt/freeware, /opt/lib, /usr/lib, /opt/IBM (where openxlC is installed) and some other directories. As I can see IBM Open XL C/C++ runtime environment filesets does not include such a library.

What's the error?

Hi Emanuel.  libclang.a is not part of the Open XL compiler product.  But you can get it from the community clang releases at https://github.com/IBM/llvm-project/releases.

For example, version 19.1.6 (which matches the version used by Open XL C/C++ for AIX 17.1.3) is available here https://github.com/IBM/llvm-project/releases/download/llvmorg-19.1.6/clang+llvm-19.1.6-powerpc64-ibm-aix-7.2.tar.xz .  It's located at "clang+llvm-19.1.6-powerpc64-ibm-aix-7.2/lib/libclang.a" inside that archive.

Regards

Rafik

Hi, 

Let me check with openxl team . 


Thanks
Ranjit

Hi,

This is a follow up of installing pgvectorscale on AIX 7.2 and from the upstreaming problems discussed in thread Rust cargo and openssl on AIX, respectively.

Because this problem does not belong to rust and openssl I've started a new thread.

What I've done so far to install pgvectorscale:

# openssl version
OpenSSL 3.0.15 3 Sep 2024 (Library: OpenSSL 3.0.15 3 Sep 2024)
# git clone --branch 0.7.1 https://github.com/timescale/pgvectorscale
# cd pgvectorscale/pgvectorscale
# export PKG_CONFIG_PATH=/usr/lib/pkgconfig
# export OPENSSL_DIR=/usr
# export CC=ibm-clang

# cargo install --locked cargo-pgrx --version $(cargo metadata --format-version 1 | jq -r '.packages[] | select(.name == "pgrx") | .version')
# cargo pgrx init --pg15 pg_config

With following step I get the libclang error:

# cargo pgrx install --release

       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling syn v2.0.102
   Compiling petgraph v0.6.5
...<truncated for clarity>...
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.a'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
warning: build failed, waiting for other jobs to finish...

With RUST_BACKTRACE=1 set:

       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`
note: To improve backtraces for build dependencies, set the CARGO_PROFILE_RELEASE_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation.

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.a'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"
  stack backtrace:
     0: rust_begin_unwind
     1: core::panicking::panic_fmt
     2: core::result::unwrap_failed
     3: core::result::Result<T,E>::expect
     4: bindgen::ensure_libclang_is_loaded::{{closure}}
     5: std::sync::once_lock::OnceLock<T>::get_or_init::{{closure}}
     6: std::sync::once_lock::OnceLock<T>::initialize::{{closure}}
     7: std::sync::poison::once::Once::call_once_force::{{closure}}
     8: std::sys::sync::once::queue::Once::call
     9: std::sync::poison::once::Once::call_once_force
    10: std::sync::once_lock::OnceLock<T>::initialize
    11: std::sync::once_lock::OnceLock<T>::get_or_try_init
    12: std::sync::once_lock::OnceLock<T>::get_or_init
    13: bindgen::ensure_libclang_is_loaded
    14: bindgen::clang_version
    15: pgrx_bindgen::build::clang::detect_include_paths_for
    16: pgrx_bindgen::build::run_bindgen
    17: pgrx_bindgen::build::get_bindings
    18: pgrx_bindgen::build::generate_bindings
    19: pgrx_bindgen::build::main::{{closure}}::{{closure}}::{{closure}}
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
  stack backtrace:
     0: rust_begin_unwind
     1: core::panicking::panic_fmt
     2: core::result::unwrap_failed
     3: core::result::Result<T,E>::expect
     4: pgrx_bindgen::build::main::{{closure}}::{{closure}}
     5: core::iter::adapters::map::map_try_fold::{{closure}}
     6: <alloc::vec::into_iter::IntoIter<T,A> as core::iter::traits::iterator::Iterator>::try_fold
     7: <core::iter::adapters::map::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
     8: <I as alloc::vec::in_place_collect::SpecInPlaceCollect<T,I>>::collect_in_place
     9: alloc::vec::in_place_collect::from_iter_in_place
    10: alloc::vec::in_place_collect::from_iter_in_place{{reify.shim}}
    11: alloc::vec::in_place_collect::<impl alloc::vec::spec_from_iter::SpecFromIter<T,I> for alloc::vec::Vec<T>>::from_iter
    12: <alloc::vec::Vec<T> as core::iter::traits::collect::FromIterator<T>>::from_iter
    13: core::iter::traits::iterator::Iterator::collect
    14: pgrx_bindgen::build::main::{{closure}}
    15: std::thread::scoped::scope::{{closure}}
    16: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
    17: std::panicking::try::do_call
    18: __rust_try
    19: std::thread::scoped::scope
    20: pgrx_bindgen::build::main
    21: core::ops::function::FnOnce::call_once
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

Ok, it searches for libclang.a but cannot find it.

I cannot find libclang.a either. I've searched in /opt/freeware, /opt/lib, /usr/lib, /opt/IBM (where openxlC is installed) and some other directories. As I can see IBM Open XL C/C++ runtime environment filesets does not include such a library.

What's the error?

Hi Rafik,

I don't understand that. I build pgvectorscale with IBM Open XL C/C++ and need a community clang release to obtain the required library.

Can you explain this a little bit more?

Hi Emanuel.  libclang.a is not part of the Open XL compiler product.  But you can get it from the community clang releases at https://github.com/IBM/llvm-project/releases.

For example, version 19.1.6 (which matches the version used by Open XL C/C++ for AIX 17.1.3) is available here https://github.com/IBM/llvm-project/releases/download/llvmorg-19.1.6/clang+llvm-19.1.6-powerpc64-ibm-aix-7.2.tar.xz .  It's located at "clang+llvm-19.1.6-powerpc64-ibm-aix-7.2/lib/libclang.a" inside that archive.

Regards

Rafik

Hi, 

Let me check with openxl team . 


Thanks
Ranjit

Hi,

This is a follow up of installing pgvectorscale on AIX 7.2 and from the upstreaming problems discussed in thread Rust cargo and openssl on AIX, respectively.

Because this problem does not belong to rust and openssl I've started a new thread.

What I've done so far to install pgvectorscale:

# openssl version
OpenSSL 3.0.15 3 Sep 2024 (Library: OpenSSL 3.0.15 3 Sep 2024)
# git clone --branch 0.7.1 https://github.com/timescale/pgvectorscale
# cd pgvectorscale/pgvectorscale
# export PKG_CONFIG_PATH=/usr/lib/pkgconfig
# export OPENSSL_DIR=/usr
# export CC=ibm-clang

# cargo install --locked cargo-pgrx --version $(cargo metadata --format-version 1 | jq -r '.packages[] | select(.name == "pgrx") | .version')
# cargo pgrx init --pg15 pg_config

With following step I get the libclang error:

# cargo pgrx install --release

       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling syn v2.0.102
   Compiling petgraph v0.6.5
...<truncated for clarity>...
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.a'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
warning: build failed, waiting for other jobs to finish...

With RUST_BACKTRACE=1 set:

       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`
note: To improve backtraces for build dependencies, set the CARGO_PROFILE_RELEASE_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation.

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.a'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"
  stack backtrace:
     0: rust_begin_unwind
     1: core::panicking::panic_fmt
     2: core::result::unwrap_failed
     3: core::result::Result<T,E>::expect
     4: bindgen::ensure_libclang_is_loaded::{{closure}}
     5: std::sync::once_lock::OnceLock<T>::get_or_init::{{closure}}
     6: std::sync::once_lock::OnceLock<T>::initialize::{{closure}}
     7: std::sync::poison::once::Once::call_once_force::{{closure}}
     8: std::sys::sync::once::queue::Once::call
     9: std::sync::poison::once::Once::call_once_force
    10: std::sync::once_lock::OnceLock<T>::initialize
    11: std::sync::once_lock::OnceLock<T>::get_or_try_init
    12: std::sync::once_lock::OnceLock<T>::get_or_init
    13: bindgen::ensure_libclang_is_loaded
    14: bindgen::clang_version
    15: pgrx_bindgen::build::clang::detect_include_paths_for
    16: pgrx_bindgen::build::run_bindgen
    17: pgrx_bindgen::build::get_bindings
    18: pgrx_bindgen::build::generate_bindings
    19: pgrx_bindgen::build::main::{{closure}}::{{closure}}::{{closure}}
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
  stack backtrace:
     0: rust_begin_unwind
     1: core::panicking::panic_fmt
     2: core::result::unwrap_failed
     3: core::result::Result<T,E>::expect
     4: pgrx_bindgen::build::main::{{closure}}::{{closure}}
     5: core::iter::adapters::map::map_try_fold::{{closure}}
     6: <alloc::vec::into_iter::IntoIter<T,A> as core::iter::traits::iterator::Iterator>::try_fold
     7: <core::iter::adapters::map::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
     8: <I as alloc::vec::in_place_collect::SpecInPlaceCollect<T,I>>::collect_in_place
     9: alloc::vec::in_place_collect::from_iter_in_place
    10: alloc::vec::in_place_collect::from_iter_in_place{{reify.shim}}
    11: alloc::vec::in_place_collect::<impl alloc::vec::spec_from_iter::SpecFromIter<T,I> for alloc::vec::Vec<T>>::from_iter
    12: <alloc::vec::Vec<T> as core::iter::traits::collect::FromIterator<T>>::from_iter
    13: core::iter::traits::iterator::Iterator::collect
    14: pgrx_bindgen::build::main::{{closure}}
    15: std::thread::scoped::scope::{{closure}}
    16: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
    17: std::panicking::try::do_call
    18: __rust_try
    19: std::thread::scoped::scope
    20: pgrx_bindgen::build::main
    21: core::ops::function::FnOnce::call_once
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

Ok, it searches for libclang.a but cannot find it.

I cannot find libclang.a either. I've searched in /opt/freeware, /opt/lib, /usr/lib, /opt/IBM (where openxlC is installed) and some other directories. As I can see IBM Open XL C/C++ runtime environment filesets does not include such a library.

What's the error?

Hi Emanuel.  I think there are two things needed by pgvectorscale:  1. A C/C++ compiler.  2. A C/C++ parser that can be embedded into pgvectorscale.  The libclang.a library (https://clang.llvm.org/docs/LibClang.html) provides the clang parser as a library for use in programs that want to parse C/C++ source code themselves.

The Open XL C/C++ for AIX product provides a standalone compiler application to compile C/C++ source code.  It does not provide the ability to embed the compiler parser into user programs.  The community clang releases linked above contain both the C/C++ compiler and this parser library.

Hi Rafik,

I don't understand that. I build pgvectorscale with IBM Open XL C/C++ and need a community clang release to obtain the required library.

Can you explain this a little bit more?

Hi Emanuel.  libclang.a is not part of the Open XL compiler product.  But you can get it from the community clang releases at https://github.com/IBM/llvm-project/releases.

For example, version 19.1.6 (which matches the version used by Open XL C/C++ for AIX 17.1.3) is available here https://github.com/IBM/llvm-project/releases/download/llvmorg-19.1.6/clang+llvm-19.1.6-powerpc64-ibm-aix-7.2.tar.xz .  It's located at "clang+llvm-19.1.6-powerpc64-ibm-aix-7.2/lib/libclang.a" inside that archive.

Regards

Rafik

Hi, 

Let me check with openxl team . 


Thanks
Ranjit

Hi,

This is a follow up of installing pgvectorscale on AIX 7.2 and from the upstreaming problems discussed in thread Rust cargo and openssl on AIX, respectively.

Because this problem does not belong to rust and openssl I've started a new thread.

What I've done so far to install pgvectorscale:

# openssl version
OpenSSL 3.0.15 3 Sep 2024 (Library: OpenSSL 3.0.15 3 Sep 2024)
# git clone --branch 0.7.1 https://github.com/timescale/pgvectorscale
# cd pgvectorscale/pgvectorscale
# export PKG_CONFIG_PATH=/usr/lib/pkgconfig
# export OPENSSL_DIR=/usr
# export CC=ibm-clang

# cargo install --locked cargo-pgrx --version $(cargo metadata --format-version 1 | jq -r '.packages[] | select(.name == "pgrx") | .version')
# cargo pgrx init --pg15 pg_config

With following step I get the libclang error:

# cargo pgrx install --release

       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling syn v2.0.102
   Compiling petgraph v0.6.5
...<truncated for clarity>...
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.a'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
warning: build failed, waiting for other jobs to finish...

With RUST_BACKTRACE=1 set:

       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`
note: To improve backtraces for build dependencies, set the CARGO_PROFILE_RELEASE_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation.

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.a'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"
  stack backtrace:
     0: rust_begin_unwind
     1: core::panicking::panic_fmt
     2: core::result::unwrap_failed
     3: core::result::Result<T,E>::expect
     4: bindgen::ensure_libclang_is_loaded::{{closure}}
     5: std::sync::once_lock::OnceLock<T>::get_or_init::{{closure}}
     6: std::sync::once_lock::OnceLock<T>::initialize::{{closure}}
     7: std::sync::poison::once::Once::call_once_force::{{closure}}
     8: std::sys::sync::once::queue::Once::call
     9: std::sync::poison::once::Once::call_once_force
    10: std::sync::once_lock::OnceLock<T>::initialize
    11: std::sync::once_lock::OnceLock<T>::get_or_try_init
    12: std::sync::once_lock::OnceLock<T>::get_or_init
    13: bindgen::ensure_libclang_is_loaded
    14: bindgen::clang_version
    15: pgrx_bindgen::build::clang::detect_include_paths_for
    16: pgrx_bindgen::build::run_bindgen
    17: pgrx_bindgen::build::get_bindings
    18: pgrx_bindgen::build::generate_bindings
    19: pgrx_bindgen::build::main::{{closure}}::{{closure}}::{{closure}}
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
  stack backtrace:
     0: rust_begin_unwind
     1: core::panicking::panic_fmt
     2: core::result::unwrap_failed
     3: core::result::Result<T,E>::expect
     4: pgrx_bindgen::build::main::{{closure}}::{{closure}}
     5: core::iter::adapters::map::map_try_fold::{{closure}}
     6: <alloc::vec::into_iter::IntoIter<T,A> as core::iter::traits::iterator::Iterator>::try_fold
     7: <core::iter::adapters::map::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
     8: <I as alloc::vec::in_place_collect::SpecInPlaceCollect<T,I>>::collect_in_place
     9: alloc::vec::in_place_collect::from_iter_in_place
    10: alloc::vec::in_place_collect::from_iter_in_place{{reify.shim}}
    11: alloc::vec::in_place_collect::<impl alloc::vec::spec_from_iter::SpecFromIter<T,I> for alloc::vec::Vec<T>>::from_iter
    12: <alloc::vec::Vec<T> as core::iter::traits::collect::FromIterator<T>>::from_iter
    13: core::iter::traits::iterator::Iterator::collect
    14: pgrx_bindgen::build::main::{{closure}}
    15: std::thread::scoped::scope::{{closure}}
    16: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
    17: std::panicking::try::do_call
    18: __rust_try
    19: std::thread::scoped::scope
    20: pgrx_bindgen::build::main
    21: core::ops::function::FnOnce::call_once
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

Ok, it searches for libclang.a but cannot find it.

I cannot find libclang.a either. I've searched in /opt/freeware, /opt/lib, /usr/lib, /opt/IBM (where openxlC is installed) and some other directories. As I can see IBM Open XL C/C++ runtime environment filesets does not include such a library.

What's the error?

Hi Rafik,

I've downloaded the community clang release version 19.1.7 (it's the same like ibm-clang --version prints) and set LIBCLANG_PATH.

Now pgvectorscale finds libclang.a but with the error Exec format error. 

# cargo pgrx install --release
       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "the `libclang` shared library at /opt/IBM/clang-llvm-19.1.7/lib/libclang.a could not be opened: Could not load module /opt/IBM/clang-llvm-19.1.7/lib/libclang.a.\nSystem error: Exec format error"
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
warning: build failed, waiting for other jobs to finish...

Usually the error implies there are different architectures. But pgvectorscale is built on AIX 7.2 64Bit and the used community clang release is for this architecture (https://github.com/IBM/llvm-project/releases/download/llvmorg-19.1.7/clang+llvm-19.1.7-powerpc64-ibm-aix-7.2.tar.xz). 

What could it be now?

Hi Emanuel.  I think there are two things needed by pgvectorscale:  1. A C/C++ compiler.  2. A C/C++ parser that can be embedded into pgvectorscale.  The libclang.a library (https://clang.llvm.org/docs/LibClang.html) provides the clang parser as a library for use in programs that want to parse C/C++ source code themselves.

The Open XL C/C++ for AIX product provides a standalone compiler application to compile C/C++ source code.  It does not provide the ability to embed the compiler parser into user programs.  The community clang releases linked above contain both the C/C++ compiler and this parser library.

Hi Rafik,

I don't understand that. I build pgvectorscale with IBM Open XL C/C++ and need a community clang release to obtain the required library.

Can you explain this a little bit more?

Hi Emanuel.  libclang.a is not part of the Open XL compiler product.  But you can get it from the community clang releases at https://github.com/IBM/llvm-project/releases.

For example, version 19.1.6 (which matches the version used by Open XL C/C++ for AIX 17.1.3) is available here https://github.com/IBM/llvm-project/releases/download/llvmorg-19.1.6/clang+llvm-19.1.6-powerpc64-ibm-aix-7.2.tar.xz .  It's located at "clang+llvm-19.1.6-powerpc64-ibm-aix-7.2/lib/libclang.a" inside that archive.

Regards

Rafik

Hi, 

Let me check with openxl team . 


Thanks
Ranjit

Hi,

This is a follow up of installing pgvectorscale on AIX 7.2 and from the upstreaming problems discussed in thread Rust cargo and openssl on AIX, respectively.

Because this problem does not belong to rust and openssl I've started a new thread.

What I've done so far to install pgvectorscale:

# openssl version
OpenSSL 3.0.15 3 Sep 2024 (Library: OpenSSL 3.0.15 3 Sep 2024)
# git clone --branch 0.7.1 https://github.com/timescale/pgvectorscale
# cd pgvectorscale/pgvectorscale
# export PKG_CONFIG_PATH=/usr/lib/pkgconfig
# export OPENSSL_DIR=/usr
# export CC=ibm-clang

# cargo install --locked cargo-pgrx --version $(cargo metadata --format-version 1 | jq -r '.packages[] | select(.name == "pgrx") | .version')
# cargo pgrx init --pg15 pg_config

With following step I get the libclang error:

# cargo pgrx install --release

       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling syn v2.0.102
   Compiling petgraph v0.6.5
...<truncated for clarity>...
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.a'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
warning: build failed, waiting for other jobs to finish...

With RUST_BACKTRACE=1 set:

       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`
note: To improve backtraces for build dependencies, set the CARGO_PROFILE_RELEASE_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation.

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.a'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"
  stack backtrace:
     0: rust_begin_unwind
     1: core::panicking::panic_fmt
     2: core::result::unwrap_failed
     3: core::result::Result<T,E>::expect
     4: bindgen::ensure_libclang_is_loaded::{{closure}}
     5: std::sync::once_lock::OnceLock<T>::get_or_init::{{closure}}
     6: std::sync::once_lock::OnceLock<T>::initialize::{{closure}}
     7: std::sync::poison::once::Once::call_once_force::{{closure}}
     8: std::sys::sync::once::queue::Once::call
     9: std::sync::poison::once::Once::call_once_force
    10: std::sync::once_lock::OnceLock<T>::initialize
    11: std::sync::once_lock::OnceLock<T>::get_or_try_init
    12: std::sync::once_lock::OnceLock<T>::get_or_init
    13: bindgen::ensure_libclang_is_loaded
    14: bindgen::clang_version
    15: pgrx_bindgen::build::clang::detect_include_paths_for
    16: pgrx_bindgen::build::run_bindgen
    17: pgrx_bindgen::build::get_bindings
    18: pgrx_bindgen::build::generate_bindings
    19: pgrx_bindgen::build::main::{{closure}}::{{closure}}::{{closure}}
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
  stack backtrace:
     0: rust_begin_unwind
     1: core::panicking::panic_fmt
     2: core::result::unwrap_failed
     3: core::result::Result<T,E>::expect
     4: pgrx_bindgen::build::main::{{closure}}::{{closure}}
     5: core::iter::adapters::map::map_try_fold::{{closure}}
     6: <alloc::vec::into_iter::IntoIter<T,A> as core::iter::traits::iterator::Iterator>::try_fold
     7: <core::iter::adapters::map::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
     8: <I as alloc::vec::in_place_collect::SpecInPlaceCollect<T,I>>::collect_in_place
     9: alloc::vec::in_place_collect::from_iter_in_place
    10: alloc::vec::in_place_collect::from_iter_in_place{{reify.shim}}
    11: alloc::vec::in_place_collect::<impl alloc::vec::spec_from_iter::SpecFromIter<T,I> for alloc::vec::Vec<T>>::from_iter
    12: <alloc::vec::Vec<T> as core::iter::traits::collect::FromIterator<T>>::from_iter
    13: core::iter::traits::iterator::Iterator::collect
    14: pgrx_bindgen::build::main::{{closure}}
    15: std::thread::scoped::scope::{{closure}}
    16: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
    17: std::panicking::try::do_call
    18: __rust_try
    19: std::thread::scoped::scope
    20: pgrx_bindgen::build::main
    21: core::ops::function::FnOnce::call_once
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

Ok, it searches for libclang.a but cannot find it.

I cannot find libclang.a either. I've searched in /opt/freeware, /opt/lib, /usr/lib, /opt/IBM (where openxlC is installed) and some other directories. As I can see IBM Open XL C/C++ runtime environment filesets does not include such a library.

What's the error?

I think the issue is that shared libraries with an "a" extension on AIX are actually archives containing a shared object.  So when you dlopen them you have to provide the archive member in the path name.  To work around this without changing the pgvectorscale source, I extracted the shared object:

Hi Rafik,

I've downloaded the community clang release version 19.1.7 (it's the same like ibm-clang --version prints) and set LIBCLANG_PATH.

Now pgvectorscale finds libclang.a but with the error Exec format error. 

# cargo pgrx install --release
       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "the `libclang` shared library at /opt/IBM/clang-llvm-19.1.7/lib/libclang.a could not be opened: Could not load module /opt/IBM/clang-llvm-19.1.7/lib/libclang.a.\nSystem error: Exec format error"
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
warning: build failed, waiting for other jobs to finish...

Usually the error implies there are different architectures. But pgvectorscale is built on AIX 7.2 64Bit and the used community clang release is for this architecture (https://github.com/IBM/llvm-project/releases/download/llvmorg-19.1.7/clang+llvm-19.1.7-powerpc64-ibm-aix-7.2.tar.xz). 

What could it be now?

Hi Emanuel.  I think there are two things needed by pgvectorscale:  1. A C/C++ compiler.  2. A C/C++ parser that can be embedded into pgvectorscale.  The libclang.a library (https://clang.llvm.org/docs/LibClang.html) provides the clang parser as a library for use in programs that want to parse C/C++ source code themselves.

The Open XL C/C++ for AIX product provides a standalone compiler application to compile C/C++ source code.  It does not provide the ability to embed the compiler parser into user programs.  The community clang releases linked above contain both the C/C++ compiler and this parser library.

Hi Rafik,

I don't understand that. I build pgvectorscale with IBM Open XL C/C++ and need a community clang release to obtain the required library.

Can you explain this a little bit more?

Hi Emanuel.  libclang.a is not part of the Open XL compiler product.  But you can get it from the community clang releases at https://github.com/IBM/llvm-project/releases.

For example, version 19.1.6 (which matches the version used by Open XL C/C++ for AIX 17.1.3) is available here https://github.com/IBM/llvm-project/releases/download/llvmorg-19.1.6/clang+llvm-19.1.6-powerpc64-ibm-aix-7.2.tar.xz .  It's located at "clang+llvm-19.1.6-powerpc64-ibm-aix-7.2/lib/libclang.a" inside that archive.

Regards

Rafik

Hi, 

Let me check with openxl team . 


Thanks
Ranjit

Hi,

This is a follow up of installing pgvectorscale on AIX 7.2 and from the upstreaming problems discussed in thread Rust cargo and openssl on AIX, respectively.

Because this problem does not belong to rust and openssl I've started a new thread.

What I've done so far to install pgvectorscale:

# openssl version
OpenSSL 3.0.15 3 Sep 2024 (Library: OpenSSL 3.0.15 3 Sep 2024)
# git clone --branch 0.7.1 https://github.com/timescale/pgvectorscale
# cd pgvectorscale/pgvectorscale
# export PKG_CONFIG_PATH=/usr/lib/pkgconfig
# export OPENSSL_DIR=/usr
# export CC=ibm-clang

# cargo install --locked cargo-pgrx --version $(cargo metadata --format-version 1 | jq -r '.packages[] | select(.name == "pgrx") | .version')
# cargo pgrx init --pg15 pg_config

With following step I get the libclang error:

# cargo pgrx install --release

       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling syn v2.0.102
   Compiling petgraph v0.6.5
...<truncated for clarity>...
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.a'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
warning: build failed, waiting for other jobs to finish...

With RUST_BACKTRACE=1 set:

       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`
note: To improve backtraces for build dependencies, set the CARGO_PROFILE_RELEASE_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation.

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.a'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"
  stack backtrace:
     0: rust_begin_unwind
     1: core::panicking::panic_fmt
     2: core::result::unwrap_failed
     3: core::result::Result<T,E>::expect
     4: bindgen::ensure_libclang_is_loaded::{{closure}}
     5: std::sync::once_lock::OnceLock<T>::get_or_init::{{closure}}
     6: std::sync::once_lock::OnceLock<T>::initialize::{{closure}}
     7: std::sync::poison::once::Once::call_once_force::{{closure}}
     8: std::sys::sync::once::queue::Once::call
     9: std::sync::poison::once::Once::call_once_force
    10: std::sync::once_lock::OnceLock<T>::initialize
    11: std::sync::once_lock::OnceLock<T>::get_or_try_init
    12: std::sync::once_lock::OnceLock<T>::get_or_init
    13: bindgen::ensure_libclang_is_loaded
    14: bindgen::clang_version
    15: pgrx_bindgen::build::clang::detect_include_paths_for
    16: pgrx_bindgen::build::run_bindgen
    17: pgrx_bindgen::build::get_bindings
    18: pgrx_bindgen::build::generate_bindings
    19: pgrx_bindgen::build::main::{{closure}}::{{closure}}::{{closure}}
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
  stack backtrace:
     0: rust_begin_unwind
     1: core::panicking::panic_fmt
     2: core::result::unwrap_failed
     3: core::result::Result<T,E>::expect
     4: pgrx_bindgen::build::main::{{closure}}::{{closure}}
     5: core::iter::adapters::map::map_try_fold::{{closure}}
     6: <alloc::vec::into_iter::IntoIter<T,A> as core::iter::traits::iterator::Iterator>::try_fold
     7: <core::iter::adapters::map::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
     8: <I as alloc::vec::in_place_collect::SpecInPlaceCollect<T,I>>::collect_in_place
     9: alloc::vec::in_place_collect::from_iter_in_place
    10: alloc::vec::in_place_collect::from_iter_in_place{{reify.shim}}
    11: alloc::vec::in_place_collect::<impl alloc::vec::spec_from_iter::SpecFromIter<T,I> for alloc::vec::Vec<T>>::from_iter
    12: <alloc::vec::Vec<T> as core::iter::traits::collect::FromIterator<T>>::from_iter
    13: core::iter::traits::iterator::Iterator::collect
    14: pgrx_bindgen::build::main::{{closure}}
    15: std::thread::scoped::scope::{{closure}}
    16: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
    17: std::panicking::try::do_call
    18: __rust_try
    19: std::thread::scoped::scope
    20: pgrx_bindgen::build::main
    21: core::ops::function::FnOnce::call_once
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

Ok, it searches for libclang.a but cannot find it.

I cannot find libclang.a either. I've searched in /opt/freeware, /opt/lib, /usr/lib, /opt/IBM (where openxlC is installed) and some other directories. As I can see IBM Open XL C/C++ runtime environment filesets does not include such a library.

What's the error?

Hi Rafik, Emanuel

Regarding libintl.h availaility, you can install gettext-devel pkg.

Thanks

Ranjit

I think the issue is that shared libraries with an "a" extension on AIX are actually archives containing a shared object.  So when you dlopen them you have to provide the archive member in the path name.  To work around this without changing the pgvectorscale source, I extracted the shared object:

Hi Rafik,

I've downloaded the community clang release version 19.1.7 (it's the same like ibm-clang --version prints) and set LIBCLANG_PATH.

Now pgvectorscale finds libclang.a but with the error Exec format error. 

# cargo pgrx install --release
       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "the `libclang` shared library at /opt/IBM/clang-llvm-19.1.7/lib/libclang.a could not be opened: Could not load module /opt/IBM/clang-llvm-19.1.7/lib/libclang.a.\nSystem error: Exec format error"
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
warning: build failed, waiting for other jobs to finish...

Usually the error implies there are different architectures. But pgvectorscale is built on AIX 7.2 64Bit and the used community clang release is for this architecture (https://github.com/IBM/llvm-project/releases/download/llvmorg-19.1.7/clang+llvm-19.1.7-powerpc64-ibm-aix-7.2.tar.xz). 

What could it be now?

Hi Emanuel.  I think there are two things needed by pgvectorscale:  1. A C/C++ compiler.  2. A C/C++ parser that can be embedded into pgvectorscale.  The libclang.a library (https://clang.llvm.org/docs/LibClang.html) provides the clang parser as a library for use in programs that want to parse C/C++ source code themselves.

The Open XL C/C++ for AIX product provides a standalone compiler application to compile C/C++ source code.  It does not provide the ability to embed the compiler parser into user programs.  The community clang releases linked above contain both the C/C++ compiler and this parser library.

Hi Rafik,

I don't understand that. I build pgvectorscale with IBM Open XL C/C++ and need a community clang release to obtain the required library.

Can you explain this a little bit more?

Hi Emanuel.  libclang.a is not part of the Open XL compiler product.  But you can get it from the community clang releases at https://github.com/IBM/llvm-project/releases.

For example, version 19.1.6 (which matches the version used by Open XL C/C++ for AIX 17.1.3) is available here https://github.com/IBM/llvm-project/releases/download/llvmorg-19.1.6/clang+llvm-19.1.6-powerpc64-ibm-aix-7.2.tar.xz .  It's located at "clang+llvm-19.1.6-powerpc64-ibm-aix-7.2/lib/libclang.a" inside that archive.

Regards

Rafik

Hi, 

Let me check with openxl team . 


Thanks
Ranjit

Hi,

This is a follow up of installing pgvectorscale on AIX 7.2 and from the upstreaming problems discussed in thread Rust cargo and openssl on AIX, respectively.

Because this problem does not belong to rust and openssl I've started a new thread.

What I've done so far to install pgvectorscale:

# openssl version
OpenSSL 3.0.15 3 Sep 2024 (Library: OpenSSL 3.0.15 3 Sep 2024)
# git clone --branch 0.7.1 https://github.com/timescale/pgvectorscale
# cd pgvectorscale/pgvectorscale
# export PKG_CONFIG_PATH=/usr/lib/pkgconfig
# export OPENSSL_DIR=/usr
# export CC=ibm-clang

# cargo install --locked cargo-pgrx --version $(cargo metadata --format-version 1 | jq -r '.packages[] | select(.name == "pgrx") | .version')
# cargo pgrx init --pg15 pg_config

With following step I get the libclang error:

# cargo pgrx install --release

       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling syn v2.0.102
   Compiling petgraph v0.6.5
...<truncated for clarity>...
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.a'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
warning: build failed, waiting for other jobs to finish...

With RUST_BACKTRACE=1 set:

       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`
note: To improve backtraces for build dependencies, set the CARGO_PROFILE_RELEASE_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation.

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.a'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"
  stack backtrace:
     0: rust_begin_unwind
     1: core::panicking::panic_fmt
     2: core::result::unwrap_failed
     3: core::result::Result<T,E>::expect
     4: bindgen::ensure_libclang_is_loaded::{{closure}}
     5: std::sync::once_lock::OnceLock<T>::get_or_init::{{closure}}
     6: std::sync::once_lock::OnceLock<T>::initialize::{{closure}}
     7: std::sync::poison::once::Once::call_once_force::{{closure}}
     8: std::sys::sync::once::queue::Once::call
     9: std::sync::poison::once::Once::call_once_force
    10: std::sync::once_lock::OnceLock<T>::initialize
    11: std::sync::once_lock::OnceLock<T>::get_or_try_init
    12: std::sync::once_lock::OnceLock<T>::get_or_init
    13: bindgen::ensure_libclang_is_loaded
    14: bindgen::clang_version
    15: pgrx_bindgen::build::clang::detect_include_paths_for
    16: pgrx_bindgen::build::run_bindgen
    17: pgrx_bindgen::build::get_bindings
    18: pgrx_bindgen::build::generate_bindings
    19: pgrx_bindgen::build::main::{{closure}}::{{closure}}::{{closure}}
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
  stack backtrace:
     0: rust_begin_unwind
     1: core::panicking::panic_fmt
     2: core::result::unwrap_failed
     3: core::result::Result<T,E>::expect
     4: pgrx_bindgen::build::main::{{closure}}::{{closure}}
     5: core::iter::adapters::map::map_try_fold::{{closure}}
     6: <alloc::vec::into_iter::IntoIter<T,A> as core::iter::traits::iterator::Iterator>::try_fold
     7: <core::iter::adapters::map::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
     8: <I as alloc::vec::in_place_collect::SpecInPlaceCollect<T,I>>::collect_in_place
     9: alloc::vec::in_place_collect::from_iter_in_place
    10: alloc::vec::in_place_collect::from_iter_in_place{{reify.shim}}
    11: alloc::vec::in_place_collect::<impl alloc::vec::spec_from_iter::SpecFromIter<T,I> for alloc::vec::Vec<T>>::from_iter
    12: <alloc::vec::Vec<T> as core::iter::traits::collect::FromIterator<T>>::from_iter
    13: core::iter::traits::iterator::Iterator::collect
    14: pgrx_bindgen::build::main::{{closure}}
    15: std::thread::scoped::scope::{{closure}}
    16: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
    17: std::panicking::try::do_call
    18: __rust_try
    19: std::thread::scoped::scope
    20: pgrx_bindgen::build::main
    21: core::ops::function::FnOnce::call_once
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

Ok, it searches for libclang.a but cannot find it.

I cannot find libclang.a either. I've searched in /opt/freeware, /opt/lib, /usr/lib, /opt/IBM (where openxlC is installed) and some other directories. As I can see IBM Open XL C/C++ runtime environment filesets does not include such a library.

What's the error?

Hi,

I have gettext-devel already installed. How can I tell cargo pgrx, rust or someone else to search in /opt/freeware/include, too?

Sorry for these questions but I have no experience with Rust or cargo. I will only compile, install and use pgvectorscale on AIX.

Regards

Hi Rafik, Emanuel

Regarding libintl.h availaility, you can install gettext-devel pkg.

Thanks

Ranjit

I think the issue is that shared libraries with an "a" extension on AIX are actually archives containing a shared object.  So when you dlopen them you have to provide the archive member in the path name.  To work around this without changing the pgvectorscale source, I extracted the shared object:

Hi Rafik,

I've downloaded the community clang release version 19.1.7 (it's the same like ibm-clang --version prints) and set LIBCLANG_PATH.

Now pgvectorscale finds libclang.a but with the error Exec format error. 

# cargo pgrx install --release
       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "the `libclang` shared library at /opt/IBM/clang-llvm-19.1.7/lib/libclang.a could not be opened: Could not load module /opt/IBM/clang-llvm-19.1.7/lib/libclang.a.\nSystem error: Exec format error"
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
warning: build failed, waiting for other jobs to finish...

Usually the error implies there are different architectures. But pgvectorscale is built on AIX 7.2 64Bit and the used community clang release is for this architecture (https://github.com/IBM/llvm-project/releases/download/llvmorg-19.1.7/clang+llvm-19.1.7-powerpc64-ibm-aix-7.2.tar.xz). 

What could it be now?

Hi Emanuel.  I think there are two things needed by pgvectorscale:  1. A C/C++ compiler.  2. A C/C++ parser that can be embedded into pgvectorscale.  The libclang.a library (https://clang.llvm.org/docs/LibClang.html) provides the clang parser as a library for use in programs that want to parse C/C++ source code themselves.

The Open XL C/C++ for AIX product provides a standalone compiler application to compile C/C++ source code.  It does not provide the ability to embed the compiler parser into user programs.  The community clang releases linked above contain both the C/C++ compiler and this parser library.

Hi Rafik,

I don't understand that. I build pgvectorscale with IBM Open XL C/C++ and need a community clang release to obtain the required library.

Can you explain this a little bit more?

Hi Emanuel.  libclang.a is not part of the Open XL compiler product.  But you can get it from the community clang releases at https://github.com/IBM/llvm-project/releases.

For example, version 19.1.6 (which matches the version used by Open XL C/C++ for AIX 17.1.3) is available here https://github.com/IBM/llvm-project/releases/download/llvmorg-19.1.6/clang+llvm-19.1.6-powerpc64-ibm-aix-7.2.tar.xz .  It's located at "clang+llvm-19.1.6-powerpc64-ibm-aix-7.2/lib/libclang.a" inside that archive.

Regards

Rafik

Hi, 

Let me check with openxl team . 


Thanks
Ranjit

Hi,

This is a follow up of installing pgvectorscale on AIX 7.2 and from the upstreaming problems discussed in thread Rust cargo and openssl on AIX, respectively.

Because this problem does not belong to rust and openssl I've started a new thread.

What I've done so far to install pgvectorscale:

# openssl version
OpenSSL 3.0.15 3 Sep 2024 (Library: OpenSSL 3.0.15 3 Sep 2024)
# git clone --branch 0.7.1 https://github.com/timescale/pgvectorscale
# cd pgvectorscale/pgvectorscale
# export PKG_CONFIG_PATH=/usr/lib/pkgconfig
# export OPENSSL_DIR=/usr
# export CC=ibm-clang

# cargo install --locked cargo-pgrx --version $(cargo metadata --format-version 1 | jq -r '.packages[] | select(.name == "pgrx") | .version')
# cargo pgrx init --pg15 pg_config

With following step I get the libclang error:

# cargo pgrx install --release

       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling syn v2.0.102
   Compiling petgraph v0.6.5
...<truncated for clarity>...
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.a'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
warning: build failed, waiting for other jobs to finish...

With RUST_BACKTRACE=1 set:

       Using PgConfig("pg15") and `pg_config` from /opt/freeware/bin/pg_config
    Building extension with features pg15
     Running command "/opt/freeware/lib/RustSDK/1.86/bin/.cargo.orig" "build" "--lib" "--release" "--features" "pg15" "--no-default-features" "--message-format=json-render-diagnostics"
   Compiling pgrx-pg-sys v0.12.9
error: failed to run custom build command for `pgrx-pg-sys v0.12.9`
note: To improve backtraces for build dependencies, set the CARGO_PROFILE_RELEASE_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation.

Caused by:
  process didn't exit successfully: `/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-ca69a8ad00060318/build-script-bindgen` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=PGRX_BUILD_VERBOSE
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_PATH
  cargo:rerun-if-env-changed=PGRX_PG_CONFIG_AS_ENV
  cargo:rerun-if-env-changed=LLVM_CONFIG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_PATH
  cargo:rerun-if-env-changed=LIBCLANG_STATIC_PATH
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=BINDGEN_EXTRA_CLANG_ARGS_powerpc64_ibm_aix
  cargo:rerun-if-env-changed=PGRX_PG_SYS_GENERATE_BINDINGS_FOR_RELEASE
  cargo:rerun-if-changed=include
  cargo:rerun-if-changed=pgrx-cshim.c
  cargo:rerun-if-changed=/var/lib/postgresql/.pgrx/config.toml
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_TARGET_INFO_PATH_PG15
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES_powerpc64-ibm-aix
  cargo:rerun-if-env-changed=PGRX_BINDGEN_NO_DETECT_INCLUDES

  --- stderr
  build_paths=BuildPaths { manifest_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9", out_dir: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out", src_dir: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/src/include", shim_src: "/var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-pg-sys-0.12.9/pgrx-cshim.c", shim_dst: "/var/lib/postgresql/pgvectorscale/target/release/build/pgrx-pg-sys-eb2aabfbf0730c37/out/pgrx-cshim.c" }
  Generating bindings for pg15
  pg_config --configure CLANG = None

  thread '<unnamed>' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/bindgen-0.70.1/lib.rs:622:27:
  Unable to find libclang: "couldn't find any valid shared libraries matching: ['libclang.a'], set the `LIBCLANG_PATH` environment variable to a path where one of these files can be found (invalid: [])"
  stack backtrace:
     0: rust_begin_unwind
     1: core::panicking::panic_fmt
     2: core::result::unwrap_failed
     3: core::result::Result<T,E>::expect
     4: bindgen::ensure_libclang_is_loaded::{{closure}}
     5: std::sync::once_lock::OnceLock<T>::get_or_init::{{closure}}
     6: std::sync::once_lock::OnceLock<T>::initialize::{{closure}}
     7: std::sync::poison::once::Once::call_once_force::{{closure}}
     8: std::sys::sync::once::queue::Once::call
     9: std::sync::poison::once::Once::call_once_force
    10: std::sync::once_lock::OnceLock<T>::initialize
    11: std::sync::once_lock::OnceLock<T>::get_or_try_init
    12: std::sync::once_lock::OnceLock<T>::get_or_init
    13: bindgen::ensure_libclang_is_loaded
    14: bindgen::clang_version
    15: pgrx_bindgen::build::clang::detect_include_paths_for
    16: pgrx_bindgen::build::run_bindgen
    17: pgrx_bindgen::build::get_bindings
    18: pgrx_bindgen::build::generate_bindings
    19: pgrx_bindgen::build::main::{{closure}}::{{closure}}::{{closure}}
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

  thread 'main' panicked at /var/lib/postgresql/.cargo/registry/src/index.crates.io-7f555b6b8ccf4919/pgrx-bindgen-0.12.9/src/build.rs:274:41:
  thread panicked while generating bindings: Any { .. }
  stack backtrace:
     0: rust_begin_unwind
     1: core::panicking::panic_fmt
     2: core::result::unwrap_failed
     3: core::result::Result<T,E>::expect
     4: pgrx_bindgen::build::main::{{closure}}::{{closure}}
     5: core::iter::adapters::map::map_try_fold::{{closure}}
     6: <alloc::vec::into_iter::IntoIter<T,A> as core::iter::traits::iterator::Iterator>::try_fold
     7: <core::iter::adapters::map::Map<I,F> as core::iter::traits::iterator::Iterator>::try_fold
     8: <I as alloc::vec::in_place_collect::SpecInPlaceCollect<T,I>>::collect_in_place
     9: alloc::vec::in_place_collect::from_iter_in_place
    10: alloc::vec::in_place_collect::from_iter_in_place{{reify.shim}}
    11: alloc::vec::in_place_collect::<impl alloc::vec::spec_from_iter::SpecFromIter<T,I> for alloc::vec::Vec<T>>::from_iter
    12: <alloc::vec::Vec<T> as core::iter::traits::collect::FromIterator<T>>::from_iter
    13: core::iter::traits::iterator::Iterator::collect
    14: pgrx_bindgen::build::main::{{closure}}
    15: std::thread::scoped::scope::{{closure}}
    16: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
    17: std::panicking::try::do_call
    18: __rust_try
    19: std::thread::scoped::scope
    20: pgrx_bindgen::build::main
    21: core::ops::function::FnOnce::call_once
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

Ok, it searches for libclang.a but cannot find it.

I cannot find libclang.a either. I've searched in /opt/freeware, /opt/lib, /usr/lib, /opt/IBM (where openxlC is installed) and some other directories. As I can see IBM Open XL C/C++ runtime environment filesets does not include such a library.

What's the error?