Error trying to execute nvidia-smi: Unable to locate executable file: nvidia-smi. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.. Assuming no GPU.

stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-04-04 16:18:05,738 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-04-04 16:18:05,746 build [INFO] - Build started 2025-04-04 16:18:05,746 build [INFO] - Running tests for Release configuration 2025-04-04 16:18:05,746 build [INFO] - /usr/bin/ctest --build-config Release --verbose --timeout 10800 2025-04-04 16:18:59,237 build [INFO] - /opt/python/cp310-cp310/bin/python3 onnxruntime_test_python.py .............../onnxruntime_src/build/Release/Release/onnxruntime/capi/onnxruntime_inference_collection.py:121: UserWarning: Specified provider 'InvalidProvider' is not in available provider names.Available providers: 'CPUExecutionProvider' warnings.warn( .....2025-04-04 16:18:59.496537984 [I:onnxruntime:TestModelSerialization, inference_session.cc:592 TraceSessionOptions] Session Options { execution_mode:0 execution_order:DEFAULT enable_profiling:0 optimized_model_filepath:"./PythonApiTestOptimizedModel.onnx" enable_mem_pattern:1 enable_mem_reuse:1 enable_cpu_mem_arena:1 profile_file_prefix:onnxruntime_profile_ session_logid:TestModelSerialization session_log_severity_level:1 session_log_verbosity_level:0 max_num_graph_transformation_steps:10 graph_optimization_level:3 intra_op_param:OrtThreadPoolParams { thread_pool_size: 0 auto_set_affinity: 0 allow_spinning: 1 dynamic_block_base_: 0 stack_size: 0 affinity_str: set_denormal_as_zero: 0 } inter_op_param:OrtThreadPoolParams { thread_pool_size: 0 auto_set_affinity: 0 allow_spinning: 1 dynamic_block_base_: 0 stack_size: 0 affinity_str: set_denormal_as_zero: 0 } use_per_session_threads:1 thread_pool_allow_spinning:1 use_deterministic_compute:0 config_options: { } } 2025-04-04 16:18:59.496563704 [I:onnxruntime:TestModelSerialization, inference_session.cc:420 ConstructorCommon] Creating and using per session threadpools since use_per_session_threads_ is true 2025-04-04 16:18:59.496571664 [I:onnxruntime:TestModelSerialization, inference_session.cc:438 ConstructorCommon] Dynamic block base set to 0 2025-04-04 16:18:59.496944823 [I:onnxruntime:TestModelSerialization, inference_session.cc:1794 Initialize] Initializing session. 2025-04-04 16:18:59.496964383 [I:onnxruntime:TestModelSerialization, inference_session.cc:1831 Initialize] Adding default CPU execution provider. 2025-04-04 16:18:59.497073343 [I:onnxruntime:TestModelSerialization, graph_partitioner.cc:1031 InlineFunctionsAOT] This model does not have any local functions defined. AOT Inlining is not performed 2025-04-04 16:18:59.497089463 [I:onnxruntime:TestModelSerialization, graph_transformer.cc:15 Apply] GraphTransformer EnsureUniqueDQForNodeUnit modified: 0 with status: OK 2025-04-04 16:18:59.497098383 [I:onnxruntime:TestModelSerialization, graph_transformer.cc:15 Apply] GraphTransformer Level1_RuleBasedTransformer modified: 0 with status: OK 2025-04-04 16:18:59.497106903 [I:onnxruntime:TestModelSerialization, graph_transformer.cc:15 Apply] GraphTransformer DoubleQDQPairsRemover modified: 0 with status: OK 2025-04-04 16:18:59.497119663 [I:onnxruntime:TestModelSerialization, graph_transformer.cc:15 Apply] GraphTransformer ConstantSharing modified: 0 with status: OK 2025-04-04 16:18:59.497137663 [I:onnxruntime:TestModelSerialization, graph_transformer.cc:15 Apply] GraphTransformer CommonSubexpressionElimination modified: 0 with status: OK 2025-04-04 16:18:59.497149023 [I:

Error trying to execute nvidia-smi: Unable to locate executable file: nvidia-smi. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.. Assuming no GPU.

stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-04-04 16:00:48,904 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-04-04 16:00:48,911 build [INFO] - Build started 2025-04-04 16:00:48,911 build [INFO] - Building targets for Release configuration 2025-04-04 16:00:48,912 build [INFO] - /usr/bin/cmake --build build/Release/Release --config Release -- -j8 2025-04-04 16:17:58,705 build [INFO] - /opt/python/cp310-cp310/bin/python3 /onnxruntime_src/setup.py bdist_wheel --nightly_build /opt/python/cp310-cp310/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. !! ******************************************************************************** Please avoid running ``setup.py`` directly. Instead, use pypa/build, pypa/installer or other standards-based tools. See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. ******************************************************************************** !! self.initialize_options() DEBUG:auditwheel.musllinux:musl libc not detected DEBUG:auditwheel.libc:Falling back to GNU libc INFO:auditwheel.main_repair:Repairing onnxruntime-1.22.0.dev20250404-cp310-cp310-linux_aarch64.whl DEBUG:auditwheel.wheel_abi:processing: onnxruntime/capi/libonnxruntime.so.1.22.0 DEBUG:auditwheel.musllinux:musl libc not detected DEBUG:auditwheel.libc:Falling back to GNU libc DEBUG:auditwheel.lddtree:parse_ld_so_conf(//etc/ld.so.conf) DEBUG:auditwheel.lddtree: glob: //etc/ld.so.conf.d/*.conf DEBUG:auditwheel.lddtree: parse_ld_so_conf(//etc/ld.so.conf.d/00-manylinux.conf) DEBUG:auditwheel.lddtree:linker ldpaths: {'conf': ['/usr/local/lib', '/lib', '/lib64/', '/usr/lib', '/usr/lib64'], 'env': ['/opt/rh/gcc-toolset-14/root/usr/lib64', '/opt/rh/gcc-toolset-14/root/usr/lib', '/usr/local/lib64'], 'interp': []} DEBUG:auditwheel.lddtree:lddtree(onnxruntime/capi/libonnxruntime.so.1.22.0) DEBUG:auditwheel.lddtree: ldpaths[rpath] = [] DEBUG:auditwheel.lddtree: ldpaths[runpath] = ['/tmp/tmp2jtxe3qt/onnxruntime/capi'] DEBUG:auditwheel.lddtree:lddtree(/lib64/libdl-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/libc-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/ld-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/librt-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/libpthread-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/libstdc++.so.6.0.25) DEBUG:auditwheel.lddtree:lddtree(/lib64/libm-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/libgcc_s-8-20210514.so.1) DEBUG:auditwheel.wheel_abi:key libgcc_s.so.1, value GCC_4.0.0 DEBUG:auditwheel.wheel_abi:key libgcc_s.so.1, value GCC_3.0 DEBUG:auditwheel.wheel_abi:key libdl.so.2, value GLIBC_2.17 DEBUG:auditwheel.wheel_abi:key libm.so.6, value GLIBC_2.27 DEBUG:auditwheel.wheel_abi:key libm.so.6, value GLIBC_2.17 DEBUG:auditwheel.wheel_abi:key libpthread.so.0, value GLIBC_2.17 DEBUG:auditwheel.wheel_abi:key libstdc++.so.6, value GLIBCXX_3.4.14 DEBUG:auditwheel.wheel_abi:key libstdc++.so.6, value GLIBCXX_3.4.17 DEBUG:auditwheel.wheel_abi:key libstdc++.so.6, value GLIBCXX_3.4.22 DEBUG:auditwheel.wheel_abi:key libstdc++.so.6, value CXXABI_1.3.8 DEBUG:auditwheel.wheel_abi:key libstdc++.so.6, value GLIBCXX_3.4.18 DEBUG:auditwheel.wheel_abi:key libstdc++.so.6, value GLIBCXX_3.4.19 DEBUG:auditwheel.wheel_abi:key libstdc++.so.6, v

stderr: WARNING! Your password will be stored unencrypted in /home/cloudtest/.docker/config.json. Configure a credential helper to remove this warning. See https://docs.docker.com/engine/reference/commandline/login/#credential-stores

Error trying to execute nvidia-smi: Unable to locate executable file: nvidia-smi. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.. Assuming no GPU.

stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --update 2025-04-04 16:00:17,597 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_wheel --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --update 2025-04-04 16:00:17,604 build [INFO] - Build started 2025-04-04 16:00:17,604 build [INFO] - Generating CMake build tree 2025-04-04 16:00:17,614 build [INFO] - /usr/bin/cmake /onnxruntime_src/cmake -Donnxruntime_RUN_ONNX_TESTS=OFF -Donnxruntime_GENERATE_TEST_REPORTS=ON -DPython_EXECUTABLE=/opt/python/cp310-cp310/bin/python3 -Donnxruntime_USE_VCPKG=ON -Donnxruntime_USE_MIMALLOC=OFF -Donnxruntime_ENABLE_PYTHON=ON -Donnxruntime_BUILD_CSHARP=OFF -Donnxruntime_BUILD_JAVA=OFF -Donnxruntime_BUILD_NODEJS=OFF -Donnxruntime_BUILD_OBJC=OFF -Donnxruntime_BUILD_SHARED_LIB=ON -Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF -Donnxruntime_USE_DNNL=OFF -Donnxruntime_USE_NNAPI_BUILTIN=OFF -Donnxruntime_USE_VSINPU=OFF -Donnxruntime_USE_RKNPU=OFF -Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF -Donnxruntime_USE_VITISAI=OFF -Donnxruntime_USE_TENSORRT=OFF -Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON -Donnxruntime_USE_TENSORRT_INTERFACE=OFF -Donnxruntime_USE_CUDA_INTERFACE=OFF -Donnxruntime_USE_OPENVINO_INTERFACE=OFF -Donnxruntime_USE_VITISAI_INTERFACE=OFF -Donnxruntime_USE_QNN_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX=OFF -Donnxruntime_DISABLE_CONTRIB_OPS=OFF -Donnxruntime_DISABLE_ML_OPS=OFF -Donnxruntime_DISABLE_RTTI=OFF -Donnxruntime_DISABLE_EXCEPTIONS=OFF -Donnxruntime_MINIMAL_BUILD=OFF -Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF -Donnxruntime_MINIMAL_BUILD_CUSTOM_OPS=OFF -Donnxruntime_REDUCED_OPS_BUILD=OFF -Donnxruntime_USE_DML=OFF -Donnxruntime_USE_WINML=OFF -Donnxruntime_BUILD_MS_EXPERIMENTAL_OPS=OFF -Donnxruntime_USE_TELEMETRY=OFF -Donnxruntime_ENABLE_LTO=OFF -Donnxruntime_USE_ACL=OFF -Donnxruntime_USE_ARMNN=OFF -Donnxruntime_ARMNN_RELU_USE_CPU=ON -Donnxruntime_ARMNN_BN_USE_CPU=ON -Donnxruntime_USE_JSEP=OFF -Donnxruntime_USE_WEBGPU=OFF -Donnxruntime_ENABLE_PIX_FOR_WEBGPU_EP=OFF -Donnxruntime_USE_EXTERNAL_DAWN=OFF -Donnxruntime_ENABLE_NVTX_PROFILE=OFF -Donnxruntime_ENABLE_TRAINING=OFF -Donnxruntime_ENABLE_TRAINING_OPS=OFF -Donnxruntime_ENABLE_TRAINING_APIS=OFF -Donnxruntime_ENABLE_CPU_FP16_OPS=OFF -Donnxruntime_USE_NCCL=OFF -Donnxruntime_BUILD_BENCHMARKS=OFF -Donnxruntime_USE_ROCM=OFF -Donnxruntime_GCOV_COVERAGE=OFF -Donnxruntime_USE_MPI=OFF -Donnxruntime_ENABLE_MEMORY_PROFILE=OFF -Donnxruntime_ENABLE_CUDA_LINE_NUMBER_INFO=OFF -Donnxruntime_USE_CUDA_NHWC_OPS=OFF -Donnxruntime_BUILD_WEBASSEMBLY_STATIC_LIB=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_CATCHING=ON -Donnxruntime_ENABLE_WEBASSEMBLY_API_EXCEPTION_CATCHING=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_THROWING=ON -Donnxruntime_WEBASSEMBLY_RUN_TESTS_IN_BROWSER=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_THREADS=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_MEMORY64=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_DEBUG_INFO=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_PROFILING=OFF -Donnxruntime_ENABLE_LAZY_TENSOR=OFF -Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF -Donnxruntime_ENABLE_CUDA_PROFILING=OFF -Donnxruntime_ENABLE_ROCM_PROFILING=OFF -Donnxruntime_USE_XNNPACK=OFF -Donnxruntime_USE_WEBNN=OFF -Donnxruntime_USE_CANN=OFF -Donnxruntime_USE_TRITON_KERNEL=OFF -Donnxruntime_DISABLE_FLOAT8_TYPES=OFF -Donnxruntime_DISABLE_SPARSE_TENSORS=OFF -Donnxruntime_DISABLE_OPTIONAL_TYPE=OFF -Donnxruntime_CUDA_MINIMAL=OFF -Donnxruntime_USE_KLEIDIAI=ON -Donnxruntime_BUILD_BENCHMARKS=ON -DCMAKE_TOOLCHAIN_FILE=/usr/local

Error trying to execute nvidia-smi: Unable to locate executable file: nvidia-smi. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.. Assuming no GPU.

stderr: + python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --build 2025-04-04 16:01:21,975 tools_python_utils [INFO] - flatbuffers module is not installed. parse_config will not be available 2025-04-04 16:01:21,978 build [DEBUG] - Command line arguments: --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --build 2025-04-04 16:01:21,981 build [INFO] - Build started 2025-04-04 16:01:21,981 build [INFO] - Building targets for Debug configuration 2025-04-04 16:01:21,981 build [INFO] - /usr/bin/cmake --build build/Debug/Debug --config Debug -- -j16 2025-04-04 16:08:28,546 build [INFO] - Build complete

stderr: WARNING! Your password will be stored unencrypted in /home/cloudtest/.docker/config.json. Configure a credential helper to remove this warning. See https://docs.docker.com/engine/reference/commandline/login/#credential-stores

Error trying to execute nvidia-smi: Unable to locate executable file: nvidia-smi. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.. Assuming no GPU.

stderr: + python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --update 2025-04-04 16:00:21,595 tools_python_utils [INFO] - flatbuffers module is not installed. parse_config will not be available 2025-04-04 16:00:21,599 build [DEBUG] - Command line arguments: --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --update 2025-04-04 16:00:21,602 build [INFO] - Build started 2025-04-04 16:00:21,602 build [INFO] - Generating CMake build tree 2025-04-04 16:00:21,610 build [INFO] - /usr/bin/cmake /onnxruntime_src/cmake -Donnxruntime_RUN_ONNX_TESTS=ON -Donnxruntime_GENERATE_TEST_REPORTS=ON -DPython_EXECUTABLE=/usr/bin/python3 -Donnxruntime_USE_VCPKG=ON -Donnxruntime_USE_MIMALLOC=OFF -Donnxruntime_ENABLE_PYTHON=OFF -Donnxruntime_BUILD_CSHARP=OFF -Donnxruntime_BUILD_JAVA=OFF -Donnxruntime_BUILD_NODEJS=OFF -Donnxruntime_BUILD_OBJC=OFF -Donnxruntime_BUILD_SHARED_LIB=ON -Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF -Donnxruntime_USE_DNNL=OFF -Donnxruntime_USE_NNAPI_BUILTIN=OFF -Donnxruntime_USE_VSINPU=OFF -Donnxruntime_USE_RKNPU=OFF -Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF -Donnxruntime_USE_VITISAI=OFF -Donnxruntime_USE_TENSORRT=OFF -Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON -Donnxruntime_USE_TENSORRT_INTERFACE=OFF -Donnxruntime_USE_CUDA_INTERFACE=OFF -Donnxruntime_USE_OPENVINO_INTERFACE=OFF -Donnxruntime_USE_VITISAI_INTERFACE=OFF -Donnxruntime_USE_QNN_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX=OFF -Donnxruntime_DISABLE_CONTRIB_OPS=OFF -Donnxruntime_DISABLE_ML_OPS=OFF -Donnxruntime_DISABLE_RTTI=OFF -Donnxruntime_DISABLE_EXCEPTIONS=OFF -Donnxruntime_MINIMAL_BUILD=OFF -Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF -Donnxruntime_MINIMAL_BUILD_CUSTOM_OPS=OFF -Donnxruntime_REDUCED_OPS_BUILD=OFF -Donnxruntime_USE_DML=OFF -Donnxruntime_USE_WINML=OFF -Donnxruntime_BUILD_MS_EXPERIMENTAL_OPS=OFF -Donnxruntime_USE_TELEMETRY=OFF -Donnxruntime_ENABLE_LTO=OFF -Donnxruntime_USE_ACL=OFF -Donnxruntime_USE_ARMNN=OFF -Donnxruntime_ARMNN_RELU_USE_CPU=ON -Donnxruntime_ARMNN_BN_USE_CPU=ON -Donnxruntime_USE_JSEP=OFF -Donnxruntime_USE_WEBGPU=OFF -Donnxruntime_ENABLE_PIX_FOR_WEBGPU_EP=OFF -Donnxruntime_USE_EXTERNAL_DAWN=OFF -Donnxruntime_ENABLE_NVTX_PROFILE=OFF -Donnxruntime_ENABLE_TRAINING=OFF -Donnxruntime_ENABLE_TRAINING_OPS=OFF -Donnxruntime_ENABLE_TRAINING_APIS=OFF -Donnxruntime_ENABLE_CPU_FP16_OPS=OFF -Donnxruntime_USE_NCCL=OFF -Donnxruntime_BUILD_BENCHMARKS=OFF -Donnxruntime_USE_ROCM=OFF -Donnxruntime_GCOV_COVERAGE=OFF -Donnxruntime_USE_MPI=OFF -Donnxruntime_ENABLE_MEMORY_PROFILE=OFF -Donnxruntime_ENABLE_CUDA_LINE_NUMBER_INFO=OFF -Donnxruntime_USE_CUDA_NHWC_OPS=OFF -Donnxruntime_BUILD_WEBASSEMBLY_STATIC_LIB=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_CATCHING=ON -Donnxruntime_ENABLE_WEBASSEMBLY_API_EXCEPTION_CATCHING=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_THROWING=ON -Donnxruntime_WEBASSEMBLY_RUN_TESTS_IN_BROWSER=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_THREADS=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_MEMORY64=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_DEBUG_INFO=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_PROFILING=OFF -Donnxruntime_ENABLE_LAZY_TENSOR=OFF -Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF -Donnxruntime_ENABLE_CUDA_PROFILING=OFF -Donnxruntime_ENABLE_ROCM_PROFILING=OFF -Donnxruntime_USE_XNNPACK=OFF -Donnxruntime_USE_WEBNN=OFF -Donnxruntime_USE_CANN=OFF -Donnxruntime_USE_TRITON_KERNEL=OFF -Donnxruntime_DISABLE_FLOAT8_TYPES=OFF -Donnxruntime_DISABLE_SPARSE_TENSORS=OFF -Donnxruntime_DISABLE_OPTIONAL_TYPE=OFF -Donnxruntime_CUDA_MINIMAL=OFF -Donnxruntime_USE_KLEIDIAI=ON -DCMAKE_TOOLCHAIN_FILE=/usr/local/share/vcpkg/scripts/buildsystems/vcpkg.cmake -DVCPKG_INSTALL_OPTIONS=--x-feature=tests;--overlay-triplets=/onnxruntime_src/build/Debug/asan;--x-buildtrees-root=/onnxruntime_src/build;--binarysource=clear\;x-gha,readw

Error trying to execute nvidia-smi: Unable to locate executable file: nvidia-smi. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.. Assuming no GPU.

stderr: + python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --test 2025-04-04 16:08:46,316 tools_python_utils [INFO] - flatbuffers module is not installed. parse_config will not be available 2025-04-04 16:08:46,319 build [DEBUG] - Command line arguments: --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_address_sanitizer --test 2025-04-04 16:08:46,322 build [INFO] - Build started 2025-04-04 16:08:46,322 build [DEBUG] - create symlink /data/models -> build/Debug/models 2025-04-04 16:08:46,323 build [INFO] - Running tests for Debug configuration 2025-04-04 16:08:46,323 build [INFO] - /usr/bin/ctest --build-config Debug --verbose --timeout 10800 2025-04-04 16:24:21,828 build [INFO] - Build complete

stderr: WARNING! Your password will be stored unencrypted in /home/cloudtest/.docker/config.json. Configure a credential helper to remove this warning. See https://docs.docker.com/engine/reference/commandline/login/#credential-stores

Error trying to execute nvidia-smi: Unable to locate executable file: nvidia-smi. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.. Assuming no GPU.

stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --update 2025-04-04 16:02:43,859 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --update 2025-04-04 16:02:43,863 build [INFO] - Build started 2025-04-04 16:02:43,863 build [INFO] - Generating CMake build tree 2025-04-04 16:02:43,871 build [INFO] - /usr/bin/cmake /onnxruntime_src/cmake -Donnxruntime_RUN_ONNX_TESTS=ON -Donnxruntime_GENERATE_TEST_REPORTS=ON -DPython_EXECUTABLE=/opt/python/cp310-cp310/bin/python3 -Donnxruntime_USE_VCPKG=ON -Donnxruntime_USE_MIMALLOC=OFF -Donnxruntime_ENABLE_PYTHON=ON -Donnxruntime_BUILD_CSHARP=OFF -Donnxruntime_BUILD_JAVA=OFF -Donnxruntime_BUILD_NODEJS=OFF -Donnxruntime_BUILD_OBJC=OFF -Donnxruntime_BUILD_SHARED_LIB=ON -Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF -Donnxruntime_USE_DNNL=OFF -Donnxruntime_USE_NNAPI_BUILTIN=OFF -Donnxruntime_USE_VSINPU=OFF -Donnxruntime_USE_RKNPU=OFF -Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF -Donnxruntime_USE_VITISAI=OFF -Donnxruntime_USE_TENSORRT=OFF -Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON -Donnxruntime_USE_TENSORRT_INTERFACE=OFF -Donnxruntime_USE_CUDA_INTERFACE=OFF -Donnxruntime_USE_OPENVINO_INTERFACE=OFF -Donnxruntime_USE_VITISAI_INTERFACE=OFF -Donnxruntime_USE_QNN_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX=OFF -Donnxruntime_DISABLE_CONTRIB_OPS=OFF -Donnxruntime_DISABLE_ML_OPS=OFF -Donnxruntime_DISABLE_RTTI=OFF -Donnxruntime_DISABLE_EXCEPTIONS=OFF -Donnxruntime_MINIMAL_BUILD=OFF -Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF -Donnxruntime_MINIMAL_BUILD_CUSTOM_OPS=OFF -Donnxruntime_REDUCED_OPS_BUILD=OFF -Donnxruntime_USE_DML=OFF -Donnxruntime_USE_WINML=OFF -Donnxruntime_BUILD_MS_EXPERIMENTAL_OPS=OFF -Donnxruntime_USE_TELEMETRY=OFF -Donnxruntime_ENABLE_LTO=OFF -Donnxruntime_USE_ACL=OFF -Donnxruntime_USE_ARMNN=OFF -Donnxruntime_ARMNN_RELU_USE_CPU=ON -Donnxruntime_ARMNN_BN_USE_CPU=ON -Donnxruntime_USE_JSEP=OFF -Donnxruntime_USE_WEBGPU=OFF -Donnxruntime_ENABLE_PIX_FOR_WEBGPU_EP=OFF -Donnxruntime_USE_EXTERNAL_DAWN=OFF -Donnxruntime_ENABLE_NVTX_PROFILE=OFF -Donnxruntime_ENABLE_TRAINING=OFF -Donnxruntime_ENABLE_TRAINING_OPS=OFF -Donnxruntime_ENABLE_TRAINING_APIS=OFF -Donnxruntime_ENABLE_CPU_FP16_OPS=OFF -Donnxruntime_USE_NCCL=OFF -Donnxruntime_BUILD_BENCHMARKS=OFF -Donnxruntime_USE_ROCM=OFF -Donnxruntime_GCOV_COVERAGE=OFF -Donnxruntime_USE_MPI=OFF -Donnxruntime_ENABLE_MEMORY_PROFILE=OFF -Donnxruntime_ENABLE_CUDA_LINE_NUMBER_INFO=OFF -Donnxruntime_USE_CUDA_NHWC_OPS=OFF -Donnxruntime_BUILD_WEBASSEMBLY_STATIC_LIB=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_CATCHING=ON -Donnxruntime_ENABLE_WEBASSEMBLY_API_EXCEPTION_CATCHING=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_THROWING=ON -Donnxruntime_WEBASSEMBLY_RUN_TESTS_IN_BROWSER=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_THREADS=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_MEMORY64=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_DEBUG_INFO=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_PROFILING=OFF -Donnxruntime_ENABLE_LAZY_TENSOR=OFF -Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF -Donnxruntime_ENABLE_CUDA_PROFILING=OFF -Donnxruntime_ENABLE_ROCM_PROFILING=OFF -Donnxruntime_USE_XNNPACK=OFF -Donnxruntime_USE_WEBNN=OFF -Donnxruntime_USE_CANN=OFF -Donnxruntime_USE_TRITON_KERNEL=OFF -Donnxruntime_DISABLE_FLOAT8_TYPES=OFF -Donnxruntime_DISABLE_SPARSE_TENSORS=OFF -Donnxruntime_DISABLE_OPTIONAL_TYPE=O

Error trying to execute nvidia-smi: Unable to locate executable file: nvidia-smi. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.. Assuming no GPU.

stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-04-04 16:10:55,350 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-04-04 16:10:55,355 build [INFO] - Build started 2025-04-04 16:10:55,355 build [DEBUG] - create symlink /data/models -> build/Release/models 2025-04-04 16:10:55,356 build [INFO] - Running tests for Release configuration 2025-04-04 16:10:55,356 build [INFO] - /usr/bin/ctest --build-config Release --verbose --timeout 10800 2025-04-04 16:23:40,654 build [INFO] - /opt/python/cp310-cp310/bin/python3 -m pip install torch --index-url https://download.pytorch.org/whl/cpu WARNING: The script isympy is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts torchfrtrace and torchrun are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2025-04-04 16:23:57,805 build [INFO] - /opt/python/cp310-cp310/bin/python3 onnxruntime_test_python.py .............../onnxruntime_src/build/Release/Release/onnxruntime/capi/onnxruntime_inference_collection.py:121: UserWarning: Specified provider 'InvalidProvider' is not in available provider names.Available providers: 'CPUExecutionProvider' warnings.warn( .....2025-04-04 16:23:58.024678206 [I:onnxruntime:TestModelSerialization, inference_session.cc:592 TraceSessionOptions] Session Options { execution_mode:0 execution_order:DEFAULT enable_profiling:0 optimized_model_filepath:"./PythonApiTestOptimizedModel.onnx" enable_mem_pattern:1 enable_mem_reuse:1 enable_cpu_mem_arena:1 profile_file_prefix:onnxruntime_profile_ session_logid:TestModelSerialization session_log_severity_level:1 session_log_verbosity_level:0 max_num_graph_transformation_steps:10 graph_optimization_level:3 intra_op_param:OrtThreadPoolParams { thread_pool_size: 0 auto_set_affinity: 0 allow_spinning: 1 dynamic_block_base_: 0 stack_size: 0 affinity_str: set_denormal_as_zero: 0 } inter_op_param:OrtThreadPoolParams { thread_pool_size: 0 auto_set_affinity: 0 allow_spinning: 1 dynamic_block_base_: 0 stack_size: 0 affinity_str: set_denormal_as_zero: 0 } use_per_session_threads:1 thread_pool_allow_spinning:1 use_deterministic_compute:0 config_options: { } } 2025-04-04 16:23:58.024693438 [I:onnxruntime:TestModelSerialization, inference_session.cc:420 ConstructorCommon] Creating and using per session threadpools since use_per_session_threads_ is true 2025-04-04 16:23:58.024698386 [I:onnxruntime:TestModelSerialization, inference_session.cc:438 ConstructorCommon] Dynamic block base set to 0 2025-04-04 16:23:58.025240270 [I:onnxruntime:TestModelSerialization, inference_session.cc:1794 Initialize] Initializing session. 2025-04-04 16:23:58.025252789 [I:onnxruntime:TestModelSerialization, inference_session.cc:1831 Initialize] Adding default CPU execution provider. 2025-04-04 16:23:58.025328703 [I:onnxruntime:TestModelSerialization, graph_partitioner.cc:1031 InlineFunctionsAOT] This model does not have any local functions defined. AOT Inlining is not performed 2025-04-04 16:23:58.025335383 [I:onnxruntime:TestModelSer

Error trying to execute nvidia-smi: Unable to locate executable file: nvidia-smi. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.. Assuming no GPU.

stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-04-04 16:03:34,202 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-04-04 16:03:34,207 build [INFO] - Build started 2025-04-04 16:03:34,207 build [INFO] - Building targets for Release configuration 2025-04-04 16:03:34,207 build [INFO] - /usr/bin/cmake --build build/Release/Release --config Release -- -j16 2025-04-04 16:10:29,914 build [INFO] - /opt/python/cp310-cp310/bin/python3 /onnxruntime_src/setup.py bdist_wheel --nightly_build /opt/python/cp310-cp310/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. !! ******************************************************************************** Please avoid running ``setup.py`` directly. Instead, use pypa/build, pypa/installer or other standards-based tools. See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. ******************************************************************************** !! self.initialize_options() DEBUG:auditwheel.musllinux:musl libc not detected DEBUG:auditwheel.libc:Falling back to GNU libc INFO:auditwheel.main_repair:Repairing onnxruntime-1.22.0.dev20250404-cp310-cp310-linux_x86_64.whl DEBUG:auditwheel.wheel_abi:processing: onnxruntime/capi/libonnxruntime.so.1.22.0 DEBUG:auditwheel.musllinux:musl libc not detected DEBUG:auditwheel.libc:Falling back to GNU libc DEBUG:auditwheel.lddtree:parse_ld_so_conf(//etc/ld.so.conf) DEBUG:auditwheel.lddtree: glob: //etc/ld.so.conf.d/*.conf DEBUG:auditwheel.lddtree: parse_ld_so_conf(//etc/ld.so.conf.d/00-manylinux.conf) DEBUG:auditwheel.lddtree:linker ldpaths: {'conf': ['/usr/local/lib', '/lib', '/lib64/', '/usr/lib', '/usr/lib64'], 'env': ['/opt/rh/gcc-toolset-14/root/usr/lib64', '/opt/rh/gcc-toolset-14/root/usr/lib', '/usr/local/lib64'], 'interp': []} DEBUG:auditwheel.lddtree:lddtree(onnxruntime/capi/libonnxruntime.so.1.22.0) DEBUG:auditwheel.lddtree: ldpaths[rpath] = [] DEBUG:auditwheel.lddtree: ldpaths[runpath] = ['/tmp/tmpv1kb6qxu/onnxruntime/capi'] DEBUG:auditwheel.lddtree:lddtree(/lib64/libdl-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/libc-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/ld-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/librt-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/libpthread-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/libstdc++.so.6.0.25) DEBUG:auditwheel.lddtree:lddtree(/lib64/libm-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/libgcc_s-8-20210514.so.1) DEBUG:auditwheel.wheel_abi:key libgcc_s.so.1, value GCC_3.4 DEBUG:auditwheel.wheel_abi:key libgcc_s.so.1, value GCC_3.0 DEBUG:auditwheel.wheel_abi:key libgcc_s.so.1, value GCC_4.0.0 DEBUG:auditwheel.wheel_abi:key libpthread.so.0, value GLIBC_2.3.4 DEBUG:auditwheel.wheel_abi:key libpthread.so.0, value GLIBC_2.2.5 DEBUG:auditwheel.wheel_abi:key libc.so.6, value GLIBC_2.16 DEBUG:auditwheel.wheel_abi:key libc.so.6, value GLIBC_2.17 DEBUG:auditwheel.wheel_abi:key libc.so.6, value GLIBC_2.4 DEBUG:auditwheel.wheel_abi:key libc.so.6, value GLIBC_2.6 DEBUG:auditwheel.wheel_abi:key libc.so.6, value GLIBC_2.3.4 DEBUG:auditwheel.wheel_abi:key libc.so.6, value GLIBC_2.3 DEBUG:auditwheel.whee

Error trying to execute nvidia-smi: Unable to locate executable file: nvidia-smi. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.. Assuming no GPU.

stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --update 2025-04-04 16:02:43,415 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --update 2025-04-04 16:02:43,420 build [INFO] - Build started 2025-04-04 16:02:43,420 build [INFO] - Generating CMake build tree 2025-04-04 16:02:43,428 build [INFO] - /usr/bin/cmake /onnxruntime_src/cmake -Donnxruntime_RUN_ONNX_TESTS=ON -Donnxruntime_GENERATE_TEST_REPORTS=ON -DPython_EXECUTABLE=/opt/python/cp310-cp310/bin/python3 -Donnxruntime_USE_VCPKG=ON -Donnxruntime_USE_MIMALLOC=OFF -Donnxruntime_ENABLE_PYTHON=ON -Donnxruntime_BUILD_CSHARP=OFF -Donnxruntime_BUILD_JAVA=OFF -Donnxruntime_BUILD_NODEJS=OFF -Donnxruntime_BUILD_OBJC=OFF -Donnxruntime_BUILD_SHARED_LIB=ON -Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF -Donnxruntime_USE_DNNL=OFF -Donnxruntime_USE_NNAPI_BUILTIN=OFF -Donnxruntime_USE_VSINPU=OFF -Donnxruntime_USE_RKNPU=OFF -Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF -Donnxruntime_USE_VITISAI=OFF -Donnxruntime_USE_TENSORRT=OFF -Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON -Donnxruntime_USE_TENSORRT_INTERFACE=OFF -Donnxruntime_USE_CUDA_INTERFACE=OFF -Donnxruntime_USE_OPENVINO_INTERFACE=OFF -Donnxruntime_USE_VITISAI_INTERFACE=OFF -Donnxruntime_USE_QNN_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX=OFF -Donnxruntime_DISABLE_CONTRIB_OPS=OFF -Donnxruntime_DISABLE_ML_OPS=OFF -Donnxruntime_DISABLE_RTTI=OFF -Donnxruntime_DISABLE_EXCEPTIONS=OFF -Donnxruntime_MINIMAL_BUILD=OFF -Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF -Donnxruntime_MINIMAL_BUILD_CUSTOM_OPS=OFF -Donnxruntime_REDUCED_OPS_BUILD=OFF -Donnxruntime_USE_DML=OFF -Donnxruntime_USE_WINML=OFF -Donnxruntime_BUILD_MS_EXPERIMENTAL_OPS=OFF -Donnxruntime_USE_TELEMETRY=OFF -Donnxruntime_ENABLE_LTO=OFF -Donnxruntime_USE_ACL=OFF -Donnxruntime_USE_ARMNN=OFF -Donnxruntime_ARMNN_RELU_USE_CPU=ON -Donnxruntime_ARMNN_BN_USE_CPU=ON -Donnxruntime_USE_JSEP=OFF -Donnxruntime_USE_WEBGPU=OFF -Donnxruntime_ENABLE_PIX_FOR_WEBGPU_EP=OFF -Donnxruntime_USE_EXTERNAL_DAWN=OFF -Donnxruntime_ENABLE_NVTX_PROFILE=OFF -Donnxruntime_ENABLE_TRAINING=ON -Donnxruntime_ENABLE_TRAINING_OPS=ON -Donnxruntime_ENABLE_TRAINING_APIS=ON -Donnxruntime_ENABLE_CPU_FP16_OPS=ON -Donnxruntime_USE_NCCL=OFF -Donnxruntime_BUILD_BENCHMARKS=OFF -Donnxruntime_USE_ROCM=OFF -Donnxruntime_GCOV_COVERAGE=OFF -Donnxruntime_USE_MPI=OFF -Donnxruntime_ENABLE_MEMORY_PROFILE=OFF -Donnxruntime_ENABLE_CUDA_LINE_NUMBER_INFO=OFF -Donnxruntime_USE_CUDA_NHWC_OPS=OFF -Donnxruntime_BUILD_WEBASSEMBLY_STATIC_LIB=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_CATCHING=ON -Donnxruntime_ENABLE_WEBASSEMBLY_API_EXCEPTION_CATCHING=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_THROWING=ON -Donnxruntime_WEBASSEMBLY_RUN_TESTS_IN_BROWSER=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_THREADS=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_MEMORY64=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_DEBUG_INFO=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_PROFILING=OFF -Donnxruntime_ENABLE_LAZY_TENSOR=OFF -Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF -Donnxruntime_ENABLE_CUDA_PROFILING=OFF -Donnxruntime_ENABLE_ROCM_PROFILING=OFF -Donnxruntime_USE_XNNPACK=OFF -Donnxruntime_USE_WEBNN=OFF -Donnxruntime_USE_CANN=OFF -Donnxruntime_USE_TRITON_KERNEL=OFF -Donnxruntime_DISABLE_FLOAT8_TYPES=OFF -Donnxruntime_DISABLE_SPARSE_TENSORS=OFF -Donn

Error trying to execute nvidia-smi: Unable to locate executable file: nvidia-smi. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.. Assuming no GPU.

stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-04-04 16:03:41,870 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --build 2025-04-04 16:03:41,875 build [INFO] - Build started 2025-04-04 16:03:41,875 build [INFO] - Building targets for Release configuration 2025-04-04 16:03:41,875 build [INFO] - /usr/bin/cmake --build build/Release/Release --config Release -- -j16 2025-04-04 16:12:28,190 build [INFO] - /opt/python/cp310-cp310/bin/python3 /onnxruntime_src/setup.py bdist_wheel --nightly_build --enable_training --enable_training_apis /opt/python/cp310-cp310/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. !! ******************************************************************************** Please avoid running ``setup.py`` directly. Instead, use pypa/build, pypa/installer or other standards-based tools. See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. ******************************************************************************** !! self.initialize_options() DEBUG:auditwheel.musllinux:musl libc not detected DEBUG:auditwheel.libc:Falling back to GNU libc INFO:auditwheel.main_repair:Repairing onnxruntime_training-1.22.0.dev20250404+cpu-cp310-cp310-linux_x86_64.whl DEBUG:auditwheel.wheel_abi:processing: onnxruntime/capi/libonnxruntime.so.1.22.0 DEBUG:auditwheel.musllinux:musl libc not detected DEBUG:auditwheel.libc:Falling back to GNU libc DEBUG:auditwheel.lddtree:parse_ld_so_conf(//etc/ld.so.conf) DEBUG:auditwheel.lddtree: glob: //etc/ld.so.conf.d/*.conf DEBUG:auditwheel.lddtree: parse_ld_so_conf(//etc/ld.so.conf.d/00-manylinux.conf) DEBUG:auditwheel.lddtree:linker ldpaths: {'conf': ['/usr/local/lib', '/lib', '/lib64/', '/usr/lib', '/usr/lib64'], 'env': ['/opt/rh/gcc-toolset-14/root/usr/lib64', '/opt/rh/gcc-toolset-14/root/usr/lib', '/usr/local/lib64'], 'interp': []} DEBUG:auditwheel.lddtree:lddtree(onnxruntime/capi/libonnxruntime.so.1.22.0) DEBUG:auditwheel.lddtree: ldpaths[rpath] = [] DEBUG:auditwheel.lddtree: ldpaths[runpath] = ['/tmp/tmpcrw8uftf/onnxruntime/capi'] DEBUG:auditwheel.lddtree:lddtree(/lib64/libdl-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/libc-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/ld-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/librt-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/libpthread-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/libstdc++.so.6.0.25) DEBUG:auditwheel.lddtree:lddtree(/lib64/libm-2.28.so) DEBUG:auditwheel.lddtree:lddtree(/lib64/libgcc_s-8-20210514.so.1) DEBUG:auditwheel.wheel_abi:key libgcc_s.so.1, value GCC_3.4 DEBUG:auditwheel.wheel_abi:key libgcc_s.so.1, value GCC_3.0 DEBUG:auditwheel.wheel_abi:key libgcc_s.so.1, value GCC_4.0.0 DEBUG:auditwheel.wheel_abi:key libpthread.so.0, value GLIBC_2.3.4 DEBUG:auditwheel.wheel_abi:key libpthread.so.0, value GLIBC_2.2.5 DEBUG:auditwheel.wheel_abi:key libc.so.6, value GLIBC_2.16 DEBUG:auditwheel.wheel_abi:key libc.so.6, value GLIBC_2.17 DEBUG:auditwheel.wheel_abi:key libc.so.6, value GLIBC_2.4 DEBUG:auditwheel.wheel_abi:key libc.so.6, value GLIBC_2.6 DEBUG:auditwheel.wheel_abi:key libc.so.6, value G

Error trying to execute nvidia-smi: Unable to locate executable file: nvidia-smi. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.. Assuming no GPU.

stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin + python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-04-04 16:12:53,098 build [DEBUG] - Command line arguments: --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --enable_training --use_binskim_compliant_compile_flags --build_wheel --build_nuget --enable_transformers_tool_test --cmake_extra_defines onnxruntime_BUILD_BENCHMARKS=ON --test 2025-04-04 16:12:53,103 build [INFO] - Build started 2025-04-04 16:12:53,103 build [DEBUG] - create symlink /data/models -> build/Release/models 2025-04-04 16:12:53,103 build [INFO] - Running tests for Release configuration 2025-04-04 16:12:53,103 build [INFO] - /usr/bin/ctest --build-config Release --verbose --timeout 10800 2025-04-04 16:26:09,628 build [INFO] - /opt/python/cp310-cp310/bin/python3 -m pip install torch --index-url https://download.pytorch.org/whl/cpu WARNING: The script isympy is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. WARNING: The scripts torchfrtrace and torchrun are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH. Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2025-04-04 16:26:27,132 build [INFO] - /opt/python/cp310-cp310/bin/python3 onnxruntime_test_python.py .............../onnxruntime_src/build/Release/Release/onnxruntime/capi/onnxruntime_inference_collection.py:121: UserWarning: Specified provider 'InvalidProvider' is not in available provider names.Available providers: 'CPUExecutionProvider' warnings.warn( .....2025-04-04 16:26:27.356691354 [I:onnxruntime:TestModelSerialization, inference_session.cc:592 TraceSessionOptions] Session Options { execution_mode:0 execution_order:DEFAULT enable_profiling:0 optimized_model_filepath:"./PythonApiTestOptimizedModel.onnx" enable_mem_pattern:1 enable_mem_reuse:1 enable_cpu_mem_arena:1 profile_file_prefix:onnxruntime_profile_ session_logid:TestModelSerialization session_log_severity_level:1 session_log_verbosity_level:0 max_num_graph_transformation_steps:10 graph_optimization_level:3 intra_op_param:OrtThreadPoolParams { thread_pool_size: 0 auto_set_affinity: 0 allow_spinning: 1 dynamic_block_base_: 0 stack_size: 0 affinity_str: set_denormal_as_zero: 0 } inter_op_param:OrtThreadPoolParams { thread_pool_size: 0 auto_set_affinity: 0 allow_spinning: 1 dynamic_block_base_: 0 stack_size: 0 affinity_str: set_denormal_as_zero: 0 } use_per_session_threads:1 thread_pool_allow_spinning:1 use_deterministic_compute:0 config_options: { } } 2025-04-04 16:26:27.356706527 [I:onnxruntime:TestModelSerialization, inference_session.cc:420 ConstructorCommon] Creating and using per session threadpools since use_per_session_threads_ is true 2025-04-04 16:26:27.356712125 [I:onnxruntime:TestModelSerialization, inference_session.cc:438 ConstructorCommon] Dynamic block base set to 0 2025-04-04 16:26:27.357268235 [I:onnxruntime:TestModelSerialization, inference_session.cc:1794 Initialize] Initializing session. 2025-04-04 16:26:27.357280454 [I:onnxruntime:TestModelSerialization, inference_session.cc:1831 Initialize] Adding default CPU execution provider. 2025-04-04 16:26:27.357367976 [I:onnxruntime:TestModelSerialization, graph_partitioner.cc:1031 InlineFunctionsAOT] This model does not have any local functions defined. AOT Inlining is not performed 2025-04-04 16:26:27.3

stderr: WARNING! Your password will be stored unencrypted in /home/cloudtest/.docker/config.json. Configure a credential helper to remove this warning. See https://docs.docker.com/engine/reference/commandline/login/#credential-stores

Error trying to execute nvidia-smi: Unable to locate executable file: nvidia-smi. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.. Assuming no GPU.

stderr: + python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_shared_lib --update 2025-04-04 15:57:14,352 tools_python_utils [INFO] - flatbuffers module is not installed. parse_config will not be available 2025-04-04 15:57:14,359 build [DEBUG] - Command line arguments: --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_shared_lib --update 2025-04-04 15:57:14,363 build [INFO] - Build started 2025-04-04 15:57:14,363 build [INFO] - Generating CMake build tree 2025-04-04 15:57:14,372 build [INFO] - /usr/bin/cmake /onnxruntime_src/cmake -Donnxruntime_RUN_ONNX_TESTS=OFF -Donnxruntime_GENERATE_TEST_REPORTS=ON -DPython_EXECUTABLE=/usr/bin/python3 -Donnxruntime_USE_VCPKG=ON -Donnxruntime_USE_MIMALLOC=OFF -Donnxruntime_ENABLE_PYTHON=OFF -Donnxruntime_BUILD_CSHARP=OFF -Donnxruntime_BUILD_JAVA=OFF -Donnxruntime_BUILD_NODEJS=OFF -Donnxruntime_BUILD_OBJC=OFF -Donnxruntime_BUILD_SHARED_LIB=ON -Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF -Donnxruntime_USE_DNNL=OFF -Donnxruntime_USE_NNAPI_BUILTIN=OFF -Donnxruntime_USE_VSINPU=OFF -Donnxruntime_USE_RKNPU=OFF -Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF -Donnxruntime_USE_VITISAI=OFF -Donnxruntime_USE_TENSORRT=OFF -Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON -Donnxruntime_USE_TENSORRT_INTERFACE=OFF -Donnxruntime_USE_CUDA_INTERFACE=OFF -Donnxruntime_USE_OPENVINO_INTERFACE=OFF -Donnxruntime_USE_VITISAI_INTERFACE=OFF -Donnxruntime_USE_QNN_INTERFACE=OFF -Donnxruntime_USE_MIGRAPHX=OFF -Donnxruntime_DISABLE_CONTRIB_OPS=OFF -Donnxruntime_DISABLE_ML_OPS=OFF -Donnxruntime_DISABLE_RTTI=OFF -Donnxruntime_DISABLE_EXCEPTIONS=OFF -Donnxruntime_MINIMAL_BUILD=OFF -Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF -Donnxruntime_MINIMAL_BUILD_CUSTOM_OPS=OFF -Donnxruntime_REDUCED_OPS_BUILD=OFF -Donnxruntime_USE_DML=OFF -Donnxruntime_USE_WINML=OFF -Donnxruntime_BUILD_MS_EXPERIMENTAL_OPS=OFF -Donnxruntime_USE_TELEMETRY=OFF -Donnxruntime_ENABLE_LTO=OFF -Donnxruntime_USE_ACL=OFF -Donnxruntime_USE_ARMNN=OFF -Donnxruntime_ARMNN_RELU_USE_CPU=ON -Donnxruntime_ARMNN_BN_USE_CPU=ON -Donnxruntime_USE_JSEP=OFF -Donnxruntime_USE_WEBGPU=OFF -Donnxruntime_ENABLE_PIX_FOR_WEBGPU_EP=OFF -Donnxruntime_USE_EXTERNAL_DAWN=OFF -Donnxruntime_ENABLE_NVTX_PROFILE=OFF -Donnxruntime_ENABLE_TRAINING=OFF -Donnxruntime_ENABLE_TRAINING_OPS=OFF -Donnxruntime_ENABLE_TRAINING_APIS=OFF -Donnxruntime_ENABLE_CPU_FP16_OPS=OFF -Donnxruntime_USE_NCCL=OFF -Donnxruntime_BUILD_BENCHMARKS=OFF -Donnxruntime_USE_ROCM=OFF -Donnxruntime_GCOV_COVERAGE=OFF -Donnxruntime_USE_MPI=OFF -Donnxruntime_ENABLE_MEMORY_PROFILE=OFF -Donnxruntime_ENABLE_CUDA_LINE_NUMBER_INFO=OFF -Donnxruntime_USE_CUDA_NHWC_OPS=OFF -Donnxruntime_BUILD_WEBASSEMBLY_STATIC_LIB=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_CATCHING=ON -Donnxruntime_ENABLE_WEBASSEMBLY_API_EXCEPTION_CATCHING=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_THROWING=ON -Donnxruntime_WEBASSEMBLY_RUN_TESTS_IN_BROWSER=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_THREADS=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_MEMORY64=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_DEBUG_INFO=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_PROFILING=OFF -Donnxruntime_ENABLE_LAZY_TENSOR=OFF -Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF -Donnxruntime_ENABLE_CUDA_PROFILING=OFF -Donnxruntime_ENABLE_ROCM_PROFILING=OFF -Donnxruntime_USE_XNNPACK=OFF -Donnxruntime_USE_WEBNN=OFF -Donnxruntime_USE_CANN=OFF -Donnxruntime_USE_TRITON_KERNEL=OFF -Donnxruntime_DISABLE_FLOAT8_TYPES=OFF -Donnxruntime_DISABLE_SPARSE_TENSORS=OFF -Donnxruntime_DISABLE_OPTIONAL_TYPE=OFF -Donnxruntime_CUDA_MINIMAL=OFF -Donnxruntime_USE_KLEIDIAI=ON -DCMAKE_TOOLCHAIN_FILE=/usr/local/share/vcpkg/scripts/buildsystems/vcpkg.cmake -DVCPKG_INSTALL_OPTIONS=--x-feature=tests;--overlay-triplets=/onnxruntime_src/build/Debug/binskim;--x-buildtrees-root=/onnxruntime_src/build;--binarys

Error trying to execute nvidia-smi: Unable to locate executable file: nvidia-smi. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.. Assuming no GPU.

stderr: + python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_shared_lib --build 2025-04-04 15:57:46,652 tools_python_utils [INFO] - flatbuffers module is not installed. parse_config will not be available 2025-04-04 15:57:46,656 build [DEBUG] - Command line arguments: --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_shared_lib --build 2025-04-04 15:57:46,661 build [INFO] - Build started 2025-04-04 15:57:46,661 build [INFO] - Building targets for Debug configuration 2025-04-04 15:57:46,661 build [INFO] - /usr/bin/cmake --build build/Debug/Debug --config Debug -- -j8 2025-04-04 16:13:34,921 build [INFO] - Build complete

Error trying to execute nvidia-smi: Unable to locate executable file: nvidia-smi. Please verify either the file path exists or the file can be found within a directory specified by the PATH environment variable. Also check the file mode to verify the file is executable.. Assuming no GPU.

stderr: + python3 tools/ci_build/build.py --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_shared_lib --test 2025-04-04 16:13:37,680 tools_python_utils [INFO] - flatbuffers module is not installed. parse_config will not be available 2025-04-04 16:13:37,684 build [DEBUG] - Command line arguments: --build_dir build/Debug --config Debug --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --use_binskim_compliant_compile_flags --build_shared_lib --test 2025-04-04 16:13:37,689 build [INFO] - Build started 2025-04-04 16:13:37,689 build [INFO] - Running tests for Debug configuration 2025-04-04 16:13:37,689 build [INFO] - /usr/bin/ctest --build-config Debug --verbose --timeout 10800 2025-04-04 16:32:42,591 build [INFO] - Build complete