Skip to content

Error when I use cuda_runtime.h and OpenVINO EP at the same time #23941

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
ddrepkk89 opened this issue Mar 7, 2025 · 1 comment
Open

Error when I use cuda_runtime.h and OpenVINO EP at the same time #23941

ddrepkk89 opened this issue Mar 7, 2025 · 1 comment
Labels
ep:OpenVINO issues related to OpenVINO execution provider stale issues that have not been addressed in a while; categorized by a bot

Comments

@ddrepkk89
Copy link

ddrepkk89 commented Mar 7, 2025

I have custom build the onnxruntime 1.20.0 with TensorRT, CUDA and OpenVINO. Build is done successfully without error. I have two sessions to initialize. I have tried the following:
Option 1: Initialize both sessions with OpenVINO -> WORKS!
Option 2: Initialize both sessions with TensorRT -> WORKS!
Option 3: Initialize one sessions with CUDA, another with OpenVINO-> WORKS!
Option 4: Initialize one session with OpenVINO, another with TensorRT without including cuda_runtime.h -> WORKS!
Option 5: Initialize one session with OpenVINO, another with TensorRT with including cuda_runtime.h -> Not Work.

I need to include cuda_runtime.h because I have other kernel functions, I need to use.

The error message at option 5 is: OpenVINO "No available backend". Why there are conflict between cuda_runtime.h and OpenVINO provider? It seems, once I load the cuda dlls, there are conflict, and OpenVINO recognize the CPU as NPU (But I don't have NPU on my PC)

My CUDA Version is 12.4, CuDNN Version 9.4, TensorRT 10.5, OpenVINO 2024.4.0.

My operating system is Windows 11. Visual Studio 2022.

@github-actions github-actions bot added the ep:OpenVINO issues related to OpenVINO execution provider label Mar 7, 2025
Copy link
Contributor

github-actions bot commented Apr 7, 2025

This issue has been automatically marked as stale due to inactivity and will be closed in 30 days if no further activity occurs. If further support is needed, please provide an update and/or more details.

@github-actions github-actions bot added the stale issues that have not been addressed in a while; categorized by a bot label Apr 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ep:OpenVINO issues related to OpenVINO execution provider stale issues that have not been addressed in a while; categorized by a bot
Projects
None yet
Development

No branches or pull requests

1 participant