Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Performance] Can onnxruntime delegate the entire process to another framework when using other providers? #23132

Open
yht183 opened this issue Dec 17, 2024 · 0 comments
Labels
ep:MIGraphX issues related to AMD MI GraphX execution provider performance issues related to performance regressions

Comments

@yht183
Copy link

yht183 commented Dec 17, 2024

Describe the issue

For example, when using the MIGraphXExecutionProvider, the execution frame also records some intermediate variable values of MIGraphX. Is it possible to provide an end-to-end method where onnxruntime only handles input and output data, and the other provider handles everything else?

To reproduce

when I run
ort_session = onnxruntime.InferenceSession(onnx_model_path, providers=["MIGraphXExecutionProvider"], provider_options=provider_options)
I found that the all_values_ in the executionFrame class records many intermediate variables, even when using other providers for inference execution. I wonder if there is a way to perform end-to-end execution when using other providers?
Image

Urgency

No response

Platform

Linux

OS Version

ubuntu2004

ONNX Runtime Installation

Built from Source

ONNX Runtime Version or Commit ID

v1.15.0

ONNX Runtime API

Python

Architecture

X64

Execution Provider

MIGraphX

Execution Provider Library Version

No response

Model File

No response

Is this a quantized model?

No

@yht183 yht183 added the performance issues related to performance regressions label Dec 17, 2024
@github-actions github-actions bot added the ep:MIGraphX issues related to AMD MI GraphX execution provider label Dec 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ep:MIGraphX issues related to AMD MI GraphX execution provider performance issues related to performance regressions
Projects
None yet
Development

No branches or pull requests

1 participant