Skip to content

[Doc] EPContext with weight sharing #24141

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 25 commits into from
Apr 15, 2025
Merged

[Doc] EPContext with weight sharing #24141

merged 25 commits into from
Apr 15, 2025

Conversation

HectorSVC
Copy link
Contributor

Description

Add section EPContext with weight sharing to EPContext design doc

@HectorSVC HectorSVC changed the title EPContext with weight sharing [Doc] EPContext with weight sharing Mar 24, 2025
@GoranDubajic
Copy link

GoranDubajic commented Mar 25, 2025

  • If the context cache Onnx model is dumped with embed_mode = 1, so there is separate context binary file beside the Onnx model in the same folder.

I suppose this is typo and it should be 'embed_mode = 0'? #Resolved


Refers to: docs/execution-providers/EP-Context-Design.md:79 in aada59a. [](commit_id = aada59a, deletion_comment = False)

@HectorSVC
Copy link
Contributor Author

  • If the context cache Onnx model is dumped with embed_mode = 1, so there is separate context binary file beside the Onnx model in the same folder.

I suppose this is typo and it should be 'embed_mode = 0'?

Refers to: docs/execution-providers/EP-Context-Design.md:79 in aada59a. [](commit_id = aada59a, deletion_comment = False)

fixed, thanks

Copy link

@GoranDubajic GoranDubajic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:shipit:

@HectorSVC HectorSVC merged commit 16bd394 into gh-pages Apr 15, 2025
3 checks passed
@HectorSVC HectorSVC deleted the ep_weight_sharing branch April 15, 2025 16:52
TedThemistokleous pushed a commit to TedThemistokleous/onnxruntime that referenced this pull request May 6, 2025
### Description
Add section EPContext with weight sharing to EPContext design doc
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants