Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MultiHeadAttention op shall return attention probabilities #23124

Open
Tracked by #23122
amancini-N opened this issue Dec 16, 2024 · 0 comments · May be fixed by #23125
Open
Tracked by #23122

MultiHeadAttention op shall return attention probabilities #23124

amancini-N opened this issue Dec 16, 2024 · 0 comments · May be fixed by #23125
Labels
core runtime issues related to core runtime

Comments

@amancini-N
Copy link
Contributor

amancini-N commented Dec 16, 2024

Support pointer-generator networks in MultiHeadAttention op. Specifically, MultiHeadAttention op shall have an additional output returning the attention probabilities (softmax result) out.

@amancini-N amancini-N changed the title Support pointer-generator in MultiHeadAttention op MultiHeadAttention op shall return attention probabilities Dec 16, 2024
@yuslepukhin yuslepukhin added the core runtime issues related to core runtime label Dec 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core runtime issues related to core runtime
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants