Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

serving报维度匹配错误 #1990

Open
PassStory opened this issue Mar 19, 2024 · 3 comments
Open

serving报维度匹配错误 #1990

PassStory opened this issue Mar 19, 2024 · 3 comments

Comments

@PassStory
Copy link

image 搭建paddle service的时候遇见问题，export model的时候我的输入设定是[None, None]，代表[batch, token_size]，在service中，preprocess函数中也是给的这个维度的数据，但是最后报这个错
@github-actions GitHub Actions
Copy link

Message that will be displayed on users' first issue

@Jiang-Jia-Jun
Copy link

部分情况下，模型本身内部计算要求了Shape，这种情况下，就算导出模型设置为None, 也得按要求的shape进入输入，否则会报错。

@PassStory
Copy link
Author

也得按要求的shape进入输入

模型本身输入的设定和导出的设定是一致的，都是[batch, token_size]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@PassStory @Jiang-Jia-Jun