Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mobile端,第一步总是返回Launch #20

Open
RainPot opened this issue Jan 7, 2025 · 6 comments
Open

Mobile端,第一步总是返回Launch #20

RainPot opened this issue Jan 7, 2025 · 6 comments
Assignees

Comments

@RainPot
Copy link

RainPot commented Jan 7, 2025

'task': '点击底部的“我的”tab',
'platform': 'Mobile'
message': "Action: 打开美团应用程序,以便进行后续操作。\nGrounded Operation: LAUNCH(app='美团', url='None')"

传入的截图已经在对应APP首页了,换了好几个Task,都是返回LAUNCH,怎样才能绕过呢。

@zRzRzRzRzRzRzR zRzRzRzRzRzRzR self-assigned this Jan 7, 2025
@zRzRzRzRzRzRzR
Copy link
Member

这段历史已经传到模型了吗,看一下完整拼接完的提示词

@cugb1004101218
Copy link

我的也是,啥都是美团,无语

@cugb1004101218
Copy link

image

@cugb1004101218
Copy link

python inference/web_demo.py --model_dir=./models --port=9999 --host=0.0.0.0 --platform=Mobile
int8量化的版本

@zhangyiwen5512
Copy link

zhangyiwen5512 commented Jan 10, 2025

使用action_op会出现这种情况,使用status_plan_action_op不会出现,但也不会再生成launch命令

@RainPot
Copy link
Author

RainPot commented Jan 13, 2025

这段历史已经传到模型了吗,看一下完整拼接完的提示词

Task: 点击金刚位中的美食icon
History steps:
0. LAUNCH(app='美团', url='None') 打开美团应用程序,以便进行后续操作
(Platform: Mobile)
(Answer in Action-Operation format.)
Model response:
Action: 打开美团应用程序,以便进行后续操作。
Grounded Operation: LAUNCH(app='美团', url='None')
Action: 打开美团应用程序,以便进行后续操作。
Grounded Operation: LAUNCH(app='美团', url='None')

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants