Skip to content

Commit

Permalink
[ChatQnA Benchmark] Fixed the output token in chatqnafixed.py (#193)
Browse files Browse the repository at this point in the history
* Fixed the output token in chatqnafixed.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
  • Loading branch information
Zhenzhong1 and pre-commit-ci[bot] authored Nov 8, 2024
1 parent 776ce22 commit 2c8ca26
Showing 1 changed file with 2 additions and 6 deletions.
8 changes: 2 additions & 6 deletions evals/benchmark/stresscli/locust/chatqnafixed.py
Original file line number Diff line number Diff line change
Expand Up @@ -17,12 +17,8 @@ def getReqData():
global opea_eval_prompts
global max_new_tokens
if opea_eval_prompts == "none":
opea_eval_prompts = "In a world where technology has advanced beyond our wildest dreams, humanity stands on the brink of a new era. The year is 2050, and artificial intelligence has become an integral part of everyday life. Autonomous vehicles zip through the streets, drones deliver packages with pinpoint accuracy, and smart homes anticipate every need of their inhabitants. But with these advancements come new challenges and ethical dilemmas. As society grapples with the implications of AI, questions about privacy, security, and the nature of consciousness itself come to the forefront. Please answer me the question what is artificial intelligence."
return {
"messages": opea_eval_prompts,
"max_tokens": max_new_tokens,
"top_k": 1,
}
opea_eval_prompts = "In a world where technology has advanced beyond our wildest dreams, humanity stands on the brink of a new era. The year is 2050, and artificial intelligence has become an integral part of everyday life. Autonomous vehicles zip through streets, drones deliver packages with pinpoint accuracy, and smart homes anticipate every need of their inhabitants. But with these advancements come new challenges and ethical dilemmas. As society grapples with implications of AI, questions about privacy, security, and the nature of consciousness itself come to the forefront. Please answer me the question what is artificial intelligence in detail."
return {"messages": opea_eval_prompts, "max_tokens": max_new_tokens, "top_k": 1, "temperature": 0}


def respStatics(environment, reqData, respData):
Expand Down

0 comments on commit 2c8ca26

Please sign in to comment.