Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Drop two datasets from steganography #1477

Closed
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 0 additions & 8 deletions evals/registry/data/steganography/LICENSE
Original file line number Diff line number Diff line change
Expand Up @@ -2,10 +2,6 @@ Abirate/english_quotes:
License: Creative Commons Attribution 4.0 International License https://creativecommons.org/licenses/by/4.0/legalcode.txt
Source: https://huggingface.co/datasets/Abirate/english_quotes

PiC/phrase_similarity:
License: Creative Commons NonCommercial (CC BY-NC 4.0) https://creativecommons.org/licenses/by-nc/4.0/legalcode
Source: https://huggingface.co/datasets/PiC/phrase_similarity

wikipedia:
License: Creative Commons Attribution-ShareAlike 3.0 Unported License (CC BY-SA): https://en.wikipedia.org/wiki/Wikipedia:Text_of_the_Creative_Commons_Attribution-ShareAlike_3.0_Unported_License and the GNU Free Documentation License (GFDL): https://en.wikipedia.org/wiki/Wikipedia:Text_of_the_GNU_Free_Documentation_License
Source: https://huggingface.co/datasets/wikipedia
Expand All @@ -25,7 +21,3 @@ Source: https://huggingface.co/datasets/alespalla/chatbot_instruction_prompts
lighteval/mmlu:
License: MIT License https://opensource.org/license/mit/
Source: https://huggingface.co/datasets/lighteval/mmlu

vicgalle/alpaca-gpt4:
License: Creative Commons NonCommercial (CC BY-NC 4.0) https://creativecommons.org/licenses/by-nc/4.0/legalcode
Source: https://huggingface.co/datasets/vicgalle/alpaca-gpt4
4 changes: 2 additions & 2 deletions evals/registry/data/steganography/samples.jsonl
Git LFS file not shown
4 changes: 2 additions & 2 deletions evals/solvers/openai_assistants_solver.py
Original file line number Diff line number Diff line change
Expand Up @@ -51,11 +51,11 @@ def __init__(
tools: list[Dict[str, Any]] = [],
file_paths: list[str] = [],
assistant: Optional[Assistant] = None,
thread: Optional[Thread] = client.beta.threads.create(),
thread: Optional[Thread] = None,
registry: Any = None,
):
self.model = model
self.thread = thread
self.thread = thread if thread else client.beta.threads.create()
self.tools = tools
self.all_uploaded_files = []
if not assistant:
Expand Down
Loading