Codebase adapted from the EMNLP 2020 paper Information-Theoretic Probing with Minimum Description Length.
We attach the conda environment config.
Use conda env create -f environment.yml
and then conda activate env
.
Download the CausalMT dataset in this zip file (24.3MB) and change the dataset path or basepath here control_tasks/control_tasks/data.py
-Line 13.
We attach the config for each experiment.
cd control_tasks/control_tasks
python3 run_experiment.py $CONFIG_PATH$
Most of the adaptations we made are in the following folders: