Code

Emnlp#7

Code

Open

chrisrytting wants to merge 93 commits intomainBYU-PCCL/lm-survey:mainfrom emnlpBYU-PCCL/lm-survey:emnlpCopy head branch name to clipboard

+59,535-166

Commits

Commits on May 12, 2023

• Add ATP-specific generate DVs workflow

  vinhowe

  committed
  a2ca02a

• Apparently we could generate DVs automatically

  vinhowe

  committed
  095912c

Commits on May 16, 2023

• Add survey cost estimation code

  vinhowe

  committed
  298d028

• Add code to automatically generate ATP configs

  vinhowe

  committed
  b6a536e

• Lowercase variables because it works for neurips

  vinhowe

  committed
  a65478c

• Add 'culling sampled below n' code (note!)

  Show description for 39026e1
  vinhowe

  committed
  39026e1

Commits on May 19, 2023

• Merge branch 'main' into neurips

  vinhowe

  committed
  f937f59

• Add output for debugging prompt construction

  vinhowe

  committed
  80110d9

• Revert "Lowercase variables because it works for neurips"

  Show description for 08e9bb5
  vinhowe

  committed
  08e9bb5

• Undo ValidOption lowercasing

  vinhowe

  committed
  7e7adef

Commits on May 20, 2023

• Revert "Add 'culling sampled below n' code (note!)"

  Show description for 7435097
  vinhowe

  committed
  7435097

• Remove n_culle_sampled_below everywhere

  vinhowe

  committed
  e0df35c

• Unsort imports in survey.py

  vinhowe

  committed
  97e84c8

• Ignore .DS_Store

  vinhowe

  committed
  b013cb9

• Merge branch 'main' into emnlp

  vinhowe

  committed
  298cf23

• s/config_filename/variables_filename/g

  vinhowe

  committed
  a990667

• Filter out out-of-schema variable values

  vinhowe

  committed
  5fc9c00

• Working async openai sampler impl

  vinhowe

  committed
  bd7a057

• Reformat

  vinhowe

  committed
  490e07c

• Remove extra comment

  vinhowe

  committed
  81c22f7

• Update example_configure_survey.py

  vinhowe

  committed
  3bd43df

• Remove unused argparse import

  vinhowe

  committed
  7b68fa6

• Reformat

  vinhowe

  committed
  fea3a1f

• Merge branch 'emnlp' into async-openai-sampling

  vinhowe

  committed
  b4a8fe9

• Remove unused prompt printing

  vinhowe

  committed
  3728470

• Merge branch 'emnlp' into async-openai-sampling

  vinhowe

  committed
  a218599

• Remove comments for copilot

  vinhowe

  committed
  2877aab

• Merge branch 'emnlp' into async-openai-sampling

  vinhowe

  committed
  4e8155d

• replace responses.csv -> data.csv

  vinhowe

  committed
  10b50a5

Commits on May 22, 2023

• Update folder structure.

  alexgshaw

  committed
  a41a1bd

• Add style check GitHub workflow

  vinhowe

  committed
  27615c8

• Merge branch 'emnlp' into async-openai-sampling

  vinhowe

  committed
  056761b

• Bug fix + add slot for response object.

  alexgshaw

  committed
  8035a00

• Fix index typing error.

  alexgshaw

  committed
  98b4acf

• Merge branch 'emnlp' into async-openai-sampling

  vinhowe

  committed
  687dcd0

• Merge branch 'emnlp' into async-openai-sampling

  vinhowe

  committed
  bd381ba

• Update async openai sampler to return response

  vinhowe

  committed
  a7febdf

• Add ordinal property to variables.json

  vinhowe

  committed
  82c356c

• Handle AutoModel async

  vinhowe

  committed
  08f02c5

• Merge pull request #8 from BYU-PCCL/async-openai-sampling

  Show description for 05ddeef
  vinhowe

  authored
  05ddeef

• Merge branch 'emnlp' into add-ordinal-to-variables

  vinhowe

  committed
  2ed52ae

• Merge pull request #11 from BYU-PCCL/add-ordinal-to-variables

  Show description for 2c31a63
  alexgshaw

  authored
  2c31a63

• Fix survey sampling.

  alexgshaw

  committed
  64afba1

• Merge branch 'emnlp' of https://github.com/BYU-PCCL/lm-survey into emnlp

  alexgshaw

  committed
  23bb834

• Update atp configuration

  vinhowe

  committed
  2b82b88

• Add ordinal functionality to Question class.

  alexgshaw

  committed
  f126bc5

• Merge branch 'emnlp' of https://github.com/BYU-PCCL/lm-survey into emnlp

  alexgshaw

  committed
  639d687

• Rework folder structure.

  alexgshaw

  committed
  3740cfc

Commits on May 23, 2023

• Temp. revert "Add style check GitHub workflow"

  Show description for d7198fb
  vinhowe

  committed
  d7198fb

• bug fix.

  alexgshaw

  committed
  b0b14e5

• Minor bug fix on question.

  alexgshaw

  committed
  aee5f3c

• rename schema to variable

  alexgshaw

  committed
  f260e71

• gitignore update

  alexgshaw

  committed
  83bdc97

Commits on May 24, 2023

• Added crude representativeness scoring

  chrisrytting

  committed
  ea66dd5

• Merge branch 'emnlp' of github.com:BYU-PCCL/lm-survey into emnlp

  chrisrytting

  committed
  8008a9f

• Update estimate survey to experiment config file

  vinhowe

  committed
  ac835b2

• Merge branch 'emnlp' of github.com:BYU-PCCL/lm-survey into emnlp

  vinhowe

  committed
  d47640a

• breadth experiment

  chrisrytting

  committed
  e3c4c8e

• Merge branch 'emnlp' of github.com:BYU-PCCL/lm-survey into emnlp

  chrisrytting

  committed
  f9347ac

• Merge branch 'emnlp' of github.com:BYU-PCCL/lm-survey into emnlp

  vinhowe

  committed
  67bbf30

• Add create atp experiment script

  vinhowe

  committed
  5940ff0

• Check in variables

  vinhowe

  committed
  39c2fe4

• Clean up create atp experiment imports

  vinhowe

  committed
  95da00f

• Do formatting for create atp experiment

  vinhowe

  committed
  562fb9d

• Update check survey prompts for experiments

  vinhowe

  committed
  28e3ac9

• Update estimate survey to experiment config file

  vinhowe

  committed
  4e79da7

• Fix ATP configuration script

  vinhowe

  committed
  cde6e24

• Use ordinals to find invalid options

  vinhowe

  committed
  9076e10

• Fix

  vinhowe

  committed
  9eba1c9

Commits on May 25, 2023

• Fix rate limit error import

  vinhowe

  committed
  f0cf51d

• Bump up rate limit to what OpenAI says we have

  vinhowe

  committed
  f510c3e

Commits on May 26, 2023

• Push updates variables

  vinhowe

  committed
  9aaead3

• Add force flag.

  alexgshaw

  committed
  ac8e3fb

• Sampler fix.

  alexgshaw

  committed
  6e9d77f

• Added logging, added functionality to fill in missing response_objects

  chrisrytting

  committed
  0a24acd

• Merge branch 'emnlp' of github.com:BYU-PCCL/lm-survey into emnlp

  chrisrytting

  committed
  ad4525d

• Bug fix.

  alexgshaw

  committed
  b058a5f

Commits on May 27, 2023

• Merge branch 'emnlp' of github.com:BYU-PCCL/lm-survey into emnlp

  chrisrytting

  committed
  34115df

Commits on May 29, 2023

• added some helpers

  chrisrytting

  committed
  5b3c884

• Added tests for infilling

  chrisrytting

  committed
  07fdbbe

• Added infilling ability, some more logging, and some extra DVS functionality

  chrisrytting

  committed
  21b8e75

• Removed data push mistake

  chrisrytting

  committed
  446672c

• Merge branch 'emnlp' of github.com:BYU-PCCL/lm-survey into emnlp

  vinhowe

  committed
  835da77

• Remove unused import in async sampler

  vinhowe

  committed
  1aff991

Commits on May 30, 2023

• Add updated estimate_survey.py

  vinhowe

  committed
  8f7e6ad

Commits on May 31, 2023

• Minor fixes.

  alexgshaw

  committed
  849e91e

• Get rid of horrible rate limit print

  vinhowe

  committed
  91b8041

• Merge branch 'emnlp' of github.com:BYU-PCCL/lm-survey into emnlp

  vinhowe

  committed
  e1b1c52

Commits on Jun 2, 2023

• Made the rep calculation neater

  chrisrytting

  committed
  f65c797

• Merge branch 'emnlp' of github.com:BYU-PCCL/lm-survey into emnlp

  chrisrytting

  committed
  c96a889

• Merge branch 'emnlp' of github.com:BYU-PCCL/lm-survey into emnlp

  vinhowe

  committed
  0909387

Commits on Jun 3, 2023

• Added weighting and an ability to extract D_H from opinionqa dataset

  chrisrytting

  committed
  df555c6

• Merge branch 'emnlp' of github.com:BYU-PCCL/lm-survey into emnlp

  chrisrytting

  committed
  a0ba33e