Main #6

sgoodm · 2023-02-22T18:06:00Z

No description provided.

…files

…cation approaches

… and refactor (includes generating outputs at hh and cluster level)

… classification for strategy

… data we cannot upload

…ing dataset (mainly for eqai work and gender classifications)

…h index cluster data

…pecific DHS WI cluster data

Turns raw gender split DHS data into ready to run model input data

…oss gender

… mlflow db (currently just designed for equitable ai model runs)

…hat don't include both a male and female export)

…lysis.

…ontent to subdir

…comparison

…ced tests

…andomized sampling variations.

sgoodm and others added 30 commits February 22, 2023 12:59

Add MAPE metric and update model scripts to support alternate config …

199ac9b

…files

Add config file for gender / equitable ai analysis

40b115f

Update gender split to prep for support for additional split/classifi…

d3cab40

…cation approaches

Add updated outputs

da47c4f

Clean up outputs

c2db525

Modify config from last runs

848d417

Clean up

8dd56bc

Update gender split script to include addition classification schemes…

a3e979b

… and refactor (includes generating outputs at hh and cluster level)

Rewrite gender data class, update class uses accordingly, and correct…

c74f8a6

… classification for strategy

Add gender classification rules to gender split script

38b815c

Add gender classification specific config to eq ai config

04d1aae

respect config file setting in src/model_bundle.py

6464d13

Add bool check for run sub projects to use config arg properly

5126e8b

Use input arg properly for dhs_gender_split.py

b6018b9

Update gitignore to include eqai proj specific dir including some dhs…

0f6b221

… data we cannot upload

Update eqai config

7d03d57

Add file to manage preparing output dirs based on subsets of an exist…

34c226e

…ing dataset (mainly for eqai work and gender classifications)

Add input arg to define config to model_prep

e5f37c8

Make dhs gender split path standardized

f8db9e4

Expand prep output script to handle integrating gender specific wealt…

9ca1be0

…h index cluster data

Refine prep outputs to adjust final_data with gender classification s…

d34f9a7

…pecific DHS WI cluster data

Adjust prep outputs final data csv format

a6c545f

Update hyperparams in model utils

0f58902

Update hyperparams in model utils

5cead93

Add commented out hyperparams for testing

7457bc1

Incorporate features from prep_outputs.py into dhs_gender_split.py

f381a00

Turns raw gender split DHS data into ready to run model input data

Add note about using HTTP2 with Prefect

6326529

Update config for runs using equal households per cluster samples acr…

37068f7

…oss gender

Add scripts dir to root with python script to generate plots from the…

41a8182

… mlflow db (currently just designed for equitable ai model runs)

Move dhs gender split script (for eqai work) to scripts dir

292401f

sgoodm added 29 commits May 11, 2023 13:33

Update gender split script to support somewhat arbitrary test sets (t…

04a3da5

…hat don't include both a male and female export)

Update mlflow plots with additional plot and formatting

249a761

Update config with additional test sets for trimmed non-gendered data

f0ff3a5

Adjust model utils for testing different subsets

6a9d8a3

Update to include additional types of plots used for gender analysis

fd391fa

Update readme to include steps for gender specific model runs and ana…

65b63ae

…lysis.

Edit conda env name to be more intuitive

fa5c40f

Add mlflow.db for replication of results

9785800

Add template script / guide for running extracts on HPC

71d5d56

Push update to misc joblib file

fee6397

Clean up gitignore a bit

0a9f72c

Move prefect dask setup script to scripts folder

5acd376

Update gitignore to allow tracking a number of additional output files

c2c0bcb

Reenable model files to be tracked in gitignore (and add existing ones)

4459d79

Update readme with more context for gender work

ed90f8a

Cleanup readme

a7a64d5

Add gitattributes file

17d4c82

Update readme

5b981c7

Update readme to cover all config settings

2f93a42

Update readme section on mlflow

2641e57

Cleanup default config

f1ed991

Update readme

e0ae45e

Add equitable ai work / supplemental analysis / outputs and related c…

90f0217

…ontent to subdir

Add better visualization of feature importance for male/female model …

7b0d1a1

…comparison

Add dhs wi recreation code and readme to equitable ai dir

4a3f457

Add eqai folder readmes

57d5ad9

Add support for running additional randomized sampling runs for balan…

9cfae20

…ced tests

Add support for permutation importance

360b011

Run additional models to gen results for permutation importance and r…

77a7baf

…andomized sampling variations.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Main #6

Main #6

sgoodm commented Feb 22, 2023

Main #6

Are you sure you want to change the base?

Main #6

Conversation

sgoodm commented Feb 22, 2023