v1.0.0

1.0.0 (2023-12-29)

If this version number is surprising, see here or here.

Features

• add CI workflow (c3caac0)
• add config template (a0590cb)
• add config-local.yaml (0395920)
• add default docker build script (af8823d)
• add dockerfiles (9cd0e8f)
• add dockerignore (bee0f05)
• add environment setup action (450a56a)
• add example env (32fe4fb)
• add FlyteRemote execution script (f9c530d)
• add kaniko build job (55497e1)
• add localctl script (0fcade5)
• add lrwine workflow (070d299)
• add makefile (6637953)
• argo: add build step for gpu container (417e983)
• argo: add container build workflow (abfea96)
• auto-generate entity configs (ae11a73)
• autoconfig workflow interfaces (498f6a0)
• build: add container build action (4d26eb9)
• build: add resource request overrides (667ec9b)
• CI: add nix jobs (d28c9a6)
• CID: build and deploy docs (b842b26)
• CID: consolidate CI and CD workflows (5bcdf97)
• CI: provide argo inputs for gpu container (5c3f6b0)
• CI: save hydra outputs as artifact (46af985)
• cli: config groups for workflows and executions (#5) (1c44862)
• conda: add virtual-packages (4cd5050)
• conda: init locks (ae1fe5a)
• config: create dataclasses from callables (f09aa7b)
• constants: init config file path constants (19114c4)
• containers: add compose configuration (803a3bd)
• containers: add nvidia drivers Dockerfile (7bcfdf9)
• containers: add pkg Dockerfile (c2b8c38)
• containers: add prod Dockerfile (adc7e34)
• dataclass_dict: construct dataclass dict (3d117e6)
• devcontainer: init (b2a6a8d)
• devshell: use flake without direnv (56f0654)
• direnv: enable (63e6a84)
• docs: add mkdocs config (6fb220b)
• docs: init mkdocs (576020f)
• docs: init quick start in readme (b9fe009)
• execute: add gpu image (aeb9341)
• execute: post url to clipboard (d81ff13)
• execute: support dev vs prod execution (51ca473)
• execute: support local workflow execution (3f453cf)
• execute: use groups to configure entities (e4659e4)
• execution_config: modes via dataclass (46fa7d5)
• flake: add devcontainer built with dockerTools (6883fe9)
• flake: add docs group to devshell and containers (3c9ead3)
• flake: build dev image with nix2container (a539ddd)
• flake: construct container manifest with flocken (11cf400)
• flake: enable nix in devcontainer (b7c2c73)
• flake: specify systems for image from env (d49c07c)
• flytezen: seed package (80732fc)
• hydra: add joblib launcher plugin (1f1b79b)
• lrwine: task parameters with resource specs (bed03c0)
• lrwine: use mashumaro for json serialization (325c1eb)
• make: add ci run (a3d6481)
• make: add codespaces targets (5e7b969)
• make: add GAR gh secret (b6fa704)
• make: add jupyter server targets (23faa1e)
• make: add targets to run workflows (351db39)
• make: add tree (9b47679)
• make: build image locally with local_image (b196667)
• make: tag images with crane (3e40eb4)
• make: update list and tag image targets (5877e51)
• make: use gh variable for non-sensitive vars (8eb367c)
• mashumaro_dataclasses: add mashumaro (47d4c89)
• nix: add flake (272c89a)
• package: move workflows and execution to pkg (4a450e0)
• poetry: initialize package (5a9fe82)
• pyproject: add docformatter configuration (2edb886)
• pyproject: add jupyter server (159726b)
• pyproject: add pyperclip (503ff66)
• pyproject: draft pyproject.toml (e692872)
• pyproject: gen conda-lock (b5338cd)
• pyproject: install mashumaro (2207e8a)
• pyright: install to dev deps (e74f03d)
• renovate: add config (bfcfd40)
• template init (91f5ac6)
• tests: add tests directory (c845b9a)
• update execute for CI wait and log (ac8acf4)
• use dataclass for workflow configuration (fbe82fc)
• vscode: add CLI debugging config (d1e1bbb)

Bug Fixes

• .github: add .gitkeep (86bea6e)
• actions: remove just install comments (06c8f9a)
• add dummy conf dir (d58655c)
• add ruff cache to gitignore (db67253)
• all: lint (f2e9eb6)
• argo: add mode parameter (2ced1a9)
• argo: allow map over multiple containerfiles (53861d4)
• argo: build container images in parallel (d46b636)
• argo: patch GITHUB_REF on PR (83fed17)
• argo: yml -> yaml (d8fc1f1)
• build-image: enable workflow_call (7fb62d8)
• build-images: accept secret on workflow_call (e4aff11)
• build-images: remove skip and concurrency group (1ade1cf)
• build-images: use CI_ prefix (ba2b82f)
• build-images: use pkg.Dockerfile (a594852)
• build-images: use PR source branch head sha (d14bf4c)
• build: check debug_enabled string equals true (1491b76)
• build: debug at first step (2bf1f51)
• build: install curl (8e25e86)
• build: remove unnecessary variable printing (972a1fc)
• build: rename skip-duplicate-runs (73382aa)
• build: reorder container registries (2484c82)
• build: set GAR from secret (ed21d1b)
• build: support multiple containerfiles (122523e)
• build: update permissions (c2f1b5a)
• build: update resource override parameters (6630954)
• build: upgrade checkout (7e50bb5)
• build: use camelCase (4f1fc2d)
• CD: accept flake config (a8b26a8)
• CD: add github-slug-action (dab0056)
• CD: allow impure checks (1c649d6)
• CD: checkout head ref (8c25192)
• CD: reenable semantic release (a1714fc)
• CD: remove dev branch from push (2c1db7d)
• CD: rename jobs (14c7186)
• CI: add workflow name (47cb8ae)
• CI: call build-images (cd976cd)
• CI: check debug_enabled string is true (b1df39a)
• CI: checkout head ref (3bf6497)
• CI: checkout head ref on PR (ad16652)
• CI: checkout pull request head sha (aab6556)
• CI: comment unused variables (670836d)
• CID: add id-token write permission to deploy-docs (e6278c3)
• CID: add pages write permission to deploy-docs (5ac96d7)
• CID: build docs without release (91fa9ad)
• CID: config-workflows on push (9dd026f)
• ci: dependency of deploy on config (3e588a2)
• CI: disable fetch depth (02099ce)
• CI: disable flytectl install API rate limit (fd871f5)
• CI: do not ignore pyproject changes in root (526203d)
• CID: remove branch condition on PR run (c2a006c)
• CID: remove tag-based conditions on config-workflows (8c9f169)
• CID: set docs environment to github-pages (152ba1e)
• CI: execute workflow in CI (a5a5aa6)
• CI: expose WORKFLOW_IMAGE in env (112cb42)
• ci: ignore root files (d40dedd)
• CI: ignore scripts path (49b8759)
• CI: include beta branch (35498d8)
• CI: link duplicate runs in parallel (bfc78ac)
• CI: pass secret to build-images (674daf0)
• ci: pip freeze and list (db2c66d)
• CI: reference correct github event var names (da963a8)
• ci: reinstate pip upgrade (b470f0d)
• CI: remove commented gh vars (5e4d2ea)
• CI: remove comments (5207f7b)
• ci: remove config debug (1b47581)
• ci: remove explicit pip upgrade (dd50dde)
• CI: remove unused flytectl install (c1d38f5)
• CI: remove unused variable (025c775)
• CI: remove unused variables (afb9a32)
• CI: remove unused variables and pin prod mode (6d2a75e)
• CI: remove workflow_call (a8471e9)
• CI: rename config output steps (f5d2683)
• ci: set config output from secret (1e5fac6)
• CI: set env vars for images (846e6f6)
• CI: set fetch-depth 0 (e627cea)
• CI: setup image build on labels (74a0dd0)
• CI: specify flytectl config artifact path (7ec70a5)
• CI: sync permissions with build (910e82d)
• ci: update actions versions (7092988)
• CI: update env vars (0ab8c83)
• CI: update permissions for skip-duplicates (9c23759)
• ci: upgrade actions (7d03160)
• CI: use github env to reference hydra outputs (655782d)
• CI: use setup_environment to manage python (7b13f9c)
• CI: use vars for variables (7eed03f)
• CI: variable name collision (029cd8d), closes /github.com/rlespinasse/github-slug-action/blame/00d4236bb38fcea6fc4aa6b1dacc7187fc8e38a0/README.md#L218
• cli: disable click (5cabe51)
• cli: remove unused comments (142c706)
• cli: remove unused execution utils (e9302ca)
• cli: update main help example (6ff6194)
• codecov: add config (d44a4c8)
• conda-lock: update (ff2fdc4)
• configuration: handle args without type hints (39f9c33)
• configuration: lint (360c677)
• configuration: note deprecated bounds (8df4547)
• configuration: return datclass_json (05f5304)
• conf: remove unused directory (8629c9c)
• constants: use dulwich to get repo root path (28b3c71)
• constants: use module path in logger name (8fc25f7)
• containers: separate deps from lib install (7aa2a70)
• dataclass_dict: move to scripts (bbb58a5)
• dataclass_dict: use dataclasses_json (315d8e2)
• deprecate requirements files (9a6495e)
• devcontainer: add docker-in-docker (92f7c18)
• devcontainer: disable docker-compose (676aba2)
• docs: path to .github (56c4b7c)
• docs: reference relevant make targets in README quick start (fb4e5c7)
• docs: update README (#23) (64e7a28)
• docs: update tree in README (b96787a)
• enable pip cache (9bb4165)
• env: account for hydra config (42be750)
• env: add LOG_LEVEL (f987ea8)
• envrc: update nix-direnv (582bc10)
• env: separate section headings (32eeedf)
• env: update dotenv example (55b8d13)
• env: update vars for local cluster execution (1ec6086)
• example: add defaults for all task args (1c21532)
• example: lint (de96dec)
• execute_utils: use inspect.getmembers to filter by type (4e1f784)
• execute: register_script > fast serialization (d7af044)
• execute: add local mode to main docstring (9bfe0a9)
• execute: add requirements (ce4f787)
• execute: comment required env var check (f5eb17b)
• execute: deprecate generate_workflow_inputs (0f0bd3b)
• execute: ensure dev randomness matches regex (a5c3fd5)
• execute: exit if error at completion (eaf5ed9)
• execute: handle workflow already terminated (0a0bc59)
• execute: lift workflow config out of store (53d7525)
• execute: lint generate_workflow_inputs (11f3d19)
• execute: lint utils (72ef4cc)
• execute: make sync default (4ca36af)
• execute: move config tree print to main() (8730272)
• execute: move env vars back inside main (330dfd7)
• execute: reenable Enum mode config (8f859c3)
• execute: refactor execute_workflow (62a618b)
• execute: remove configure hydra util (b0ee5e9)
• execute: remove env vars check (61f202b)
• execute: remove redundant ref to src (95de701)
• execute: rename git_info_to_workflow_version (d97361f)
• execute: restore complete destination path (43aa0bf)
• execute: return module and function (070cd9b)
• execute: separate make_config declaration (cee6ade)
• execute: set default config_path=None (e021d7f)
• execute: set distinct local/remote config (82fd5a6)
• execute: specify wf vs task registration (e1e6d04)
• execute: update hydra/help (8094181)
• execute: update docstring (dfed8d5)
• execute: update docstring (69e8bd0)
• execute: update docstrings and comments (b83b308)
• execute: update for enumerated modes (9c81e6f)
• execute: update help (f7186fa)
• execute: update imports (e093663)
• execute: update local image file paths (c13f828)
• execute: update main docstring (721a438)
• execute: updates to register before execution (d61050c)
• execute: use register_script in dev mode (622399d)
• execute: use dataclass to configure workflow (6b3ab4f)
• execute: use hydra groups for mode config (b75e08f)
• execute: use sys.exit (22b90d4)
• execute: workflow_execution_mode --> mode (288d741)
• execute: write package updates to src directory (fdbedee)
• execution_config: move comment to docstring (6b84877)
• execution_config: set default remote dev (03f1fd3)
• execution_utils: auto string-lower on version (80a33c5)
• execution_utils: check env vars for git info (2949ddd)
• execution_utils: disable fetch (6d61e66)
• execution_utils: fall back to env vars in detached head state (61a36b3)
• execution_utils: fetch refs (dc3dc76)
• execution_utils: include config group help (5b2b665)
• execution_utils: list branches (59cf5b1)
• execution_utils: reenable tasks (2a84eab)
• execution_utils: remove comments (97a896d)
• execution_utils: support Dict[str, DataClass] (b348b49)
• execution_utils: transiently allow no git repo (f2859f5)
• execution_utils: update help (16a47f5)
• execution_utils: update help override examples (5797316)
• execution_utils: use dulwich instead of git binary (b4e6dbb)
• flake: add awk and grep to devPackages (2038c09)
• flake: add coreutils for dev and to path (d8aea97)
• flake: add extraPackages pip to mkPoetryEnv (66faefc)
• flake: add flytezen git buildInputs (acda1ff)
• flake: add formatter (7106d07)
• flake: add github sha tags (86324ba)
• flake: add github token (c2ad239)
• flake: add gnutar to devPackages (b69ef53)
• flake: add gzip to sysPackages (05b151e)
• flake: add man to devPackages (809a47c)
• flake: add manual ghcr.io registry (a92e5ab)
• flake: add nobody to nixbld (d147c9a)
• flake: add platform-conditional overrides set (0072541)
• flake: add pre and postCheck hooks (df86f94)
• flake: add shadow pkg and nixbld group (f06a768)
• flake: add shadow to devPackages (ee01ecc)
• flake: chmod root home after all modifying scripts (c513e2d)
• flake: cleanup default package (659fa4c)
• flake: comment on copying local changes to devcontainer (955632b)
• flake: copy local repo into container (fc833e1)
• flake: disable mkdocs-material wheel for all systems (3690a0b)
• flake: disable branch autoTag and set from env (bac5b01)
• flake: disable grpcio wheel (cf9330c)
• flake: disable pre-commit (71ff4e4)
• flake: enable allRefs when rev is not on default (f1080bf)
• flake: enable github without registry (a7f673f)
• flake: include repo source in devcontainer (1cf7089)
• flake: install shadow on supported systems (bb85336)
• flake: lint and update comments (be54295)
• flake: make root's home writable in development (27042c4)
• flake: minimal dockerTools image (ea18fc7)
• flake: move gnutar to sysPackages (515357d)
• flake: move shadow to sys packages (cbf6010)
• flake: only build env into container (aed0df3)
• flake: qualify devcontainer built with nix2container (62a6bac)
• flake: quote registry name (914f4a9)
• flake: reenable automated layer construction (8d9b181)
• flake: reenable multiarch build (44ff7ef)
• flake: reenable poetryenv with pkg src (24b39ce)
• flake: refactor devcontainer components (4be4c43)
• flake: remove fakeNss from sysPackages (24eae8a)
• flake: remove redundant permission updates (d346ce2)
• flake: remove redundant poetry install (9c33652)
• flake: remove root from nixbld (6aa9ab3)
• flake: replicate devShell in devcontainer (1b1814a)
• flake: set WorkingDir in devcontainerConfig (9babb13)
• flake: set contents in layeredimage (ce10b2f)
• flake: set explicit maxLayers on devcontainerDockerTools (3ff38ed)
• flake: set git meta env vars in images (2595170)
• flake: set global PYTHONPATH (b213aff)
• flake: setup root user once (4189801)
• flake: sync github.repo with devcontainerDockerTools.name (46ca783)
• flake: use flake-parts (ce81875)
• flake: use packageName and gitHubOrg variables (bb94dd4)
• flake: zshrc escape dollar signs with backslash (ffa1c9a)
• flyte: add pkce config template (f1adf59)
• github: add codeowners (52913f4)
• hydra: add clause for detached head state (1d923e9)
• hydra: ignore config outputs folder (0f7b469)
• hydra: ignore multirun outputs (1f14abf)
• hydra: update help config (21f6667)
• ignore config.yaml (108b36a)
• init: lint (7630bee)
• kaniko: point build job to correct repo (1d55fb9)
• labels: update labeler (ddb5ceb)
• lint: line length 80 (83a8d71)
• localctl: create empty config directory (35f958e)
• localctl: note command source (00276c5)
• logging: lint (e800d55)
• logging: rename from logging_utils (59243f0)
• lrwine: add sample inputs for all tasks (3d8fd81)
• lrwine: comment sleep debug in get_data task (831981a)
• lrwine: comments illustrate multiple args (b323c75)
• lrwine: explicitly type Any fields (30a686d)
• lrwine: lint (8a1cf60)
• lrwine: lint (d702a5d)
• lrwine: pretty print parameters to log (a3c8d9e)
• lrwine: remove debug (ac8e842)
• lrwine: remove unnecessary comments (7ff1884)
• lrwine: set cache, retries, and timeout (92510c5)
• lrwine: set default instance of wf inputs (eaa73bc)
• lrwine: switch back to mashumaro (b1d825c)
• lrwine: test LR input (26d6cb2)
• lrwine: toggle cache (af53c23)
• lrwine: toggle use of dataclasses_json (1a608e6)
• lrwine: use -gpu image (aba2351)
• lrwine: use module path in logger name (721408b)
• lrwine: use pb compatible output type (5c05343)
• make/readme: update tree (b122356)
• make: actions debug default false (449b342)
• make: add build targets (c63386f)
• make: add build to local_image target (aaa33ac)
• make: add build workflow (78461bf)
• make: add nix targets (84301b3)
• make: add setup and execution headings (8fc91a1)
• make: add target to find pth files in nix store (bd0f192)
• make: add target to install qemu arm64 (fd2bcf5)
• make: add target to remove local images (daa940a)
• make: add target to run jupyter server in devcontainer [no ci] (aeb6c49)
• make: add workflow name (b8efce6)
• make: add workflow package path (c9c6f22)
• make: add WORKFLOW_IMAGE to ghsecrets (da76b31)
• make: allow impure devcontainer builds (2aa9745)
• make: call cli (6428de8)
• make: comment unused gh vars (ab07ecd)
• make: compose_list also print processes (9e34419)
• make: doc make run with overrides (0a9f284)
• make: exclude site from tree target (d585941)
• make: export pip depends on lock (64623a3)
• make: ignore coverage in tree (2f20e8c)
• make: ignore venv in tree (f6f0c95)
• make: lint (#8) (b337416)
• make: move git metadata local vars to top (fd3ec94)
• make: remove commented gh var set cmds (f73cc5d)
• make: remove unused secret set cmds (1d05c85)
• make: set PAGER=cat for gh list commands (5f51b44)
• make: set run_unregistered from env vars (a1773ea)
• make: simplify test run flags (50914d9)
• make: support hydra cli overrides (d78b98e)
• make: support sha256 digest for image removal (36ebb06)
• make: targets to start devcontainer (2ffd9dc)
• make: update tag_images target doc (8ac771e)
• make: update for explicit modes (6fdb52a)
• make: update gh secrets/vars targets (aaff451)
• make: update gh vars (81f0ea2)
• make: update install_crane target (f8c0fb7)
• make: update local cluster targets (5fea37b)
• make: update mode to execution_context (ccb0799)
• make: update_config (648c816)
• make: use git short sha for image tag (e600479)
• make: use global image tag env (d0a1075)
• make: use poetry shell with cli run commands (427b2d3)
• make: use WORKFLOW_ARGS without flag (74b2166)
• poetry: add dulwich (64a47e9)
• poetry: build venv in project root (ed4a34c)
• pyproject: add plumbum (803fa6c)
• pyproject: add poethepoet to test extras (7620f3f)
• pyproject: appease linter (2941d74)
• pyproject: separate dev deps by category (3f93c64)
• pyproject: separate mkdocstrings-python (ce32246)
• pyproject: update deps (567e3c4)
• pyproject: update lint deps (d57d2ba)
• pyproject: update protobof and pyarrow (3201dac)
• pytest: include xdoctests in pytest runner (19637ff)
• python version string (56bc882)
• readme: add directory tree draft (4b02fa2)
• README: update tree (6b699f6)
• reenable workflow image variable in ci (b615fe2)
• refactor execution utils from execute script (0c2bc7e)
• remove original dockerfile and build script (2dfd69f)
• remove unused containerfile (0cf14e6)
• remove unused requirements file (3936a48)
• remove unused requirements-execute file (45e30e9)
• rename local cluster (7de7675)
• requirements: export from poetry (1b611d8)
• ruff: allow F401 (fix imports) (0f3b93f)
• setup_environment: use poetry groups (fc1a1d9)
• src: gitkeep dir (5ab7052)
• tests: add test_cli (8c86009)
• tests: remove test_main (3c3914a)
• uncomment main.py (fe73bcd)
• update dir tree (3d03e17)
• update execution script (6c3b936)
• vscode: add settings (2c7abab)
• vscode: set default scrollback (c0cdd6b)

Reverts

• Revert "fix(argo): patch GITHUB_REF on PR" (3dc6ba8)
• Revert "debug(CI): disconnect build for debugging" (6fb9f8a)
• Revert "test(build): 200GB storage" (8113a2d)