-
Notifications
You must be signed in to change notification settings - Fork 23
2021 01 05.devel
Andre Merzky edited this page Jan 5, 2021
·
2 revisions
- release
- RP/RU Jan:
- env isolation
- unit -> task
- @aymen: run example
- Multi-DVM
- RU:
- scattered changes, env isolation support
- RS:
- small scattered fixes
- RE:
- see milestone
- AM.IP: review tag in current scheduler
- RP/RU Jan:
- XSEDE allocation:
- expires in 3 month
- most is unused
- extension makes sense
- we should focus on leadership machines
- Shantenu will draft
- roadmap update for stack
- expedite:
- NoDB
- conda pack: TODO IP, MTi
- expedite:
- TODO AGENDA:
- task description
- termination in function executor
- TODO AY: commit term queue
- TODO AM, MTi: discuss
verify
/prepare
- ZMQ tests consistently failing (timing uncertainties)
- TODO MTi, IP
- TODO Agenda: futures
- TODO AGENDA RCT
- data archival
- where to store raw data
- archival services for experimental data
- how long should we keep paper data?
- different rules, machines, paper relevance ...
- just assume they live forever
- only add data into archive which has analysis attached
- only add data for published papers?
- Github LFS: 60,-- per 50GB / yr
- allows to version, annotate, ...
- Pylon: free
- unstructured, structure difficult to enforce
- own server: maintenance, how to host, how to share?
- TODO ALL: clarify GIT-LFS usage mode
- TODO ALL: propose gdrive data organisation
- TODO AGENDA: follow-up
- TODO AGENDA: discussions
- GH is not cheap
- glacier is cheapest
- data curation is a major issue
- we need to prescribe structure
- try with gdrive as cheap reasonable option
- gdrive allows fuse
- TODO AM : clean / document Matteo's script
- TODO MTu: document structure
- data archival