Skip to content

2021 01 05.devel

Andre Merzky edited this page Jan 5, 2021 · 2 revisions
  • release
    • RP/RU Jan:
      • env isolation
      • unit -> task
        • @aymen: run example
      • Multi-DVM
    • RU:
      • scattered changes, env isolation support
    • RS:
      • small scattered fixes
    • RE:
      • see milestone
      • AM.IP: review tag in current scheduler
  • XSEDE allocation:
    • expires in 3 month
    • most is unused
    • extension makes sense
    • we should focus on leadership machines
    • Shantenu will draft
  • roadmap update for stack
    • expedite:
      • NoDB
    • conda pack: TODO IP, MTi
  • TODO AGENDA:
    • task description
  • termination in function executor
    • TODO AY: commit term queue
    • TODO AM, MTi: discuss verify / prepare
  • ZMQ tests consistently failing (timing uncertainties)
    • TODO MTi, IP
  • TODO Agenda: futures
  • TODO AGENDA RCT
    • data archival
      • where to store raw data
      • archival services for experimental data
    • how long should we keep paper data?
      • different rules, machines, paper relevance ...
      • just assume they live forever
    • only add data into archive which has analysis attached
    • only add data for published papers?
    • Github LFS: 60,-- per 50GB / yr
      • allows to version, annotate, ...
    • Pylon: free
      • unstructured, structure difficult to enforce
    • own server: maintenance, how to host, how to share?
    • TODO ALL: clarify GIT-LFS usage mode
    • TODO ALL: propose gdrive data organisation
    • TODO AGENDA: follow-up
    • TODO AGENDA: discussions
    • GH is not cheap
      • glacier is cheapest
    • data curation is a major issue
      • we need to prescribe structure
    • try with gdrive as cheap reasonable option
    • gdrive allows fuse
      • TODO AM : clean / document Matteo's script
      • TODO MTu: document structure
TODOs
Clone this wiki locally