2019 08 06.devel

• TODO AM: visit October?

  • scheduling
  • virtualenv isolation

• TODO:

  • clean out old group members

• Summit

  • TODO Aymen: to get access (notary)
  • TODO HL: project expired, should get on UCL & Jeroen

• integration testing RM

  • HL: move toward proper integration
  • no HL allocation on many machines :-/
  • TODO AM: clean out resource list

• unit tests

  • focus on schedulers (cont, cont_ordered)

• Python 3

  • delay decision flake8 / pycodestyle
  • TODO AM: fix SAGA examples
  • Python.3 transition for RP progresses

• Releases

  • TODO AM: EnTK will need a hotfix: multiple workflows on same app manager creates conflicts in pipeline IDs
  • TODO AM: pilot failure does not lead to notification
  • TODO AM/MT: resource config from pilot description

• Frontera: full day training session upcoming (Aug. 22nd, focus: MPI)

  • also containers / singularity
  • TODO AM: sync with Jeremy Cohen
  • SJ: masters student incoming, focus containers

• no gsissh client module for Debian anymore

  • TODO AM: XSEDE ticket
  • TODO AM: check with ANL

• Discussion: co-location of tasks via core pinning / new scheduler

  • app scheduling and pinning
  • labeled scheduler (preferred)
    • TODO AM: prototype, iterate with users
  • bundle in a single unit

• Discussion: mlab replacement, rmq setup

  • create MDB per user, Matteo created script for that
  • heavy users: move out to Jetstream
  • TODO AM: check with Srinivas
  • TODO MT: create DB for Lucas