Skip to content

Latest commit

 

History

History
63 lines (49 loc) · 3.3 KB

index.md

File metadata and controls

63 lines (49 loc) · 3.3 KB

Final Report | Installation | How it Works | How to use | Code

Google Summer of Code 2018

This project is co-mentored by CERN-HSF and Imperial College, London for Google Summer of Code 2018.

Index

Mentors

  • Ulrik Egede
  • Jakub Moscicki
  • Diogo Castro
  • Enric Tejedor
  • Ben Jones

Introduction

Jupyter Notebook is an interactive computing environment that creates notebooks which contains computer code as well as rich text elements like equations, figures, plots, widgets and theory. Ganga is an open source iPython based interface tool to the computing grid which leverage the power of distributed computing grid and provide scientists an interface supported by a powerful backend where they can submit their computation intensive programs to Ganga as a batch job. HTCondor is a workload management system created by University of Wisconsin-Madison. It is based on High-Throughput Computing which effectively utilizes the computing power of idle computers on a network or on a computing grid and offload computing intensive tasks on the idle machines available on a network or computing grid. This project implements an extension for Jupyter Notebook and also integrate it to SWAN Notebook service which is a cloud data analysis service developed and powered by CERN. This extension easily submits and monitor computation jobs to HTCondor using Ganga toolkit inside Notebook. The frontend extension displays status of ongoing job in Notebook itself and also allow termination of ongoing jobs. The Ganga Tab in Jupyter Tree view displays information and status of all Ganga Jobs.

Features

  • Ganga Cell Magic for creating new Ganga Jobs.
  • Frontend widget to show Job information and status.
  • Ganga Tab to show information and status of all Ganga Jobs.

Documentation

Gallery

Submitting Jobs

submitting

Resubmitting Failed Jobs

resubmit

Ganga tree tab

treetab

Future Work

  • Pending Work
    • Provide option to create Job Script in notebook itself.
  • Future Ideas
    • Implementing the extension for JupyterLab.

Useful Links