Authors: James L. McDonagh, Michael Johnston, Vassilis Vassiliadis, Dmitry Zubarev and Hsiang Han Hsu
Virtual experiment to estimate lambda max. using DFT and Semi-Empirical methods followed by a TD-DFT step on the optimized geometry. Calculations use GAMESS-US
- Getting started
- Experiment Inputs
- Experiment Outputs
- Handling Errors
- Computational Details
- Development
- Help and Support
- Contributing
- License
- Get access to an environment hosting a deployment of the Simulation Toolkit for Scientific Discovery (ST4SD).
- Add the experiments to your ST4SD deployment using these instructions or check the ST4SD experiment registry for other pre-configured variants of the experiments the developers have created.
- See here for the specific inputs these experiments require
- See here for general information on running and interacting with virtual-experiments
This will add a basic parameterised package for the Semi-Empirical experiment called excitation-energy-pm6-gamess-us
api.api_experiment_push({"metadata": {"package": {"name": "excitation-energy-pm6-gamess-us", "tags": ["latest", "1.0.0"], "maintainer": "https://github.com/michael-johnston", "license": "Apache 2.0", "description": "Uses semi the PM6 semi empirical method to perform geometry optimization and calculate the band-gap and related properties. This is followed by a TD-DFT calculation to calculate the excitation energy. The calculation is performed with GAMESS-US. Functional/Basis-Set for both calculations are PM6 method: B3LYP/KTZVP + D3. Number of states for TD-DFT is 10.", "keywords": ["smiles", "computational chemistry", "semi-empirical", "td-dft", "homo", "lumo", "band-gap", "excitation-energy", "electric-moments", "oscillator-strength", "gamess-us"]}}, "base": {"packages": [{"source": {"git": {"location": {"url": "https://github.com/st4sd/excitation-energy-gamess.git", "commit": "2a2dddbf5b95c9d657605d163eec5f02e5f489ad"}}}, "config": {"manifestPath": "semi-empirical/manifest.yaml", "path": "semi-empirical/excitation-energy-se-gamess-us.yaml"}}]}, "parameterisation": {"presets": {"runtime": {"args": ["--failSafeDelays=no", "--registerWorkflow=yes"]}}, "executionOptions": {"variables": [{"name": "numberMolecules"}, {"name": "startIndex"}, {"name": "gamess-number-processors"}, {"name": "gamess-memory"}, {"name": "gamess-walltime-minutes"}, {"name": "gamess-grace-period-seconds"}], "platform": ["openshift", "openshift-kubeflux"]}}})
This will add a basic parameterised package for the DFT experiment called excitation-energy-dft-gamess-us
api.api_experiment_push({"metadata": {"package": {"name": "excitation-energy-dft-gamess-us", "tags": ["latest", "1.0.0"], "maintainer": "https://github.com/michael-johnston", "license": "Apache 2.0", "description": "Uses DFT to perform geometry optimization and calculate the band-gap and related properties. This is followed by a TD-DFT calculation to calculate the excitation energy. The calculation is performed with GAMESS-US. Functional/Basis-Set for both calculations are Default method: B3LYP/KTZVP. Number of states for TD-DFT is 10.", "keywords": ["smiles", "computational chemistry", "dft", "td-dft", "homo", "lumo", "band-gap", "excitation-energy", "electric-moments", "oscillator-strength", "gamess-us"]}}, "base": {"packages": [{"source": {"git": {"location": {"url": "https://github.com/st4sd/excitation-energy-gamess.git", "commit": "2a2dddbf5b95c9d657605d163eec5f02e5f489ad"}}}, "config": {"manifestPath": "dft/manifest.yaml", "path": "dft/excitation-energy-dft-gamess-us.yaml"}}]}, "parameterisation": {"presets": {"runtime": {"args": ["--failSafeDelays=no", "--registerWorkflow=yes"]}}, "executionOptions": {"variables": [{"name": "numberMolecules"}, {"name": "startIndex"}, {"name": "gamess-number-processors"}, {"name": "gamess-memory"}, {"name": "gamess-walltime-minutes"}, {"name": "gamess-grace-period-seconds"}], "platform": ["openshift", "openshift-kubeflux"]}}})
You can create your own parameterised packages for these experiments. See here for more information about how to do this. This repo contains files with the above json in easy to edit form you can use as a basis.
Both experiments require an input CSV file, called input_smiles.csv
, with columns label
and smiles
. The label column should contain unique integers (e.g. the row number). The smiles
column should contain the SMILE representation of the input molecules. The file can contain other columns - these will be ignored.
Example:
label,smiles
0,O=S(=O)([O-])c1c(C(F)(F)F)cc(C(F)(F)F)cc1C(F)(F)F.Cc1cc(OC(C)(C)C)cc(C)c1[S+](c1ccccc1)c1ccccc1
1,O=S(=O)([O-])c1ccc(C(F)(F)F)cc1C(F)(F)F.Cc1ccc([S+](c2ccccc2)c2ccccc2)c(C)c1
An example payload for both experiments can be created as follows:
smiles_data = pd.read_csv('smiles_data.csv')[['label', 'SMILES']]
payload = {
"inputs": [{
"content": smiles_data.to_csv(index=False),
"filename": "input_smiles.csv"
}]
}
Note: When you submit the input_smiles.csv
content directly in the payload as in this example, that content can come from a file with any name - here it was smiles_data.csv
.
By default, the experiment will just measure the first molecule in this file. You can specify a range of molecules to measure using the startIndex
and numberMolecules
variables.
payload = {
"variables": {
"startIndex": 0, #Start at the first molecule in the input file
"numberMolecules": 2, #Choose two molecules to measure
},
"inputs": [{
"content": smiles_data.to_csv(index=False),
"filename": "input_smiles.csv"
}]
}
See here for general information on running virtual-experiments.
Both experiments have an interface which allows easy retrieval of the properties they measure. You can see the interface in your ST4SD registry UI when you add one of the experiments (or if you examine other pre-configured packages based on these experiments in the global ST4SD experiment registry)
See here for more information on accessing the outputs of an experiment run
The experiment has two key outputs called OptimisationResults
and TDDFTResults
.
OptimisationResults
provides the various HOMO, LUMO, and band-gap energies of the molecules.
To retrieve
path, contents = api.api_rest_uid_output(rest_uid, "OptimisationResults")
print(contents.decode('utf-8'))
TDDFTResults
provides the Koopman's energy, excitation energy in electron volts, and maximum oscillator strength
To retrieve
path, contents = api.api_rest_uid_output(rest_uid, "TDDFTResults")
print(contents.decode('utf-8'))
If the run processed 2 molecules this could print:
label,koopmans,excitation-energy,osc-str-max
0,-10.667,13.124,0.4152
1,-13.87,24.366,0.4252
If the calculation failed for any of the molecules its entries for energetic quantities in this file with be populated with N/A
(see Errors for more details)
There are various errors that can occur during the calculation that prevent the experiment from completing. The common places to check should an error occur, or you suspect an error has occurred are:
-
stage0.SMILESToGAMESSInput
-
Problem: Workflow shutdown on
SMILESToGAMESSInput
component -
Symptoms:
- The experiment will finish extremely quickly, typically with an error state referring to a known issue in
SMILESToGAMESSInput
For example:1 jobs failed unexpectedly. Job: stage0.SMILESToGAMESSInput1. Returncode 1. Reason KnownIssue
- Can also occur with an unknown error in
SMILESToGAMESSInput
- The experiment will finish extremely quickly, typically with an error state referring to a known issue in
-
Things to check
- Check the log file
out.stdout
instage1.SMILESToGAMESSInput$N
(see Computational Details)). The most likely cause will be a mistake in the SMILES input string. Under the hood RDKit is used to generate 3D structures from each SMILES string followed by a force field optimization. if either of these fail this error can occur. The most common error here is a typo in the SMILES string. We suggest that the user tries to visualize the SMILES string for example using smarts.plus.
- Check the log file
-
-
stage1.GeometryOptimisation
-
Problem: Inability to optimize structure
-
Symptoms:
- The experiment will take considerably longer than expected.
- The experiment reports success but has a
stage-state
ofcomponent_shutdown
- The workflow ends successfully but some homo-lumo energies are missing from the
OptimisationResults
or properties table (instead there appearN\A
). . - The log file reports restart failed - where possible in this case a reason will be given
-
Explanation and things to check
- Once the GAMESS component (
GeometryOptimisation
) finishes its output is checked by thestage1.ExtractEnergies
component. This decides, based on the output file contents, if a successful run is made. As a default if there is some data to report the output is marked as successful, theExtractEnergies
component exits with success and the experiment continues. This can lead to a failure at a later stage related to the optimization itself. A common reason for GAMESS failures can be issues writing to disk. A first check should be to make sure the complete output exists inout.stdout
and inmolecule.dat
in theGeometryOptimisation
component for the failed molecule (molecule.dat
is used to restart with the latest orbitals and coefficients).
- Once the GAMESS component (
-
The computation uses GAMESS version 01. Briefly the calculation consists of:
- RDKit parsing SMILES strings and generating 3D geometries (
stage0.SMILESToGAMESSInput
) - Setting of appropriate GAMESS variables (
stage0.SetBasis
,stage0.SetFunctional
) - GAMESS geometry optimization (
stage1.GeometryOptimisation
) - GAMESS output file parsing (
stage1.ExtractEnergies
andstage2.ExtractEnergies
) - Output generated to summarize the energy terms (
stage1.ExtractEnergies
,stage2.ExtractEnergies
, andstage2.ProcessTDDFTOutput
)
The identifiers of the workflow components performing each step are given in brackets. These can be used to the various api.cdb_*
calls to find out more information about these components
For those with knowledge of GAMESS the options set can be found in semi-empirical/data-semi-empirical/input_molecule.txt
. The walltime for the calculation is 1hour. If it is hit the calculation is restarted if suitable data can be found in the molecule.dat
file under the working directory of the GeometryOptimisation
component.
A single conformer of the input SMILES string is selected as the lowest energy conformer from 50 generated structures which are minimized by the UFF force field implemented in RDKit
GAMESS does not indicate success/failure of the calculation via its exit-code. When the calculation is completed its consistency is checked by the ExtractEnergies
component in stages 1 and 2. To check the outputs of this for all molecules in the list of SMILES submitted use:
api.cdb_get_components_last_stdout(instance_uri=m['instance'], component='ExtractEnergies', stage=1)
Note: Set stage
to 2 to check whether there was a problem with the stage2.TDDFTCalculation
.
To check the stdout of the GAMESS geometry optimisation for e.g. the first molecule in the list submitted use:
api.cdb_get_components_last_stdout(instance_uri=m['instance'], component='GeometryOptimisation0', stage=1)
To check the GAMESS output of the Nth
molecule substitute N
for $N
above.
- Fork this repository. You will find 2 virtual experiments in this repository. One that uses DFT methods and a second one that uses Semi-Empirical methods.
- Modify the code
- Push your code to your forked GitHub repository. Then follow the getting started instructions above.
Note: Remember to update your parameterised package
payload so that it points to your forked GitHub repository.
Please feel free to reach out to one of the maintainers listed in the MAINTAINERS.md page.
We always welcome external contributions. Please see our guidance for details on how to do so.
This project is licensed under the Apache 2.0 license. Please see details here.