Docswiki - User contributions [en]

DISCOTRESS

2021-09-29T10:37:41Z

Djs244:

'''DISCOTRESS''' is a C++ program to simulate and analyze the dynamics on kinetic transition networks, beyond the functionality provided in [[PATHSAMPLE]]. '''DISCOTRESS''' is written and maintained by Daniel J. Sharpe, and can be found [https://github.com/danieljsharpe/DISCOTRESS here].

==Functionality==

'''DISCOTRESS''' contains implementations of state-of-the-art algorithms to robustly and efficiently perform quantitative analyses of a kinetic network. Some recommended functionality that is very powerful for gaining a detailed understanding of your kinetic network is as follows:

* simulate trajectories by kinetic path sampling, thereby sampling the first passage time distribution and obtaining a numerical estimate for the time-dependent occupation probability distribution of macrostates

* calculate the probability of visiting states on a direct transition path between two endpoint states

* calculate the committor probabilities for all nodes of the network (and hence analyze the network by equilibrium or nonequilibrium transition path theory)

* decompose the ensemble of first passage paths into a finite set of flux-paths and their associated contributions to the net productive flux

==Getting Started==

'''DISCOTRESS''' has its own system of input files, so first you will need to convert your kinetic network database from '''PATHSAMPLE''' format (''min.data'', ''ts.data''). You will need to construct the following 3 files:

* ''edge_conns.dat'' - two-column file containing a list of connections, can be extracted straightforwardly as the corresponding columns of ''ts.data''

* ''edge_weights.dat'' - two-column file containing the natural log of transition rates corresponding to the entries in ''edge_conns.dat''. You will need to dump these data from '''PATHSAMPLE''' (Fortran script available)

* ''stat_prob.dat'' - single-column file containing the natural log of stationary probabilities of nodes in the network. You will need to dump these data, which are directly related to the energies of minima, from '''PATHSAMPLE''' (Fortran script available).

Further information on these '''DISCOTRESS''' input files and others, including the ''input.kmc'' file of keywords, is available [https://github.com/danieljsharpe/DISCOTRESS/blob/master/documentation.md here].

Further helpful scripts to analyze the output of '''DISCOTRESS''' are available [https://github.com/danieljsharpe/DISCOTRESS_tools here].

==Analyzing your database==

The routines that are implemented in DISCOTRESS allow for numerous detailed analyses of kinetic networks that are not possible by conventional methods. You may wish to conduct a particular analysis to complement your initial report of the database and validate your qualitative observations based on the topology of the energy landscape. Alternatively, you may wish to conduct an extensive quantitative analysis of a database that you have constructed in a separate report. Using DISCOTRESS, you can e.g. find the key transition paths that facilitate the productive transition between endpoint states (by shortest paths analysis, transition path theory, or simulation of trajectories) and identify the key states that mediate these pathways (by calculating reactive visitation probabilities, committor probabilities, etc.)

A presentation ("Sharpe - Recent advances in the numerical analysis of finite Markov chains") describing the quantitative methods is available in the "AVT presentations" folder of the Wales group google drive [https://drive.google.com/drive/u/0/folders/0ByQUHkoP5DEnOVhUR3RzTUQyWmc?resourcekey=0-zfSotsYqPBhxA3KZPiuuDg here].

==Tutorials==

Tutorials are available [https://github.com/danieljsharpe/DISCOTRESS_tutorials here].

==FAQs==

Answers to some FAQs are available [https://github.com/danieljsharpe/DISCOTRESS/blob/master/FAQs.md here].

Comprehensive Contents Page

2021-07-01T11:40:16Z

Djs244: /* DISCOTRESS */

This page is designed to organise all of the pages on this wiki, as well as provide other useful links. Note that some pages may appear under more than one heading.

== Getting Started ==
[[Wales Group]] provides good step-by-step instructions. Relevant pages are:

=== Acquiring and compiling the group software ===
* [[SVN setup]]
* [[Git Workflow]]
* [[Wales Group Version control]] - to keep the code standardised.
* Theory Sector [http://wwmm.ch.cam.ac.uk/wikis/cuc3/index.php/SVN_Page SVN Page] - some useful general information on SVN commands.
* [[Compiling Wales Group codes using cmake]] - CMake (Cross-platform Make) allows us to compile and test the group codebase regardless of platform. This page provides crucial information how to compile using cmake.
* [[ElaborateDiff]]

=== Maintaining code health ===
* [[Jenkins CI]] - explains Jenkins, which we use to download our code and compile each of our targets with each of the compilers every night.
* https://wales-jenkins.ch.cam.ac.uk/ - log for our Jenkins tests.
* [[Branching and Merging]]
* [[Cmake interface building]]
* [[Installing python modules]]
* [[Revamping the modules system]]

=== Collaborators without access to the SVN repository ===
For licensing reasons, some code cannot be included in the Wales Group public tarball.
* http://www-wales.ch.cam.ac.uk/svn.tar.bz2 - Wales group public tarball. Includes [[GMIN]], [[OPTIM]] and [[PATHSAMPLE]].
If a collaborator has a [[CHARMM]] or [[AMBER]] licence, we do maintain separate tarballs which include the [[CHARMM]], [[AMBER]] and [[CHARMM]]+[[AMBER]] source and interfaces. These are not linked anywhere on the website and require a username ('''wales''') and password ('''group''') to download:

* [http://www-wales.ch.cam.ac.uk/CHARMM/svn.CHARMM.tar.bz2 CHARMM]
* [http://www-wales.ch.cam.ac.uk/AMBER/svn.AMBER.tar.bz2 AMBER]
* [http://www-wales.ch.cam.ac.uk/both/svn.both.tar.bz2 AMBER+CHARMM]

=== Running on Windows ===
Not particularly recommended.
* [[Running Wales Group software on Windows 7]]

== Wales Group Programs ==

=== Programs ===
* [[GMIN]]: A program for finding global minima and calculating thermodynamic properties from basin-sampling.
* [[OPTIM]]: A program for optimizing geometries and calculating reaction pathways.
* [[PATHSAMPLE]]: A driver for OPTIM to create stationary point databases using discrete path sampling and perform kinetic analysis.
* [[Pele]]: Python energy landscape explorer. A pythonic rewrite of some core functionality of GMIN, OPTIM, and PATHSAMPLE. Can be very useful for visualizing your system and for rapidly implementing and testing new ideas.
* [[DISCOTRESS]]: A program to perform detailed quantitative analysis of a kinetic network (stationary point database)

=== Curated Examples ===
* https://github.com/wales-group/examples - set of tutorials detailing how to use GMIN, OPTIM and PATHSAMPLE. Essential for beginners.
* http://www-wales.ch.cam.ac.uk/VM/Wales_Group_VM.ova - Pre-prepared teaching virtual machine. This contains the code and examples.
* https://www.virtualbox.org/wiki/Downloads - This is required if using the VM above.
* https://github.com/wales-group/examples.git - Alternatively, you can run the examples on your own machine. To get hold of the relevant files:
<pre>
git clone https://github.com/wales-group/examples.git
</pre>

== Useful Notes on Wales Group Programs and Subroutines ==
=== [[GMIN]] ===
* [[Adding a model to GMIN]] - rough outline of the subroutines that need to be changed to add a new model to GMIN
* [[Compiling Wales Group codes using cmake | Compiling GMIN using cmake ]]
* [[Selecting search parameters for GMIN]]
* [[Global optimization of biomolecules using CHARMM]]
* [[Global optimization of biomolecules using AMBER9]]
* [[Global optimization of biomolecules using AMBER9 with Structural Restraints]]
* [[Calculating binding free energy using the FSA method]]
* [[Restarting a GMIN run from a dump file]]
* [[Using the implicit membrane model IMM1]]
* [[Running a Go model with the AMHGMIN]]
* [[Running a G\=o model with the AMHGMIN]]
* [[Ligand binding-mode searches with HBONDMATRIX]]
* [[Compiling and using GMIN with QUIP]]
* [[Using GMIN and OPTIM with GPUs]]
* [[Using GMIN to generate endpoints]]
* [[Using GMIN to generate endpoints (CHARMM)]]
* [[Generating a GMIN Eclipse project]]
* [[Mutational BH steps]]
* [[Biomolecules in the energy landscape framework]]
* [[DMAGMIN setup]]
* [[Keywords]]
* [[PYGMIN & DMACRYS]]
* [[Rotamer moves in AMBER]]
* [[Python interface for GMIN/OPTIM]]

==== Scripts ====
* [[makerestart]]: A bash script to automatically set up a GMIN restart run
* [[progress]] A bash script to tell you the % completion of a GMIN job and give an estimated time remaining

==== Useful info for coding GMIN ====
* [[Program flow]] - contains information about what the various files in GMIN do and what order they're called.
* [[amberinterface]]

==== Projects ====
* [[GMIN MOVES module]]
* [[GMIN SANITY module]]
* [[GMIN TESTS module]]
* [[CAMSHIFT]]

=== [[OPTIM]] ===
* [[Adding a model to OPTIM]] - rough outline of the subrounties that need to be changed to add a new model to OPTIM
* [[Adding partially finished OPTIM stationary points to a PATHSAMPLE database]]
* [[perm-pdb.py]]: A python program that creates a ''perm.allow'' file for use with [[OPTIM]] and [[PATHSAMPLE]].
* [[visualising normal modes using VMD and OPTIM]]
* [[Compiling Wales Group codes using cmake | Compiling OPTIM using cmake ]]
* [[OPTIM/Q-Chem Tutorial]]
* [[OPTIM and PY ellipsoids tutorial]]
* [[OPTIM output files]]
* [[Minimizing a structure using OPTIM and AMBER9]]
* [[Minimizing a structure using OPTIM and CHARMM]]
* [[Creating movies (.mpg) of paths using OPTIM]]
* [[Performing a normal mode analysis of a biomolecule using OPTIM (AMBER and CHARMM)]]
* [[Debugging odd transition states in OPTIM]]
* [[Connecting two minima with a pathway]] - step by step
* [[Compiling and using OPTIM with QUIP]]
* [[Running an Gaussian03 interfaced OPTIM job]]
* [[The effect of calculating less than the maximum number of eigenvalues using ENDHESS n]]
* [[Biomolecules in the energy landscape framework]]
* [[BLJ60 example setup]]
* [[Finding an initial path with OPTIM and starting up PATHSAMPLE]]
* [[Finding an initial path with OPTIM and starting up PATHSAMPLE (CHARMM)]]
* [[Python interface for GMIN/OPTIM]]
* [[Thomson problem in OPTIM]]
* [[Instanton tunneling and classical rate calculations with OPTIM]]
* [[Loading OPTIM's min.data.info files into PATHSAMPLE]]
* [[common setup problem : No Frequency Warning]]

=== [[PATHSAMPLE]] ===
* [[Adding a model to PATHSAMPLE]] - rough outline of the subrounties that need to be changed to add a new model to PATHSAMPLE
* [[Alternatively, making the initial path with PATHSAMPLE itself]]
* [[Alternatively, making the initial path with PATHSAMPLE itself (CHARMM)]]
* [[perm-pdb.py]]: A python program that creates a ''perm.allow'' file for use with [[OPTIM]] and [[PATHSAMPLE]].
* [[dijkstra_test.py]]: A python script to test whether the information in pairlist and ts.data connects the A and B set. (If not, PATHSAMPLE will not work without actually exiting.)
* [[Compiling Wales Group codes using cmake | Compiling PATHSAMPLE using cmake ]]
* [[IMPORTANT: Using PATHSAMPLE safely on sinister]]
* [[Adding a model for PATHSAMPLE]]
* [[List of output files for PATHSAMPLE]]
* [[Using BHINTERP to find minima between two end points]]
* [[Finding an initial path between two end points (minima)]]
* [[Adding partially finished OPTIM stationary points to a PATHSAMPLE database]]
* [[Optimising a path]]
* [[Fine tuning UNTRAP]] - ensuring that it picks sensible minima
* [[Calculating rate constants (GT and fastest path)]]
* [[Calculating rate constants (SGT, DGT, and SDGT)]]
* [[Identifying the k fastest paths between endpoints using KSHORTESTPATHS]]
* [[Removing minima and transition states from the database]]
* [[Relaxing existing minima with new potential and creating new database]]
* [[Relaxing existing transition states with new potential and creating new database]]
* [[If things go wrong...]]
* [[If you lost file min.data, but still you have points.min]]
* [[path.info file is not read, causes PATHSAMPLE to die]]
* [[BLJ60 example setup]]
* [[When PATHSAMPLE finds a connected path, but using DIJKSTRA 0 fails to find the connected path]]
* [[Biomolecules in PATHSAMPLE]]
* [[Biomolecules in the energy landscape framework]]
* [[Expanding the kinetic transition network with PATHSAMPLE]]
* [[Expanding the kinetic transition network with PATHSAMPLE (CHARMM)]]
* [[Finding an initial path with OPTIM and starting up PATHSAMPLE]]
* [[Finding an initial path with OPTIM and starting up PATHSAMPLE (CHARMM)]]
* [[Pathsampling short paths]]
* [[Pathsampling short paths (CHARMM)]]
* [[Loading OPTIM's min.data.info files into PATHSAMPLE]]
* [[Connecting Sub-databases]]
* [[CHECKSPMUTATE]]: An extension of CHECKSPODATA which allows for a protein to be mutated or transformed into a homologue.
* [[Pathway Gap Filling Post-CHECKSPMUTATE]]: Post-processing following CHECKSPMUTATE
* [[STARTING INITIAL PATH JOBS WITH PATHSAMPLE]]: How to start initial path jobs with PATHSAMPLE if no min.data or path.info files are present.

=== [[Notes on MINPERMDIST | MINPERMDIST]] ===

=== [[Quasi-continuous interpolation for biomolecules | QCI]] ===

=== [[DISCOTRESS | Detailed kinetic network analysis with DISCOTRESS]] ===

== Non-Group Software ==

=== [[AMBER]] ===
Molecular dynamics simulation program and associated force fields.
* [http://ambermd.org/ AMBER]
* [http://ambermd.org/tutorials/ AMBER tutorials] - recommended reading for '''ANYONE''' using AMBER!
* [[Notes on AMBER 12 interface]]
* [[Using AMBER 14 on the GPU and compute clusters]]
* [[Generating parameters using AMBER's built in General Forcefield (gaff)]]
* [[Generating parameters using RESP charges from GAMESS-US]]
* [[Simple scripts for LEaP to create topology and coordinate files]]
* [[Preparing an AMBER topology file for a protein system]] - step by step guide
* [[Setting up]] - step by step guide to prepare and then symmetrise a simple (protein-only) system
* [[Using Molfacture to edit molecules and add hydrogens]]
* [[Preparing an AMBER topology file for a protein plus ligand system]] - step by step guide
* [[Symmetrising AMBER topology files]] - step by step guide for symmetrising a complex protein+ligand system
* [[Producing a PDB from a coordinates and topology file]] - using ''amdpdb''
* [[Running GMIN with MD move steps AMBER]]
* [[Performing a normal mode analysis of a biomolecule using OPTIM (AMBER and CHARMM)]]
* [[Evaluating different components of AMBER energy function with SANDER]]
* [[Mutational BH steps]]
* [[CHECKSPMUTATE]]: An extension of CHECKSPODATA which allows for a protein to be mutated or transformed into a homologue.
* [[Pathway Gap Filling Post-CHECKSPMUTATE]]: Post-processing following CHECKSPMUTATE
* [[REMD with AMBER]]
* [[Performing a hydrogen-bond analysis]]
* [[Alternatively, making the initial path with PATHSAMPLE itself]]
* [[Biomolecules in the energy landscape framework]]
* [[perm-prmtop.py]] - A python program that converts an AMBER9 topology file into one with a symmetrised potential with respect to exchange (updated for AMBER12 and ff14SB).
* [[Rotamer moves in AMBER]]
* [[Creating mismatched DNA duplex using NAB]]

=== [[aux2bib]] ===
To generate a bib file containing only the entries cited in a given .tex file from a larger bib or multiple bib files.
* [https://ctan.org/pkg/bibtools Get script here]

=== [[CamCasp]] ===
Cambridge package for Calculation of Anisotropic Site Properties
From Anthony Stone's website: 'CamCASP is a collection of scripts and programs written by Dr Alston Misquitta and myself for the calculation ab initio of distributed multipoles, polarizabilities, dispersion coefficients and repulsion parameters for individual molecules, and interaction energies between pairs of molecules using SAPT(DFT).'
* [http://www-stone.ch.cam.ac.uk/programs.html CamCASP home]
* [[CamCASP/Programming]]
* [[CamCASP/Programming/5/example1]]
* [[CamCASP/Notes]]
* [[CamCASP/Bugs]]
* [[CamCASP/ToDo/diskIO]]
* [[CamCASP/ToDo/Memory]]
* [[CamCASP/CodeExamples/DirectAccess]]

=== [[CPMD]] ===
Implementation of DFT for ''ab-initio'' molecular dynamics.
* [http://www.cpmd.org/ Home Page]
* [[CPMDInput]]

=== [[CHARMM]] ===
Molecular dynamics simulation program and associated force fields.
* [https://www.charmm.org/charmm/?CFID=65f7b3aa-8037-452a-bcd1-7583dd83a087&CFTOKEN=0 CHARMM]
* [[Generating pdb, crd and psf for a peptide sequence]]
* [[Converting between '.crd' and '.pdb']]
* [[Calculating energy of a conformation]]
* [[Calculating molecular properties]]
* [[Calculating order parameters]]
* [[CAMSHIFT]]
* [[Setting up (CHARMM)]] - step by step guide to prepare and then symmetrise a simple (protein-only) system
* [[If you need to change the number of atoms (e.g. making a united-atom charmm19 .crd file, or if atoms are missing)]]
* [[Performing a normal mode analysis of a biomolecule using OPTIM (AMBER and CHARMM)]]
* [[Minimizing a structure using OPTIM and CHARMM]]
* [[Alternatively, making the initial path with PATHSAMPLE itself (CHARMM)]]
* [[Expanding the kinetic transition network with PATHSAMPLE (CHARMM)]]
* [[Finding an initial path with OPTIM and starting up PATHSAMPLE (CHARMM)]]
* [[Pathsampling short paths (CHARMM)]]

=== [[disconnectionDPS]] ===
Produces disconnectivity graphs from min.data and ts.data files. This is included in the Wales group public tarball.
* [[Constructing Free Energy Disconnectivity Graphs]]

=== [[DMACRYS]] ===
Package which models crystals of rigid molecules.
* [http://www.chem.ucl.ac.uk/cposs/dmacrys/index.html Home Page]
* [[DMACRYS interface]]
* [[DMAGMIN setup]]
* [[PYGMIN & DMACRYS]]

=== [[GAMESS]] ===
General ''ab initio'' quantum chemistry package.
* [https://www.msg.chem.iastate.edu/gamess/ GAMESS]

=== [[Gaussian]] ===
General purpose package for computational chemistry calculations.
* [[Running an Gaussian03 interfaced OPTIM job]]

=== [[gnuplot]] ===
Open source graphing program.
* [http://www.gnuplot.info/ gnuplot]
* [[Plotting a quick histogram in gnuplot using the raw data]]
* [[Plotting data in real time]]
* [[Linear and non-linear regression in gnuplot]]

=== [[GROMACS]] ===
Molecular dynamics package.
* [[Installing GROMACS on Clust]]
* [http://www.mdtutorials.com/gmx/ External tutorials]
* [http://www.gromacs.org/Documentation/Tutorials More external tutorials]

=== [[HiRE-RNA]] ===
High-res course-grained energy model for RNA.
* [https://pubs.acs.org/doi/10.1021/jp102497y Explanatory Paper]

=== [[latex2html]] ===
Script which converts latex documents into HTML pages.
* [https://www.latex2html.org/ Get script here]

=== [[MMTSB-toolset]] ===
Group of perl scripts which can be used to setup and run energy minimization, structural analysis and MD with CHARMM or AMBER.
* [http://feig.bch.msu.edu/mmtsb/Main_Page Documentation]
* [http://www.mmtsb.org/workshops/mmtsb-ctbp_2006/Tutorials/WorkshopTutorials_2006.html External tutorials]
* [[Installing and setting up the MMTSB toolset]]
* [[REX (Replica EXchange MD) with the MMTSB-toolset]]

=== [[Simulations using OPEP | OPEP]] ===
OPEP is a coarse-grained force field providing a potential for proteins and RNA.
* [http://opep.galaxy.ibpc.fr/ OPEP file generator here]
* [[Biomolecules in the energy landscape framework]]

=== [[pgprof]] ===
Profiler for portland-compiled codes
* [[Portland compiler fails trying to allocate an unexpectedly large amount of memory: issue with large arrays]]

=== [[Pymol]] ===
Molecular visualisation program.
* [https://pymol.org/2/ PyMOL]
* [https://pymolwiki.org/index.php/Main_Page PyMOL Community Wiki]
* [[loading AMBER prmtop and inpcrd files into Pymol]]
* [[producing sexy ray-traced images]]
* [[advanced colouring]]
* [[Installing python modules]]
* [[PYGMIN & DMACRYS]]
* [[path2pdb.py]] - A python program to convert ''path.info'' to ''path_all.pdb'' - you can easy visualize your path in VMD :)
* [[extractedmin2pdb.py]]: A python program to convert ''exctractedmin'' to PDB format
=== [[VASP]] ===
OPTIM has an interface to VASP, which is installed on CSD3. In collaboration with Bora Karasulu the interface has been updated to use VASP format POSCAR input files for both single- and double-ended optimisations and path searches. The OPTIM odata file requires a line like

VASP 'mpirun -ppn 16 -np 16 /home/bk393/APPS/vasp.5.4.4/with-VTST/bin/vasp_std > vasp.out'

POSCAR files can be visualised using ase, the Atomic Simulation Environment, which can be accessed on volkhan via

module load anaconda/python3/5.3.0

pip install ase --user

ase-gui POSCAR1.vasp &

which assumes that ~/.input/bin is in your $PATH environment variable.

=== [[VMD]] ===
Molecular visualisation program.
* [http://www.ks.uiuc.edu/Research/vmd/current/ug/ug.html Documentation]
* [http://www.ks.uiuc.edu/Training/Tutorials/vmd/tutorial-html/index.html External tutorials]
* [[using VMD to display and manipulate '.pdb' files]]
* [[loading coordinate files into VMD with the help of an AMBER topology file]] e.g. to visualise the results of a GMIN run using AMBER9
* [[visualising normal modes using VMD and OPTIM]]
* [[path2pdb.py]]: A python program to convert ''path.info'' to ''path_all.pdb'' - you can easy visualize your path in VMD :)
* [[path2xyz.py]]: A python program to convert ''path.info'' to ''path_all.xyz''
* [[extractedmin2pdb.py]]: A python program to convert ''exctractedmin'' to PDB format
* [[Useful .vmdrc file]]
* [[plotGMINms.tcl]]: a tcl script for plotting ellipsoids in VMD.
* [[VMD script to annotate each frame of a trajectory]]

=== [[xfig]] ===
Open source vector graphics editor
* [https://ctan.org/tex-archive/support/epstopdf/ Convert eps to pdf]

=== [[Xmakemol]] ===
Program for visualising atomic and molecular systems.
* [https://www.nongnu.org/xmakemol/ XMakemol]

=== [[xmgrace]] ===
2D plotting tool.
* [http://exciting-code.org/xmgrace-quickstart Xmgrace]

== Theoretical/Mathematical Notes ==

* [[Density of states and thermodynamics from energy distributions at different temperatures]]
* [[Ellipsoid.model]]
* [[Ellipsoid.model.xyz]]
* [[Ellipsoid.xyz]]
* [[Gencoords]]
* [[GenCoords]]
* [[GenCoords Models]]
* [[Rotamer moves in AMBER]]
* [[Thomson problem in OPTIM]]

=== Angle-axis notes ===

* [[Angle-axis framework]]
* [[Computing normal modes in angle-axis]]

=== Rigid Bodies ===

* [[Automatic Rigid Body Grouping]]
* [[Rigid body input files for proteins using genrigid-input.py]]
* [[Local Rigid Body Framework]]
* [[Local rigid body in OPTIM]]

== Useful Scripts ==
* [[perm-prmtop.py]]: A python program that converts an AMBER9 topology file into one with a symmetrised potential with respect to exchange (updated for AMBER12 and ff14SB).
* [[perm-pdb.py]]: A python program that creates a ''perm.allow'' file for use with [[OPTIM]] and [[PATHSAMPLE]].
* [[path2pdb.py]]: A python program to convert ''path.info'' to ''path_all.pdb'' - you can easy visualize your path in VMD :)
* [[path2xyz.py]]: A python program to convert ''path.info'' to ''path_all.xyz''
* [[dijkstra_test.py]]: A python script to test whether the information in pairlist and ts.data connects the A and B set. (If not, PATHSAMPLE will not work without actually exiting.)
* [[extractedmin2pdb.py]]: A python program to convert ''exctractedmin'' to PDB format
* [[colourdiscon.py]]: A python program for sorting input for disconnectivity graphs
* [[pdb_to_movie.py]]: A python program to create an AMH movieseg file from a PDB file
* [[makerestart]]: A bash script to automatically set up a GMIN restart run
* [[progress]] A bash script to tell you the % completion of a GMIN job and give an estimated time remaining
* [[recommended bash aliases]]
* [[David's .inputrc file]]
* [[Useful .vmdrc file]]
* [[Density of states and thermodynamics from energy distributions at different temperatures]]
* [[GenCoords]]: A fortran program to generate coarse grain building blocks and initial coords using a set of geometric models.
* [[plotGMINms.tcl]]: a tcl script for plotting ellipsoids in VMD.
See also the SCRIPTS/ directory in the SVN repository!
* [[Computing CHARMM FF energy using GMIN, MMTSB and CHARMM]] - Computes the Charmm FF energy of the same structure. Useful for cross-validating force field settings in GMIN data file, CHARMM input file and MMTSB options.
* [[Automatic Rigid Body Grouping]]
* [[ElaborateDiff]]
* [[Parameter-scanning script]]
* [[Pdb to movie.py]]
* [[VMD script to annotate each frame of a trajectory]]

== Useful links ==
* [http://www.ch.cam.ac.uk/computing/theory-compute-clusters The Theory Compute Clusters support page]. Contains useful cluster specific information, including example job submission scripts.

* A useful website which contains AMBER (GAFF) and OPLS parameters for small molecules. http://virtualchemistry.org/gmld.php . This could save us lot of time while trying to derive parameters on our own. If you are lucky, the molecule of your interest may already be there in the existing database. The topology files are in GROMACS format but possibly can be converted into AMBER parameter files. (script anyone ?)

* The moving-domain QM/MM method developed by Victor Batista's group http://gascon.chem.uconn.edu/software. This approach can be used in the derivation of charges for large proteins and nucleic acids, where a full-fledged ONIOM based calculation is comptutationally prohibitive. It has been applied to systems like the Gramicidin ion channel and Photosystem II.

== Miscellaneous ==
* [[Animated GIF on the group website]]
* [[Backup strategy]]
* [[Chain crossing]]
* [[Computer Office services]]
* [[Computing values only once]]
* [[Decoding heat capacity curves]]
* [[Differences from Clust]]
* [[Fixing thunderbird links]]
* [[If you need to change the number of atoms (e.g. making a united-atom charmm19 .crd file, or if atoms are missing)]]
* [[Intel Trace Analyzer and Collector]]
* [[LDAP plans]]
* [[Lapack compilation]]
* [[Mek-quake Queueing system]]
* [[Mek-quake initial setup notes]]
* [[New mek-quake]]
* [[Maui compilation]]
* [[Torque and Maui]]
* [[Mercurial]]
* [[Migrating to the new SVN server]]
* [[NECI Parallelization]]
* [[Optimization tricks]]
* [[Other IT stuff]]
* [[Porfuncs Documentation]]
* [[Progress]]
* [[Proposed changes to backup and archiving]]
* [[Rama upgrade]]
* [[Remastering Knoppix]]
* [[See unpacked nodes]]
* [[Tardis scheduling policy]]
* [[Zippo Sicortex machine]]
* [[Beginner's guide to working in Wales group]]

== Useful linux stuff ==

===Basics===
* [[basic linux commands everyone should know!]]
* [[piping and redirecting output from one command or file to another]] - how to save yourself hours!
* [[bash loop tricks]]
* [[bash history searching]]

===Remote access===
* [[setting up aliases to quickly log you in to a different machine]]
* [[transfering files to and from your workstation]] -using ''scp'' or ''rsync''
* [[using 'ssh-keygen' to automatically log you into clusters from your workstation]] (no more typing in your password!)
* [[mounting sharedscratch locally]]

===Find and replace===
* [[short 'sed' examples]]
* [[quick guide to awk]]
* [[short 'awk' examples]]

===File manipulation===
* [[sorting a file by multiple columns]]
* [[using tar and gzip to compress/uncompress files | using tar and bzip2 to compress/uncompress files]]
* [[conversion between different data file formats]] -'almost one-line' scripts
* [[conversion between different image file formats]] - the ''convert'' command
* [[removing an excessive number of files from a directory - when 'rm' just isn't enough]]

===Cluster queues===
* [[submitting jobs, interactively or to a cluster queue system]]
* [[identifying job on a node]] - if you need to kill only one of few running jobs
* [[getting started with SLURM]]
* [[a guide to using SLURM to run PATHSAMPLE]]
* [[a guide to using SLURM to run GPU jobs on pat]]
* [[managing interactive jobs on cluster]]

===Miscellaneous/uncategorised===
* [[installing packages on your managed CUC3 workstation]]
* [[running programs in the background]] - so you can use your shell for other things at the same time
* [[finding bugs in latex documents that will not compile]]
* [[printing files from the command line using 'lpr']]
* [[uploading non image files to the wiki]]

== Compiler Flags ==

* [[Compiler Flags]]
* [[Blacklisting Compilers]]
* [[Lapack compilation]]
* [[Pdb to movie.py]]
* [[Portland compiler fails trying to allocate an unexpectedly large amount of memory: issue with large arrays]]

== SuSE ==

* [[Upgrading destiny]]
* [[Upgrading sword]]
* [[SuSE 10.1 workstation image]]
* [[SuSE 10.2 workstation image]]
* [[SuSE 10.3 workstation image]]
* [[SuSE 11.1]]

--[[User:adk44|adk44]] 17.00, 9 May 2019 (BST)

Comprehensive Contents Page

2021-07-01T11:39:45Z

Djs244: /* Useful Notes on Wales Group Programs and Subroutines */

This page is designed to organise all of the pages on this wiki, as well as provide other useful links. Note that some pages may appear under more than one heading.

== Getting Started ==
[[Wales Group]] provides good step-by-step instructions. Relevant pages are:

=== Acquiring and compiling the group software ===
* [[SVN setup]]
* [[Git Workflow]]
* [[Wales Group Version control]] - to keep the code standardised.
* Theory Sector [http://wwmm.ch.cam.ac.uk/wikis/cuc3/index.php/SVN_Page SVN Page] - some useful general information on SVN commands.
* [[Compiling Wales Group codes using cmake]] - CMake (Cross-platform Make) allows us to compile and test the group codebase regardless of platform. This page provides crucial information how to compile using cmake.
* [[ElaborateDiff]]

=== Maintaining code health ===
* [[Jenkins CI]] - explains Jenkins, which we use to download our code and compile each of our targets with each of the compilers every night.
* https://wales-jenkins.ch.cam.ac.uk/ - log for our Jenkins tests.
* [[Branching and Merging]]
* [[Cmake interface building]]
* [[Installing python modules]]
* [[Revamping the modules system]]

=== Collaborators without access to the SVN repository ===
For licensing reasons, some code cannot be included in the Wales Group public tarball.
* http://www-wales.ch.cam.ac.uk/svn.tar.bz2 - Wales group public tarball. Includes [[GMIN]], [[OPTIM]] and [[PATHSAMPLE]].
If a collaborator has a [[CHARMM]] or [[AMBER]] licence, we do maintain separate tarballs which include the [[CHARMM]], [[AMBER]] and [[CHARMM]]+[[AMBER]] source and interfaces. These are not linked anywhere on the website and require a username ('''wales''') and password ('''group''') to download:

* [http://www-wales.ch.cam.ac.uk/CHARMM/svn.CHARMM.tar.bz2 CHARMM]
* [http://www-wales.ch.cam.ac.uk/AMBER/svn.AMBER.tar.bz2 AMBER]
* [http://www-wales.ch.cam.ac.uk/both/svn.both.tar.bz2 AMBER+CHARMM]

=== Running on Windows ===
Not particularly recommended.
* [[Running Wales Group software on Windows 7]]

== Wales Group Programs ==

=== Programs ===
* [[GMIN]]: A program for finding global minima and calculating thermodynamic properties from basin-sampling.
* [[OPTIM]]: A program for optimizing geometries and calculating reaction pathways.
* [[PATHSAMPLE]]: A driver for OPTIM to create stationary point databases using discrete path sampling and perform kinetic analysis.
* [[Pele]]: Python energy landscape explorer. A pythonic rewrite of some core functionality of GMIN, OPTIM, and PATHSAMPLE. Can be very useful for visualizing your system and for rapidly implementing and testing new ideas.
* [[DISCOTRESS]]: A program to perform detailed quantitative analysis of a kinetic network (stationary point database)

=== Curated Examples ===
* https://github.com/wales-group/examples - set of tutorials detailing how to use GMIN, OPTIM and PATHSAMPLE. Essential for beginners.
* http://www-wales.ch.cam.ac.uk/VM/Wales_Group_VM.ova - Pre-prepared teaching virtual machine. This contains the code and examples.
* https://www.virtualbox.org/wiki/Downloads - This is required if using the VM above.
* https://github.com/wales-group/examples.git - Alternatively, you can run the examples on your own machine. To get hold of the relevant files:
<pre>
git clone https://github.com/wales-group/examples.git
</pre>

== Useful Notes on Wales Group Programs and Subroutines ==
=== [[GMIN]] ===
* [[Adding a model to GMIN]] - rough outline of the subroutines that need to be changed to add a new model to GMIN
* [[Compiling Wales Group codes using cmake | Compiling GMIN using cmake ]]
* [[Selecting search parameters for GMIN]]
* [[Global optimization of biomolecules using CHARMM]]
* [[Global optimization of biomolecules using AMBER9]]
* [[Global optimization of biomolecules using AMBER9 with Structural Restraints]]
* [[Calculating binding free energy using the FSA method]]
* [[Restarting a GMIN run from a dump file]]
* [[Using the implicit membrane model IMM1]]
* [[Running a Go model with the AMHGMIN]]
* [[Running a G\=o model with the AMHGMIN]]
* [[Ligand binding-mode searches with HBONDMATRIX]]
* [[Compiling and using GMIN with QUIP]]
* [[Using GMIN and OPTIM with GPUs]]
* [[Using GMIN to generate endpoints]]
* [[Using GMIN to generate endpoints (CHARMM)]]
* [[Generating a GMIN Eclipse project]]
* [[Mutational BH steps]]
* [[Biomolecules in the energy landscape framework]]
* [[DMAGMIN setup]]
* [[Keywords]]
* [[PYGMIN & DMACRYS]]
* [[Rotamer moves in AMBER]]
* [[Python interface for GMIN/OPTIM]]

==== Scripts ====
* [[makerestart]]: A bash script to automatically set up a GMIN restart run
* [[progress]] A bash script to tell you the % completion of a GMIN job and give an estimated time remaining

==== Useful info for coding GMIN ====
* [[Program flow]] - contains information about what the various files in GMIN do and what order they're called.
* [[amberinterface]]

==== Projects ====
* [[GMIN MOVES module]]
* [[GMIN SANITY module]]
* [[GMIN TESTS module]]
* [[CAMSHIFT]]

=== [[OPTIM]] ===
* [[Adding a model to OPTIM]] - rough outline of the subrounties that need to be changed to add a new model to OPTIM
* [[Adding partially finished OPTIM stationary points to a PATHSAMPLE database]]
* [[perm-pdb.py]]: A python program that creates a ''perm.allow'' file for use with [[OPTIM]] and [[PATHSAMPLE]].
* [[visualising normal modes using VMD and OPTIM]]
* [[Compiling Wales Group codes using cmake | Compiling OPTIM using cmake ]]
* [[OPTIM/Q-Chem Tutorial]]
* [[OPTIM and PY ellipsoids tutorial]]
* [[OPTIM output files]]
* [[Minimizing a structure using OPTIM and AMBER9]]
* [[Minimizing a structure using OPTIM and CHARMM]]
* [[Creating movies (.mpg) of paths using OPTIM]]
* [[Performing a normal mode analysis of a biomolecule using OPTIM (AMBER and CHARMM)]]
* [[Debugging odd transition states in OPTIM]]
* [[Connecting two minima with a pathway]] - step by step
* [[Compiling and using OPTIM with QUIP]]
* [[Running an Gaussian03 interfaced OPTIM job]]
* [[The effect of calculating less than the maximum number of eigenvalues using ENDHESS n]]
* [[Biomolecules in the energy landscape framework]]
* [[BLJ60 example setup]]
* [[Finding an initial path with OPTIM and starting up PATHSAMPLE]]
* [[Finding an initial path with OPTIM and starting up PATHSAMPLE (CHARMM)]]
* [[Python interface for GMIN/OPTIM]]
* [[Thomson problem in OPTIM]]
* [[Instanton tunneling and classical rate calculations with OPTIM]]
* [[Loading OPTIM's min.data.info files into PATHSAMPLE]]
* [[common setup problem : No Frequency Warning]]

=== [[PATHSAMPLE]] ===
* [[Adding a model to PATHSAMPLE]] - rough outline of the subrounties that need to be changed to add a new model to PATHSAMPLE
* [[Alternatively, making the initial path with PATHSAMPLE itself]]
* [[Alternatively, making the initial path with PATHSAMPLE itself (CHARMM)]]
* [[perm-pdb.py]]: A python program that creates a ''perm.allow'' file for use with [[OPTIM]] and [[PATHSAMPLE]].
* [[dijkstra_test.py]]: A python script to test whether the information in pairlist and ts.data connects the A and B set. (If not, PATHSAMPLE will not work without actually exiting.)
* [[Compiling Wales Group codes using cmake | Compiling PATHSAMPLE using cmake ]]
* [[IMPORTANT: Using PATHSAMPLE safely on sinister]]
* [[Adding a model for PATHSAMPLE]]
* [[List of output files for PATHSAMPLE]]
* [[Using BHINTERP to find minima between two end points]]
* [[Finding an initial path between two end points (minima)]]
* [[Adding partially finished OPTIM stationary points to a PATHSAMPLE database]]
* [[Optimising a path]]
* [[Fine tuning UNTRAP]] - ensuring that it picks sensible minima
* [[Calculating rate constants (GT and fastest path)]]
* [[Calculating rate constants (SGT, DGT, and SDGT)]]
* [[Identifying the k fastest paths between endpoints using KSHORTESTPATHS]]
* [[Removing minima and transition states from the database]]
* [[Relaxing existing minima with new potential and creating new database]]
* [[Relaxing existing transition states with new potential and creating new database]]
* [[If things go wrong...]]
* [[If you lost file min.data, but still you have points.min]]
* [[path.info file is not read, causes PATHSAMPLE to die]]
* [[BLJ60 example setup]]
* [[When PATHSAMPLE finds a connected path, but using DIJKSTRA 0 fails to find the connected path]]
* [[Biomolecules in PATHSAMPLE]]
* [[Biomolecules in the energy landscape framework]]
* [[Expanding the kinetic transition network with PATHSAMPLE]]
* [[Expanding the kinetic transition network with PATHSAMPLE (CHARMM)]]
* [[Finding an initial path with OPTIM and starting up PATHSAMPLE]]
* [[Finding an initial path with OPTIM and starting up PATHSAMPLE (CHARMM)]]
* [[Pathsampling short paths]]
* [[Pathsampling short paths (CHARMM)]]
* [[Loading OPTIM's min.data.info files into PATHSAMPLE]]
* [[Connecting Sub-databases]]
* [[CHECKSPMUTATE]]: An extension of CHECKSPODATA which allows for a protein to be mutated or transformed into a homologue.
* [[Pathway Gap Filling Post-CHECKSPMUTATE]]: Post-processing following CHECKSPMUTATE
* [[STARTING INITIAL PATH JOBS WITH PATHSAMPLE]]: How to start initial path jobs with PATHSAMPLE if no min.data or path.info files are present.

=== [[Notes on MINPERMDIST | MINPERMDIST]] ===

=== [[Quasi-continuous interpolation for biomolecules | QCI]] ===

=== [[Detailed kinetic network analysis with DISCOTRESS | DISCOTRESS]] ===

== Non-Group Software ==

=== [[AMBER]] ===
Molecular dynamics simulation program and associated force fields.
* [http://ambermd.org/ AMBER]
* [http://ambermd.org/tutorials/ AMBER tutorials] - recommended reading for '''ANYONE''' using AMBER!
* [[Notes on AMBER 12 interface]]
* [[Using AMBER 14 on the GPU and compute clusters]]
* [[Generating parameters using AMBER's built in General Forcefield (gaff)]]
* [[Generating parameters using RESP charges from GAMESS-US]]
* [[Simple scripts for LEaP to create topology and coordinate files]]
* [[Preparing an AMBER topology file for a protein system]] - step by step guide
* [[Setting up]] - step by step guide to prepare and then symmetrise a simple (protein-only) system
* [[Using Molfacture to edit molecules and add hydrogens]]
* [[Preparing an AMBER topology file for a protein plus ligand system]] - step by step guide
* [[Symmetrising AMBER topology files]] - step by step guide for symmetrising a complex protein+ligand system
* [[Producing a PDB from a coordinates and topology file]] - using ''amdpdb''
* [[Running GMIN with MD move steps AMBER]]
* [[Performing a normal mode analysis of a biomolecule using OPTIM (AMBER and CHARMM)]]
* [[Evaluating different components of AMBER energy function with SANDER]]
* [[Mutational BH steps]]
* [[CHECKSPMUTATE]]: An extension of CHECKSPODATA which allows for a protein to be mutated or transformed into a homologue.
* [[Pathway Gap Filling Post-CHECKSPMUTATE]]: Post-processing following CHECKSPMUTATE
* [[REMD with AMBER]]
* [[Performing a hydrogen-bond analysis]]
* [[Alternatively, making the initial path with PATHSAMPLE itself]]
* [[Biomolecules in the energy landscape framework]]
* [[perm-prmtop.py]] - A python program that converts an AMBER9 topology file into one with a symmetrised potential with respect to exchange (updated for AMBER12 and ff14SB).
* [[Rotamer moves in AMBER]]
* [[Creating mismatched DNA duplex using NAB]]

=== [[aux2bib]] ===
To generate a bib file containing only the entries cited in a given .tex file from a larger bib or multiple bib files.
* [https://ctan.org/pkg/bibtools Get script here]

=== [[CamCasp]] ===
Cambridge package for Calculation of Anisotropic Site Properties
From Anthony Stone's website: 'CamCASP is a collection of scripts and programs written by Dr Alston Misquitta and myself for the calculation ab initio of distributed multipoles, polarizabilities, dispersion coefficients and repulsion parameters for individual molecules, and interaction energies between pairs of molecules using SAPT(DFT).'
* [http://www-stone.ch.cam.ac.uk/programs.html CamCASP home]
* [[CamCASP/Programming]]
* [[CamCASP/Programming/5/example1]]
* [[CamCASP/Notes]]
* [[CamCASP/Bugs]]
* [[CamCASP/ToDo/diskIO]]
* [[CamCASP/ToDo/Memory]]
* [[CamCASP/CodeExamples/DirectAccess]]

=== [[CPMD]] ===
Implementation of DFT for ''ab-initio'' molecular dynamics.
* [http://www.cpmd.org/ Home Page]
* [[CPMDInput]]

=== [[CHARMM]] ===
Molecular dynamics simulation program and associated force fields.
* [https://www.charmm.org/charmm/?CFID=65f7b3aa-8037-452a-bcd1-7583dd83a087&CFTOKEN=0 CHARMM]
* [[Generating pdb, crd and psf for a peptide sequence]]
* [[Converting between '.crd' and '.pdb']]
* [[Calculating energy of a conformation]]
* [[Calculating molecular properties]]
* [[Calculating order parameters]]
* [[CAMSHIFT]]
* [[Setting up (CHARMM)]] - step by step guide to prepare and then symmetrise a simple (protein-only) system
* [[If you need to change the number of atoms (e.g. making a united-atom charmm19 .crd file, or if atoms are missing)]]
* [[Performing a normal mode analysis of a biomolecule using OPTIM (AMBER and CHARMM)]]
* [[Minimizing a structure using OPTIM and CHARMM]]
* [[Alternatively, making the initial path with PATHSAMPLE itself (CHARMM)]]
* [[Expanding the kinetic transition network with PATHSAMPLE (CHARMM)]]
* [[Finding an initial path with OPTIM and starting up PATHSAMPLE (CHARMM)]]
* [[Pathsampling short paths (CHARMM)]]

=== [[disconnectionDPS]] ===
Produces disconnectivity graphs from min.data and ts.data files. This is included in the Wales group public tarball.
* [[Constructing Free Energy Disconnectivity Graphs]]

=== [[DMACRYS]] ===
Package which models crystals of rigid molecules.
* [http://www.chem.ucl.ac.uk/cposs/dmacrys/index.html Home Page]
* [[DMACRYS interface]]
* [[DMAGMIN setup]]
* [[PYGMIN & DMACRYS]]

=== [[GAMESS]] ===
General ''ab initio'' quantum chemistry package.
* [https://www.msg.chem.iastate.edu/gamess/ GAMESS]

=== [[Gaussian]] ===
General purpose package for computational chemistry calculations.
* [[Running an Gaussian03 interfaced OPTIM job]]

=== [[gnuplot]] ===
Open source graphing program.
* [http://www.gnuplot.info/ gnuplot]
* [[Plotting a quick histogram in gnuplot using the raw data]]
* [[Plotting data in real time]]
* [[Linear and non-linear regression in gnuplot]]

=== [[GROMACS]] ===
Molecular dynamics package.
* [[Installing GROMACS on Clust]]
* [http://www.mdtutorials.com/gmx/ External tutorials]
* [http://www.gromacs.org/Documentation/Tutorials More external tutorials]

=== [[HiRE-RNA]] ===
High-res course-grained energy model for RNA.
* [https://pubs.acs.org/doi/10.1021/jp102497y Explanatory Paper]

=== [[latex2html]] ===
Script which converts latex documents into HTML pages.
* [https://www.latex2html.org/ Get script here]

=== [[MMTSB-toolset]] ===
Group of perl scripts which can be used to setup and run energy minimization, structural analysis and MD with CHARMM or AMBER.
* [http://feig.bch.msu.edu/mmtsb/Main_Page Documentation]
* [http://www.mmtsb.org/workshops/mmtsb-ctbp_2006/Tutorials/WorkshopTutorials_2006.html External tutorials]
* [[Installing and setting up the MMTSB toolset]]
* [[REX (Replica EXchange MD) with the MMTSB-toolset]]

=== [[Simulations using OPEP | OPEP]] ===
OPEP is a coarse-grained force field providing a potential for proteins and RNA.
* [http://opep.galaxy.ibpc.fr/ OPEP file generator here]
* [[Biomolecules in the energy landscape framework]]

=== [[pgprof]] ===
Profiler for portland-compiled codes
* [[Portland compiler fails trying to allocate an unexpectedly large amount of memory: issue with large arrays]]

=== [[Pymol]] ===
Molecular visualisation program.
* [https://pymol.org/2/ PyMOL]
* [https://pymolwiki.org/index.php/Main_Page PyMOL Community Wiki]
* [[loading AMBER prmtop and inpcrd files into Pymol]]
* [[producing sexy ray-traced images]]
* [[advanced colouring]]
* [[Installing python modules]]
* [[PYGMIN & DMACRYS]]
* [[path2pdb.py]] - A python program to convert ''path.info'' to ''path_all.pdb'' - you can easy visualize your path in VMD :)
* [[extractedmin2pdb.py]]: A python program to convert ''exctractedmin'' to PDB format
=== [[VASP]] ===
OPTIM has an interface to VASP, which is installed on CSD3. In collaboration with Bora Karasulu the interface has been updated to use VASP format POSCAR input files for both single- and double-ended optimisations and path searches. The OPTIM odata file requires a line like

VASP 'mpirun -ppn 16 -np 16 /home/bk393/APPS/vasp.5.4.4/with-VTST/bin/vasp_std > vasp.out'

POSCAR files can be visualised using ase, the Atomic Simulation Environment, which can be accessed on volkhan via

module load anaconda/python3/5.3.0

pip install ase --user

ase-gui POSCAR1.vasp &

which assumes that ~/.input/bin is in your $PATH environment variable.

=== [[VMD]] ===
Molecular visualisation program.
* [http://www.ks.uiuc.edu/Research/vmd/current/ug/ug.html Documentation]
* [http://www.ks.uiuc.edu/Training/Tutorials/vmd/tutorial-html/index.html External tutorials]
* [[using VMD to display and manipulate '.pdb' files]]
* [[loading coordinate files into VMD with the help of an AMBER topology file]] e.g. to visualise the results of a GMIN run using AMBER9
* [[visualising normal modes using VMD and OPTIM]]
* [[path2pdb.py]]: A python program to convert ''path.info'' to ''path_all.pdb'' - you can easy visualize your path in VMD :)
* [[path2xyz.py]]: A python program to convert ''path.info'' to ''path_all.xyz''
* [[extractedmin2pdb.py]]: A python program to convert ''exctractedmin'' to PDB format
* [[Useful .vmdrc file]]
* [[plotGMINms.tcl]]: a tcl script for plotting ellipsoids in VMD.
* [[VMD script to annotate each frame of a trajectory]]

=== [[xfig]] ===
Open source vector graphics editor
* [https://ctan.org/tex-archive/support/epstopdf/ Convert eps to pdf]

=== [[Xmakemol]] ===
Program for visualising atomic and molecular systems.
* [https://www.nongnu.org/xmakemol/ XMakemol]

=== [[xmgrace]] ===
2D plotting tool.
* [http://exciting-code.org/xmgrace-quickstart Xmgrace]

== Theoretical/Mathematical Notes ==

* [[Density of states and thermodynamics from energy distributions at different temperatures]]
* [[Ellipsoid.model]]
* [[Ellipsoid.model.xyz]]
* [[Ellipsoid.xyz]]
* [[Gencoords]]
* [[GenCoords]]
* [[GenCoords Models]]
* [[Rotamer moves in AMBER]]
* [[Thomson problem in OPTIM]]

=== Angle-axis notes ===

* [[Angle-axis framework]]
* [[Computing normal modes in angle-axis]]

=== Rigid Bodies ===

* [[Automatic Rigid Body Grouping]]
* [[Rigid body input files for proteins using genrigid-input.py]]
* [[Local Rigid Body Framework]]
* [[Local rigid body in OPTIM]]

== Useful Scripts ==
* [[perm-prmtop.py]]: A python program that converts an AMBER9 topology file into one with a symmetrised potential with respect to exchange (updated for AMBER12 and ff14SB).
* [[perm-pdb.py]]: A python program that creates a ''perm.allow'' file for use with [[OPTIM]] and [[PATHSAMPLE]].
* [[path2pdb.py]]: A python program to convert ''path.info'' to ''path_all.pdb'' - you can easy visualize your path in VMD :)
* [[path2xyz.py]]: A python program to convert ''path.info'' to ''path_all.xyz''
* [[dijkstra_test.py]]: A python script to test whether the information in pairlist and ts.data connects the A and B set. (If not, PATHSAMPLE will not work without actually exiting.)
* [[extractedmin2pdb.py]]: A python program to convert ''exctractedmin'' to PDB format
* [[colourdiscon.py]]: A python program for sorting input for disconnectivity graphs
* [[pdb_to_movie.py]]: A python program to create an AMH movieseg file from a PDB file
* [[makerestart]]: A bash script to automatically set up a GMIN restart run
* [[progress]] A bash script to tell you the % completion of a GMIN job and give an estimated time remaining
* [[recommended bash aliases]]
* [[David's .inputrc file]]
* [[Useful .vmdrc file]]
* [[Density of states and thermodynamics from energy distributions at different temperatures]]
* [[GenCoords]]: A fortran program to generate coarse grain building blocks and initial coords using a set of geometric models.
* [[plotGMINms.tcl]]: a tcl script for plotting ellipsoids in VMD.
See also the SCRIPTS/ directory in the SVN repository!
* [[Computing CHARMM FF energy using GMIN, MMTSB and CHARMM]] - Computes the Charmm FF energy of the same structure. Useful for cross-validating force field settings in GMIN data file, CHARMM input file and MMTSB options.
* [[Automatic Rigid Body Grouping]]
* [[ElaborateDiff]]
* [[Parameter-scanning script]]
* [[Pdb to movie.py]]
* [[VMD script to annotate each frame of a trajectory]]

== Useful links ==
* [http://www.ch.cam.ac.uk/computing/theory-compute-clusters The Theory Compute Clusters support page]. Contains useful cluster specific information, including example job submission scripts.

* A useful website which contains AMBER (GAFF) and OPLS parameters for small molecules. http://virtualchemistry.org/gmld.php . This could save us lot of time while trying to derive parameters on our own. If you are lucky, the molecule of your interest may already be there in the existing database. The topology files are in GROMACS format but possibly can be converted into AMBER parameter files. (script anyone ?)

* The moving-domain QM/MM method developed by Victor Batista's group http://gascon.chem.uconn.edu/software. This approach can be used in the derivation of charges for large proteins and nucleic acids, where a full-fledged ONIOM based calculation is comptutationally prohibitive. It has been applied to systems like the Gramicidin ion channel and Photosystem II.

== Miscellaneous ==
* [[Animated GIF on the group website]]
* [[Backup strategy]]
* [[Chain crossing]]
* [[Computer Office services]]
* [[Computing values only once]]
* [[Decoding heat capacity curves]]
* [[Differences from Clust]]
* [[Fixing thunderbird links]]
* [[If you need to change the number of atoms (e.g. making a united-atom charmm19 .crd file, or if atoms are missing)]]
* [[Intel Trace Analyzer and Collector]]
* [[LDAP plans]]
* [[Lapack compilation]]
* [[Mek-quake Queueing system]]
* [[Mek-quake initial setup notes]]
* [[New mek-quake]]
* [[Maui compilation]]
* [[Torque and Maui]]
* [[Mercurial]]
* [[Migrating to the new SVN server]]
* [[NECI Parallelization]]
* [[Optimization tricks]]
* [[Other IT stuff]]
* [[Porfuncs Documentation]]
* [[Progress]]
* [[Proposed changes to backup and archiving]]
* [[Rama upgrade]]
* [[Remastering Knoppix]]
* [[See unpacked nodes]]
* [[Tardis scheduling policy]]
* [[Zippo Sicortex machine]]
* [[Beginner's guide to working in Wales group]]

== Useful linux stuff ==

===Basics===
* [[basic linux commands everyone should know!]]
* [[piping and redirecting output from one command or file to another]] - how to save yourself hours!
* [[bash loop tricks]]
* [[bash history searching]]

===Remote access===
* [[setting up aliases to quickly log you in to a different machine]]
* [[transfering files to and from your workstation]] -using ''scp'' or ''rsync''
* [[using 'ssh-keygen' to automatically log you into clusters from your workstation]] (no more typing in your password!)
* [[mounting sharedscratch locally]]

===Find and replace===
* [[short 'sed' examples]]
* [[quick guide to awk]]
* [[short 'awk' examples]]

===File manipulation===
* [[sorting a file by multiple columns]]
* [[using tar and gzip to compress/uncompress files | using tar and bzip2 to compress/uncompress files]]
* [[conversion between different data file formats]] -'almost one-line' scripts
* [[conversion between different image file formats]] - the ''convert'' command
* [[removing an excessive number of files from a directory - when 'rm' just isn't enough]]

===Cluster queues===
* [[submitting jobs, interactively or to a cluster queue system]]
* [[identifying job on a node]] - if you need to kill only one of few running jobs
* [[getting started with SLURM]]
* [[a guide to using SLURM to run PATHSAMPLE]]
* [[a guide to using SLURM to run GPU jobs on pat]]
* [[managing interactive jobs on cluster]]

===Miscellaneous/uncategorised===
* [[installing packages on your managed CUC3 workstation]]
* [[running programs in the background]] - so you can use your shell for other things at the same time
* [[finding bugs in latex documents that will not compile]]
* [[printing files from the command line using 'lpr']]
* [[uploading non image files to the wiki]]

== Compiler Flags ==

* [[Compiler Flags]]
* [[Blacklisting Compilers]]
* [[Lapack compilation]]
* [[Pdb to movie.py]]
* [[Portland compiler fails trying to allocate an unexpectedly large amount of memory: issue with large arrays]]

== SuSE ==

* [[Upgrading destiny]]
* [[Upgrading sword]]
* [[SuSE 10.1 workstation image]]
* [[SuSE 10.2 workstation image]]
* [[SuSE 10.3 workstation image]]
* [[SuSE 11.1]]

--[[User:adk44|adk44]] 17.00, 9 May 2019 (BST)

Comprehensive Contents Page

2021-07-01T11:35:33Z

Djs244: /* Programs */

This page is designed to organise all of the pages on this wiki, as well as provide other useful links. Note that some pages may appear under more than one heading.

== Getting Started ==
[[Wales Group]] provides good step-by-step instructions. Relevant pages are:

=== Acquiring and compiling the group software ===
* [[SVN setup]]
* [[Git Workflow]]
* [[Wales Group Version control]] - to keep the code standardised.
* Theory Sector [http://wwmm.ch.cam.ac.uk/wikis/cuc3/index.php/SVN_Page SVN Page] - some useful general information on SVN commands.
* [[Compiling Wales Group codes using cmake]] - CMake (Cross-platform Make) allows us to compile and test the group codebase regardless of platform. This page provides crucial information how to compile using cmake.
* [[ElaborateDiff]]

=== Maintaining code health ===
* [[Jenkins CI]] - explains Jenkins, which we use to download our code and compile each of our targets with each of the compilers every night.
* https://wales-jenkins.ch.cam.ac.uk/ - log for our Jenkins tests.
* [[Branching and Merging]]
* [[Cmake interface building]]
* [[Installing python modules]]
* [[Revamping the modules system]]

=== Collaborators without access to the SVN repository ===
For licensing reasons, some code cannot be included in the Wales Group public tarball.
* http://www-wales.ch.cam.ac.uk/svn.tar.bz2 - Wales group public tarball. Includes [[GMIN]], [[OPTIM]] and [[PATHSAMPLE]].
If a collaborator has a [[CHARMM]] or [[AMBER]] licence, we do maintain separate tarballs which include the [[CHARMM]], [[AMBER]] and [[CHARMM]]+[[AMBER]] source and interfaces. These are not linked anywhere on the website and require a username ('''wales''') and password ('''group''') to download:

* [http://www-wales.ch.cam.ac.uk/CHARMM/svn.CHARMM.tar.bz2 CHARMM]
* [http://www-wales.ch.cam.ac.uk/AMBER/svn.AMBER.tar.bz2 AMBER]
* [http://www-wales.ch.cam.ac.uk/both/svn.both.tar.bz2 AMBER+CHARMM]

=== Running on Windows ===
Not particularly recommended.
* [[Running Wales Group software on Windows 7]]

== Wales Group Programs ==

=== Programs ===
* [[GMIN]]: A program for finding global minima and calculating thermodynamic properties from basin-sampling.
* [[OPTIM]]: A program for optimizing geometries and calculating reaction pathways.
* [[PATHSAMPLE]]: A driver for OPTIM to create stationary point databases using discrete path sampling and perform kinetic analysis.
* [[Pele]]: Python energy landscape explorer. A pythonic rewrite of some core functionality of GMIN, OPTIM, and PATHSAMPLE. Can be very useful for visualizing your system and for rapidly implementing and testing new ideas.
* [[DISCOTRESS]]: A program to perform detailed quantitative analysis of a kinetic network (stationary point database)

=== Curated Examples ===
* https://github.com/wales-group/examples - set of tutorials detailing how to use GMIN, OPTIM and PATHSAMPLE. Essential for beginners.
* http://www-wales.ch.cam.ac.uk/VM/Wales_Group_VM.ova - Pre-prepared teaching virtual machine. This contains the code and examples.
* https://www.virtualbox.org/wiki/Downloads - This is required if using the VM above.
* https://github.com/wales-group/examples.git - Alternatively, you can run the examples on your own machine. To get hold of the relevant files:
<pre>
git clone https://github.com/wales-group/examples.git
</pre>

== Useful Notes on Wales Group Programs and Subroutines ==
=== [[GMIN]] ===
* [[Adding a model to GMIN]] - rough outline of the subroutines that need to be changed to add a new model to GMIN
* [[Compiling Wales Group codes using cmake | Compiling GMIN using cmake ]]
* [[Selecting search parameters for GMIN]]
* [[Global optimization of biomolecules using CHARMM]]
* [[Global optimization of biomolecules using AMBER9]]
* [[Global optimization of biomolecules using AMBER9 with Structural Restraints]]
* [[Calculating binding free energy using the FSA method]]
* [[Restarting a GMIN run from a dump file]]
* [[Using the implicit membrane model IMM1]]
* [[Running a Go model with the AMHGMIN]]
* [[Running a G\=o model with the AMHGMIN]]
* [[Ligand binding-mode searches with HBONDMATRIX]]
* [[Compiling and using GMIN with QUIP]]
* [[Using GMIN and OPTIM with GPUs]]
* [[Using GMIN to generate endpoints]]
* [[Using GMIN to generate endpoints (CHARMM)]]
* [[Generating a GMIN Eclipse project]]
* [[Mutational BH steps]]
* [[Biomolecules in the energy landscape framework]]
* [[DMAGMIN setup]]
* [[Keywords]]
* [[PYGMIN & DMACRYS]]
* [[Rotamer moves in AMBER]]
* [[Python interface for GMIN/OPTIM]]

==== Scripts ====
* [[makerestart]]: A bash script to automatically set up a GMIN restart run
* [[progress]] A bash script to tell you the % completion of a GMIN job and give an estimated time remaining

==== Useful info for coding GMIN ====
* [[Program flow]] - contains information about what the various files in GMIN do and what order they're called.
* [[amberinterface]]

==== Projects ====
* [[GMIN MOVES module]]
* [[GMIN SANITY module]]
* [[GMIN TESTS module]]
* [[CAMSHIFT]]

=== [[OPTIM]] ===
* [[Adding a model to OPTIM]] - rough outline of the subrounties that need to be changed to add a new model to OPTIM
* [[Adding partially finished OPTIM stationary points to a PATHSAMPLE database]]
* [[perm-pdb.py]]: A python program that creates a ''perm.allow'' file for use with [[OPTIM]] and [[PATHSAMPLE]].
* [[visualising normal modes using VMD and OPTIM]]
* [[Compiling Wales Group codes using cmake | Compiling OPTIM using cmake ]]
* [[OPTIM/Q-Chem Tutorial]]
* [[OPTIM and PY ellipsoids tutorial]]
* [[OPTIM output files]]
* [[Minimizing a structure using OPTIM and AMBER9]]
* [[Minimizing a structure using OPTIM and CHARMM]]
* [[Creating movies (.mpg) of paths using OPTIM]]
* [[Performing a normal mode analysis of a biomolecule using OPTIM (AMBER and CHARMM)]]
* [[Debugging odd transition states in OPTIM]]
* [[Connecting two minima with a pathway]] - step by step
* [[Compiling and using OPTIM with QUIP]]
* [[Running an Gaussian03 interfaced OPTIM job]]
* [[The effect of calculating less than the maximum number of eigenvalues using ENDHESS n]]
* [[Biomolecules in the energy landscape framework]]
* [[BLJ60 example setup]]
* [[Finding an initial path with OPTIM and starting up PATHSAMPLE]]
* [[Finding an initial path with OPTIM and starting up PATHSAMPLE (CHARMM)]]
* [[Python interface for GMIN/OPTIM]]
* [[Thomson problem in OPTIM]]
* [[Instanton tunneling and classical rate calculations with OPTIM]]
* [[Loading OPTIM's min.data.info files into PATHSAMPLE]]
* [[common setup problem : No Frequency Warning]]

=== [[PATHSAMPLE]] ===
* [[Adding a model to PATHSAMPLE]] - rough outline of the subrounties that need to be changed to add a new model to PATHSAMPLE
* [[Alternatively, making the initial path with PATHSAMPLE itself]]
* [[Alternatively, making the initial path with PATHSAMPLE itself (CHARMM)]]
* [[perm-pdb.py]]: A python program that creates a ''perm.allow'' file for use with [[OPTIM]] and [[PATHSAMPLE]].
* [[dijkstra_test.py]]: A python script to test whether the information in pairlist and ts.data connects the A and B set. (If not, PATHSAMPLE will not work without actually exiting.)
* [[Compiling Wales Group codes using cmake | Compiling PATHSAMPLE using cmake ]]
* [[IMPORTANT: Using PATHSAMPLE safely on sinister]]
* [[Adding a model for PATHSAMPLE]]
* [[List of output files for PATHSAMPLE]]
* [[Using BHINTERP to find minima between two end points]]
* [[Finding an initial path between two end points (minima)]]
* [[Adding partially finished OPTIM stationary points to a PATHSAMPLE database]]
* [[Optimising a path]]
* [[Fine tuning UNTRAP]] - ensuring that it picks sensible minima
* [[Calculating rate constants (GT and fastest path)]]
* [[Calculating rate constants (SGT, DGT, and SDGT)]]
* [[Identifying the k fastest paths between endpoints using KSHORTESTPATHS]]
* [[Removing minima and transition states from the database]]
* [[Relaxing existing minima with new potential and creating new database]]
* [[Relaxing existing transition states with new potential and creating new database]]
* [[If things go wrong...]]
* [[If you lost file min.data, but still you have points.min]]
* [[path.info file is not read, causes PATHSAMPLE to die]]
* [[BLJ60 example setup]]
* [[When PATHSAMPLE finds a connected path, but using DIJKSTRA 0 fails to find the connected path]]
* [[Biomolecules in PATHSAMPLE]]
* [[Biomolecules in the energy landscape framework]]
* [[Expanding the kinetic transition network with PATHSAMPLE]]
* [[Expanding the kinetic transition network with PATHSAMPLE (CHARMM)]]
* [[Finding an initial path with OPTIM and starting up PATHSAMPLE]]
* [[Finding an initial path with OPTIM and starting up PATHSAMPLE (CHARMM)]]
* [[Pathsampling short paths]]
* [[Pathsampling short paths (CHARMM)]]
* [[Loading OPTIM's min.data.info files into PATHSAMPLE]]
* [[Connecting Sub-databases]]
* [[CHECKSPMUTATE]]: An extension of CHECKSPODATA which allows for a protein to be mutated or transformed into a homologue.
* [[Pathway Gap Filling Post-CHECKSPMUTATE]]: Post-processing following CHECKSPMUTATE
* [[STARTING INITIAL PATH JOBS WITH PATHSAMPLE]]: How to start initial path jobs with PATHSAMPLE if no min.data or path.info files are present.

=== [[Notes on MINPERMDIST | MINPERMDIST]] ===

=== [[Quasi-continuous interpolation for biomolecules | QCI]] ===

== Non-Group Software ==

=== [[AMBER]] ===
Molecular dynamics simulation program and associated force fields.
* [http://ambermd.org/ AMBER]
* [http://ambermd.org/tutorials/ AMBER tutorials] - recommended reading for '''ANYONE''' using AMBER!
* [[Notes on AMBER 12 interface]]
* [[Using AMBER 14 on the GPU and compute clusters]]
* [[Generating parameters using AMBER's built in General Forcefield (gaff)]]
* [[Generating parameters using RESP charges from GAMESS-US]]
* [[Simple scripts for LEaP to create topology and coordinate files]]
* [[Preparing an AMBER topology file for a protein system]] - step by step guide
* [[Setting up]] - step by step guide to prepare and then symmetrise a simple (protein-only) system
* [[Using Molfacture to edit molecules and add hydrogens]]
* [[Preparing an AMBER topology file for a protein plus ligand system]] - step by step guide
* [[Symmetrising AMBER topology files]] - step by step guide for symmetrising a complex protein+ligand system
* [[Producing a PDB from a coordinates and topology file]] - using ''amdpdb''
* [[Running GMIN with MD move steps AMBER]]
* [[Performing a normal mode analysis of a biomolecule using OPTIM (AMBER and CHARMM)]]
* [[Evaluating different components of AMBER energy function with SANDER]]
* [[Mutational BH steps]]
* [[CHECKSPMUTATE]]: An extension of CHECKSPODATA which allows for a protein to be mutated or transformed into a homologue.
* [[Pathway Gap Filling Post-CHECKSPMUTATE]]: Post-processing following CHECKSPMUTATE
* [[REMD with AMBER]]
* [[Performing a hydrogen-bond analysis]]
* [[Alternatively, making the initial path with PATHSAMPLE itself]]
* [[Biomolecules in the energy landscape framework]]
* [[perm-prmtop.py]] - A python program that converts an AMBER9 topology file into one with a symmetrised potential with respect to exchange (updated for AMBER12 and ff14SB).
* [[Rotamer moves in AMBER]]
* [[Creating mismatched DNA duplex using NAB]]

=== [[aux2bib]] ===
To generate a bib file containing only the entries cited in a given .tex file from a larger bib or multiple bib files.
* [https://ctan.org/pkg/bibtools Get script here]

=== [[CamCasp]] ===
Cambridge package for Calculation of Anisotropic Site Properties
From Anthony Stone's website: 'CamCASP is a collection of scripts and programs written by Dr Alston Misquitta and myself for the calculation ab initio of distributed multipoles, polarizabilities, dispersion coefficients and repulsion parameters for individual molecules, and interaction energies between pairs of molecules using SAPT(DFT).'
* [http://www-stone.ch.cam.ac.uk/programs.html CamCASP home]
* [[CamCASP/Programming]]
* [[CamCASP/Programming/5/example1]]
* [[CamCASP/Notes]]
* [[CamCASP/Bugs]]
* [[CamCASP/ToDo/diskIO]]
* [[CamCASP/ToDo/Memory]]
* [[CamCASP/CodeExamples/DirectAccess]]

=== [[CPMD]] ===
Implementation of DFT for ''ab-initio'' molecular dynamics.
* [http://www.cpmd.org/ Home Page]
* [[CPMDInput]]

=== [[CHARMM]] ===
Molecular dynamics simulation program and associated force fields.
* [https://www.charmm.org/charmm/?CFID=65f7b3aa-8037-452a-bcd1-7583dd83a087&CFTOKEN=0 CHARMM]
* [[Generating pdb, crd and psf for a peptide sequence]]
* [[Converting between '.crd' and '.pdb']]
* [[Calculating energy of a conformation]]
* [[Calculating molecular properties]]
* [[Calculating order parameters]]
* [[CAMSHIFT]]
* [[Setting up (CHARMM)]] - step by step guide to prepare and then symmetrise a simple (protein-only) system
* [[If you need to change the number of atoms (e.g. making a united-atom charmm19 .crd file, or if atoms are missing)]]
* [[Performing a normal mode analysis of a biomolecule using OPTIM (AMBER and CHARMM)]]
* [[Minimizing a structure using OPTIM and CHARMM]]
* [[Alternatively, making the initial path with PATHSAMPLE itself (CHARMM)]]
* [[Expanding the kinetic transition network with PATHSAMPLE (CHARMM)]]
* [[Finding an initial path with OPTIM and starting up PATHSAMPLE (CHARMM)]]
* [[Pathsampling short paths (CHARMM)]]

=== [[disconnectionDPS]] ===
Produces disconnectivity graphs from min.data and ts.data files. This is included in the Wales group public tarball.
* [[Constructing Free Energy Disconnectivity Graphs]]

=== [[DMACRYS]] ===
Package which models crystals of rigid molecules.
* [http://www.chem.ucl.ac.uk/cposs/dmacrys/index.html Home Page]
* [[DMACRYS interface]]
* [[DMAGMIN setup]]
* [[PYGMIN & DMACRYS]]

=== [[GAMESS]] ===
General ''ab initio'' quantum chemistry package.
* [https://www.msg.chem.iastate.edu/gamess/ GAMESS]

=== [[Gaussian]] ===
General purpose package for computational chemistry calculations.
* [[Running an Gaussian03 interfaced OPTIM job]]

=== [[gnuplot]] ===
Open source graphing program.
* [http://www.gnuplot.info/ gnuplot]
* [[Plotting a quick histogram in gnuplot using the raw data]]
* [[Plotting data in real time]]
* [[Linear and non-linear regression in gnuplot]]

=== [[GROMACS]] ===
Molecular dynamics package.
* [[Installing GROMACS on Clust]]
* [http://www.mdtutorials.com/gmx/ External tutorials]
* [http://www.gromacs.org/Documentation/Tutorials More external tutorials]

=== [[HiRE-RNA]] ===
High-res course-grained energy model for RNA.
* [https://pubs.acs.org/doi/10.1021/jp102497y Explanatory Paper]

=== [[latex2html]] ===
Script which converts latex documents into HTML pages.
* [https://www.latex2html.org/ Get script here]

=== [[MMTSB-toolset]] ===
Group of perl scripts which can be used to setup and run energy minimization, structural analysis and MD with CHARMM or AMBER.
* [http://feig.bch.msu.edu/mmtsb/Main_Page Documentation]
* [http://www.mmtsb.org/workshops/mmtsb-ctbp_2006/Tutorials/WorkshopTutorials_2006.html External tutorials]
* [[Installing and setting up the MMTSB toolset]]
* [[REX (Replica EXchange MD) with the MMTSB-toolset]]

=== [[Simulations using OPEP | OPEP]] ===
OPEP is a coarse-grained force field providing a potential for proteins and RNA.
* [http://opep.galaxy.ibpc.fr/ OPEP file generator here]
* [[Biomolecules in the energy landscape framework]]

=== [[pgprof]] ===
Profiler for portland-compiled codes
* [[Portland compiler fails trying to allocate an unexpectedly large amount of memory: issue with large arrays]]

=== [[Pymol]] ===
Molecular visualisation program.
* [https://pymol.org/2/ PyMOL]
* [https://pymolwiki.org/index.php/Main_Page PyMOL Community Wiki]
* [[loading AMBER prmtop and inpcrd files into Pymol]]
* [[producing sexy ray-traced images]]
* [[advanced colouring]]
* [[Installing python modules]]
* [[PYGMIN & DMACRYS]]
* [[path2pdb.py]] - A python program to convert ''path.info'' to ''path_all.pdb'' - you can easy visualize your path in VMD :)
* [[extractedmin2pdb.py]]: A python program to convert ''exctractedmin'' to PDB format
=== [[VASP]] ===
OPTIM has an interface to VASP, which is installed on CSD3. In collaboration with Bora Karasulu the interface has been updated to use VASP format POSCAR input files for both single- and double-ended optimisations and path searches. The OPTIM odata file requires a line like

VASP 'mpirun -ppn 16 -np 16 /home/bk393/APPS/vasp.5.4.4/with-VTST/bin/vasp_std > vasp.out'

POSCAR files can be visualised using ase, the Atomic Simulation Environment, which can be accessed on volkhan via

module load anaconda/python3/5.3.0

pip install ase --user

ase-gui POSCAR1.vasp &

which assumes that ~/.input/bin is in your $PATH environment variable.

=== [[VMD]] ===
Molecular visualisation program.
* [http://www.ks.uiuc.edu/Research/vmd/current/ug/ug.html Documentation]
* [http://www.ks.uiuc.edu/Training/Tutorials/vmd/tutorial-html/index.html External tutorials]
* [[using VMD to display and manipulate '.pdb' files]]
* [[loading coordinate files into VMD with the help of an AMBER topology file]] e.g. to visualise the results of a GMIN run using AMBER9
* [[visualising normal modes using VMD and OPTIM]]
* [[path2pdb.py]]: A python program to convert ''path.info'' to ''path_all.pdb'' - you can easy visualize your path in VMD :)
* [[path2xyz.py]]: A python program to convert ''path.info'' to ''path_all.xyz''
* [[extractedmin2pdb.py]]: A python program to convert ''exctractedmin'' to PDB format
* [[Useful .vmdrc file]]
* [[plotGMINms.tcl]]: a tcl script for plotting ellipsoids in VMD.
* [[VMD script to annotate each frame of a trajectory]]

=== [[xfig]] ===
Open source vector graphics editor
* [https://ctan.org/tex-archive/support/epstopdf/ Convert eps to pdf]

=== [[Xmakemol]] ===
Program for visualising atomic and molecular systems.
* [https://www.nongnu.org/xmakemol/ XMakemol]

=== [[xmgrace]] ===
2D plotting tool.
* [http://exciting-code.org/xmgrace-quickstart Xmgrace]

== Theoretical/Mathematical Notes ==

* [[Density of states and thermodynamics from energy distributions at different temperatures]]
* [[Ellipsoid.model]]
* [[Ellipsoid.model.xyz]]
* [[Ellipsoid.xyz]]
* [[Gencoords]]
* [[GenCoords]]
* [[GenCoords Models]]
* [[Rotamer moves in AMBER]]
* [[Thomson problem in OPTIM]]

=== Angle-axis notes ===

* [[Angle-axis framework]]
* [[Computing normal modes in angle-axis]]

=== Rigid Bodies ===

* [[Automatic Rigid Body Grouping]]
* [[Rigid body input files for proteins using genrigid-input.py]]
* [[Local Rigid Body Framework]]
* [[Local rigid body in OPTIM]]

== Useful Scripts ==
* [[perm-prmtop.py]]: A python program that converts an AMBER9 topology file into one with a symmetrised potential with respect to exchange (updated for AMBER12 and ff14SB).
* [[perm-pdb.py]]: A python program that creates a ''perm.allow'' file for use with [[OPTIM]] and [[PATHSAMPLE]].
* [[path2pdb.py]]: A python program to convert ''path.info'' to ''path_all.pdb'' - you can easy visualize your path in VMD :)
* [[path2xyz.py]]: A python program to convert ''path.info'' to ''path_all.xyz''
* [[dijkstra_test.py]]: A python script to test whether the information in pairlist and ts.data connects the A and B set. (If not, PATHSAMPLE will not work without actually exiting.)
* [[extractedmin2pdb.py]]: A python program to convert ''exctractedmin'' to PDB format
* [[colourdiscon.py]]: A python program for sorting input for disconnectivity graphs
* [[pdb_to_movie.py]]: A python program to create an AMH movieseg file from a PDB file
* [[makerestart]]: A bash script to automatically set up a GMIN restart run
* [[progress]] A bash script to tell you the % completion of a GMIN job and give an estimated time remaining
* [[recommended bash aliases]]
* [[David's .inputrc file]]
* [[Useful .vmdrc file]]
* [[Density of states and thermodynamics from energy distributions at different temperatures]]
* [[GenCoords]]: A fortran program to generate coarse grain building blocks and initial coords using a set of geometric models.
* [[plotGMINms.tcl]]: a tcl script for plotting ellipsoids in VMD.
See also the SCRIPTS/ directory in the SVN repository!
* [[Computing CHARMM FF energy using GMIN, MMTSB and CHARMM]] - Computes the Charmm FF energy of the same structure. Useful for cross-validating force field settings in GMIN data file, CHARMM input file and MMTSB options.
* [[Automatic Rigid Body Grouping]]
* [[ElaborateDiff]]
* [[Parameter-scanning script]]
* [[Pdb to movie.py]]
* [[VMD script to annotate each frame of a trajectory]]

== Useful links ==
* [http://www.ch.cam.ac.uk/computing/theory-compute-clusters The Theory Compute Clusters support page]. Contains useful cluster specific information, including example job submission scripts.

* A useful website which contains AMBER (GAFF) and OPLS parameters for small molecules. http://virtualchemistry.org/gmld.php . This could save us lot of time while trying to derive parameters on our own. If you are lucky, the molecule of your interest may already be there in the existing database. The topology files are in GROMACS format but possibly can be converted into AMBER parameter files. (script anyone ?)

* The moving-domain QM/MM method developed by Victor Batista's group http://gascon.chem.uconn.edu/software. This approach can be used in the derivation of charges for large proteins and nucleic acids, where a full-fledged ONIOM based calculation is comptutationally prohibitive. It has been applied to systems like the Gramicidin ion channel and Photosystem II.

== Miscellaneous ==
* [[Animated GIF on the group website]]
* [[Backup strategy]]
* [[Chain crossing]]
* [[Computer Office services]]
* [[Computing values only once]]
* [[Decoding heat capacity curves]]
* [[Differences from Clust]]
* [[Fixing thunderbird links]]
* [[If you need to change the number of atoms (e.g. making a united-atom charmm19 .crd file, or if atoms are missing)]]
* [[Intel Trace Analyzer and Collector]]
* [[LDAP plans]]
* [[Lapack compilation]]
* [[Mek-quake Queueing system]]
* [[Mek-quake initial setup notes]]
* [[New mek-quake]]
* [[Maui compilation]]
* [[Torque and Maui]]
* [[Mercurial]]
* [[Migrating to the new SVN server]]
* [[NECI Parallelization]]
* [[Optimization tricks]]
* [[Other IT stuff]]
* [[Porfuncs Documentation]]
* [[Progress]]
* [[Proposed changes to backup and archiving]]
* [[Rama upgrade]]
* [[Remastering Knoppix]]
* [[See unpacked nodes]]
* [[Tardis scheduling policy]]
* [[Zippo Sicortex machine]]
* [[Beginner's guide to working in Wales group]]

== Useful linux stuff ==

===Basics===
* [[basic linux commands everyone should know!]]
* [[piping and redirecting output from one command or file to another]] - how to save yourself hours!
* [[bash loop tricks]]
* [[bash history searching]]

===Remote access===
* [[setting up aliases to quickly log you in to a different machine]]
* [[transfering files to and from your workstation]] -using ''scp'' or ''rsync''
* [[using 'ssh-keygen' to automatically log you into clusters from your workstation]] (no more typing in your password!)
* [[mounting sharedscratch locally]]

===Find and replace===
* [[short 'sed' examples]]
* [[quick guide to awk]]
* [[short 'awk' examples]]

===File manipulation===
* [[sorting a file by multiple columns]]
* [[using tar and gzip to compress/uncompress files | using tar and bzip2 to compress/uncompress files]]
* [[conversion between different data file formats]] -'almost one-line' scripts
* [[conversion between different image file formats]] - the ''convert'' command
* [[removing an excessive number of files from a directory - when 'rm' just isn't enough]]

===Cluster queues===
* [[submitting jobs, interactively or to a cluster queue system]]
* [[identifying job on a node]] - if you need to kill only one of few running jobs
* [[getting started with SLURM]]
* [[a guide to using SLURM to run PATHSAMPLE]]
* [[a guide to using SLURM to run GPU jobs on pat]]
* [[managing interactive jobs on cluster]]

===Miscellaneous/uncategorised===
* [[installing packages on your managed CUC3 workstation]]
* [[running programs in the background]] - so you can use your shell for other things at the same time
* [[finding bugs in latex documents that will not compile]]
* [[printing files from the command line using 'lpr']]
* [[uploading non image files to the wiki]]

== Compiler Flags ==

* [[Compiler Flags]]
* [[Blacklisting Compilers]]
* [[Lapack compilation]]
* [[Pdb to movie.py]]
* [[Portland compiler fails trying to allocate an unexpectedly large amount of memory: issue with large arrays]]

== SuSE ==

* [[Upgrading destiny]]
* [[Upgrading sword]]
* [[SuSE 10.1 workstation image]]
* [[SuSE 10.2 workstation image]]
* [[SuSE 10.3 workstation image]]
* [[SuSE 11.1]]

--[[User:adk44|adk44]] 17.00, 9 May 2019 (BST)

DISCOTRESS

2021-07-01T11:30:33Z

Djs244:

DISCOTRESS

2021-07-01T11:20:10Z

Djs244: Created DISCOTRESS page

'''DISCOTRESS''' is a C++ program to simulate and analyze the dynamics on kinetic transition networks, beyond the functionality provided in [[PATHSAMPLE]]. '''DISCOTRESS''' is written and maintained by Daniel J. Sharpe, and can be found here

==Functionality==

'''DISCOTRESS''' contains implementations of state-of-the-art algorithms to robustly and efficiently perform quantitative analyses of a kinetic network. Some recommended functionality that is very powerful for gaining a detailed understanding of your kinetic network is as follows:

* simulate trajectories by kinetic path sampling, thereby sampling the first passage time distribution and obtaining a numerical estimate for the time-dependent occupation probability distribution of macrostates

* calculate the probability of visiting a state on a direct transition path between two endpoint states

* decompose the ensemble of first passage paths into a finite set of flux-paths and their associated contributions to the net productive flux

==Getting Started==

'''DISCOTRESS''' has its own system of input files, so first you will need to convert your kinetic network database from '''PATHSAMPLE''' format (''min.data'',''ts.data''). You will need to construct the following 3 files:

* ''edge_conns.dat'' - two-column file containing a list of connections, can be extracted straightforwardly as the corresponding columns of ''ts.data''

* ''edge_weights.dat'' - two-column file containing the natural log of transition rates corresponding to the entries in ''edge_conns.dat''. You will need to dump these data from '''PATHSAMPLE''' (Fortran script available)

* ''stat_prob.dat'' - single-column file containing the natural log of stationary probabilities of nodes in the network. You will need to dump these data, which are directly related to the energies of minima, from '''PATHSAMPLE''' (Fortran script available).

Further information on these '''DISCOTRESS''' input files and others, including the ''input.kmc'' file of keywords, is available here

==Tutorials==

Tutorials are available here

Main Page

2021-07-01T10:58:19Z

Djs244: /* Helpful Software */

<big>'''Welcome to the Wales group software wiki'''</big>

For info on compiling our code from the source tarball, see the [[Compiling Wales Group code using CMake | cmake]] page.

== Members ==
The writable (Raven login required with admitto password) version is located [http://wikis.ch.cam.ac.uk/walesdocs/wiki/ here]. If you modify the writable version, the changes will appear on the read only version.

= Contact details =

If you have something to add to this wiki, or would like to contribute code, please get in touch with Professor Wales.

= Comprehensive Contents Page =
Please click [[Comprehensive Contents Page | here]] for a comprehensive, organised list of all of the pages comprising this wiki + some other useful links.

= Group Software =
All of our software is freely available under the [http://www.gnu.org/licenses/gpl.html GPL]. However, there are cases when we interface to commercial codes such as [http://ambermd.org/ AMBER] and [http://www.charmm.org/ CHARMM]. These files are absent from the source tarball. If you do have a license, please contact Professor Wales for access to a full version. We work on three separate programs:

*[[GMIN]]: A program for finding global minima and calculating thermodynamic properties from basin-sampling.
GMIN employs the basin-hopping algorithm described by Wales and Doye (''J. Phys. Chem. A, 101, 5111, 1997''[http://pubs.acs.org/doi/abs/10.1021/jp970984n]) to locate global minima on a potential energy surface. Many potentials are included. The latest version also includes an implementation of basin-sampling as described in T.V. Bogdan, D.J. Wales and F. Calvo (''J. Chem. Phys., 124, 044102, 2006''[http://www-wales.ch.cam.ac.uk/pdf/JCP.124.044102.2006.pdf]).

*[[OPTIM]]: A program for optimizing geometries and calculating reaction pathways
The geometry optimization scheme in OPTIM is based on eigenvector-following and was originally built from the optimizer in the ACES package written by Prof. John F. Stanton. OPTIM has analytic first and second derivatives coded for dozens of empirical potentials, and can also treat systems involving periodic boundary conditions and solve general optimization problems such as least squares fits.

*[[PATHSAMPLE]]: A driver for OPTIM to create stationary point databases using discrete path sampling and perform kinetic analysis.

= Helpful Software =
We have developed many scripts within the group to use in conjunction with our software - all of which are provided here. We also use other programs which are linked below:

*[[DisconnectionDPS]]

*[[DISCOTRESS]]

= Group Members Only =
Please click [[wales:Group-Only Contents Page | here]] for group members-only pages.