Difference between revisions of "Admin Tips"

From wiki
Jump to: navigation, search
Line 11: Line 11:
  
 
  This is a unix/linux based system of 11 high speed machines for processing bioinformatics datasets. The frontend or gateway machine is called marvin, while the other 10 are called nodes, numbered 1 to 10. Most operations are done using command line, although it's possible to use Graphical Interface, not very many programs have this available.
 
  This is a unix/linux based system of 11 high speed machines for processing bioinformatics datasets. The frontend or gateway machine is called marvin, while the other 10 are called nodes, numbered 1 to 10. Most operations are done using command line, although it's possible to use Graphical Interface, not very many programs have this available.
 
+
 
  Further details here:
 
  Further details here:
 
  http://bioinformatics.st-andrews.ac.uk/cluster/  
 
  http://bioinformatics.st-andrews.ac.uk/cluster/  

Revision as of 13:29, 3 August 2016

Simple commands on all nodes, giving node name

  • Gives the running kernel version of all the nodes:
for i in node{1..10}; do ssh $i 'echo -n "$HOSTNAME: "; uname -a';done

New users

After having set up, here is some text that can be sent to a new user:

This is a unix/linux based system of 11 high speed machines for processing bioinformatics datasets. The frontend or gateway machine is called marvin, while the other 10 are called nodes, numbered 1 to 10. Most operations are done using command line, although it's possible to use Graphical Interface, not very many programs have this available.

Further details here:
http://bioinformatics.st-andrews.ac.uk/cluster/ 

How to use:
http://bioinformatics.st-andrews.ac.uk/cluster-manual/ 

Other useful links:
http://bioinformatics.st-andrews.ac.uk/cluster-manual/

Three useful links about command-line bioinformatics:
http://www.vicbioinformatics.com/documents/command-line
http://people.duke.edu/~ccc14/pcfb/unix.html
http://userweb.eng.gla.ac.uk/umer.ijaz/bioinformatics/linux.html

Compiling software

Red Hat Developer Toolset

Seeing as the cluster runs with RHEL 6 which, though updated continuously, was released in 2011, there are various things it's incapable of. Primary among these is a gcc compiler with the C++ standard C++11, which alot of software is now using. THis requires gcc version 4.8 instead of the 4.4 RHEL6 uses. The solution is the poorly named developer toolset, which Red Hat makes available. To invoke it:

scl enable devtoolset-2 "bash"

This will open a new bash subprocess where the gcc will be version 4.8

harvest-tools

  • Very unconventional manner of installation, creates symlinks from the buildtree.
  • this means that testing must be done via a users who had no hand in compilation.
  • definitely needs RH Developer Toolset

Procedure: clone from git-tree, run autoconf, and the configure step should be something like this:

./configure --prefix=/usr/local/Modules/modulefiles/tools/harvest-tools/gitv0_ebf7ecc --with-protobuf=/usr/local/Modules/modulefiles/tools/protobuf/gitv0_0622030 --with-capnp=/usr/local/Modules/modulefiles/tools/capnproto/0.5.3