Difference between revisions of "Admin Tips"
(Created page with " ==Simple commands on all nodes, giving node name == for i in node{1..10}; do ssh $i 'echo -n "$HOSTNAME: "; uname -a';done") |
(→Red Hat Developer Toolset) |
||
| (6 intermediate revisions by one other user not shown) | |||
| Line 2: | Line 2: | ||
==Simple commands on all nodes, giving node name == | ==Simple commands on all nodes, giving node name == | ||
| + | * Gives the running kernel version of all the nodes: | ||
for i in node{1..10}; do ssh $i 'echo -n "$HOSTNAME: "; uname -a';done | for i in node{1..10}; do ssh $i 'echo -n "$HOSTNAME: "; uname -a';done | ||
| + | |||
| + | = New users = | ||
| + | |||
| + | |||
| + | After having set up, here is some text that can be sent to a new user: | ||
| + | |||
| + | This is a unix/linux based system of 11 high speed machines for processing bioinformatics datasets. The frontend or gateway machine is called marvin, while the other 10 are called nodes, numbered 1 to 10. Most operations are done using command line, although it's possible to use Graphical Interface, not very many programs have this available. | ||
| + | |||
| + | Further details here: | ||
| + | http://bioinformatics.st-andrews.ac.uk/cluster/ | ||
| + | |||
| + | How to use: | ||
| + | http://bioinformatics.st-andrews.ac.uk/cluster-manual/ | ||
| + | |||
| + | Other useful links: | ||
| + | http://bioinformatics.st-andrews.ac.uk/cluster-manual/ | ||
| + | |||
| + | Three useful links about command-line bioinformatics: | ||
| + | http://www.vicbioinformatics.com/documents/command-line | ||
| + | http://people.duke.edu/~ccc14/pcfb/unix.html | ||
| + | http://userweb.eng.gla.ac.uk/umer.ijaz/bioinformatics/linux.html | ||
| + | |||
| + | =Compiling software= | ||
| + | |||
| + | == Red Hat Developer Toolset == | ||
| + | |||
| + | Seeing as the cluster runs with RHEL 6 which, though updated continuously, was released in 2011, there are various things it's incapable of. Primary among these is a gcc compiler with the C++ standard C++11, which alot of software is now using. THis requires gcc version 4.8 instead of the 4.4 RHEL6 uses. The solution is the poorly named developer toolset, which Red Hat makes available. To invoke it: | ||
| + | |||
| + | scl enable devtoolset-2 "bash" | ||
| + | |||
| + | This will open a new bash subprocess where the gcc will be version 4.8 | ||
| + | |||
| + | |||
| + | There is also GCC 6.3 installed too. | ||
| + | |||
| + | source /opt/rh/devtoolset-6/enable | ||
| + | |||
| + | Note: loads it's own python and perl. | ||
| + | |||
| + | == harvest-tools == | ||
| + | |||
| + | * Very unconventional manner of installation, creates symlinks from the buildtree. | ||
| + | * this means that testing must be done via a users who had no hand in compilation. | ||
| + | * definitely needs RH Developer Toolset | ||
| + | |||
| + | Procedure: clone from git-tree, run autoconf, and the configure step should be something like this: | ||
| + | |||
| + | ./configure --prefix=/usr/local/Modules/modulefiles/tools/harvest-tools/gitv0_ebf7ecc --with-protobuf=/usr/local/Modules/modulefiles/tools/protobuf/gitv0_0622030 --with-capnp=/usr/local/Modules/modulefiles/tools/capnproto/0.5.3 | ||
Latest revision as of 13:11, 8 October 2018
Contents
Simple commands on all nodes, giving node name
- Gives the running kernel version of all the nodes:
for i in node{1..10}; do ssh $i 'echo -n "$HOSTNAME: "; uname -a';done
New users
After having set up, here is some text that can be sent to a new user:
This is a unix/linux based system of 11 high speed machines for processing bioinformatics datasets. The frontend or gateway machine is called marvin, while the other 10 are called nodes, numbered 1 to 10. Most operations are done using command line, although it's possible to use Graphical Interface, not very many programs have this available. Further details here: http://bioinformatics.st-andrews.ac.uk/cluster/ How to use: http://bioinformatics.st-andrews.ac.uk/cluster-manual/ Other useful links: http://bioinformatics.st-andrews.ac.uk/cluster-manual/ Three useful links about command-line bioinformatics: http://www.vicbioinformatics.com/documents/command-line http://people.duke.edu/~ccc14/pcfb/unix.html http://userweb.eng.gla.ac.uk/umer.ijaz/bioinformatics/linux.html
Compiling software
Red Hat Developer Toolset
Seeing as the cluster runs with RHEL 6 which, though updated continuously, was released in 2011, there are various things it's incapable of. Primary among these is a gcc compiler with the C++ standard C++11, which alot of software is now using. THis requires gcc version 4.8 instead of the 4.4 RHEL6 uses. The solution is the poorly named developer toolset, which Red Hat makes available. To invoke it:
scl enable devtoolset-2 "bash"
This will open a new bash subprocess where the gcc will be version 4.8
There is also GCC 6.3 installed too.
source /opt/rh/devtoolset-6/enable
Note: loads it's own python and perl.
harvest-tools
- Very unconventional manner of installation, creates symlinks from the buildtree.
- this means that testing must be done via a users who had no hand in compilation.
- definitely needs RH Developer Toolset
Procedure: clone from git-tree, run autoconf, and the configure step should be something like this:
./configure --prefix=/usr/local/Modules/modulefiles/tools/harvest-tools/gitv0_ebf7ecc --with-protobuf=/usr/local/Modules/modulefiles/tools/protobuf/gitv0_0622030 --with-capnp=/usr/local/Modules/modulefiles/tools/capnproto/0.5.3
