How to perform long running jobs

Tue, 11/04/2014 - 9:30am -- root
In order to maintain network permissions over time (days, weeks, etc.) you will need to take extra steps before executing your code. Here is an example of the commands to run using bigmem03:


ssh bigmem03.stat.wisc.edu
stashticket
/s/std/bin/runauth /usr/bin/screen
ssh bigmem03
R CMD BATCH your_r_code_file &
Ctrl-A d
exit

Then, reattach to your screen session by logging back into the server and typing

screen -r

If you need to know more about screen, see the man page for screen (man screen). The idea is to run an ssh session inside a screen session. This will ensure that your AFS tokens remain valid after you leave the computer for hours, days, or weeks at a time.

TIP: you can avoid having to use the stashticket command every time if you put /s/std/bin/stashticket in your ~/.bashrc.local (or ~/.cshrc.local, depending on which shell you're using)

Posted by: 
Mike Cammilleri