Performing job monitoring tasks while running jobs on a cluster/supercomputer can be done by several tools (such as qstat, showstart, …). Unfortunately the most of these standard tools are made by computer scientist for computer scientists, but now, there is an alternative: now.
At some point in my life, I started to get sick of qstats, greps, awks, … because it takes a couple of seconds every time one has to write them. If we multiply these seconds by the number of times I need them and by the number of computational members in my group, we get enough time to prepare a couple of new inputs, or write some post/comments in my blog.
So, I wrote my own job monitoring/visualization script, based on some ideas of my friend Iñaki during my time in the theoretical chemistry group in Donostia. That script, initially did nothing but execute these programs and display ONLY the information I need, and ALL the information I need. This information includes: Continue reading
Sometimes, specially in small 1s computational groups, it is usual that the people uses Must the workstations for running calculations, and in case of a “trusted” network, were all the colleagues can log-in to each other’s computers, it is sometimes also the case, that everybody calculates cheap mlb jerseys everywhere. But at the moment of submitting a calculation, if your own PC is already busy, how do Here I find a computer in my network, which is not Safes running Brunch anything at the moment?
You could ssh to each host and run <it>top</it> or something like that, but that is really slow when you have a lot of computers, and you have vs. to repeat the task very often.
The solution: “checkpc”
checkpc is a python script which can scan a whole network of computers and return the load of all PCs within it in less than wholesale mlb jerseys 3 seconds. Continue reading
When we perform molecular dynamics (MD) simulations, sometimes we want to store a frame every time step, Handbags in order to increase the quality of the statistics (i.e. when calculating radial cheap nba jerseys distribution functions). But on the other hand, due to their big size, these Here trajectories might cheap jerseys be very resend: difficult progressing to handle by visualization programs (VMD, jmol, …), because they 2016 usually load the hole file into memory, and storing every frame (or each few frames) in a long MD with a lot of atoms can produce a trajectory file of several MB or even GB.
The solution: shrinking the big trajectory into a smaller one with my “shrink_traj” script.
This script cheap nba jerseys takes a trajectory wholesale nba jerseys file (in xyz format) and copies each nth frame to another file, resulting on a smaller and easier to handle file specially suitable for visualization.
A typical problem in the life of a computational scientist: your calculations take longer than the wall time in the supercomputer. If the job can be restarted, we can work around that by re-sending it manually but that is quite tedious sometimes.
My solution: use the “resend” BASH script 😉 (which you can download here)
As in the case of the most of my scripts, there is a “-h” option. This helps if you don’t remember the syntax, this option will remind you about the few possibilities.
You need the job script you submit to the queue, and the input(s). The script keeps checking the qstat for the current user, and searching for the path from where the resend was executed. Whenever there is no job running or in queue with the same path, it submits another one. If there is a job with the same path, it waits for one minute and tries again.
The resend script is as easy to use as:
user> nohup resend -n 5 -f /path/to/script.cmd &
were “-n” option specifies the number of times the job will be resent (default: 3) and “-f” the path to the batch job script (default: ./job.cmd). It is useful to include the last option in order to be able identify the process (by i.e. “ps”) if necessary.
For killing the script, you can use:
this will break the internal loop and exit the script.
From the same directory, or just search the PID and kill it.
Another trick: if you already have executed the program, but you notice that you would like to run the job some more times, you can resend it again and the job will be sent as many times as the sum of resend’s both scripts request.
Finally I have written the first post in this blog.
It has been a hard decision, cheap jerseys but finally, after transforming my super-complex multilanguage dynamic website into a funny tablet pc, with fancy pure-CSS animated buttons, I noticed that I should maybe use a more sober layout, so I redesigned everything again to make it look a little bit more serious. Then I noticed that I would like to embed a blog, which according to my philosophy, should be self programmed from scratch (with vi!), but the need for more advances features took ??? me to the difficult decision of migrating everything to wordpress.
The blog format will allow me to post about the contents of my old websites in a more simple and effective way.
A comment on the layout: the background Glass image is a natural cheap jerseys (not edited) picture I took in the snowy Oulu, and the layout is based on Reparation the twenty twelve theme with hard css customization.
The favicon is the representation of some orbitals in an Al+3 pentagon, which using cheap nba jerseys the right cut-off and the right wholesale jerseys China angle, looks like some funny smiley alien, or something.