How to distribute R jobs to Windows cluster.
Intro: PHS research computing has installed R on our windows cluster. You can submit indvidual R batch jobs just like you in the linux clusters. One particular useful feature is that you can use parametric sweep to quickly depoly large amount of independent R jobs into the cluster without writing any extra job script.
The path of R is C:\Program Files (x86)\R\R-2.8.0\bin\R.exe, you can either specify it in your command line, or, you can specify it in your working directory.
Step 1. Please read "Access windows cluster rcwinclu" and How to submit a job in windows cluster before proceed.
Step 2. Configure your R job environment
* Upload your R script and necessary datasets to the cluster stroage \\rcwinclu\PartnersID. example.R can be used as an example script.
* If you will submit single R job: Start HPC Job Manager from your own desktop (or from HPCWIN), configure your job like this  . Change "testy" to your own partners ID .
* If you will submit many independent R jobs (runing same program but different argument), you can use "parametric sweep" and submit them. Download Example2.R and configure your job in "HPC Job Manager" like this . Again, Change "testy" to your own partners ID .
Step 3. Click the "submit" button to submit jobs.
note: There is a parallel R solution from a company called "REvolution Computing", if you are interested in knowing more and might get a version for testing purpose, some documentation is avaiable at \\rcwinclu\public\Software\RevolutionR
|
