Partners High Performance Computing Cluster
Partners applications via Mac/PC
Clinical & research applications
DFCI bioinformatics computer
PHS Research Computing cluster
Bioinformatics news
Data Storage & Backup
Sharing files & collaboration
HIPAA, ePHI and research (internal)
RPDR
HPCGG
Biomedical Engineering Model Shop
Harvard's GForge Implementation
Institutional research distribution lists

 

pHPC account registration pHPC user guide pHPC services pHPC web protal


Access Windows Cluster RCWINCLU



Intro: There are TWO approaches that you can use in order to submit your computing jobs to the windows cluster in our current PHS environment. The first one is that you need to remote logon to one of our powerful windows boxes named hpcwin.research.partners.org (referred as HPCWIN) with your partners ID. Then you develop apps over there, and submit your computing work to the windows cluster from there. The second approach is that you setup your own HPC client environment in your own lab computers, and use the windows cluster directly from your working environment. The advantage of the second approach is that you can interact with backend windows HPC directly, distribute computing work directly to the system and allocate and present results on your client machine (the network between the two might cause some problems, however, we have other resources specifically for retrieving remote graphics, please contact us for details if interested).



Method One: Using HPCWIN.RESEARCH.PARTNERS.ORG as cluster gateway and IDE center to access Windows cluster (recommended)



1> If you do not have a Partners ID, please contact Partners Healthcare IS help desk to get your Partners ID. Once you have it, email us, and we will add your partners ID as a user account for both HPCWIN and for Windows Cluster (you are not able to proceed through the following steps without having accounts on both systems).

2> Please use Remote Desktop Connection to connect to HPCWIN.RESEARCH.PARTNERS.ORG with your partners ID and password, once you login, click start --> all programs --> Microsoft visual studio 2008. Then you can start developing your applications. All necessary libraries have been installed in the system. Please refer to the other documentation “DevelopParallelOrMPI.doc” for details.

3> In HPCWIN, you should store most of your stuff in E:\$USER, or E:\YourLabName (if you need to share docs with other users in your lab) , currently we have 1TB storage in the E:\ at this moment, not huge, but okay for programming purposes. You can also test run/debug your application directly on HPCWIN.

4> In HPCWIN, you need to setup drive mapping by using use the network path \\rcwinclu\YOUR-PARTNERS-ID. That is your home folder located in the windows cluster. Once you finish programming/compiling in HPCWIN, you need to upload all your executable applications and necessary data files to your home directory in rcwinclu cluster. (If you have large input data file size, say, more than 100GB. please let us know before you do that). .

5> In HPCWIN, click "Start" --> "All Programs" --> "Microsoft HPC Pack" --> "HPC Job Manager". This will start the cluster client utility. The first time it will pop up a window and ask for head node location, type rcwinclu.partners.org .

6> Please retrieve all necessary documentation about how to submit jobs from \\rcwinclu\public\windowsHPC_doc . It contains detailed steps of how to submit jobs. Please also contact yxu11@partners.org if you have questions.



Method Two: Setting up windows cluster client environment in your own lab. Please feel free to contact ERIS system admin for assistance.



1> If you do not have a Partners ID, please contact Partners Healthcare IS to get your Partners ID . Once you are ready to use the windows cluster, email us, and we will add your partners ID as a user account for the windows cluster.

2> Define your client machine. Here are several hostnames I recommend you to use "xxxlab-1", "xxxlab-2" (xxx is your PI’s lastname abbreviation). After you decided the name, email us . We will register those hostnames into the Partners domain. ONLY after it joins the Partners domain, can this machine work with the windows cluster and submit/monitor jobs. If you want to use a laptop and work from home, you need to have a Partners VPN account ready in order to access PHS network.

3> Please have one of the following systems installed in your client machine
   a. Windows XP with service Pack 2
  b. Or, Windows Vista
  c. Or, Windows server 2003

4> We need to access your client machine and make the machine join the PHS domain. This is what we will do on your computer: Change your computer name to one of the names that you have decided in Step <2>, join the domain by going to "System Properties" --> "Computer Name/Domain Changes" --> type the computer name for "computer name" and "partners.org" for "member of domain". We can either do it through Remote Desktop Session or through MSN live meeting , or we can visit your lab to do it. (The reason we have to this is because only an authorized IS member can complete this procedure).

5> After your computer joins the domain, please go to \\rcwinclu\public\HPC_Pack_2008_RC1 and download the entire folder; After you download and install it, follow the steps and choose “ HPC Pack client utility”. When it finishes, you will have "HPC Job Manager" in your "Programs" list and have a folder "C:\program files\Microsoft HPC Pack " .

6> When you start "HPC Job Manager" , it will ask you the location of remote head node. Type "rcwinclu.partners.org" as the remote head node. After a few seconds, your job manager will successfully start its working environment. Please contact Jerry Xu or Dennis Gurgul for more instructions on submitting jobs. Here are some documentations available \\rcwinclu\share\public\windowsHPC_doc .