Difference: CondorClusterHomepage (35 vs. 36)

Revision 362012-04-27 - brodbd

Line: 1 to 1
Changed:
<
<

CLMA Condor Cluster

>
>

CLMS Parallel Computing Cluster

 

What is it?

Changed:
<
<
Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
>
>
The Computational Linguistics program maintains a cluster of several servers (referred to as "compute nodes") that can run multiple processes in parallel, allowing large jobs -- if properly constructed -- to be run faster than they could on any single computer. We offer two high-performance computing frameworks:
 
Changed:
<
<
Equipment for the patas cluster is partially funded by the Student Technology Fee.
>
>
  • Condor can run any type of software, but leaves the details of handling the data to you. It's essentially a very flexible scheduler for matching batch jobs with available compute nodes.
  • Hadoop can only run programs written using the MapReduce framework; however, it handles many of the intermediate data processing details itself.
 
Added:
>
>
Equipment for the cluster is partially funded by the Student Technology Fee.
 

How do I get an account?

If you do not yet have a Computational Linguistics account, fill out our online account request form. You must have a valid UW NetID.

Line: 14 to 15
  Open an SSH connection to patas.ling.washington.edu port 22 or dryas.ling.washington.edu port 22. You can also access files on the cluster directly via Samba filesystem shares. See HowToAccessPatas for more information.
Changed:
<
<

How do I use Condor to run my jobs?

>
>

How do I use Condor to run my parallel jobs?

  Visit the HowToUseCondor Wiki page for a quick introduction. You may also want to view the PDF presentation I wrote for orientation.
Deleted:
<
<
 

Software notes and reference information

General Tips and How-Tos

Line: 32 to 32
 
Added:
>
>
  • PatasMahout - Using the Mahout scalable machine learning toolkit
 
 
This site is powered by the TWiki collaboration platformCopyright & by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback
Privacy Statement Terms & Conditions