Difference: CondorClusterHomepage (1 vs. 36)

Revision 362012-04-27 - brodbd

Line: 1 to 1
Changed:
<
<

CLMA Condor Cluster

>
>

CLMS Parallel Computing Cluster

 

What is it?

Changed:
<
<		Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
>
>		The Computational Linguistics program maintains a cluster of several servers (referred to as "compute nodes") that can run multiple processes in parallel, allowing large jobs -- if properly constructed -- to be run faster than they could on any single computer. We offer two high-performance computing frameworks:
 
Changed:
<
<		Equipment for the patas cluster is partially funded by the Student Technology Fee.
>
>
  • Condor can run any type of software, but leaves the details of handling the data to you. It's essentially a very flexible scheduler for matching batch jobs with available compute nodes.
  • Hadoop can only run programs written using the MapReduce framework; however, it handles many of the intermediate data processing details itself.
 
Added:
>
>		Equipment for the cluster is partially funded by the Student Technology Fee.
 

How do I get an account?

If you do not yet have a Computational Linguistics account, fill out our online account request form. You must have a valid UW NetID.

Line: 14 to 15
  Open an SSH connection to patas.ling.washington.edu port 22 or dryas.ling.washington.edu port 22. You can also access files on the cluster directly via Samba filesystem shares. See HowToAccessPatas for more information.
Changed:
<
<

How do I use Condor to run my jobs?

>
>

How do I use Condor to run my parallel jobs?

  Visit the HowToUseCondor Wiki page for a quick introduction. You may also want to view the PDF presentation I wrote for orientation.
Deleted:
<
<
 

Software notes and reference information

General Tips and How-Tos

Line: 32 to 32
 
Added:
>
>
  • PatasMahout - Using the Mahout scalable machine learning toolkit
 

Revision 352012-04-26 - brodbd

Line: 1 to 1
 

CLMA Condor Cluster

What is it?

Line: 19 to 19
 Visit the HowToUseCondor Wiki page for a quick introduction. You may also want to view the PDF presentation I wrote for orientation.

Software notes and reference information

Changed:
<
<
>
>

General Tips and How-Tos

 
Changed:
<
<
>
>
  • DataProtection - What we do to protect data stored on our systems against loss, and what users need to do to protect their own data.
  • DiskQuotas
 
Changed:
<
<
  • DataProtection - What we do to protect data stored on our systems against loss, and what users need to do to protect their own data.
  • DiskQuotas
>
>

Parallel/High-Performance Computing

 
Added:
>
>

Programming Languages

 

Linguistics software

A listing of linguistics software on Patas can be found in the CompLing database.

Revision 342011-12-28 - ebender

Line: 1 to 1
 

CLMA Condor Cluster

What is it?

Line: 37 to 37
 

Linguistics software

Changed:
<
<		A listing of linguistics software on Patas can be found in the CompLing database.
>
>		A listing of linguistics software on Patas can be found in the CompLing database.
 

Patas? What's that?

Revision 332011-09-13 - brodbd

Line: 1 to 1
 

CLMA Condor Cluster

What is it?

Line: 18 to 18
  Visit the HowToUseCondor Wiki page for a quick introduction. You may also want to view the PDF presentation I wrote for orientation.
Changed:
<
<

Software notes

>
>

Software notes and reference information

 

Revision 322011-09-09 - brodbd

Line: 1 to 1
 

CLMA Condor Cluster

What is it?

Line: 24 to 24
 
Changed:
<
<
>
>
 

Revision 312011-08-23 - brodbd

Line: 1 to 1
 

CLMA Condor Cluster

What is it?

Line: 20 to 20
 

Software notes

Added:
>
>
 

Revision 302011-01-07 - levow

Line: 1 to 1
 

CLMA Condor Cluster

What is it?

Line: 8 to 8
 

How do I get an account?

Changed:
<
<		If you do not yet have a Computational Linguistics account, fill out our online account request form. You must have a valid UW NetID.
>
>		If you do not yet have a Computational Linguistics account, fill out our online account request form. You must have a valid UW NetID.
 

How do I access the cluster?

Revision 292010-10-06 - brodbd

Line: 1 to 1
Changed:
<
<

patas.ling.washington.edu Condor Cluster

>
>

CLMA Condor Cluster

 

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.

Line: 41 to 41
 

Patas? What's that?

Patas monkeys are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.

Deleted:
<
<		 -- brodbd - 06 Jan 2010

Revision 282010-06-29 - brodbd

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Line: 20 to 20
 

Software notes

Added:
>
>
 
Deleted:
<
<
 

Revision 272010-05-26 - brodbd

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Line: 22 to 22
 
Added:
>
>
 

Revision 262010-05-17 - brodbd

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Line: 12 to 12
 

How do I access the cluster?

Changed:
<
<		Open an SSH connection to patas.ling.washington.edu port 22 or dryas.ling.washington.edu port 22. See HowToAccessPatas for more information.
>
>		Open an SSH connection to patas.ling.washington.edu port 22 or dryas.ling.washington.edu port 22. You can also access files on the cluster directly via Samba filesystem shares. See HowToAccessPatas for more information.
 

How do I use Condor to run my jobs?

Revision 252010-01-06 - brodbd

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Line: 10 to 10
  If you do not yet have a Computational Linguistics account, fill out our online account request form. You must have a valid UW NetID.
Changed:
<
<

How do I access patas?

>
>

How do I access the cluster?

 
Changed:
<
<		Open an SSH connection to patas.ling.washington.edu port 22. See HowToAccessPatas for more information.
>
>		Open an SSH connection to patas.ling.washington.edu port 22 or dryas.ling.washington.edu port 22. See HowToAccessPatas for more information.
 

How do I use Condor to run my jobs?

Line: 40 to 40
  Patas monkeys are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.
Changed:
<
<		-- brodbd - 23 Sep 2009
>
>		-- brodbd - 06 Jan 2010

Revision 242009-09-23 - brodbd

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Line: 27 to 30
 
Added:
>
>
 

Linguistics software

Line: 36 to 40
  Patas monkeys are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.
Changed:
<
<		-- brodbd - 04 May 2009
>
>		-- brodbd - 23 Sep 2009

Revision 232009-05-04 - brodbd

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Added:
>
>
  Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Added:
>
>		Equipment for the patas cluster is partially funded by the Student Technology Fee.
 

How do I get an account?

If you do not yet have a Computational Linguistics account, fill out our online account request form. You must have a valid UW NetID.
Line: 33 to 36
  Patas monkeys are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.
Changed:
<
<		-- brodbd - 27 Mar 2009
>
>		-- brodbd - 04 May 2009

Revision 222009-03-27 - brodbd

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Line: 15 to 15
 

Software notes

Added:
>
>
 
Line: 24 to 25
 
Deleted:
<
<

Differences between patas and pongo

This section documents differences between the software loaded on patas and the software loaded on pongo.
  • The base operating system is Red Hat Enterprise Linux Server 5, instead of Debian Stable.
  • We are running a 64-bit operating system, with compatibility libraries to support 32-bit software.
  • The 64-bit version of Sun's Java Virtual Machine is installed. This provides nearly 4 gigabytes of heap space, instead of 2 gigabytes in the 32-bit version. This is also a server JVM, meaning it performs some extra optimization. This results in slower startup times but long-running jobs complete faster.
  • To encourage efficient use of the cluster, as well as to make sure the system stays responsive, long-running jobs on patas itself will automatically have their CPU priority lowered. Jobs submitted to Condor are immune from this and always run at full priority.
 

Linguistics software

A listing of linguistics software on Patas can be found in the CompLing database.

Patas? What's that?

Changed:
<
<		Patas monkeys (pronounced "pä təs" or "pə tä", depending on which dictionary you believe) are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.
>
>		Patas monkeys are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.
 
Changed:
<
<		-- brodbd - 17 Jan 2009
>
>		-- brodbd - 27 Mar 2009

Revision 212009-01-17 - brodbd

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Line: 17 to 17
 
Added:
>
>
 
  • XmingGotchas - Problems with running Emacs (and some other apps) using the Windows X server Xming
Added:
>
>
 

Differences between patas and pongo

This section documents differences between the software loaded on patas and the software loaded on pongo.
Line: 32 to 37
 

Patas? What's that?

Changed:
<
<		Patas monkeys (pronounced "pä təs" or "pə tä", depending on which dictionary you believe) are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.

-- brodbd - 07 Jul 2008

>
>		Patas monkeys (pronounced "pä təs" or "pə tä", depending on which dictionary you believe) are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.
 
Added:
>
>		-- brodbd - 17 Jan 2009

Revision 202008-07-07 - brodbd

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Deleted:
<
<

How is it different from OpenMosix?

If you've used our Pongo OpenMosix cluster, you may be wondering how Condor differs. There are some key differences:
  • OpenMosix attempts to be transparent to the user. Processes are all run on the head node, and they are then migrated to available compute nodes. By contrast, Condor requires the user to set up the job specifically to be run on the cluster. (The software, however, does not need to be cluster-aware.)
  • OpenMosix jobs can be interactive; Condor jobs must run without user interaction.
  • OpenMosix cannot migrate jobs that use threads or shared memory, and jobs sometimes crash during migration. Condor can run any software that can be set up to run non-interactively, and it will have the same stability it would on a stand-alone system.
 

How do I get an account?

Deleted:
<
<		If you have a pongo account, you already have access to the Condor cluster. ssh to patas.ling.washington.edu.
 If you do not yet have a Computational Linguistics account, fill out our online account request form. You must have a valid UW NetID.
Changed:
<
<

How do I use it?

>
>

How do I access patas?

Open an SSH connection to patas.ling.washington.edu port 22. See HowToAccessPatas for more information.

How do I use Condor to run my jobs?

 Visit the HowToUseCondor Wiki page for a quick introduction. You may also want to view the PDF presentation I wrote for orientation.

Software notes

Line: 39 to 34
  Patas monkeys (pronounced "pä təs" or "pə tä", depending on which dictionary you believe) are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.
Changed:
<
<		-- brodbd - 13 Feb 2008
>
>		-- brodbd - 07 Jul 2008
 

Revision 192008-02-13 - brodbd

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Line: 20 to 20
 

Software notes

Added:
>
>
 
Line: 36 to 37
 

Patas? What's that?

Changed:
<
<		Patas monkeys (pronounced "pä'təs") are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.
>
>		Patas monkeys (pronounced "pä təs" or "pə tä", depending on which dictionary you believe) are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.
 
Changed:
<
<		-- DavidBrodbeck - 08 Jan 2008
>
>		-- brodbd - 13 Feb 2008
 

Revision 182008-02-06 - brodbd

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Line: 19 to 19
 

Software notes

Added:
>
>
 

Revision 172008-01-08 - DavidBrodbeck

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Line: 20 to 20
 

Software notes

* PatasShebangLines - Script headers for installed interpreters.

Added:
>
>
  • XmingGotchas - Problems with running Emacs (and some other apps) using the Windows X server Xming
 

Differences between patas and pongo

This section documents differences between the software loaded on patas and the software loaded on pongo.
Line: 36 to 37
  Patas monkeys (pronounced "pä'təs") are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.
Changed:
<
<		-- DavidBrodbeck - 04 Dec 2007
>
>		-- DavidBrodbeck - 08 Jan 2008
 

Revision 162007-12-04 - DavidBrodbeck

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Line: 18 to 18
 Visit the HowToUseCondor Wiki page for a quick introduction. You may also want to view the PDF presentation I wrote for orientation.

Software notes

Added:
>
>		 * PatasShebangLines - Script headers for installed interpreters.

Differences between patas and pongo

 This section documents differences between the software loaded on patas and the software loaded on pongo.
  • The base operating system is Red Hat Enterprise Linux Server 5, instead of Debian Stable.
  • We are running a 64-bit operating system, with compatibility libraries to support 32-bit software.
Line: 32 to 36
  Patas monkeys (pronounced "pä'təs") are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.
Changed:
<
<		-- DavidBrodbeck - 20 Nov 2007
>
>		-- DavidBrodbeck - 04 Dec 2007
 

Revision 152007-11-20 - DavidBrodbeck

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Line: 24 to 24
 
  • The 64-bit version of Sun's Java Virtual Machine is installed. This provides nearly 4 gigabytes of heap space, instead of 2 gigabytes in the 32-bit version. This is also a server JVM, meaning it performs some extra optimization. This results in slower startup times but long-running jobs complete faster.
  • To encourage efficient use of the cluster, as well as to make sure the system stays responsive, long-running jobs on patas itself will automatically have their CPU priority lowered. Jobs submitted to Condor are immune from this and always run at full priority.
Changed:
<
<

Software on pongo that is not yet installed on patas

This should only be a temporary situation -- most of these will eventually make it onto the new cluster.
  • Some software that resides in /NLP_TOOLS on pongo has not yet been installed on patas.
  • SRILM (Regression tests fail) -- fixed, 23-JUL-2007. (Locale issue -- LANG or LC_ALL must be set to en_US instead of en_US.UTF-8 before regression tests will pass.)
  • Lingua-BrillTagger, Lingua-Wordnet Perl modules ("make test" fails)
  • Text-NSP-1.01 Perl module ("make test" fails)
  • WordNet-Similarity (won't build) -- fixed & installed, 16-JUL-2007
>
>

Linguistics software

A listing of linguistics software on Patas can be found in the CompLing database.

 

Patas? What's that?

Patas monkeys (pronounced "pä'təs") are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.

Changed:
<
<		-- DavidBrodbeck - 24 Sep 2007
>
>		-- DavidBrodbeck - 20 Nov 2007
 

Revision 142007-10-26 - DavidBrodbeck

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Line: 15 to 15
 If you do not yet have a Computational Linguistics account, fill out our online account request form. You must have a valid UW NetID.

How do I use it?

Changed:
<
<		Visit the HowToUseCondor Wiki page for a quick introduction.
>
>		Visit the HowToUseCondor Wiki page for a quick introduction. You may also want to view the PDF presentation I wrote for orientation.
 

Software notes

This section documents differences between the software loaded on patas and the software loaded on pongo.

Revision 132007-09-24 - DavidBrodbeck

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Line: 26 to 26
 

Software on pongo that is not yet installed on patas

This should only be a temporary situation -- most of these will eventually make it onto the new cluster.
Changed:
<
<
  • The NLP_TOOLS directory from pongo is not currently installed -- working on this one with Fei.
>
>
  • Some software that resides in /NLP_TOOLS on pongo has not yet been installed on patas.
 
  • SRILM (Regression tests fail) -- fixed, 23-JUL-2007. (Locale issue -- LANG or LC_ALL must be set to en_US instead of en_US.UTF-8 before regression tests will pass.)
  • Lingua-BrillTagger, Lingua-Wordnet Perl modules ("make test" fails)
  • Text-NSP-1.01 Perl module ("make test" fails)
Line: 36 to 36
  Patas monkeys (pronounced "pä'təs") are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.
Changed:
<
<		-- DavidBrodbeck - 23 Aug 2007
>
>		-- DavidBrodbeck - 24 Sep 2007
 

Revision 122007-08-23 - DavidBrodbeck

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Line: 12 to 12
 

How do I get an account?

If you have a pongo account, you already have access to the Condor cluster. ssh to patas.ling.washington.edu.
Added:
>
>		If you do not yet have a Computational Linguistics account, fill out our online account request form. You must have a valid UW NetID.
 

How do I use it?

Visit the HowToUseCondor Wiki page for a quick introduction.
Line: 34 to 36
  Patas monkeys (pronounced "pä'təs") are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.
Changed:
<
<		-- DavidBrodbeck - 23 Jul 2007
>
>		-- DavidBrodbeck - 23 Aug 2007
 

Revision 112007-08-22 - DavidBrodbeck

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Line: 20 to 20
 
  • The base operating system is Red Hat Enterprise Linux Server 5, instead of Debian Stable.
  • We are running a 64-bit operating system, with compatibility libraries to support 32-bit software.
  • The 64-bit version of Sun's Java Virtual Machine is installed. This provides nearly 4 gigabytes of heap space, instead of 2 gigabytes in the 32-bit version. This is also a server JVM, meaning it performs some extra optimization. This results in slower startup times but long-running jobs complete faster.
Added:
>
>
  • To encourage efficient use of the cluster, as well as to make sure the system stays responsive, long-running jobs on patas itself will automatically have their CPU priority lowered. Jobs submitted to Condor are immune from this and always run at full priority.
 

Software on pongo that is not yet installed on patas

This should only be a temporary situation -- most of these will eventually make it onto the new cluster.

Revision 102007-08-13 - EmilyBender

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Line: 31 to 31
 

Patas? What's that?

Changed:
<
<		Patas monkeys (pronounced "pə'tä") are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.
>
>		Patas monkeys (pronounced "pä'təs") are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.
  -- DavidBrodbeck - 23 Jul 2007

Revision 92007-07-23 - DavidBrodbeck

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Line: 24 to 24
 

Software on pongo that is not yet installed on patas

This should only be a temporary situation -- most of these will eventually make it onto the new cluster.
  • The NLP_TOOLS directory from pongo is not currently installed -- working on this one with Fei.
Changed:
<
<
  • SRILM (Regression tests fail) -- fixed, 23-JUL-2007. (Locale issue -- LANG or LC_ALL must be set to C before regression tests will pass.)
>
>
  • SRILM (Regression tests fail) -- fixed, 23-JUL-2007. (Locale issue -- LANG or LC_ALL must be set to en_US instead of en_US.UTF-8 before regression tests will pass.)
 
  • Lingua-BrillTagger, Lingua-Wordnet Perl modules ("make test" fails)
  • Text-NSP-1.01 Perl module ("make test" fails)
  • WordNet-Similarity (won't build) -- fixed & installed, 16-JUL-2007

Revision 82007-07-23 - DavidBrodbeck

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Line: 23 to 23
 

Software on pongo that is not yet installed on patas

This should only be a temporary situation -- most of these will eventually make it onto the new cluster.
Changed:
<
<
  • The NLP_TOOLS directory from pongo is not currently installed.
  • SRILM (Regression tests fail)
>
>
  • The NLP_TOOLS directory from pongo is not currently installed -- working on this one with Fei.
  • SRILM (Regression tests fail) -- fixed, 23-JUL-2007. (Locale issue -- LANG or LC_ALL must be set to C before regression tests will pass.)
 
  • Lingua-BrillTagger, Lingua-Wordnet Perl modules ("make test" fails)
  • Text-NSP-1.01 Perl module ("make test" fails)
  • WordNet-Similarity (won't build) -- fixed & installed, 16-JUL-2007

Patas? What's that?

Changed:
<
<		Patas monkeys are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.
>
>		Patas monkeys (pronounced "pə'tä") are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.
 
Changed:
<
<		-- DavidBrodbeck - 13 Jul 2007
>
>		-- DavidBrodbeck - 23 Jul 2007
 

Revision 72007-07-18 - EmilyBender

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Changed:
<
<

How is it different from OpenMosix ?

>
>

How is it different from OpenMosix?

 If you've used our Pongo OpenMosix cluster, you may be wondering how Condor differs. There are some key differences:
Changed:
<
<
  • OpenMosix attempts to be transparent to the user. Processes are all run on the head node, and they are then migrated to available compute nodes. By contrast, Condor requires the user to set up the job specifically to be run on the cluster. (The software, however, does not need to be cluster-aware.)
  • OpenMosix jobs can be interactive; Condor jobs must run without user interaction.
  • OpenMosix cannot migrate jobs that use threads or shared memory, and jobs sometimes crash during migration. Condor can run any software that can be set up to run non-interactively, and it will have the same stability it would on a stand-alone system.
>
>
  • OpenMosix attempts to be transparent to the user. Processes are all run on the head node, and they are then migrated to available compute nodes. By contrast, Condor requires the user to set up the job specifically to be run on the cluster. (The software, however, does not need to be cluster-aware.)
  • OpenMosix jobs can be interactive; Condor jobs must run without user interaction.
  • OpenMosix cannot migrate jobs that use threads or shared memory, and jobs sometimes crash during migration. Condor can run any software that can be set up to run non-interactively, and it will have the same stability it would on a stand-alone system.
 

How do I get an account?

If you have a pongo account, you already have access to the Condor cluster. ssh to patas.ling.washington.edu.

Revision 62007-07-18 - DavidBrodbeck

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.

How is it different from OpenMosix ?

Changed:
<
<		If you've used our Pongo OpenMosix cluster, you may be wondering how Condor differs. There are some key, fundamental differences:
>
>		If you've used our Pongo OpenMosix cluster, you may be wondering how Condor differs. There are some key differences:
 
  • OpenMosix attempts to be transparent to the user. Processes are all run on the head node, and they are then migrated to available compute nodes. By contrast, Condor requires the user to set up the job specifically to be run on the cluster. (The software, however, does not need to be cluster-aware.)
  • OpenMosix jobs can be interactive; Condor jobs must run without user interaction.
  • OpenMosix cannot migrate jobs that use threads or shared memory, and jobs sometimes crash during migration. Condor can run any software that can be set up to run non-interactively, and it will have the same stability it would on a stand-alone system.
Line: 17 to 17
 

Software notes

This section documents differences between the software loaded on patas and the software loaded on pongo.
Changed:
<
<
  • The base operating system is Redhat Enterprise Linux Server 5, instead of Debian Stable.
>
>
  • The base operating system is Red Hat Enterprise Linux Server 5, instead of Debian Stable.
 
  • We are running a 64-bit operating system, with compatibility libraries to support 32-bit software.
  • The 64-bit version of Sun's Java Virtual Machine is installed. This provides nearly 4 gigabytes of heap space, instead of 2 gigabytes in the 32-bit version. This is also a server JVM, meaning it performs some extra optimization. This results in slower startup times but long-running jobs complete faster.

Software on pongo that is not yet installed on patas

This should only be a temporary situation -- most of these will eventually make it onto the new cluster.
Added:
>
>
  • The NLP_TOOLS directory from pongo is not currently installed.
 
  • SRILM (Regression tests fail)
  • Lingua-BrillTagger, Lingua-Wordnet Perl modules ("make test" fails)
  • Text-NSP-1.01 Perl module ("make test" fails)

Revision 52007-07-16 - DavidBrodbeck

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Line: 26 to 26
 
  • SRILM (Regression tests fail)
  • Lingua-BrillTagger, Lingua-Wordnet Perl modules ("make test" fails)
  • Text-NSP-1.01 Perl module ("make test" fails)
Changed:
<
<
>
>
  • WordNet-Similarity (won't build) -- fixed & installed, 16-JUL-2007
 

Patas? What's that?

Revision 42007-07-13 - DavidBrodbeck

Line: 1 to 1
 

patas.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.
Line: 23 to 23
 

Software on pongo that is not yet installed on patas

This should only be a temporary situation -- most of these will eventually make it onto the new cluster.
Changed:
<
<
  • SRILM (Library issues, must be recompiled)
>
>
  • SRILM (Regression tests fail)
 
  • Lingua-BrillTagger, Lingua-Wordnet Perl modules ("make test" fails)
  • Text-NSP-1.01 Perl module ("make test" fails)
Changed:
<
<
  • WordNet-Similarity (build issues)
>
>
 

Patas? What's that?

Revision 32007-07-13 - DavidBrodbeck

Line: 1 to 1
Changed:
<
<

kong.ling.washington.edu Condor Cluster

>
>

patas.ling.washington.edu Condor Cluster

 

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.

How is it different from OpenMosix ?

If you've used our Pongo OpenMosix cluster, you may be wondering how Condor differs. There are some key, fundamental differences:
Changed:
<
<
  • OpenMosix attempts to be transparent to the user. Processes are all run on the head node, and they are then migrated to available compute nodes. By contrast, Condor requires the user to set up the job specifically to be run on the cluster.
>
>
  • OpenMosix attempts to be transparent to the user. Processes are all run on the head node, and they are then migrated to available compute nodes. By contrast, Condor requires the user to set up the job specifically to be run on the cluster. (The software, however, does not need to be cluster-aware.)
 
  • OpenMosix jobs can be interactive; Condor jobs must run without user interaction.
  • OpenMosix cannot migrate jobs that use threads or shared memory, and jobs sometimes crash during migration. Condor can run any software that can be set up to run non-interactively, and it will have the same stability it would on a stand-alone system.

How do I get an account?

Changed:
<
<		If you have a pongo account, you already have access to the Condor cluster. ssh to kong.ling.washington.edu.
>
>		If you have a pongo account, you already have access to the Condor cluster. ssh to patas.ling.washington.edu.
 

How do I use it?

Visit the HowToUseCondor Wiki page for a quick introduction.

Software notes

Changed:
<
<		This section documents differences between the software loaded on kong and the software loaded on pongo.
>
>		This section documents differences between the software loaded on patas and the software loaded on pongo.
 
  • The base operating system is Redhat Enterprise Linux Server 5, instead of Debian Stable.
  • We are running a 64-bit operating system, with compatibility libraries to support 32-bit software.
  • The 64-bit version of Sun's Java Virtual Machine is installed. This provides nearly 4 gigabytes of heap space, instead of 2 gigabytes in the 32-bit version. This is also a server JVM, meaning it performs some extra optimization. This results in slower startup times but long-running jobs complete faster.
Changed:
<
<

Software on pongo that is not yet installed on kong

>
>

Software on pongo that is not yet installed on patas

 This should only be a temporary situation -- most of these will eventually make it onto the new cluster.
  • SRILM (Library issues, must be recompiled)
  • Lingua-BrillTagger, Lingua-Wordnet Perl modules ("make test" fails)
  • Text-NSP-1.01 Perl module ("make test" fails)
  • WordNet-Similarity (build issues)
Added:
>
>

Patas? What's that?

 
Changed:
<
<		-- DavidBrodbeck - 11 Jul 2007
>
>		Patas monkeys are slender, ground-dwelling primates found in central Africa. They can run faster than any other primate, reaching speeds of up to 55 km/hr.

-- DavidBrodbeck - 13 Jul 2007

 

Revision 22007-07-11 - DavidBrodbeck

Line: 1 to 1
 

kong.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.

How is it different from OpenMosix ?

If you've used our Pongo OpenMosix cluster, you may be wondering how Condor differs. There are some key, fundamental differences:
Changed:
<
<
  • OpenMosix is transparent to the user. Processes are all run on the head node, and they are then migrated to available compute nodes. By contrast, Condor requires the user to set up the job specifically to be run on the cluster.
>
>
  • OpenMosix attempts to be transparent to the user. Processes are all run on the head node, and they are then migrated to available compute nodes. By contrast, Condor requires the user to set up the job specifically to be run on the cluster.
 
  • OpenMosix jobs can be interactive; Condor jobs must run without user interaction.
  • OpenMosix cannot migrate jobs that use threads or shared memory, and jobs sometimes crash during migration. Condor can run any software that can be set up to run non-interactively, and it will have the same stability it would on a stand-alone system.
Line: 17 to 17
 

Software notes

This section documents differences between the software loaded on kong and the software loaded on pongo.
Changed:
<
<
  • The base operating system is RedHat Enterprise Linux Server 5, instead of Debian Stable.
>
>
  • The base operating system is Redhat Enterprise Linux Server 5, instead of Debian Stable.
 
  • We are running a 64-bit operating system, with compatibility libraries to support 32-bit software.
  • The 64-bit version of Sun's Java Virtual Machine is installed. This provides nearly 4 gigabytes of heap space, instead of 2 gigabytes in the 32-bit version. This is also a server JVM, meaning it performs some extra optimization. This results in slower startup times but long-running jobs complete faster.
Added:
>
>

Software on pongo that is not yet installed on kong

This should only be a temporary situation -- most of these will eventually make it onto the new cluster.
  • SRILM (Library issues, must be recompiled)
  • Lingua-BrillTagger, Lingua-Wordnet Perl modules ("make test" fails)
  • Text-NSP-1.01 Perl module ("make test" fails)
  • WordNet-Similarity (build issues)
 
Changed:
<
<		-- DavidBrodbeck - 10 Jul 2007
>
>		 -- DavidBrodbeck - 11 Jul 2007
 

Revision 12007-07-11 - DavidBrodbeck

Line: 1 to 1
Added:
>
>

kong.ling.washington.edu Condor Cluster

What is it?

Condor is a batch-oriented clustering system. Jobs are submitted into a job queue, matched with an available compute node, and run on that node.

How is it different from OpenMosix ?

If you've used our Pongo OpenMosix cluster, you may be wondering how Condor differs. There are some key, fundamental differences:
  • OpenMosix is transparent to the user. Processes are all run on the head node, and they are then migrated to available compute nodes. By contrast, Condor requires the user to set up the job specifically to be run on the cluster.
  • OpenMosix jobs can be interactive; Condor jobs must run without user interaction.
  • OpenMosix cannot migrate jobs that use threads or shared memory, and jobs sometimes crash during migration. Condor can run any software that can be set up to run non-interactively, and it will have the same stability it would on a stand-alone system.

How do I get an account?

If you have a pongo account, you already have access to the Condor cluster. ssh to kong.ling.washington.edu.

How do I use it?

Visit the HowToUseCondor Wiki page for a quick introduction.

Software notes

This section documents differences between the software loaded on kong and the software loaded on pongo.
  • The base operating system is RedHat Enterprise Linux Server 5, instead of Debian Stable.
  • We are running a 64-bit operating system, with compatibility libraries to support 32-bit software.
  • The 64-bit version of Sun's Java Virtual Machine is installed. This provides nearly 4 gigabytes of heap space, instead of 2 gigabytes in the 32-bit version. This is also a server JVM, meaning it performs some extra optimization. This results in slower startup times but long-running jobs complete faster.

-- DavidBrodbeck - 10 Jul 2007

View topic | History: r36 < r35 < r34 < r33 | More topic actions...
 
This site is powered by the TWiki collaboration platformCopyright &© by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback
Privacy Statement Terms & Conditions