Monitoring LoadLeveler jobs on Big Red at IU

On this page:

• Useful commands for checking job status
• Common status codes
• Cancelling jobs

Useful commands for checking job status

Following are some useful commands for checking the status of LoadLeveler jobs you're running on Big Red at Indiana University. Most of the examples use the llq command, and listed are only a few of the most useful options for llq. For a complete explanation of all llq options, enter:

• To determine the current status of all submitted jobs, enter: llq
• To limit the listing to only those jobs in a specific queue (or class), enter: llq -c queuename

  Replace queuename with the appropriate queue name. To get a description of all Big Red queues, enter:

  llclass
• To see the status of only your jobs, enter: llq -u username

  Replace username with your username. To add multiple usernames, separate them with spaces.

• To see the status of all your jobs in a certain queue, enter: llq -c queuename -u username
• To see brief information about a particular job, enter: llq jobid

  Replace jobid with the appropriate job ID. To add multiple job IDs, separate them with spaces.

• For detailed information about a job, enter: llq -l -s jobid

  If the job status is Idle, Queued, or Deferred, a detailed job evaluation will appear in the last section of the output, which should help you determine why your job is not running.

  For further diagnostic information, use the Maui command checkjob -v jobid.

• If your job isn't running, find out when it's scheduled using the Maui command showstart jobid.
  
  
• For the most detailed information about a job, enter: llq -l -x jobid

  Note: The -x and -s options are incompatible.

• For a detailed list of the statuses for all your jobs, enter: llq -username -l

  Note: This will produce a long output if you have many jobs.

• To determine the status of all nodes on Big Red, enter: llstatus

  This will produce about one thousand lines of output, one for each node on Big Red. For a description of the fields displayed, enter:

  man llstatus

Common status codes

Following are the more common status codes:

Cancelling jobs

To cancel jobs you have submitted to LoadLeveler, whether they're waiting to run or already running, use the llcancel command:

Replace jobid with the appropriate job ID.

If you want to keep a job in its place in the queue, but prevent it from running, you can put it on hold. Enter:

To release it from hold, enter:

This document was developed with support from the National Science Foundation (NSF) under Grant No. 0503697 to the University of Chicago and subcontracted to Indiana University. Additional support was provided by IU through its participation in the TeraGrid, which is supported by the NSF under Grants No. 0833618, SCI451237, SCI535258, and SCI504075. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the NSF.

Comments/Questions/Corrections