Difference between revisions of "Resource Limits"

From Linux-VServer

Jump to: navigation, search
 
Line 1: Line 1:
 
Most properties related to system resources, might it be the memory consumption, the number of processes or file-handles, qualify for imposing limits on them.
 
Most properties related to system resources, might it be the memory consumption, the number of processes or file-handles, qualify for imposing limits on them.
  
The Linux kernel provides the getrlimit and setrlimit system calls to get and set resource limits respectively.  Each resource has an associated soft and hard limit. The soft limit is the value that the kernel enforces for the corresponding resource.  The hard limit acts as a ceiling for the soft limit: an unprivileged process may only set its soft limit to a value in the range from 0 up to the hard limit, and (irreversibly) lower its hard limit.  A privileged process (under Linux: one with the CAP_SYS_RESOURCE capability) may make arbitrary changes to either limit value.
+
The Linux kernel provides the getrlimit and setrlimit system calls to get and set resource limits ''per process''.  Each resource has an associated soft and hard limit. The soft limit is the value that the kernel enforces for the corresponding resource.  The hard limit acts as a ceiling for the soft limit: an unprivileged process may only set its soft limit to a value in the range from 0 up to the hard limit, and (irreversibly) lower its hard limit.  A privileged process (one with the CAP_SYS_RESOURCE capability) may make arbitrary changes to either limit value.
  
The Linux-VServer kernel extends this system to provide resource limits for whole contexts, not just single processes. Additionally a few new limit types were introduced to be able to fine tune the existing limits.
+
The Linux-VServer kernel extends this system to provide resource limits for ''whole contexts'', not just single processes. Additionally a few new limit types missing in the vanilla kernel were introduced.
  
 
Additionally the context limit system keeps track of observed maxima and resource limit hits, to provide some feedback for the administrator. See [[Context Accounting]] for details.
 
Additionally the context limit system keeps track of observed maxima and resource limit hits, to provide some feedback for the administrator. See [[Context Accounting]] for details.
Line 36: Line 36:
 
|-
 
|-
 
| N
 
| N
| The limit can be set with vlimit using its name, rather than its number
+
| The limit cannot be set with vlimit using its name. Use its number instead.
 
|}
 
|}
  
Line 96: Line 96:
 
| RSS
 
| RSS
 
| -m
 
| -m
| AEN
+
| AE
 
| page
 
| page
 
| max resident set size
 
| max resident set size
Line 104: Line 104:
 
| PROC
 
| PROC
 
| -u
 
| -u
| AEN
+
| AE
 
| 1
 
| 1
 
| max number of processes
 
| max number of processes
Line 112: Line 112:
 
| FILES
 
| FILES
 
| -n
 
| -n
| AEN
+
| AE
 
| 1
 
| 1
 
| max number of open files
 
| max number of open files
Line 120: Line 120:
 
| VML
 
| VML
 
| -l
 
| -l
| AEN
+
| AE
 
| page
 
| page
 
| max locked-in-memory address space
 
| max locked-in-memory address space
Line 128: Line 128:
 
| VM
 
| VM
 
| -v
 
| -v
| AEN
+
| AE
 
| page
 
| page
 
| address space limit
 
| address space limit
Line 136: Line 136:
 
| LOCKS
 
| LOCKS
 
| -x
 
| -x
| AEN
+
| AE
 
| 1
 
| 1
 
| maximum file locks held
 
| maximum file locks held
Line 152: Line 152:
 
| MSGQ
 
| MSGQ
 
| -q
 
| -q
| AE
+
| AEN
 
| Byte
 
| Byte
 
| maximum bytes in POSIX mqueues
 
| maximum bytes in POSIX mqueues
Line 188: Line 188:
 
| NSOCK
 
| NSOCK
 
| SOCK
 
| SOCK
| AE
+
| AEN
 
| 1
 
| 1
 
| max number of open sockets
 
| max number of open sockets
Line 195: Line 195:
 
| OPENFD
 
| OPENFD
 
| OFD
 
| OFD
| AE
+
| AEN
 
| 1
 
| 1
 
| max number of open filedescriptors
 
| max number of open filedescriptors
Line 202: Line 202:
 
| ANON
 
| ANON
 
| ANON
 
| ANON
| AE
+
| AEN
 
| page
 
| page
 
| anonymous memory limit
 
| anonymous memory limit
Line 209: Line 209:
 
| SHMEM
 
| SHMEM
 
| SHM
 
| SHM
| AE
+
| AEN
 
| page
 
| page
 
| shared memory limit
 
| shared memory limit
Line 216: Line 216:
 
| SEMARY
 
| SEMARY
 
| SEMA
 
| SEMA
| A
+
| AN
 
| 1
 
| 1
 
| max number of semaphore arrays
 
| max number of semaphore arrays
Line 223: Line 223:
 
| NSEMS
 
| NSEMS
 
| SEMS
 
| SEMS
| A
+
| AN
 
| 1
 
| 1
 
| max number of semaphores
 
| max number of semaphores
Line 230: Line 230:
 
| DENTRY
 
| DENTRY
 
| DENT
 
| DENT
| AE
+
| AEN
 
| 1
 
| 1
 
| max number of dentry structs
 
| max number of dentry structs

Revision as of 18:00, 28 October 2006

Most properties related to system resources, might it be the memory consumption, the number of processes or file-handles, qualify for imposing limits on them.

The Linux kernel provides the getrlimit and setrlimit system calls to get and set resource limits per process. Each resource has an associated soft and hard limit. The soft limit is the value that the kernel enforces for the corresponding resource. The hard limit acts as a ceiling for the soft limit: an unprivileged process may only set its soft limit to a value in the range from 0 up to the hard limit, and (irreversibly) lower its hard limit. A privileged process (one with the CAP_SYS_RESOURCE capability) may make arbitrary changes to either limit value.

The Linux-VServer kernel extends this system to provide resource limits for whole contexts, not just single processes. Additionally a few new limit types missing in the vanilla kernel were introduced.

Additionally the context limit system keeps track of observed maxima and resource limit hits, to provide some feedback for the administrator. See Context Accounting for details.


Contents

List of resource limits

Below is a list of resource limits used for contexts and processes within. The tables contain the following information:

ID 
Resource limit ID
Name 
Human readable identifier used in userspace utilities
procfs 
Name used in /proc/virtual/*/limit
ulimit 
command line switch for the ulimit utility
Unit 
Aprropriate unit for the limit
Tag 
Special resource limit code to denote if resources are accounted, enforced (see below)
Description 
Description of capability/flag effects

Special resource limit codes

The tag column may contain one or more of the following tags:

Tag Description
A Limit will be accounted
E Limit will be enforced
N The limit cannot be set with vlimit using its name. Use its number instead.

Linux Resource Limits

Below is a list of resource limits available in vanilla Linux (>=2.6.18).

ID Name procfs ulimit Tag Unit Description
0 CPU -- -t ms CPU time in ms
1 FSIZE -- -f KiB Maximum filesize
2 DATA -- -d KiB max data size
3 STACK -- -s KiB max stack size
4 CORE -- -c KiB max core file size
5 RSS RSS -m AE page max resident set size
6 NPROC PROC -u AE 1 max number of processes
7 NOFILE FILES -n AE 1 max number of open files
8 MEMLOCK VML -l AE page max locked-in-memory address space
9 AS VM -v AE page address space limit
10 LOCKS LOCKS -x AE 1 maximum file locks held
11 SIGPENDING -- -i 1 max number of pending signals
12 MSGQUEUE MSGQ -q AEN Byte maximum bytes in POSIX mqueues
13 NICE -- 1 max nice prio allowed to raise to
14 RTPRIO -- -r 1 maximum realtime priority

Linux-VServer Resource Limits

Below is a list of additional resource limits available in the Linux-VServer kernel.

ID Name procfs Tag Unit Description
16 NSOCK SOCK AEN 1 max number of open sockets
17 OPENFD OFD AEN 1 max number of open filedescriptors
18 ANON ANON AEN page anonymous memory limit
19 SHMEM SHM AEN page shared memory limit
20 SEMARY SEMA AN 1 max number of semaphore arrays
21 NSEMS SEMS AN 1 max number of semaphores
22 DENTRY DENT AEN 1 max number of dentry structs

Determinig the Page Size

You can use the following program to determine the page size for your architecture (if it supports the getpagesize() function)

#include <stdlib.h>
#include <stdint.h>
#include <unistd.h>

int main(int argc, char *argv[])
{
        int page_size = getpagesize();
        printf("The page size is %d\n", page_size);
        exit(0);
}

Here's how to compile and run it (assuming you save it as pagesize.c):

# gcc pagesize.c -o pagesize
# ./pagesize 
The page size is 4096

Note: Whether getpagesize() is present as a Linux system call depends on the architecture. If it is, it returns the kernel symbol PAGE_SIZE, which is architecture and machine model dependent. Generally, one uses binaries that are architecture but not machine model dependent, in order to have a single binary distribution per architecture. This means that a user program should not find PAGE_SIZE at compile time from a header file, but use an actual system call, at least for those architectures (like sun4) where this dependency exists. Here libc4, libc5, glibc 2.0 fail because their getpagesize() returns a statically derived value, and does not use a system call. Things are OK in glibc 2.1.

If you prefer, you can get the pagesize using python, just start a python console and write:

>>> import resource
>>> resource.getpagesize()
4096

Configure Resource Limits in util-vserver

For example, if the adress space size (AS) and the resident set size (RSS) should be limited, the appropriate config files should be the following. You might have to create parent directories first.

# ls -al /etc/vservers/myguest/rlimits
total 28
drwxr-xr-x  2 root root 4096 2005-08-24 12:37 .
drwxr-xr-x  5 root root 4096 2005-08-24 00:22 ..
-rw-r--r--  1 root root    6 2005-08-24 12:43 as
-rw-r--r--  1 root root    6 2005-08-24 12:37 rss

# cat /etc/vservers/myguest/rlimits/as
90000

# cat /etc/vservers/myguest/rlimits/rss
10000
Personal tools