Difference between revisions of "Mainline Kernel Virtualization"

From Linux-VServer

Jump to: navigation, search
(Added Paul Menage's new patchset)
(+cat)
 
(5 intermediate revisions by 2 users not shown)
Line 27: Line 27:
  
 
: - support for a subsystem to keep a container alive via refcounts (e.g. the BeanCounters numfiles counter has a reference to the beancounter object from each file charged to that beancounter, so needs to be able to keep the beancounter alive until the file is destroyed)
 
: - support for a subsystem to keep a container alive via refcounts (e.g. the BeanCounters numfiles counter has a reference to the beancounter object from each file charged to that beancounter, so needs to be able to keep the beancounter alive until the file is destroyed)
 +
 +
* 12.02.2007 [http://lkml.org/lkml/2007/2/12/88 containers (V7): Generic Process Containers] by '''Paul Menage''' (from '''Google''')
 +
 +
: This is an update to my multi-hierarchy multi-subsystem generic process containers patch. Changes since V6 (22nd December) include:
 +
 +
: - updated to 2.6.20
 +
 +
: - added more details about multiple hierarchy support in the documentation
 +
 +
: - reduced the per-task memory overhead to one pointer (previously it was one pointer for each hierarchy). Now each task has a pointer to a container_group, which holds the pointers to the containers (one per active hierarchy) that the task is attached to and the associated per-subsystem state (one per active subsystem). This container group is shared (with reference counts) between all tasks that have the same set of container mappings.
 +
 +
: - added API support for binding/unbinding subsystems to/from active hierarchies, by remounting with -oremount,<new-subsys-list>. Currently this fails with EBUSY if the hierarchy has a child containers; full implementation support is left to a later patch.
 +
 +
: - added a bind() subsystem callback to indicate when a subsystem is moved between hierarchies
 +
 +
: - added container_clone(subsys, task), which creates a child container for the hierarchy that the specified subsystem is bound to, and moves the given task into that container. An example use of this would be in sys_unshare, which could, if the namespace container subsystem is active, create a child container when the new namespace is created.
 +
 +
: - temporarily removed the "release agent" support. It's only currently used by CPUsets, and intrudes somewhat on the per-container reference counting. If necessary it can be re-added, either as a generic subsystem feature or a CPUset-specific feature, via a kernel thread that periodically polls containers that have been designated as notify_on_release to see if they are releasable
 +
 +
* 06.04.2007 [http://lkml.org/lkml/2007/4/6/297 Containers (V8): Generic Process Containers] by '''Paul Menage''' (from '''Google''')
 +
 +
: This is an update to my multi-hierarchy multi-subsystem generic process containers patch. Changes since V7 (12th Feb) include:
 +
 +
: - Removed the config-time choice of the number of supported hierarchies - this is now completely dynamic; new hierarchies are allocated on demand, and freed when no longer in use.
 +
 +
: - Subsystems are now registered at compile-time in linux/container_subsys.h. This allows for faster access to subsystem state since the id is a compile-time constant, so there's only a single extra pointer dereference compared to having a pointer directly in the task_struct. It also avoids wasting space with unused subsystem pointers.
 +
 +
: - Removed the container pointers from container_group - this results in a structure very similar to Srivatsa Vaddagiri's rcfs approach. (RCFS uses the nsproxy object rather than the container_group object; merging container_group and nsproxy would be pretty straightforward if desired).
 +
 +
: - Removed callback_mutex from container subsystem to be purely back in the cpuset subsystem. Renamed manage_mutex to container_mutex.
 +
 +
: - Condensed post_attach_task() into attach_task() now that callback_mutex is purely within cpuset.c
 +
 +
: - Simplified the container_subsys_state reference counting - stricter rules on liveness make adding reference counts cheaper.
 +
 +
* 27.04.2007 [http://lkml.org/lkml/2007/4/27/146 Containers (V9): Generic Process Containers] by '''Paul Menage''' (from '''Google''')
 +
 +
: This is an update to my multi-hierarchy multi-subsystem generic process containers patch. Changes since V8 (April 6th) include:
 +
 +
: - The patchset has been rebased over 2.6.21-rc7-mm1
 +
 +
: - The patchset has been restructured based on feedback; more functionality is now split out into separate patches where practical.
 +
 +
: - The container_group structure has been renamed css_group since this is more descriptive of its true function
 +
 +
: - Added a simplified file registration interface, and a simple interface for the common operation of returning a single number to userspace from a container control file
 +
 +
: - Added a simple "debug" subsystem that is both an example of how to use the container system and a useful debugging tool for checking reference counts, etc.
 +
 +
* 29.05.2007 [http://kerneltrap.org/mailarchive/linux-kernel/2007/5/29/96922 Containers(V10): Generic Process Containers] by '''Paul Menage''' (from '''Google''')
 +
 +
: This is an update to my multi-hierarchy multi-subsystem generic process containers patch. Changes since V9 (April 27th) include:
 +
 +
: - The patchset has been rebased over 2.6.22-rc2-mm1
 +
 +
: - A lattice of lists linking tasks to their css_groups and css_groups to their containers has been added to support more efficient iteration across the member tasks of a container.
 +
 +
: - Support for the cpusets "release agent" functionality has been added back in; this is based on a workqueue concept similar to the changes that Cliff Wickman has been pushing for supporting CPU hot-unplug.
 +
 +
: - Several uses of tasklist_lock replaced by reliance on RCU
 +
 +
: - Misc cleanups
 +
 +
: - Tested with a tweaked version of PaulJ's cpuset_test script
 +
 +
* 20.07.2007 [http://lkml.org/lkml/2007/7/20/337 Task Containers(V11)] by '''Paul Menage''' (from '''Google''')
 +
 +
: This is an update to the task containers patchset.
 +
 +
: Changes since V10 (May 30th) include:
 +
 +
: - Based on 2.6.22-rc6-mm1 (minus existing container patches, see below)
 +
 +
: - Rolled in various fix/tidy patches contributed by akpm and others
 +
 +
: - Reorganisation of the mount/unmount code to use sget(); the new approach is modelled on the NFS superblock code. This fixes some potential lock inversions pointed out by lockdep.
 +
 +
: - Fix various lockdep warnings
 +
 +
: - Changed the create() subsystem callback to return a pointer to the new state object rather than updating the subsystem pointer in the container directly.
 +
 +
: - Changed container_add_file() to automatically prefix the subsystem name (and a period) on to all container files unless the filesystem is mounted with the "noprefix" option (intended for use by the legacy cpuset filesystem emulation). 
 +
 +
: - Added a release_agent= mount option to allow the release agent path to be specified at mount time.
 +
 +
: - css_put() is now completely non-blocking
 +
 +
: - css_get()/css_put() avoid taking/dropping reference counts on the root state since this can't be freed anyway; this saves some atomic ops
 +
 +
: API changes (for subsystem writers):
 +
: 1) return your new css object from create() callback
 +
: 2) remove the subsystem name prefix from your cftype structures
 +
: 3) pass your subsystem pointer as an additional new parameter to container_add_file() and container_add_files()
 +
 +
[[Category:Community]]

Latest revision as of 20:23, 21 October 2011

[edit] Actively Developed Patches

  • 19.09.2006 Containers(V2) by Rohit Seth (from Google) based on CPUsets
Over the limit memory handler is called when number of pages (anon + pagecache) exceed the limit. Currently, this memory handler scans the mappings and tasks belonging to container (file and anonymous) and tries to deactivate pages. If the number of page cache pages is also high then it also invalidate mappings.
This patchset extracts the process grouping code from cpusets into a generic container system, and makes the cpusets code a client of the container system.
It also provides a very simple additional container subsystem to do per-container CPU usage accounting; this is primarily to demonstrate use of the container subsystem API, but is useful in its own right.
This is an update to my generic containers patch. The major change is support for multiple hierarchies of containers (up to a limit specified at build time).
Note that this hasn't yet undergone intensive testing following the multi-hierarchy introduction, but I wanted to get the basic idea out for comments.
This is an update to my multi-hierarchy generic containers patch (against 2.6.19-rc6). Changes include:
- an example patch implementing the BeanCounters core and numfiles counters over generic containers. The addition of the BeanCounters code unifies the three main process grouping abstractions (Cpusets, ResGroups and BeanCounters).
- a patch splitting Cpusets into two independently groupable subsystems, Cpusets and Memsets.
- support for a subsystem to keep a container alive via refcounts (e.g. the BeanCounters numfiles counter has a reference to the beancounter object from each file charged to that beancounter, so needs to be able to keep the beancounter alive until the file is destroyed)
This is an update to my multi-hierarchy multi-subsystem generic process containers patch. Changes since V6 (22nd December) include:
- updated to 2.6.20
- added more details about multiple hierarchy support in the documentation
- reduced the per-task memory overhead to one pointer (previously it was one pointer for each hierarchy). Now each task has a pointer to a container_group, which holds the pointers to the containers (one per active hierarchy) that the task is attached to and the associated per-subsystem state (one per active subsystem). This container group is shared (with reference counts) between all tasks that have the same set of container mappings.
- added API support for binding/unbinding subsystems to/from active hierarchies, by remounting with -oremount,<new-subsys-list>. Currently this fails with EBUSY if the hierarchy has a child containers; full implementation support is left to a later patch.
- added a bind() subsystem callback to indicate when a subsystem is moved between hierarchies
- added container_clone(subsys, task), which creates a child container for the hierarchy that the specified subsystem is bound to, and moves the given task into that container. An example use of this would be in sys_unshare, which could, if the namespace container subsystem is active, create a child container when the new namespace is created.
- temporarily removed the "release agent" support. It's only currently used by CPUsets, and intrudes somewhat on the per-container reference counting. If necessary it can be re-added, either as a generic subsystem feature or a CPUset-specific feature, via a kernel thread that periodically polls containers that have been designated as notify_on_release to see if they are releasable
This is an update to my multi-hierarchy multi-subsystem generic process containers patch. Changes since V7 (12th Feb) include:
- Removed the config-time choice of the number of supported hierarchies - this is now completely dynamic; new hierarchies are allocated on demand, and freed when no longer in use.
- Subsystems are now registered at compile-time in linux/container_subsys.h. This allows for faster access to subsystem state since the id is a compile-time constant, so there's only a single extra pointer dereference compared to having a pointer directly in the task_struct. It also avoids wasting space with unused subsystem pointers.
- Removed the container pointers from container_group - this results in a structure very similar to Srivatsa Vaddagiri's rcfs approach. (RCFS uses the nsproxy object rather than the container_group object; merging container_group and nsproxy would be pretty straightforward if desired).
- Removed callback_mutex from container subsystem to be purely back in the cpuset subsystem. Renamed manage_mutex to container_mutex.
- Condensed post_attach_task() into attach_task() now that callback_mutex is purely within cpuset.c
- Simplified the container_subsys_state reference counting - stricter rules on liveness make adding reference counts cheaper.
This is an update to my multi-hierarchy multi-subsystem generic process containers patch. Changes since V8 (April 6th) include:
- The patchset has been rebased over 2.6.21-rc7-mm1
- The patchset has been restructured based on feedback; more functionality is now split out into separate patches where practical.
- The container_group structure has been renamed css_group since this is more descriptive of its true function
- Added a simplified file registration interface, and a simple interface for the common operation of returning a single number to userspace from a container control file
- Added a simple "debug" subsystem that is both an example of how to use the container system and a useful debugging tool for checking reference counts, etc.
This is an update to my multi-hierarchy multi-subsystem generic process containers patch. Changes since V9 (April 27th) include:
- The patchset has been rebased over 2.6.22-rc2-mm1
- A lattice of lists linking tasks to their css_groups and css_groups to their containers has been added to support more efficient iteration across the member tasks of a container.
- Support for the cpusets "release agent" functionality has been added back in; this is based on a workqueue concept similar to the changes that Cliff Wickman has been pushing for supporting CPU hot-unplug.
- Several uses of tasklist_lock replaced by reliance on RCU
- Misc cleanups
- Tested with a tweaked version of PaulJ's cpuset_test script
This is an update to the task containers patchset.
Changes since V10 (May 30th) include:
- Based on 2.6.22-rc6-mm1 (minus existing container patches, see below)
- Rolled in various fix/tidy patches contributed by akpm and others
- Reorganisation of the mount/unmount code to use sget(); the new approach is modelled on the NFS superblock code. This fixes some potential lock inversions pointed out by lockdep.
- Fix various lockdep warnings
- Changed the create() subsystem callback to return a pointer to the new state object rather than updating the subsystem pointer in the container directly.
- Changed container_add_file() to automatically prefix the subsystem name (and a period) on to all container files unless the filesystem is mounted with the "noprefix" option (intended for use by the legacy cpuset filesystem emulation).
- Added a release_agent= mount option to allow the release agent path to be specified at mount time.
- css_put() is now completely non-blocking
- css_get()/css_put() avoid taking/dropping reference counts on the root state since this can't be freed anyway; this saves some atomic ops
API changes (for subsystem writers):
1) return your new css object from create() callback
2) remove the subsystem name prefix from your cftype structures
3) pass your subsystem pointer as an additional new parameter to container_add_file() and container_add_files()
Retrieved from "http://linux-vserver.org/index.php?title=Mainline_Kernel_Virtualization&oldid=4887"
Personal tools