Increase file descriptors on Linux and Linux Docker containers

2 minute readReferenceScalability

A file descriptor is an object that a process uses to read or write to an open file and open network sockets (although there are other uses).

Operating systems place limits on the number of file descriptors that a process can open. In addition to per-process limits, an OS also has a global limit on the number of file descriptors that all its processes, together, might consume.

A common bottleneck in the default Linux operating system configuration is a lack of file descriptors.

CloudBees CD/RO server

a CloudBees CD/RO server uses approximately one file descriptor per running job step and three per uncompleted job.

The following example configures CloudBees CD/RO to use a new limit of 32768:

  1. Add the following line to the init script for the CloudBees CD/RO Server (in /etc/init.d/commander ) before the su - command:

    ulimit -n 32768
  2. Restart the CloudBees CD/RO server:

    /etc/init.d/commanderServer restart

CloudBees CD/RO Agent

a CloudBees CD/RO agent uses at least two file descriptors per running job step.

It is important to make sure that operating systems on high traffic sites are configured to provide sufficient numbers of file descriptors to CloudBees CD/RO.

The following example describes how to raise the maximum number of file descriptors to 32768 for the CloudBees CD/RO process on the Red Hat Linux distribution:

  1. Allow all users to modify their file descriptor limits from an initial value of 1024 up to the maximum permitted value of 32768 by changing /etc/security/limits.conf. The following two lines should be part of the file contents:

    soft nofile 1024
    hard nofile 32768
  2. In /etc/pam.d/login, add the following line if it does not already exist:

    session required pam_limits.so
  3. Configure CloudBees CD/RO to use the new limits. Add the following line to the init script for the CloudBees CD/RO Agent (in /etc/init.d/ecmdrAgent or /etc/init.d/commanderAgent ):

    ulimit -n 32768
  4. Restart the CloudBees CD/RO agent:

    /etc/init.d/commanderAgent restart