Enhanced CPU and memory monitoring (7.6.3)

FortiWeb has enhanced its system monitoring capabilities to improve the precision of CPU and memory usage analysis. These enhancements enable the system to capture critical diagnostic data during high resource utilization events, facilitating more effective troubleshooting.

CPU Monitoring Enhancements

To address transient CPU spikes, FortiWeb now increases the sampling frequency to once per second. If CPU utilization exceeds the threshold (default: 90%), the system captures:

• The stack information of the top five processes with the highest CPU usage

• 10 seconds of perf data for in-depth performance analysis

• Proxy throughput statistics

Memory Monitoring Enhancements

Given the slower rate of memory consumption changes, FortiWeb monitors memory every five minutes. When utilization surpasses 90%, the system records:

• The top ten processes with the highest memory usage

• Overall memory status (/proc/meminfo, /proc/slabinfo)

• Active socket connections

• Proxy session statistics

Additionally, if memory usage fluctuates by more than 10%, the change is logged for historical comparison.

Configurable Parameters in new CLI configuration

Administrators can fine-tune monitoring behavior through the CLI:

config system cpumem-monitor
  set cpu-capture-interval <int>
  set cpu-check-interval <int>
  set cpu-high-threshold <int>
  set cpumem-monitor {enable|disable}
  set debug {enable|disable}
  set max-files <int>
  set mem-capture-interval <int>
  set mem-change-threshold <int>
  set mem-check-interval <int>
  set mem-high-threshold <int>
  set per-cpu-detect {enable|disable}
end

CPU Monitoring:

• cpu-high-threshold (default: 90%)

• cpu-check-interval (default: 1 second)

• cpu-capture-interval (default: 60 seconds)

Memory Monitoring:

• mem-high-threshold (default: 90%)

• mem-check-interval (default: 300 seconds)

• mem-change-threshold (default: 10%)

• mem-capture-interval (default: 1800 seconds)

Log Retention and Optimization

To prevent excessive disk usage, log files are limited to 100MB each, with a maximum of 10 retained CPU and memory log files. If CPU or memory utilization remains high over time, the data capture interval will gradually increase to reduce redundant logging.

Kernel-Level Monitoring Signals

FortiWeb introduces process-level CPU and memory monitoring at the kernel level:

• High CPU Usage Signal: If a process exceeds 90% CPU usage for 5 seconds, a signal is sent for handling.

• Memory Growth Signal: If a process’s memory usage increases by more than 100MB over five consecutive checks, a signal is sent for further action.

• Signal Handler Registration: Developers can register handlers to respond to CPU and memory alerts.