From Wiki-UX.info

Wiki-UX / How to report CPU usage using Glance
Jump to: navigation, search

How to report CPU usage using Glance

The following article describes how to use Glance to create a report of the CPU utilization by process ID.

Contents

Create report configuration file

# cat > /tmp/cpu-report.cfg << EOF
DATA TYPE PROCESS
DATE
TIME
PROC_PROC_ID
PROC_PROC_NAME
PROC_CPU_TOTAL_UTIL
PROC_CPU_TOTAL_UTIL_CUM
PROC_CPU_TOTAL_TIME_CUM
CPU_TOTAL_UTIL
EOF

Create extract report

Create a report between know and the previous day

# extract -p -xp -r /tmp/cpu-report.cfg -f /tmp/cpu-report.out,purge -b TODAY-1 -e LAST
 
 
Writing PROCESS data to file /tmp/cpu-report.out

Create a report between a time range

extract -p -xp -r /tmp/cpu-report.cfg -f /tmp/cpu-report.out,purge \
-b "08/24/09 06:00" -e "08/24/09 08:00"

Example Report

# cat /tmp/cpu-report.out
Process                CPU       CPU
   Date      Time      PID           Name        CPU %   % Cum   Time Cum
...
04/28/2009 17:37:00      24860 gzip               58.35   60.49       36.01
04/28/2009 17:37:00       1457 mxdomainmgr         0.06    0.99     1032.23
04/28/2009 17:37:00      24859 pax                 1.10    2.03        1.21
04/28/2009 17:37:00      24528 list_expander       9.06    6.41        7.68
04/28/2009 17:38:00      24860 gzip               80.57   70.97       84.85
04/28/2009 17:38:00       1457 mxdomainmgr         0.00    0.99     1032.60
04/28/2009 17:38:00      24859 pax                 2.17    2.32        2.78
04/28/2009 17:39:00      24860 gzip               91.49   78.58      140.55
04/28/2009 17:39:00       1457 mxdomainmgr         0.00    0.99     1032.90
04/28/2009 17:39:00      24859 pax                 1.10    2.20        3.95
04/28/2009 17:40:00      24860 gzip               90.37   81.82      195.76
04/28/2009 17:40:00       1457 mxdomainmgr         0.00    0.99     1033.21
04/28/2009 17:40:00      24859 pax                 1.08    2.10        5.04
04/28/2009 17:41:00         66 vxfsd               0.00    0.01       59.19
04/28/2009 17:41:00      24860 gzip               82.80   82.34      247.05
04/28/2009 17:41:00       1457 mxdomainmgr         0.00    0.99     1033.53
04/28/2009 17:41:00      24859 pax                 3.17    2.42        7.27
04/28/2009 17:42:00         66 vxfsd               0.00    0.01       59.24
04/28/2009 17:42:00      24860 gzip               56.52   78.23      281.29
04/28/2009 17:42:00      24862 sh                 24.90    5.87       21.12
04/28/2009 17:42:00       1457 mxdomainmgr         0.00    0.99     1033.88
...

Note that the report have one minute time frame for the processes. The colums shows the average CPU usage, the Cumulative CPU usage and the Cumulative Time of the running process.

Sorting Report

To quickly check what processes are taking the most cpu time, the report can be order by the key colum, for example, for the CPU % column (5), you can use:

( head -n 2 cpu-report.out ; tail -n $(expr $(cat cpu-report.out | wc -l) - 2) cpu-report.out | \
sort -nrk 5,5 ) | head -n 100

For example:

# ( head -n 2 cpu-report.out ; \
> tail -n $(expr $(cat cpu-report.out | wc -l) - 2) cpu-report.out | \
> sort -nrk 5,5 ) | head -n 100
                                   Process                CPU       CPU
   Date      Time      PID           Name        CPU %   % Cum   Time Cum
06/04/2009 00:21:00      20538 oraclegpopa        72.18   60.74      437.56
06/04/2009 02:34:01      22688 oraclegpopc        71.68   59.19      178.10
06/04/2009 00:29:00      20538 oraclegpopa        71.19   63.20      758.71
06/04/2009 00:23:00      20538 oraclegpopa        71.15   61.96      520.67
06/04/2009 00:31:00      20538 oraclegpopa        70.18   63.46      837.46
06/04/2009 00:34:00      20538 oraclegpopa        70.17   64.12      962.30
06/04/2009 00:18:00      20538 oraclegpopa        69.18   59.07      318.82
06/05/2009 00:44:00      29812 oraclegpopa        69.17   62.56     1051.41
06/05/2009 02:38:00       6194 oraclegpopc        69.15   50.19       60.25
06/05/2009 02:34:00      23592 oraclegpopc        68.39   57.73      174.05
06/04/2009 00:36:00      20538 oraclegpopa        68.18   64.27     1041.23
06/04/2009 00:37:00      20538 oraclegpopa        68.17   64.45     1082.82
06/04/2009 00:33:00      20538 oraclegpopa        68.17   63.83      919.49
06/05/2009 00:24:00      29812 oraclegpopa        68.15   61.27      294.54
06/04/2009 02:16:00      14544 gzip               67.21   48.95       58.53
06/04/2009 02:14:00      27748 oraclegpop1        67.21   58.52      175.50
06/05/2009 00:46:00      29812 oraclegpopa        67.19   62.25     1120.61
06/05/2009 00:34:00      29812 oraclegpopa        67.18   62.00      670.04
06/04/2009 00:27:00      20538 oraclegpopa        67.17   62.56      675.97
06/04/2009 00:22:00      20538 oraclegpopa        66.28   61.24      477.87
06/04/2009 00:02:00      12548 oraclegpopa        66.19   45.91      908.74
06/05/2009 00:32:00      29812 oraclegpopa        66.18   61.68      591.85
06/05/2009 02:41:00       6194 oraclegpopc        66.17   56.82      170.42
06/04/2009 00:32:00      20538 oraclegpopa        66.17   63.62      877.61
06/04/2009 00:38:00      20538 oraclegpopa        66.16   64.53     1122.71
06/04/2009 00:26:00      20538 oraclegpopa        66.15   62.23      634.56
06/05/2009 00:27:00      29812 oraclegpopa        66.14   61.85      408.26
06/05/2009 00:26:00      29812 oraclegpopa        66.14   61.34      368.12
06/04/2009 22:53:00      24603 symparser          65.70    0.79      564.02
06/05/2009 02:33:00      23592 oraclegpopc        65.50   54.68      131.31
06/04/2009 00:24:00      20538 oraclegpopa        65.18   62.20      559.80
06/04/2009 00:13:00      20538 oraclegpopa        65.17   56.56      136.06
06/05/2009 00:37:00      29812 oraclegpopa        65.15   62.04      781.88
06/05/2009 00:23:00      29812 oraclegpopa        65.15   60.18      252.51
06/04/2009 00:28:00      20538 oraclegpopa        65.15   62.74      715.38
06/04/2009 02:13:00      27748 oraclegpop1        64.22   56.16      134.73
06/05/2009 00:42:00      29812 oraclegpopa        64.19   62.28      972.09
06/05/2009 02:14:00      28008 oraclegpop1        64.18   56.17      168.38
06/05/2009 00:14:00      20972 oraclegpopa        64.18   46.03     1104.91
06/04/2009 00:04:00      12548 oraclegpopa        64.18   46.70      981.02
06/04/2009 02:31:01      22688 oraclegpopc        64.17   50.87       61.79
06/04/2009 00:11:00      20538 oraclegpopa        64.17   49.73       59.94
06/05/2009 00:19:00      29812 oraclegpopa        64.14   56.97      102.72
06/04/2009 00:19:00      20538 oraclegpopa        64.14   59.75      358.09
06/05/2009 00:41:00      29812 oraclegpopa        63.19   62.17      933.07
06/05/2009 00:38:00      29812 oraclegpopa        63.17   62.14      820.59
06/04/2009 00:16:00      20538 oraclegpopa        63.17   57.24      240.59
06/05/2009 00:22:00      29812 oraclegpopa        63.16   59.19      212.99
06/05/2009 00:21:00      29812 oraclegpopa        63.16   58.21      174.68
06/05/2009 00:29:00      29812 oraclegpopa        63.14   61.95      483.28

Report CPU process Hogs

Once you have identified the major CPU process hogs, the next step consist in extracting from the consolidated report those samples that contains information of the process. The following script to report only the oraclegp* processes. The awk code snip on the for loop extract only process matching the pattern and remove duplicated names before creating the process reports:

#! /usr/bin/bash
printf "Process name pattern: "
read PATTERN
 
for process in `grep ${PATTERN}|> cpu-report.out | sort -k 4,4 | \
awk 'BEGIN {PROC="foo"} {if ($4 != PROC) {printf "%s\n", $4; PROC = $4 }}'`
do
 
# Extract process reports
echo "Extracting $process..."
/usr/xpg4/bin/tail -n $(expr $(cat cpu-report.out | wc -l) - 2) cpu-report.out | \
grep $process | \
awk 'BEGIN {LINE=1; print "#Spl   Date       Time       PID Process Name     CPU % CPU % Cum  CPU Time Cum"}
{ if (NF == 7) {
 printf "%-6d %10s %8s %5d %-16s %5.2f %9.2f %13.2f\n", \
 LINE, $1, $2, $3, $4, $5, $6, $7
 LINE++
 }
}' > $process.out

Chart process hoags

#! /usr/bin/bash
printf "Process name pattern: "
read PATTERN
 
for process in `grep ${PATTERN}|> cpu-report.out | sort -k 4,4 | \
awk 'BEGIN {PROC="foo"} {if ($4 != PROC) {printf "%s\n", $4; PROC = $4 }}'`
do
 
# Extract process reports
echo "Extracting $process..."
/usr/xpg4/bin/tail -n $(expr $(cat cpu-report.out | wc -l) - 2) cpu-report.out | \
grep $process | \
awk 'BEGIN {LINE=1; print "#Spl   Date       Time       PID Process Name     CPU % CPU % Cum  CPU Time Cum"}
{ if (NF == 7) {
 printf "%-6d %10s %8s %5d %-16s %5.2f %9.2f %13.2f\n", \
 LINE, $1, $2, $3, $4, $5, $6, $7
 LINE++
 }
}' > $process.out
 
# Gnuplot chart creation (only CPU %)
cat > process.plt<<EOF
set terminal png
set size 1,1
set xlabel "Samples"
set ylabel "% CPU"
set yrange [0:120]
set output "$process.png"
plot "$process.out" using 1:6 title "$process CPU usage" with lines
EOF
 
echo "Plotting $process.png."
/usr/sfw/bin/gnuplot process.plt 2> /dev/null
 
mv $process.out $process.png glance
 
done
 
rm *.plt

Creating CSV files

for process in `grep oraclegp cpu-report.out | sort -k 4,4 | \
awk 'BEGIN {PROC="foo"} {if ($4 != PROC) {printf "%s\n", $4; PROC = $4 }}'`
do
/usr/xpg4/bin/tail -n $(expr $(cat cpu-report.out | wc -l) - 2) cpu-report.out | \
grep $process | \
awk 'BEGIN {print "\"Date and Time\",\"PID\",\"Process Name\",\"CPU %\",\"CPU % Cum\",\"CPU Time Cum\""}
{printf "\"%s %s\",\"%6d\",\"%s\",\"%4.2f\",\"%4.2f\",\"%4.2f\"\n", \
$1, $2, $3, $4, $5, $6, $7}' | unix2dos > csv/$process.csv
done

More Scripts

for time in `sort -rnk 3,3 sarc.avg | head -n 21 | sort -nk 2,2 | 
awk '{print substr($2, 1, 5)}'`
do
grep "$time" cpu-report.out
done | sort -rnk 5,5 | head -n 21

Authors

This page was last modified on 25 August 2009, at 15:36. This page has been accessed 9,971 times.