AIX 5L Problem Determination - IBM Redbooks

Since this system is a 4-way SMP, the overall CPU usage is only 25 percent. To
analyze what is actually happening on this system, use the trace facility. Notice
that the process ID of aixterm is 19436.
This aixterm command process seems to wait continuously; therefore, the
tracing time is limited to one second.
Using the following command sequence, all system events for one second are
traced:
# trace -a; sleep 1; trcstop
It is not known what the aixterm process is doing since no event hook IDs can be
specified at this point. The trace generates a raw trace file of the following size:
# ls -l /var/adm/ras/trcfile
-rw-rw-rw- 1 root system 557152 Jul 17 14:27 /var/adm/ras/trcfile
Based on this file, a trace report can be generated with trcrpt. Since the
process ID is known, you can use this information as a filter and limit the output
of the report using the following commands:
# trcrpt -p 19436 > /tmp/trace.out
# ls -l /tmp/trace.out
-rw-r--r-- 1 root system 201014 Jul 17 14:31 /tmp/trace.out
The contents of the trace report is provided in the following example as an
extracted part of the complete report (limited due to space constraints):
Mon Jul 17 14:27:27 2000
System: AIX server1 Node: 4
Machine: 000BC6FD4C00
Internet Address: 0903F038 9.3.240.56
The system contains 4 cpus, of which 4 were traced.
Buffering: Kernel Heap
This is from a 32-bit kernel.
trace -a
ID ELAPSED_SEC DELTA_MSEC APPL SYSCALL KERNEL INTERRUPT
100 0.004256674 4.256674 DECREMENTER
INTERRUPT iar=D031EB
60 cpuid=FFFFFFFF
234 0.004258505 0.001831 clock: iar=D031EB60
lr=D036CA24 [2503
usec]
112 0.004260143 0.001638 lock: lock lock
addr=352118 loc
k status=10000001 requested_mode=LOCK_READ return addr=2D80C name=0000.0000
Chapter 9. System access and printer problem determination 215