| underh20.scubadiving@gmail.com 2006-09-21, 1:25 pm |
| Our Fujitsu 650 server has 16G memory and 4 x 2.16Ghz cpus. It runs
Solaris 10, Veritas File System / Volume Manager 4.1, Oracle 10g rel-2
and Websphere 6.0.2.11. Our application is experiencing slowness.
Users are blaming the server and prgrommers are blaming the database
and Java/Websphere.
I would like expert advice on finding out why our free memory is
getting low and paging occuring. Also, any suggestions on performance
turning will be greatly appreciated. Please find below outputs from
vmstat, top and mrb.
Thanks, Bill
# vmstat -p 3
memory page executable anonymous
filesystem
swap free re mf fr de sr epi epo epf api apo apf fpi
fpo fpf
18879568 1095152 161 501 139 0 9 39 0 0 1 3 3 1018
136 136
17549624 769640 146 380 0 0 0 0 0 0 0 0 0 56
0 0
17549728 769832 130 1178 8 0 0 0 0 0 0 0 0 16
11 8
17549656 769800 83 157 0 0 0 0 0 0 0 0 0 24
0 0
17551280 770704 9 69 0 0 0 0 0 0 5 0 0 24
0 0
17554408 772400 35 150 0 0 0 0 0 0 0 0 0 21
0 0
17551056 770376 68 353 0 0 0 0 0 0 0 0 0 13
0 0
17547024 768936 96 924 24 0 0 0 0 0 0 0 0 0
27 24
17544584 766752 50 703 0 0 0 3 0 0 3 0 0 27
0 0
17547216 769216 172 858 0 0 0 0 0 0 32 0 0 5
0 0
17547392 769712 12 15 0 0 0 0 0 0 16 0 0 112
0 0
17547776 769608 1 0 0 0 0 0 0 0 0 0 0 13
0 0
17548584 769952 14 133 3 0 0 0 0 0 0 0 0 0
3 3
17549184 769408 206 637 8 0 0 0 0 0 11 0 0 93
8 8
17550128 770520 156 648 0 0 0 0 0 0 0 0 0 74
0 0
17558368 777256 2 2 0 0 0 0 0 0 0 0 0 5
0 0
17558224 777128 300 2838 3 0 0 0 0 0 0 0 0 21
3 3
# top
last pid: 23955; load avg: 1.17, 1.60, 2.32; up 10+16:59:25
13:14:39
437 processes: 434 sleeping, 3 on cpu
CPU states: 68.2% idle, 27.4% user, 4.3% kernel, 0.0% iowait, 0.0%
swap
Memory: 16G phys mem, 468M free mem, 20G swap, 19G free swap
PID USERNAME LWP PRI NICE SIZE RES STATE TIME CPU COMMAND
27034 l1wasadm 102 0 10 1363M 1227M cpu 767:42 99.56% java
27515 l1wasadm 99 29 10 1283M 1143M sleep 118:08 4.68% java
26227 root 3 59 0 11M 6592K sleep 49:31 1.93% BESClient
8492 l1oasts 11 59 0 66M 26M sleep 155:20 1.00% oidldapd
23910 root 1 41 0 3656K 2480K cpu 0:00 0.89% top
26044 l1wasadm 78 29 10 408M 305M sleep 4:49 0.57% java
11533 l1proqa 1 59 0 1656M 1639M sleep 7:38 0.50% oracle
2294 root 6 59 0 7800K 1624K sleep 71:32 0.47% rmserver
26652 l1wasadm 90 29 10 870M 719M sleep 19:34 0.44% java
12951 root 1 59 0 15M 6536K sleep 5:36 0.35%
WebSphere5
25795 l1wasadm 73 29 10 464M 362M sleep 10:33 0.28% java
27786 l1prodv 13 54 0 1664M 1571M sleep 1:51 0.25% oracle
10753 l1proqa 1 59 0 1653M 1636M sleep 12:57 0.21% oracle
4466 root 61 29 10 241M 91M sleep 94:45 0.19% java
10960 l1proqa 29 29 10 269M 95M sleep 18:40 0.19% java
# mdb -k
Loading modules: [ unix krtld genunix specfs dtrace ufs sd fcp fctl ip
sctp usba nca md
logindmux ptm cpc fcip sppp random crypto nfs ipc ]
>
> ::memstat
Page Summary Pages MB %Tot
------------ ---------------- ---------------- ----
Kernel 310524 2425 15%
Anon 1347909 10530 65%
Exec and libs 102849 803 5%
Page cache 163654 1278 8%
Free (cachelist) 86524 675 4%
Free (freelist) 54830 428 3%
Total 2066290 16142
Physical 2023770 15810
|