Adaptive mutex spin: 139987 events in 14.090 seconds (9935 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 76496 55% 55% 0.00 75843 256 Bucket sdt_probe+0x38 43200 31% 86% 0.00 462604 256 Bucket (usermode) 4925 4% 89% 0.00 29671 vm reserv domain sdt_probe+0x38 4398 3% 92% 0.00 60709 UPVO entry (usermode) 2785 2% 94% 0.00 119445 vm reserv domain (usermode) 1536 1% 95% 0.00 27744 32 Bucket sdt_probe+0x38 1182 1% 96% 0.00 74569 UPVO entry sdt_probe+0x38 627 0% 97% 0.00 76759 vm active pagequeue (usermode) 576 0% 97% 0.00 113210 32 Bucket (usermode) 540 0% 97% 0.00 23746 vm active pagequeue sdt_probe+0x38 525 0% 98% 0.00 24657 vnode interlock sdt_probe+0x38 464 0% 98% 0.00 592656 pmap (usermode) 387 0% 98% 0.00 158799 kernelpmap (usermode) 308 0% 99% 0.00 36194 vm page free queue (usermode) 266 0% 99% 0.00 216536 xhci0 (usermode) 157 0% 99% 0.00 32431 ttymtx sdt_probe+0x38 146 0% 99% 0.00 70634 ttymtx (usermode) 121 0% 99% 0.00 99274 kernelpmap sdt_probe+0x38 112 0% 99% 0.00 68252 so_snd sdt_probe+0x38 110 0% 99% 0.00 137218 process lock (usermode) 107 0% 99% 0.00 172905 sellck (usermode) 94 0% 99% 0.00 65768 so_rcv sdt_probe+0x38 90 0% 99% 0.00 34627 process lock sdt_probe+0x38 75 0% 99% 0.00 8825 pipe mutex sdt_probe+0x38 75 0% 100% 0.00 343254 SLB table (usermode) 71 0% 100% 0.00 231325 vnode interlock (usermode) 62 0% 100% 0.00 21857 vm inactive pagequeue sdt_probe+0x38 56 0% 100% 0.00 143370 so_snd (usermode) 56 0% 100% 0.00 118932 pipe mutex (usermode) 52 0% 100% 0.00 25866 vm pgcache sdt_probe+0x38 49 0% 100% 0.00 21267 vm page free queue sdt_probe+0x38 40 0% 100% 0.00 287008 vm inactive pagequeue (usermode) 39 0% 100% 0.00 121226 xhci0 sdt_probe+0x38 33 0% 100% 0.00 133892 kqueue (usermode) 22 0% 100% 0.00 53358 vm pgcache (usermode) 22 0% 100% 0.00 326783 so_rcv (usermode) 20 0% 100% 0.00 97313 process_exit sdt_probe+0x38 20 0% 100% 0.00 41573 SLB table sdt_probe+0x38 18 0% 100% 0.00 13250 select mtxpool sdt_probe+0x38 14 0% 100% 0.00 138584 pmap sdt_probe+0x38 12 0% 100% 0.00 10771 cred (usermode) 11 0% 100% 0.00 193153 bge3 sdt_probe+0x38 10 0% 100% 0.00 146032 bounce pages lock sdt_probe+0x38 9 0% 100% 0.00 4417 CAM doneq (usermode) 8 0% 100% 0.00 407378 bge3 (usermode) 7 0% 100% 0.00 18547 thread_dtor sdt_probe+0x38 7 0% 100% 0.00 163124 bounce pages lock (usermode) 6 0% 100% 0.00 11739 USB device mutex sdt_probe+0x38 5 0% 100% 0.00 172599 USB device mutex (usermode) 4 0% 100% 0.00 65810 sellck sdt_probe+0x38 4 0% 100% 0.00 8611 kqueue sdt_probe+0x38 3 0% 100% 0.00 440937 select mtxpool (usermode) 3 0% 100% 0.00 1040665 process_exit (usermode) 2 0% 100% 0.00 32582 umass0 sdt_probe+0x38 2 0% 100% 0.00 297145 umass0 (usermode) 2 0% 100% 0.00 6394 cred sdt_probe+0x38 2 0% 100% 0.00 52201 FFS (usermode) 1 0% 100% 0.00 5127 vm map (system) sdt_probe+0x38 1 0% 100% 0.00 34487 umass2 (usermode) 1 0% 100% 0.00 25712 umass1 sdt_probe+0x38 1 0% 100% 0.00 31410 umass1 (usermode) 1 0% 100% 0.00 47122 umass3 (usermode) 1 0% 100% 0.00 24614 umass3 sdt_probe+0x38 1 0% 100% 0.00 96024 ncvn (usermode) 1 0% 100% 0.00 23292 ncvn sdt_probe+0x38 1 0% 100% 0.00 5705 process_exec (usermode) 1 0% 100% 0.00 1269 procid sdt_probe+0x38 1 0% 100% 0.00 20959 FFS sdt_probe+0x38 1 0% 100% 0.00 395324 AHCI channel lock sdt_probe+0x38 1 0% 100% 0.00 91357 exec args kva sdt_probe+0x38 1 0% 100% 0.00 6311 itimer lock (usermode) ------------------------------------------------------------------------------- Adaptive mutex block: 14 events in 14.090 seconds (1 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 4 29% 29% 0.00 582718 xhci0 sdt_probe+0x38 3 21% 50% 0.00 671342 umass0 sdt_probe+0x38 3 21% 71% 0.00 1040592 sellck sdt_probe+0x38 1 7% 79% 0.00 455445 xhci0 (usermode) 1 7% 86% 0.00 748407 umass1 sdt_probe+0x38 1 7% 93% 0.00 3771495 kernelpmap sdt_probe+0x38 1 7% 100% 0.00 1762182 select mtxpool sdt_probe+0x38 ------------------------------------------------------------------------------- Spin lock spin: 125928 events in 14.090 seconds (8937 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 115762 92% 92% 0.00 0 witness lock (usermode) 6410 5% 97% 0.00 0 witness lock sdt_probe+0x38 2851 2% 99% 0.00 1452172 sleepq chain (usermode) 196 0% 99% 0.00 1527926 smp rendezvous (usermode) 183 0% 100% 0.00 152861 sleepq chain sdt_probe+0x38 138 0% 100% 0.00 1174830 turnstile chain (usermode) 121 0% 100% 0.00 287206 turnstile chain sdt_probe+0x38 62 0% 100% 0.00 31517 turnstile lock sdt_probe+0x38 51 0% 100% 0.00 88391 callout (usermode) 38 0% 100% 0.00 60998 callout sdt_probe+0x38 28 0% 100% 0.00 222234 smp rendezvous sdt_probe+0x38 15 0% 100% 0.00 28503 et_hw_mtx sdt_probe+0x38 12 0% 100% 0.00 48102 turnstile lock (usermode) 11 0% 100% 0.00 24266 et_hw_mtx (usermode) 2 0% 100% 0.00 53553 sched lock 6 (usermode) 2 0% 100% 0.00 13805 sched lock 21 (usermode) 2 0% 100% 0.00 111063 sched lock 134 (usermode) 2 0% 100% 0.00 19748 sched lock 12 (usermode) 2 0% 100% 0.00 278175 sched lock 0 (usermode) 2 0% 100% 0.00 101909 bge_taskq sdt_probe+0x38 1 0% 100% 0.00 10178 sched lock 9 (usermode) 1 0% 100% 0.00 5838 sched lock 74 (usermode) 1 0% 100% 0.00 11295 sched lock 85 (usermode) 1 0% 100% 0.00 12438 sched lock 88 (usermode) 1 0% 100% 0.00 109457 sched lock 63 (usermode) 1 0% 100% 0.00 12610 sched lock 58 (usermode) 1 0% 100% 0.00 126304 sched lock 63 sdt_probe+0x38 1 0% 100% 0.00 11709 sched lock 68 (usermode) 1 0% 100% 0.00 320819 sched lock 71 (usermode) 1 0% 100% 0.00 56190 sched lock 4 sdt_probe+0x38 1 0% 100% 0.00 11967 sched lock 32 (usermode) 1 0% 100% 0.00 5506 sched lock 23 sdt_probe+0x38 1 0% 100% 0.00 214155 sched lock 159 (usermode) 1 0% 100% 0.00 1598 sched lock 22 (usermode) 1 0% 100% 0.00 84796 sched lock 48 sdt_probe+0x38 1 0% 100% 0.00 11219 sched lock 46 sdt_probe+0x38 1 0% 100% 0.00 46969 sched lock 40 (usermode) 1 0% 100% 0.00 6594 sched lock 51 sdt_probe+0x38 1 0% 100% 0.00 34581 sched lock 50 sdt_probe+0x38 1 0% 100% 0.00 27401 sched lock 52 (usermode) 1 0% 100% 0.00 182 sched lock 54 (usermode) 1 0% 100% 0.00 1655 sched lock 157 (usermode) 1 0% 100% 0.00 5738 sched lock 156 sdt_probe+0x38 1 0% 100% 0.00 13545 sched lock 153 (usermode) 1 0% 100% 0.00 59314 sched lock 153 sdt_probe+0x38 1 0% 100% 0.00 441745 sched lock 141 (usermode) 1 0% 100% 0.00 188441 sched lock 142 sdt_probe+0x38 1 0% 100% 0.00 49939 sched lock 144 (usermode) 1 0% 100% 0.00 21269 sched lock 132 (usermode) 1 0% 100% 0.00 17209 sched lock 13 sdt_probe+0x38 1 0% 100% 0.00 173601 sched lock 134 sdt_probe+0x38 1 0% 100% 0.00 167112 sched lock 135 sdt_probe+0x38 1 0% 100% 0.00 5440 sched lock 140 (usermode) 1 0% 100% 0.00 12207 sched lock 103 (usermode) 1 0% 100% 0.00 494 sched lock 0 sdt_probe+0x38 1 0% 100% 0.00 18671 sched lock 110 (usermode) 1 0% 100% 0.00 1798 sched lock 107 (usermode) 1 0% 100% 0.00 25718 sched lock 129 (usermode) ------------------------------------------------------------------------------- Thread lock spin: 1279 events in 14.090 seconds (91 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 87 7% 7% 0.00 31589 sched lock 142 sdt_probe+0x38 72 6% 12% 0.00 45179 sched lock 140 sdt_probe+0x38 51 4% 16% 0.00 167212 sched lock 0 sdt_probe+0x38 33 3% 19% 0.00 36365 sched lock 136 sdt_probe+0x38 29 2% 21% 0.00 21855 sched lock 158 sdt_probe+0x38 27 2% 23% 0.00 34006 sched lock 141 sdt_probe+0x38 22 2% 25% 0.00 22301 sched lock 159 sdt_probe+0x38 22 2% 27% 0.00 32879 sched lock 156 sdt_probe+0x38 22 2% 29% 0.00 28552 sched lock 132 sdt_probe+0x38 21 2% 30% 0.00 22430 sched lock 110 sdt_probe+0x38 20 2% 32% 0.00 27615 sched lock 28 sdt_probe+0x38 17 1% 33% 0.00 16403 sched lock 155 sdt_probe+0x38 17 1% 34% 0.00 68751 sched lock 135 sdt_probe+0x38 15 1% 36% 0.00 75893 sched lock 48 sdt_probe+0x38 15 1% 37% 0.00 31745 sched lock 134 sdt_probe+0x38 14 1% 38% 0.00 5440 sched lock 130 sdt_probe+0x38 13 1% 39% 0.00 17995 sched lock 144 sdt_probe+0x38 13 1% 40% 0.00 6431 sched lock 131 sdt_probe+0x38 12 1% 41% 0.00 9575 sched lock 1 sdt_probe+0x38 11 1% 42% 0.00 43140 sched lock 7 sdt_probe+0x38 11 1% 43% 0.00 49623 sched lock 51 sdt_probe+0x38 11 1% 43% 0.00 38476 sched lock 24 sdt_probe+0x38 11 1% 44% 0.00 180483 sched lock 148 sdt_probe+0x38 11 1% 45% 0.00 9209 sched lock 127 sdt_probe+0x38 10 1% 46% 0.00 45220 sched lock 88 sdt_probe+0x38 10 1% 47% 0.00 17287 sched lock 54 sdt_probe+0x38 10 1% 47% 0.00 18289 sched lock 137 sdt_probe+0x38 10 1% 48% 0.00 55943388 sched lock 105 sdt_probe+0x38 9 1% 49% 0.00 70883 sched lock 99 sdt_probe+0x38 9 1% 50% 0.00 28980 sched lock 89 sdt_probe+0x38 9 1% 50% 0.00 113014 sched lock 76 sdt_probe+0x38 9 1% 51% 0.00 5390 sched lock 64 sdt_probe+0x38 9 1% 52% 0.00 108559 sched lock 60 sdt_probe+0x38 9 1% 52% 0.00 20607 sched lock 4 sdt_probe+0x38 9 1% 53% 0.00 11152 sched lock 31 sdt_probe+0x38 9 1% 54% 0.00 20254 sched lock 30 sdt_probe+0x38 9 1% 55% 0.00 17996 sched lock 157 sdt_probe+0x38 9 1% 55% 0.00 9020 sched lock 151 sdt_probe+0x38 9 1% 56% 0.00 55003 sched lock 139 sdt_probe+0x38 9 1% 57% 0.00 21847 sched lock 119 sdt_probe+0x38 9 1% 57% 0.00 7360 sched lock 117 sdt_probe+0x38 9 1% 58% 0.00 29761 sched lock 108 sdt_probe+0x38 9 1% 59% 0.00 5873 sched lock 106 sdt_probe+0x38 8 1% 59% 0.00 25830 sched lock 56 sdt_probe+0x38 8 1% 60% 0.00 28033 sched lock 53 sdt_probe+0x38 8 1% 61% 0.00 4815 sched lock 40 sdt_probe+0x38 8 1% 61% 0.00 4670 sched lock 25 sdt_probe+0x38 8 1% 62% 0.00 14847 sched lock 152 sdt_probe+0x38 8 1% 63% 0.00 22504 sched lock 147 sdt_probe+0x38 8 1% 63% 0.00 3874 sched lock 126 sdt_probe+0x38 8 1% 64% 0.00 13787 sched lock 124 sdt_probe+0x38 8 1% 64% 0.00 13507 sched lock 116 sdt_probe+0x38 8 1% 65% 0.00 5865 sched lock 115 sdt_probe+0x38 8 1% 66% 0.00 19439 sched lock 11 sdt_probe+0x38 7 1% 66% 0.00 80453 sleepq chain sdt_probe+0x38 7 1% 67% 0.00 6647 sched lock 87 sdt_probe+0x38 7 1% 67% 0.00 49420 sched lock 66 sdt_probe+0x38 7 1% 68% 0.00 27049 sched lock 5 sdt_probe+0x38 7 1% 68% 0.00 172277 sched lock 39 sdt_probe+0x38 7 1% 69% 0.00 15798 sched lock 21 sdt_probe+0x38 7 1% 70% 0.00 13879 sched lock 154 sdt_probe+0x38 7 1% 70% 0.00 8446 sched lock 146 sdt_probe+0x38 7 1% 71% 0.00 7936 sched lock 133 sdt_probe+0x38 7 1% 71% 0.00 9864 sched lock 13 sdt_probe+0x38 7 1% 72% 0.00 14710 sched lock 114 sdt_probe+0x38 7 1% 72% 0.00 5333 sched lock 111 sdt_probe+0x38 7 1% 73% 0.00 6425 sched lock 107 sdt_probe+0x38 7 1% 73% 0.00 5532 sched lock 101 sdt_probe+0x38 6 0% 74% 0.00 5140 sched lock 98 sdt_probe+0x38 6 0% 74% 0.00 2742 sched lock 96 sdt_probe+0x38 6 0% 75% 0.00 9078 sched lock 95 sdt_probe+0x38 6 0% 75% 0.00 8693 sched lock 92 sdt_probe+0x38 6 0% 76% 0.00 18997 sched lock 9 sdt_probe+0x38 6 0% 76% 0.00 13288 sched lock 68 sdt_probe+0x38 6 0% 77% 0.00 5800 sched lock 55 sdt_probe+0x38 6 0% 77% 0.00 60960216 sched lock 49 sdt_probe+0x38 6 0% 78% 0.00 46512 sched lock 29 sdt_probe+0x38 6 0% 78% 0.00 5588 sched lock 2 sdt_probe+0x38 6 0% 78% 0.00 6372 sched lock 150 sdt_probe+0x38 6 0% 79% 0.00 119969 sched lock 138 sdt_probe+0x38 6 0% 79% 0.00 7020 sched lock 123 sdt_probe+0x38 6 0% 80% 0.00 19411 sched lock 122 sdt_probe+0x38 6 0% 80% 0.00 12167 sched lock 120 sdt_probe+0x38 6 0% 81% 0.00 11940 sched lock 12 sdt_probe+0x38 6 0% 81% 0.00 85187 sched lock 104 sdt_probe+0x38 5 0% 82% 0.00 7901 sched lock 86 sdt_probe+0x38 5 0% 82% 0.00 65260 sched lock 84 sdt_probe+0x38 5 0% 82% 0.00 4454 sched lock 80 sdt_probe+0x38 5 0% 83% 0.00 15430 sched lock 73 sdt_probe+0x38 5 0% 83% 0.00 5801 sched lock 71 sdt_probe+0x38 5 0% 84% 0.00 13971 sched lock 70 sdt_probe+0x38 5 0% 84% 0.00 9235 sched lock 69 sdt_probe+0x38 5 0% 84% 0.00 25250 sched lock 62 sdt_probe+0x38 5 0% 85% 0.00 16969 sched lock 52 sdt_probe+0x38 5 0% 85% 0.00 14150 sched lock 47 sdt_probe+0x38 5 0% 86% 0.00 3178 sched lock 44 sdt_probe+0x38 5 0% 86% 0.00 12674 sched lock 42 sdt_probe+0x38 5 0% 86% 0.00 11743 sched lock 153 sdt_probe+0x38 5 0% 87% 0.00 19829 sched lock 15 sdt_probe+0x38 5 0% 87% 0.00 10521 sched lock 145 sdt_probe+0x38 5 0% 88% 0.00 36712 sched lock 14 sdt_probe+0x38 5 0% 88% 0.00 5771 sched lock 121 sdt_probe+0x38 5 0% 88% 0.00 15205 sched lock 102 sdt_probe+0x38 4 0% 89% 0.00 3159 sched lock 93 sdt_probe+0x38 4 0% 89% 0.00 6811 sched lock 81 sdt_probe+0x38 4 0% 89% 0.00 9155 sched lock 78 sdt_probe+0x38 4 0% 90% 0.00 30291 sched lock 63 sdt_probe+0x38 4 0% 90% 0.00 161297 sched lock 6 sdt_probe+0x38 4 0% 90% 0.00 9878 sched lock 37 sdt_probe+0x38 4 0% 91% 0.00 20293 sched lock 34 sdt_probe+0x38 4 0% 91% 0.00 91550 sched lock 33 sdt_probe+0x38 4 0% 91% 0.00 9834 sched lock 32 sdt_probe+0x38 4 0% 91% 0.00 3991 sched lock 27 sdt_probe+0x38 4 0% 92% 0.00 7021 sched lock 23 sdt_probe+0x38 4 0% 92% 0.00 6532 sched lock 22 sdt_probe+0x38 4 0% 92% 0.00 23269 sched lock 18 sdt_probe+0x38 4 0% 93% 0.00 13229 sched lock 17 sdt_probe+0x38 3 0% 93% 0.00 13413 sched lock 94 sdt_probe+0x38 3 0% 93% 0.00 8070 sched lock 90 sdt_probe+0x38 3 0% 93% 0.00 13056 sched lock 79 sdt_probe+0x38 3 0% 94% 0.00 14594 sched lock 77 sdt_probe+0x38 3 0% 94% 0.00 24673 sched lock 74 sdt_probe+0x38 3 0% 94% 0.00 10228 sched lock 67 sdt_probe+0x38 3 0% 94% 0.00 23820 sched lock 59 sdt_probe+0x38 3 0% 95% 0.00 17196 sched lock 58 sdt_probe+0x38 3 0% 95% 0.00 7347 sched lock 50 sdt_probe+0x38 3 0% 95% 0.00 6327 sched lock 46 sdt_probe+0x38 3 0% 95% 0.00 27813 sched lock 41 sdt_probe+0x38 3 0% 96% 0.00 4998 sched lock 36 sdt_probe+0x38 3 0% 96% 0.00 3623 sched lock 19 sdt_probe+0x38 3 0% 96% 0.00 10807 sched lock 16 sdt_probe+0x38 3 0% 96% 0.00 2142 sched lock 149 sdt_probe+0x38 3 0% 96% 0.00 3538 sched lock 129 sdt_probe+0x38 3 0% 97% 0.00 5810 sched lock 118 sdt_probe+0x38 3 0% 97% 0.00 8313 sched lock 113 sdt_probe+0x38 3 0% 97% 0.00 20507 sched lock 112 sdt_probe+0x38 3 0% 97% 0.00 20475 sched lock 103 sdt_probe+0x38 2 0% 98% 0.00 5051 sched lock 97 sdt_probe+0x38 2 0% 98% 0.00 3637 sched lock 85 sdt_probe+0x38 2 0% 98% 0.00 7011 sched lock 75 sdt_probe+0x38 2 0% 98% 0.00 45852 sched lock 72 sdt_probe+0x38 2 0% 98% 0.00 233212 sched lock 65 sdt_probe+0x38 2 0% 98% 0.00 20450 sched lock 38 sdt_probe+0x38 2 0% 99% 0.00 5567 sched lock 3 sdt_probe+0x38 2 0% 99% 0.00 3305 sched lock 143 sdt_probe+0x38 2 0% 99% 0.00 4315 sched lock 125 sdt_probe+0x38 2 0% 99% 0.00 11018 sched lock 128 sdt_probe+0x38 2 0% 99% 0.00 5440 sched lock 109 sdt_probe+0x38 2 0% 99% 0.00 3496 sched lock 10 sdt_probe+0x38 1 0% 99% 0.00 25288 sched lock 91 sdt_probe+0x38 1 0% 99% 0.00 4950 sched lock 8 sdt_probe+0x38 1 0% 100% 0.00 206678 sched lock 82 sdt_probe+0x38 1 0% 100% 0.00 3090 sched lock 61 sdt_probe+0x38 1 0% 100% 0.00 21496 sched lock 45 sdt_probe+0x38 1 0% 100% 0.00 5125 sched lock 43 sdt_probe+0x38 1 0% 100% 0.00 20365 sched lock 20 sdt_probe+0x38 1 0% 100% 0.00 143400737 sched lock 35 sdt_probe+0x38 1 0% 100% 0.00 24834 callout sdt_probe+0x38 ------------------------------------------------------------------------------- R/W writer blocked by writer: 151 events in 14.090 seconds (11 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 29 19% 19% 0.00 24118958 page pv 232 (usermode) 23 15% 34% 0.00 20925166 page pv 229 (usermode) 8 5% 40% 0.00 29583232 page pv 229 sdt_probe+0x38 6 4% 44% 0.00 38784720 page pv 228 sdt_probe+0x38 5 3% 47% 0.00 49328840 page pv 84 (usermode) 5 3% 50% 0.00 56773581 page pv 228 (usermode) 4 3% 53% 0.00 14209796 page pv 232 sdt_probe+0x38 4 3% 56% 0.00 7966116 page pv 22 sdt_probe+0x38 3 2% 58% 0.00 2436392 page pv 82 (usermode) 3 2% 60% 0.00 13567775 page pv 6 sdt_probe+0x38 3 2% 62% 0.00 191778912 page pv 45 (usermode) 3 2% 64% 0.00 44697428 page pv 253 sdt_probe+0x38 3 2% 66% 0.00 25110627 page pv 253 (usermode) 3 2% 68% 0.00 40913553 page pv 251 (usermode) 3 2% 70% 0.00 110878811 page pv 234 (usermode) 2 1% 71% 0.00 31644926 page pv 80 sdt_probe+0x38 2 1% 72% 0.00 49713652 page pv 254 sdt_probe+0x38 2 1% 74% 0.00 839777 page pv 252 (usermode) 2 1% 75% 0.00 136412869 page pv 252 sdt_probe+0x38 2 1% 76% 0.00 32003307 page pv 251 sdt_probe+0x38 2 1% 77% 0.00 96493674 page pv 249 (usermode) 2 1% 79% 0.00 504763944 page pv 20 sdt_probe+0x38 2 1% 80% 0.00 22450636 page pv 186 sdt_probe+0x38 2 1% 81% 0.00 18007199 page pv 17 (usermode) 2 1% 83% 0.00 4475444 page pv 128 sdt_probe+0x38 1 1% 83% 0.00 405897 page pv 89 sdt_probe+0x38 1 1% 84% 0.00 172253 page pv 86 sdt_probe+0x38 1 1% 85% 0.00 70154260 page pv 80 (usermode) 1 1% 85% 0.00 8097414 page pv 79 (usermode) 1 1% 86% 0.00 4993084 page pv 79 sdt_probe+0x38 1 1% 87% 0.00 262350164 page pv 57 sdt_probe+0x38 1 1% 87% 0.00 225360062 page pv 57 (usermode) 1 1% 88% 0.00 435188445 page pv 52 (usermode) 1 1% 89% 0.00 43991570 page pv 53 sdt_probe+0x38 1 1% 89% 0.00 62247468 page pv 45 sdt_probe+0x38 1 1% 90% 0.00 87611157 page pv 46 (usermode) 1 1% 91% 0.00 3680509 page pv 36 sdt_probe+0x38 1 1% 91% 0.00 4033022 page pv 36 (usermode) 1 1% 92% 0.00 7910744 page pv 39 sdt_probe+0x38 1 1% 93% 0.00 16422878 page pv 42 sdt_probe+0x38 1 1% 93% 0.00 70361737 page pv 44 sdt_probe+0x38 1 1% 94% 0.00 427126 page pv 25 sdt_probe+0x38 1 1% 95% 0.00 4644468 page pv 22 (usermode) 1 1% 95% 0.00 1873276 page pv 199 sdt_probe+0x38 1 1% 96% 0.00 27120566 page pv 2 sdt_probe+0x38 1 1% 97% 0.00 986177 page pv 16 sdt_probe+0x38 1 1% 97% 0.00 17741280 page pv 17 sdt_probe+0x38 1 1% 98% 0.00 67749245 page pv 195 sdt_probe+0x38 1 1% 99% 0.00 343886 page pv 118 sdt_probe+0x38 1 1% 99% 0.00 1656291 page pv 120 sdt_probe+0x38 1 1% 100% 0.00 386232 page pv 127 sdt_probe+0x38 ------------------------------------------------------------------------------- R/W writer blocked by readers: 11 events in 14.090 seconds (1 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 7 64% 64% 0.00 39091653 vmobject (usermode) 4 36% 100% 0.00 20864627 vmobject sdt_probe+0x38 ------------------------------------------------------------------------------- R/W writer spin on writer: 170216 events in 14.090 seconds (12080 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 34181 20% 20% 0.00 5364539 page pv 229 (usermode) 11528 7% 27% 0.00 81656 page pv 182 sdt_probe+0x38 8272 5% 32% 0.00 3056621 page pv 182 (usermode) 7961 5% 36% 0.00 69386 page pv 23 sdt_probe+0x38 7356 4% 41% 0.00 83605 page pv 183 sdt_probe+0x38 7126 4% 45% 0.00 270029 page pv 229 sdt_probe+0x38 6426 4% 49% 0.00 67694 page pv 24 sdt_probe+0x38 6284 4% 52% 0.00 86578 page pv 15 sdt_probe+0x38 6264 4% 56% 0.00 53369 page pv 25 sdt_probe+0x38 4406 3% 59% 0.00 3400947 page pv 183 (usermode) 4058 2% 61% 0.00 2496665 page pv 15 (usermode) 3754 2% 63% 0.00 4643891 page pv 228 (usermode) 3673 2% 65% 0.00 17830881 page pv 250 (usermode) 3586 2% 67% 0.00 486450 page pv 120 (usermode) 2442 1% 69% 0.00 4227072 page pv 23 (usermode) 2411 1% 70% 0.00 1442806 page pv 24 (usermode) 2294 1% 72% 0.00 94410 page pv 120 sdt_probe+0x38 1750 1% 73% 0.00 85295 page pv 250 sdt_probe+0x38 1619 1% 74% 0.00 18653881 page pv 248 (usermode) 1530 1% 75% 0.00 46248609 page pv 249 (usermode) 1313 1% 75% 0.00 19221361 page pv 251 (usermode) 1263 1% 76% 0.00 2914428 page pv 25 (usermode) 1244 1% 77% 0.00 35650629 page pv 232 (usermode) 1230 1% 78% 0.00 182311 page pv 228 sdt_probe+0x38 1090 1% 78% 0.00 265042 page pv 136 (usermode) 950 1% 79% 0.00 214312 page pv 184 (usermode) 844 0% 79% 0.00 13589956 page pv 48 (usermode) 784 0% 80% 0.00 100435 page pv 128 (usermode) 700 0% 80% 0.00 881694 page pv 216 (usermode) 693 0% 81% 0.00 24449338 page pv 40 (usermode) 620 0% 81% 0.00 13551329 page pv 80 (usermode) 609 0% 81% 0.00 2353642 page pv 56 (usermode) 584 0% 82% 0.00 11405496 page pv 16 (usermode) 491 0% 82% 0.00 1048274 page pv 72 (usermode) 481 0% 82% 0.00 61807841 page pv 53 (usermode) 454 0% 82% 0.00 350847 page pv 251 sdt_probe+0x38 449 0% 83% 0.00 276953 page pv 240 (usermode) 430 0% 83% 0.00 92128 page pv 192 (usermode) 417 0% 83% 0.00 42850676 page pv 20 (usermode) 416 0% 83% 0.00 61401 page pv 249 sdt_probe+0x38 409 0% 84% 0.00 21162272 page pv 82 (usermode) 401 0% 84% 0.00 4601800 page pv 8 (usermode) 387 0% 84% 0.00 50494573 page pv 19 (usermode) 377 0% 84% 0.00 38036500 page pv 83 (usermode) 373 0% 85% 0.00 165962 page pv 96 (usermode) 344 0% 85% 0.00 103829 page pv 208 (usermode) 331 0% 85% 0.00 93213 page pv 168 (usermode) 330 0% 85% 0.00 198802 page pv 224 (usermode) 323 0% 85% 0.00 69622713 page pv 41 (usermode) 317 0% 86% 0.00 29281012 page pv 84 (usermode) 311 0% 86% 0.00 89044 page pv 56 sdt_probe+0x38 311 0% 86% 0.00 333649 page pv 185 (usermode) 307 0% 86% 0.00 5644991 page pv 73 (usermode) 304 0% 86% 0.00 247332 page pv 64 (usermode) 295 0% 86% 0.00 118757 page pv 0 (usermode) 281 0% 87% 0.00 23362931 page pv 51 (usermode) 276 0% 87% 0.00 43194689 page pv 49 (usermode) 273 0% 87% 0.00 106607 page pv 248 sdt_probe+0x38 270 0% 87% 0.00 13199137 page pv 86 (usermode) 270 0% 87% 0.00 29708040 page pv 17 (usermode) 269 0% 87% 0.00 36479838 page pv 21 (usermode) 263 0% 88% 0.00 14430993 page pv 76 (usermode) 260 0% 88% 0.00 51033751 page pv 50 (usermode) 258 0% 88% 0.00 37090220 page pv 52 (usermode) 248 0% 88% 0.00 38208203 page pv 18 (usermode) 247 0% 88% 0.00 11696615 page pv 78 (usermode) 241 0% 88% 0.00 31398984 page pv 252 (usermode) 238 0% 88% 0.00 52530232 page pv 45 (usermode) 237 0% 89% 0.00 19570780 page pv 70 (usermode) 229 0% 89% 0.00 44797477 page pv 22 (usermode) 220 0% 89% 0.00 23894819 page pv 233 (usermode) 210 0% 89% 0.00 53221738 page pv 235 (usermode) 208 0% 89% 0.00 61175 page pv 224 sdt_probe+0x38 205 0% 89% 0.00 458500 page pv 241 (usermode) 204 0% 89% 0.00 49723073 page pv 37 (usermode) 204 0% 89% 0.00 90553 page pv 185 sdt_probe+0x38 203 0% 90% 0.00 119444 page pv 144 (usermode) 200 0% 90% 0.00 97080 page pv 200 (usermode) 199 0% 90% 0.00 3887891 page pv 32 (usermode) 198 0% 90% 0.00 1457656 page pv 26 (usermode) 198 0% 90% 0.00 102940 page pv 181 sdt_probe+0x38 197 0% 90% 0.00 1792398 page pv 91 (usermode) 195 0% 90% 0.00 39181614 page pv 54 (usermode) 195 0% 90% 0.00 43018516 page pv 39 (usermode) 194 0% 90% 0.00 28711631 page pv 253 (usermode) 193 0% 91% 0.00 123473 page pv 152 (usermode) 190 0% 91% 0.00 133656 page pv 88 (usermode) 189 0% 91% 0.00 16630397 page pv 69 (usermode) 188 0% 91% 0.00 73419213 page pv 234 (usermode) 186 0% 91% 0.00 122813 page pv 240 sdt_probe+0x38 185 0% 91% 0.00 6780478 page pv 77 (usermode) 181 0% 91% 0.00 41496250 page pv 35 (usermode) 177 0% 91% 0.00 45608544 page pv 42 (usermode) 176 0% 91% 0.00 46309088 page pv 43 (usermode) 174 0% 92% 0.00 34477832 page pv 44 (usermode) 173 0% 92% 0.00 6556948 page pv 57 (usermode) 172 0% 92% 0.00 107580 page pv 57 sdt_probe+0x38 172 0% 92% 0.00 481508 page pv 123 (usermode) 170 0% 92% 0.00 27986094 page pv 236 (usermode) 169 0% 92% 0.00 445877 page pv 181 (usermode) 165 0% 92% 0.00 13580930 page pv 34 (usermode) 163 0% 92% 0.00 9697854 page pv 87 (usermode) 162 0% 92% 0.00 10136308 page pv 79 (usermode) 161 0% 92% 0.00 50188 page pv 123 sdt_probe+0x38 155 0% 93% 0.00 49456 page pv 92 sdt_probe+0x38 153 0% 93% 0.00 124042 page pv 176 (usermode) 146 0% 93% 0.00 19766090 page pv 63 (usermode) 136 0% 93% 0.00 23977719 page pv 254 (usermode) 136 0% 93% 0.00 78325 page pv 241 sdt_probe+0x38 134 0% 93% 0.00 209936 page pv 160 (usermode) 132 0% 93% 0.00 79427 page pv 72 sdt_probe+0x38 132 0% 93% 0.00 103408 page pv 246 sdt_probe+0x38 131 0% 93% 0.00 3133642 page pv 245 (usermode) 130 0% 93% 0.00 225580 page pv 226 (usermode) 128 0% 93% 0.00 53359430 page pv 46 (usermode) 125 0% 93% 0.00 73625 page pv 226 sdt_probe+0x38 122 0% 93% 0.00 50770000 page pv 38 (usermode) 118 0% 94% 0.00 11431399 page pv 71 (usermode) 115 0% 94% 0.00 13095228 page pv 55 (usermode) 112 0% 94% 0.00 829513 page pv 92 (usermode) 112 0% 94% 0.00 36664856 page pv 47 (usermode) 109 0% 94% 0.00 8532027 page pv 85 (usermode) 108 0% 94% 0.00 340950 page pv 247 (usermode) 106 0% 94% 0.00 87076 page pv 8 sdt_probe+0x38 106 0% 94% 0.00 81822 page pv 144 sdt_probe+0x38 106 0% 94% 0.00 121043 page pv 136 sdt_probe+0x38 105 0% 94% 0.00 154865 page pv 80 sdt_probe+0x38 105 0% 94% 0.00 347442 page pv 137 (usermode) 103 0% 94% 0.00 38264494 page pv 36 (usermode) 103 0% 94% 0.00 604733 page pv 118 (usermode) 102 0% 94% 0.00 8504768 page pv 66 (usermode) 101 0% 94% 0.00 84426 page pv 88 sdt_probe+0x38 99 0% 94% 0.00 81472 page pv 216 sdt_probe+0x38 98 0% 95% 0.00 5906970 page pv 9 (usermode) 96 0% 95% 0.00 82212 page pv 40 sdt_probe+0x38 96 0% 95% 0.00 38545 page pv 178 sdt_probe+0x38 94 0% 95% 0.00 107498 page pv 97 sdt_probe+0x38 94 0% 95% 0.00 119343 page pv 247 sdt_probe+0x38 94 0% 95% 0.00 90794 page pv 244 sdt_probe+0x38 94 0% 95% 0.00 148025 page pv 104 (usermode) 91 0% 95% 0.00 86954 page pv 192 sdt_probe+0x38 90 0% 95% 0.00 520030 page pv 244 (usermode) 89 0% 95% 0.00 135013 page pv 73 sdt_probe+0x38 88 0% 95% 0.00 292567 page pv 201 (usermode) 87 0% 95% 0.00 2025571 page pv 81 (usermode) 87 0% 95% 0.00 10989728 page pv 239 (usermode) 87 0% 95% 0.00 23618655 page pv 238 (usermode) 86 0% 95% 0.00 141906 page pv 184 sdt_probe+0x38 85 0% 95% 0.00 26239765 page pv 237 (usermode) 85 0% 95% 0.00 70983 page pv 118 sdt_probe+0x38 83 0% 95% 0.00 106185 page pv 96 sdt_probe+0x38 83 0% 95% 0.00 34388 page pv 188 sdt_probe+0x38 82 0% 96% 0.00 75880 page pv 128 sdt_probe+0x38 79 0% 96% 0.00 68815 page pv 245 sdt_probe+0x38 74 0% 96% 0.00 199154 page pv 188 (usermode) 72 0% 96% 0.00 69609 page pv 104 sdt_probe+0x38 70 0% 96% 0.00 86749 page pv 91 sdt_probe+0x38 70 0% 96% 0.00 14781688 page pv 58 (usermode) 69 0% 96% 0.00 130949 page pv 0 sdt_probe+0x38 67 0% 96% 0.00 373707 page pv 246 (usermode) 66 0% 96% 0.00 185869 page pv 169 (usermode) 65 0% 96% 0.00 556231 page pv 225 (usermode) 63 0% 96% 0.00 2124977 page pv 232 sdt_probe+0x38 63 0% 96% 0.00 177701 page pv 16 sdt_probe+0x38 62 0% 96% 0.00 695690 page pv 20 sdt_probe+0x38 62 0% 96% 0.00 84287 page pv 178 (usermode) 61 0% 96% 0.00 8010087 page pv 75 (usermode) 61 0% 96% 0.00 151768 page pv 53 sdt_probe+0x38 61 0% 96% 0.00 155726 page pv 177 (usermode) 59 0% 96% 0.00 73834 page pv 106 sdt_probe+0x38 57 0% 96% 0.00 302152 tcpinp (usermode) 56 0% 96% 0.00 6616179 page pv 11 (usermode) 55 0% 96% 0.00 8891933 page pv 255 (usermode) 55 0% 96% 0.00 89335 page pv 195 sdt_probe+0x38 55 0% 96% 0.00 88965 page pv 189 sdt_probe+0x38 54 0% 96% 0.00 99372 page pv 200 sdt_probe+0x38 54 0% 96% 0.00 197569 page pv 189 (usermode) 53 0% 96% 0.00 90206 page pv 101 sdt_probe+0x38 52 0% 96% 0.00 179453 page pv 193 (usermode) 51 0% 97% 0.00 145836 page pv 18 sdt_probe+0x38 49 0% 97% 0.00 64472 page pv 227 sdt_probe+0x38 49 0% 97% 0.00 15138262 page pv 217 (usermode) 49 0% 97% 0.00 391181 page pv 186 (usermode) 49 0% 97% 0.00 118294 page pv 129 (usermode) 48 0% 97% 0.00 229186 page pv 97 (usermode) 48 0% 97% 0.00 94677 page pv 225 sdt_probe+0x38 48 0% 97% 0.00 62352 page pv 112 (usermode) 47 0% 97% 0.00 155370 page pv 81 sdt_probe+0x38 47 0% 97% 0.00 84714 page pv 208 sdt_probe+0x38 47 0% 97% 0.00 82007 page pv 186 sdt_probe+0x38 46 0% 97% 0.00 69751 page pv 83 sdt_probe+0x38 46 0% 97% 0.00 129871 page pv 152 sdt_probe+0x38 45 0% 97% 0.00 91087 page pv 105 sdt_probe+0x38 44 0% 97% 0.00 85480 page pv 209 sdt_probe+0x38 43 0% 97% 0.00 154277 page pv 84 sdt_probe+0x38 43 0% 97% 0.00 82835 page pv 78 sdt_probe+0x38 43 0% 97% 0.00 62227 page pv 111 sdt_probe+0x38 42 0% 97% 0.00 135044 page pv 82 sdt_probe+0x38 42 0% 97% 0.00 201670 page pv 54 sdt_probe+0x38 41 0% 97% 0.00 109349 page pv 193 sdt_probe+0x38 39 0% 97% 0.00 117199 page pv 48 sdt_probe+0x38 39 0% 97% 0.00 130107 page pv 231 sdt_probe+0x38 39 0% 97% 0.00 93695 page pv 227 (usermode) 39 0% 97% 0.00 166543 page pv 106 (usermode) 38 0% 97% 0.00 154054 page pv 64 sdt_probe+0x38 38 0% 97% 0.00 103702 page pv 205 sdt_probe+0x38 38 0% 97% 0.00 84018 page pv 202 sdt_probe+0x38 38 0% 97% 0.00 65685 page pv 169 sdt_probe+0x38 38 0% 97% 0.00 118359 page pv 108 sdt_probe+0x38 37 0% 97% 0.00 247729 page pv 202 (usermode) 37 0% 97% 0.00 210389 page pv 196 (usermode) 36 0% 97% 0.00 138929 page pv 63 sdt_probe+0x38 36 0% 97% 0.00 335357 page pv 6 sdt_probe+0x38 36 0% 97% 0.00 60863 page pv 26 sdt_probe+0x38 36 0% 97% 0.00 280335 page pv 243 (usermode) 36 0% 97% 0.00 1125858 page pv 21 sdt_probe+0x38 36 0% 97% 0.00 74507 page pv 206 sdt_probe+0x38 35 0% 97% 0.00 101111 page pv 98 (usermode) 35 0% 97% 0.00 146533 page pv 87 sdt_probe+0x38 34 0% 97% 0.00 72041 page pv 86 sdt_probe+0x38 34 0% 97% 0.00 157728 page pv 77 sdt_probe+0x38 34 0% 98% 0.00 692510 page pv 74 (usermode) 34 0% 98% 0.00 355204 page pv 6 (usermode) 34 0% 98% 0.00 58082 page pv 133 sdt_probe+0x38 34 0% 98% 0.00 71043 page pv 102 sdt_probe+0x38 33 0% 98% 0.00 55683 page pv 89 sdt_probe+0x38 33 0% 98% 0.00 105061 page pv 76 sdt_probe+0x38 33 0% 98% 0.00 6767998 page pv 253 sdt_probe+0x38 33 0% 98% 0.00 115138 page pv 243 sdt_probe+0x38 33 0% 98% 0.00 243030 page pv 199 (usermode) 33 0% 98% 0.00 78827 page pv 196 sdt_probe+0x38 32 0% 98% 0.00 3914586 page pv 68 (usermode) 32 0% 98% 0.00 171375 page pv 42 sdt_probe+0x38 32 0% 98% 0.00 10792175 page pv 22 sdt_probe+0x38 32 0% 98% 0.00 80202 page pv 207 sdt_probe+0x38 32 0% 98% 0.00 132188 page pv 201 sdt_probe+0x38 31 0% 98% 0.00 107648 page pv 99 sdt_probe+0x38 31 0% 98% 0.00 6106859 page pv 60 (usermode) 31 0% 98% 0.00 91125 page pv 223 sdt_probe+0x38 31 0% 98% 0.00 274439 page pv 205 (usermode) 31 0% 98% 0.00 535492 page pv 171 (usermode) 31 0% 98% 0.00 251043 page pv 155 (usermode) 31 0% 98% 0.00 83360 page pv 153 sdt_probe+0x38 31 0% 98% 0.00 85603 page pv 107 sdt_probe+0x38 30 0% 98% 0.00 167772 page pv 41 sdt_probe+0x38 30 0% 98% 0.00 115889 page pv 203 sdt_probe+0x38 30 0% 98% 0.00 77802 page pv 199 sdt_probe+0x38 30 0% 98% 0.00 703112 page pv 17 sdt_probe+0x38 30 0% 98% 0.00 53069 page pv 110 sdt_probe+0x38 29 0% 98% 0.00 84886 page pv 85 sdt_probe+0x38 29 0% 98% 0.00 121309 page pv 51 sdt_probe+0x38 29 0% 98% 0.00 59321 page pv 212 sdt_probe+0x38 29 0% 98% 0.00 137352 page pv 153 (usermode) 29 0% 98% 0.00 111624 page pv 132 sdt_probe+0x38 28 0% 98% 0.00 108249 page pv 98 sdt_probe+0x38 28 0% 98% 0.00 637834 page pv 89 (usermode) 28 0% 98% 0.00 1775614 page pv 45 sdt_probe+0x38 28 0% 98% 0.00 66378 page pv 3 sdt_probe+0x38 28 0% 98% 0.00 1980922 page pv 254 sdt_probe+0x38 28 0% 98% 0.00 62605 page pv 131 sdt_probe+0x38 27 0% 98% 0.00 100897 vmobject (usermode) 27 0% 98% 0.00 99977 page pv 74 sdt_probe+0x38 27 0% 98% 0.00 76104 page pv 32 sdt_probe+0x38 27 0% 98% 0.00 256098 page pv 209 (usermode) 27 0% 98% 0.00 60683 page pv 187 sdt_probe+0x38 27 0% 98% 0.00 80897 page pv 168 sdt_probe+0x38 27 0% 98% 0.00 67533 page pv 122 sdt_probe+0x38 27 0% 98% 0.00 210418 page pv 121 (usermode) 27 0% 98% 0.00 238110 page pv 108 (usermode) 26 0% 98% 0.00 210619 page pv 195 (usermode) 26 0% 98% 0.00 49410 page pv 112 sdt_probe+0x38 26 0% 98% 0.00 315620 page pv 101 (usermode) 25 0% 98% 0.00 104498 page pv 198 sdt_probe+0x38 25 0% 98% 0.00 57495 page pv 109 sdt_probe+0x38 24 0% 98% 0.00 376375 page pv 99 (usermode) 24 0% 98% 0.00 3297961 page pv 67 (usermode) 24 0% 98% 0.00 1314882 page pv 62 (usermode) 24 0% 98% 0.00 100779 page pv 49 sdt_probe+0x38 24 0% 98% 0.00 96076 page pv 194 sdt_probe+0x38 24 0% 99% 0.00 1808722 page pv 19 sdt_probe+0x38 23 0% 99% 0.00 78911 page pv 71 sdt_probe+0x38 23 0% 99% 0.00 99523 page pv 230 sdt_probe+0x38 23 0% 99% 0.00 360485 page pv 206 (usermode) 23 0% 99% 0.00 82668 page pv 190 sdt_probe+0x38 23 0% 99% 0.00 152531 page pv 164 (usermode) 23 0% 99% 0.00 100753 page pv 160 sdt_probe+0x38 23 0% 99% 0.00 95638 page pv 103 sdt_probe+0x38 22 0% 99% 0.00 205205 page pv 9 sdt_probe+0x38 22 0% 99% 0.00 392110 page pv 231 (usermode) 22 0% 99% 0.00 231618 page pv 190 (usermode) 21 0% 99% 0.00 285889 page pv 230 (usermode) 21 0% 99% 0.00 87472 page pv 217 sdt_probe+0x38 21 0% 99% 0.00 62138 page pv 214 sdt_probe+0x38 21 0% 99% 0.00 57578 page pv 197 sdt_probe+0x38 21 0% 99% 0.00 124426 page pv 191 sdt_probe+0x38 21 0% 99% 0.00 128765 page pv 140 (usermode) 21 0% 99% 0.00 1486792 page pv 12 (usermode) 21 0% 99% 0.00 280479 page pv 109 (usermode) 21 0% 99% 0.00 294485 page pv 105 (usermode) 20 0% 99% 0.00 46960 page pv 219 sdt_probe+0x38 20 0% 99% 0.00 161001 page pv 212 (usermode) 20 0% 99% 0.00 57357 page pv 211 sdt_probe+0x38 20 0% 99% 0.00 100853 page pv 204 sdt_probe+0x38 20 0% 99% 0.00 55956 page pv 156 sdt_probe+0x38 20 0% 99% 0.00 88012 page pv 140 sdt_probe+0x38 20 0% 99% 0.00 117687 page pv 135 sdt_probe+0x38 20 0% 99% 0.00 58498 page pv 113 sdt_probe+0x38 19 0% 99% 0.00 287245 page pv 154 (usermode) 19 0% 99% 0.00 91333 page pv 129 sdt_probe+0x38 19 0% 99% 0.00 285424 page pv 107 (usermode) 19 0% 99% 0.00 238348 page pv 102 (usermode) 18 0% 99% 0.00 208438 page pv 69 sdt_probe+0x38 18 0% 99% 0.00 77544 page pv 52 sdt_probe+0x38 18 0% 99% 0.00 107318 page pv 242 sdt_probe+0x38 18 0% 99% 0.00 238370 page pv 198 (usermode) 18 0% 99% 0.00 97883 page pv 176 sdt_probe+0x38 18 0% 99% 0.00 352517 page pv 132 (usermode) 18 0% 99% 0.00 193174 page pv 113 (usermode) 18 0% 99% 0.00 320772 page pv 110 (usermode) 18 0% 99% 0.00 449335 page pv 100 (usermode) 17 0% 99% 0.00 159864 page pv 55 sdt_probe+0x38 17 0% 99% 0.00 351779 page pv 3 (usermode) 17 0% 99% 0.00 2208651 page pv 252 sdt_probe+0x38 17 0% 99% 0.00 101002 page pv 220 sdt_probe+0x38 17 0% 99% 0.00 65326 page pv 215 sdt_probe+0x38 17 0% 99% 0.00 215895 page pv 204 (usermode) 17 0% 99% 0.00 38664 page pv 171 sdt_probe+0x38 17 0% 99% 0.00 117482 page pv 154 sdt_probe+0x38 17 0% 99% 0.00 116622 page pv 130 sdt_probe+0x38 17 0% 99% 0.00 374108 page pv 103 (usermode) 17 0% 99% 0.00 107080 page pv 100 sdt_probe+0x38 16 0% 99% 0.00 119172 page pv 94 sdt_probe+0x38 16 0% 99% 0.00 116262 page pv 7 sdt_probe+0x38 16 0% 99% 0.00 130143 page pv 68 sdt_probe+0x38 16 0% 99% 0.00 166776 page pv 59 sdt_probe+0x38 16 0% 99% 0.00 102103 page pv 242 (usermode) 16 0% 99% 0.00 115594 page pv 239 sdt_probe+0x38 16 0% 99% 0.00 32429 page pv 175 (usermode) 16 0% 99% 0.00 140042 page pv 131 (usermode) 16 0% 99% 0.00 52178 page pv 115 sdt_probe+0x38 16 0% 99% 0.00 255375 page pv 111 (usermode) 15 0% 99% 0.00 248899 tcpinp sdt_probe+0x38 15 0% 99% 0.00 157348 page pv 75 sdt_probe+0x38 15 0% 99% 0.00 2387448 page pv 59 (usermode) 15 0% 99% 0.00 1292196 page pv 44 sdt_probe+0x38 15 0% 99% 0.00 81691 page pv 221 sdt_probe+0x38 15 0% 99% 0.00 232686 page pv 214 (usermode) 15 0% 99% 0.00 40201 page pv 210 sdt_probe+0x38 15 0% 99% 0.00 112671 page pv 203 (usermode) 15 0% 99% 0.00 101312 page pv 155 sdt_probe+0x38 15 0% 99% 0.00 346637 page pv 135 (usermode) 15 0% 99% 0.00 179196 page pv 122 (usermode) 15 0% 99% 0.00 2186183 page pv 10 (usermode) 14 0% 99% 0.00 135359 page pv 50 sdt_probe+0x38 14 0% 99% 0.00 156762 page pv 237 sdt_probe+0x38 14 0% 99% 0.00 30793 page pv 2 sdt_probe+0x38 14 0% 99% 0.00 33925 page pv 173 (usermode) 14 0% 99% 0.00 152149 page pv 167 sdt_probe+0x38 14 0% 99% 0.00 658418 page pv 156 (usermode) 14 0% 99% 0.00 108127 page pv 146 sdt_probe+0x38 14 0% 99% 0.00 108045 page pv 14 sdt_probe+0x38 14 0% 99% 0.00 640636 page pv 14 (usermode) 14 0% 99% 0.00 76482 page pv 121 sdt_probe+0x38 14 0% 99% 0.00 65315 page pv 116 sdt_probe+0x38 13 0% 99% 0.00 221135 page pv 211 (usermode) 13 0% 99% 0.00 260891 page pv 194 (usermode) 13 0% 99% 0.00 69765 page pv 172 (usermode) 13 0% 99% 0.00 338254 page pv 165 (usermode) 13 0% 99% 0.00 83508 page pv 159 sdt_probe+0x38 13 0% 99% 0.00 211009 SUrw (usermode) 12 0% 99% 0.00 114590 page pv 90 sdt_probe+0x38 12 0% 99% 0.00 4063474 page pv 79 sdt_probe+0x38 12 0% 99% 0.00 574900 page pv 67 sdt_probe+0x38 12 0% 99% 0.00 119684 page pv 66 sdt_probe+0x38 12 0% 99% 0.00 77646 page pv 60 sdt_probe+0x38 12 0% 99% 0.00 127549 page pv 43 sdt_probe+0x38 12 0% 99% 0.00 28240929 page pv 37 sdt_probe+0x38 12 0% 99% 0.00 1865771 page pv 36 sdt_probe+0x38 12 0% 99% 0.00 38682 page pv 255 sdt_probe+0x38 12 0% 100% 0.00 236990 page pv 223 (usermode) 12 0% 100% 0.00 118919 page pv 215 (usermode) 12 0% 100% 0.00 437931 page pv 197 (usermode) 12 0% 100% 0.00 112677 page pv 177 sdt_probe+0x38 12 0% 100% 0.00 46732 page pv 172 sdt_probe+0x38 12 0% 100% 0.00 124255 page pv 137 sdt_probe+0x38 11 0% 100% 0.00 142386 page pv 33 (usermode) 11 0% 100% 0.00 55490 page pv 218 sdt_probe+0x38 11 0% 100% 0.00 183621 page pv 207 (usermode) 11 0% 100% 0.00 38305 page pv 175 sdt_probe+0x38 11 0% 100% 0.00 138909 page pv 166 sdt_probe+0x38 11 0% 100% 0.00 114567 page pv 165 sdt_probe+0x38 11 0% 100% 0.00 124426 page pv 164 sdt_probe+0x38 11 0% 100% 0.00 347794 page pv 159 (usermode) 11 0% 100% 0.00 73758 page pv 125 sdt_probe+0x38 11 0% 100% 0.00 335422 page pv 116 (usermode) 11 0% 100% 0.00 141980 page pv 10 sdt_probe+0x38 11 0% 100% 0.00 79121 page pv 1 (usermode) 10 0% 100% 0.00 111453 vmobject sdt_probe+0x38 10 0% 100% 0.00 87426 page pv 93 sdt_probe+0x38 10 0% 100% 0.00 135712 page pv 7 (usermode) 10 0% 100% 0.00 106049 page pv 236 sdt_probe+0x38 10 0% 100% 0.00 434795 page pv 2 (usermode) 10 0% 100% 0.00 94118 page pv 173 sdt_probe+0x38 10 0% 100% 0.00 77853 page pv 163 sdt_probe+0x38 10 0% 100% 0.00 86595 page pv 161 (usermode) 10 0% 100% 0.00 90367 page pv 142 sdt_probe+0x38 10 0% 100% 0.00 50510 page pv 141 sdt_probe+0x38 10 0% 100% 0.00 82423 page pv 127 sdt_probe+0x38 10 0% 100% 0.00 243103 page pv 125 (usermode) 10 0% 100% 0.00 262389 page pv 12 sdt_probe+0x38 9 0% 100% 0.00 161519 page pv 61 (usermode) 9 0% 100% 0.00 43661 page pv 35 sdt_probe+0x38 9 0% 100% 0.00 231661 page pv 34 sdt_probe+0x38 9 0% 100% 0.00 88870 page pv 30 (usermode) 9 0% 100% 0.00 174537 page pv 235 sdt_probe+0x38 9 0% 100% 0.00 158860 page pv 218 (usermode) 9 0% 100% 0.00 270346 page pv 210 (usermode) 9 0% 100% 0.00 539924 page pv 187 (usermode) 9 0% 100% 0.00 293020 page pv 147 (usermode) 9 0% 100% 0.00 72930 page pv 139 sdt_probe+0x38 9 0% 100% 0.00 119356 page pv 130 (usermode) 9 0% 100% 0.00 209701 page pv 11 sdt_probe+0x38 9 0% 100% 0.00 90019 page pv 1 sdt_probe+0x38 8 0% 100% 0.00 186299 page pv 65 sdt_probe+0x38 8 0% 100% 0.00 75122 page pv 62 sdt_probe+0x38 8 0% 100% 0.00 81916 page pv 61 sdt_probe+0x38 8 0% 100% 0.00 9462241 page pv 39 sdt_probe+0x38 8 0% 100% 0.00 203598 page pv 222 (usermode) 8 0% 100% 0.00 157234 page pv 170 (usermode) 8 0% 100% 0.00 53508 page pv 162 sdt_probe+0x38 8 0% 100% 0.00 122646 page pv 161 sdt_probe+0x38 8 0% 100% 0.00 48386 page pv 157 sdt_probe+0x38 8 0% 100% 0.00 118574 page pv 149 sdt_probe+0x38 8 0% 100% 0.00 41896 page pv 134 sdt_probe+0x38 8 0% 100% 0.00 18646 SUrw sdt_probe+0x38 7 0% 100% 0.00 433912 page pv 65 (usermode) 7 0% 100% 0.00 73747 page pv 70 sdt_probe+0x38 7 0% 100% 0.00 48830 page pv 4 sdt_probe+0x38 7 0% 100% 0.00 106485 page pv 221 (usermode) 7 0% 100% 0.00 54080 page pv 220 (usermode) 7 0% 100% 0.00 148687 page pv 219 (usermode) 7 0% 100% 0.00 664281 page pv 163 (usermode) 7 0% 100% 0.00 105421 page pv 158 (usermode) 7 0% 100% 0.00 489037 page pv 150 (usermode) 7 0% 100% 0.00 128302 page pv 147 sdt_probe+0x38 7 0% 100% 0.00 252842 page pv 127 (usermode) 7 0% 100% 0.00 30806 page pv 117 sdt_probe+0x38 6 0% 100% 0.00 177218 page pv 95 (usermode) 6 0% 100% 0.00 196824 page pv 94 (usermode) 6 0% 100% 0.00 683243 page pv 93 (usermode) 6 0% 100% 0.00 152104 page pv 90 (usermode) 6 0% 100% 0.00 247972 page pv 46 sdt_probe+0x38 6 0% 100% 0.00 287530 page pv 238 sdt_probe+0x38 6 0% 100% 0.00 36668 page pv 213 sdt_probe+0x38 6 0% 100% 0.00 237205 page pv 157 (usermode) 6 0% 100% 0.00 491970 page pv 146 (usermode) 6 0% 100% 0.00 223335 page pv 133 (usermode) 6 0% 100% 0.00 1010567 page pv 134 (usermode) 6 0% 100% 0.00 3643460 page pv 13 (usermode) 6 0% 100% 0.00 59858 page pv 124 sdt_probe+0x38 5 0% 100% 0.00 121520 page pv 58 sdt_probe+0x38 5 0% 100% 0.00 82495 page pv 47 sdt_probe+0x38 5 0% 100% 0.00 1073625 page pv 234 sdt_probe+0x38 5 0% 100% 0.00 38008 page pv 222 sdt_probe+0x38 5 0% 100% 0.00 938226 page pv 213 (usermode) 5 0% 100% 0.00 144648 page pv 191 (usermode) 5 0% 100% 0.00 29125 page pv 174 sdt_probe+0x38 5 0% 100% 0.00 50764 page pv 145 sdt_probe+0x38 5 0% 100% 0.00 607770 page pv 139 (usermode) 5 0% 100% 0.00 48436 page pv 138 sdt_probe+0x38 5 0% 100% 0.00 190609 page pv 126 sdt_probe+0x38 4 0% 100% 0.00 15599 page pv 95 sdt_probe+0x38 4 0% 100% 0.00 51915 page pv 5 sdt_probe+0x38 4 0% 100% 0.00 61160 page pv 29 sdt_probe+0x38 4 0% 100% 0.00 30376 page pv 233 sdt_probe+0x38 4 0% 100% 0.00 41222 page pv 166 (usermode) 4 0% 100% 0.00 138067 page pv 162 (usermode) 4 0% 100% 0.00 11377 page pv 151 sdt_probe+0x38 4 0% 100% 0.00 105588 page pv 150 sdt_probe+0x38 3 0% 100% 0.00 135205 page pv 5 (usermode) 3 0% 100% 0.00 86603 page pv 4 (usermode) 3 0% 100% 0.00 106782 page pv 30 sdt_probe+0x38 3 0% 100% 0.00 335109 page pv 29 (usermode) 3 0% 100% 0.00 91572 page pv 148 sdt_probe+0x38 3 0% 100% 0.00 50149 page pv 148 (usermode) 3 0% 100% 0.00 163199 page pv 145 (usermode) 3 0% 100% 0.00 150384 page pv 143 sdt_probe+0x38 3 0% 100% 0.00 657362 page pv 142 (usermode) 3 0% 100% 0.00 61799 page pv 138 (usermode) 3 0% 100% 0.00 170136 page pv 124 (usermode) 3 0% 100% 0.00 90438 page pv 119 sdt_probe+0x38 2 0% 100% 0.00 117042 page pv 33 sdt_probe+0x38 2 0% 100% 0.00 45344 page pv 174 (usermode) 2 0% 100% 0.00 20957 page pv 158 sdt_probe+0x38 2 0% 100% 0.00 324701 page pv 151 (usermode) 2 0% 100% 0.00 1399000 page pv 149 (usermode) 2 0% 100% 0.00 54645 page pv 143 (usermode) 2 0% 100% 0.00 344869 page pv 126 (usermode) 2 0% 100% 0.00 365780 page pv 119 (usermode) 2 0% 100% 0.00 38366 page pv 115 (usermode) 2 0% 100% 0.00 22718 page pv 114 sdt_probe+0x38 1 0% 100% 0.00 6389 page pv 27 sdt_probe+0x38 1 0% 100% 0.00 42669 page pv 27 (usermode) 1 0% 100% 0.00 182683 page pv 28 sdt_probe+0x38 1 0% 100% 0.00 68993 page pv 38 sdt_probe+0x38 1 0% 100% 0.00 178197 page pv 167 (usermode) 1 0% 100% 0.00 421347 page pv 13 sdt_probe+0x38 1 0% 100% 0.00 38584 page pv 141 (usermode) 1 0% 100% 0.00 146870 page pv 179 sdt_probe+0x38 1 0% 100% 0.00 114557 page pv 117 (usermode) ------------------------------------------------------------------------------- R/W writer spin on readers: 19 events in 14.090 seconds (1 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 11 58% 58% 0.00 515386 vmobject (usermode) 6 32% 89% 0.00 358625 vmobject sdt_probe+0x38 1 5% 95% 0.00 25804 page pv 76 sdt_probe+0x38 1 5% 100% 0.00 10843 page pv 26 sdt_probe+0x38 ------------------------------------------------------------------------------- R/W reader spin on writer: 6 events in 14.090 seconds (0 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 3 50% 50% 0.00 45633 vmobject (usermode) 1 17% 67% 0.00 95545403 page pv 86 (usermode) 1 17% 83% 0.00 26748513 page pv 76 (usermode) 1 17% 100% 0.00 34944789 page pv 16 (usermode) ------------------------------------------------------------------------------- SX exclusive block: 140 events in 14.090 seconds (10 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 60 43% 43% 0.00 44886525 proctree (usermode) 42 30% 73% 0.00 4918697 vm map (user) (usermode) 17 12% 85% 0.00 46373740 proctree sdt_probe+0x38 8 6% 91% 0.00 74444229 allproc (usermode) 7 5% 96% 0.00 12833595 vm map (user) sdt_probe+0x38 6 4% 100% 0.00 213074052 allproc sdt_probe+0x38 ------------------------------------------------------------------------------- SX shared block: 36 events in 14.090 seconds (3 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 33 92% 92% 0.00 7317038 vm map (user) (usermode) 3 8% 100% 0.00 22931950 vm map (user) sdt_probe+0x38 ------------------------------------------------------------------------------- SX exclusive spin: 823 events in 14.090 seconds (58 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 457 56% 56% 0.00 1638880 proctree (usermode) 120 15% 70% 0.00 5332839 vm map (user) (usermode) 114 14% 84% 0.00 1107396 vm map (user) sdt_probe+0x38 105 13% 97% 0.00 480593 proctree sdt_probe+0x38 19 2% 99% 0.00 1469286 allproc (usermode) 8 1% 100% 0.00 2617770 allproc sdt_probe+0x38 ------------------------------------------------------------------------------- SX shared spin: 224 events in 14.090 seconds (16 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 123 55% 55% 0.00 21625812 vm map (user) (usermode) 50 22% 77% 0.00 1362887 proctree (usermode) 45 20% 97% 0.00 137040 proctree sdt_probe+0x38 6 3% 100% 0.00 405016 vm map (user) sdt_probe+0x38 ------------------------------------------------------------------------------- Adaptive mutex hold: 4881758 events in 14.090 seconds (346463 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 3630994 74% 74% 0.00 238626 pmap sdt_probe+0x38 458505 9% 84% 0.00 3753 256 Bucket sdt_probe+0x38 204458 4% 88% 0.00 7076 UPVO entry sdt_probe+0x38 139827 3% 91% 0.00 13373 vm reserv sdt_probe+0x38 68793 1% 92% 0.00 4312 32 Bucket sdt_probe+0x38 60987 1% 93% 0.00 7116 select mtxpool sdt_probe+0x38 48427 1% 94% 0.00 5887 vm reserv domain sdt_probe+0x38 47611 1% 95% 0.00 63237 process lock sdt_probe+0x38 40442 1% 96% 0.00 9754 vnode interlock sdt_probe+0x38 36854 1% 97% 0.00 11043 vm active pagequeue sdt_probe+0x38 21571 0% 97% 0.00 13553 vm page free queue sdt_probe+0x38 19446 0% 98% 0.00 16487 pipe mutex sdt_probe+0x38 7885 0% 98% 0.00 12190 sigacts sdt_probe+0x38 7404 0% 98% 0.00 23891 kernelpmap sdt_probe+0x38 6910 0% 98% 0.00 45144 xhci0 sdt_probe+0x38 6120 0% 98% 0.00 41866 so_snd sdt_probe+0x38 5924 0% 99% 0.00 36298 ttymtx sdt_probe+0x38 5912 0% 99% 0.00 10301 vm inactive pagequeue sdt_probe+0x38 5685 0% 99% 0.00 7490 vm pgcache sdt_probe+0x38 5426 0% 99% 0.00 51479 so_rcv sdt_probe+0x38 3955 0% 99% 0.00 17485 bounce pages lock sdt_probe+0x38 3285 0% 99% 0.00 46728 bge3 sdt_probe+0x38 3213 0% 99% 0.00 18601 SLB table sdt_probe+0x38 3192 0% 99% 0.00 8997 process_exit sdt_probe+0x38 3131 0% 99% 0.00 81462 socket sdt_probe+0x38 3094 0% 99% 0.00 31755 session sdt_probe+0x38 3074 0% 99% 0.00 10891 devthrd sdt_probe+0x38 2639 0% 99% 0.00 60178 sellck sdt_probe+0x38 2077 0% 99% 0.00 5836 cred sdt_probe+0x38 1920 0% 100% 0.00 6531 thread_dtor sdt_probe+0x38 1677 0% 100% 0.00 7255 FFS sdt_probe+0x38 1478 0% 100% 0.00 138477 process group sdt_probe+0x38 1452 0% 100% 0.00 31597 kqueue sdt_probe+0x38 1188 0% 100% 0.00 8804 pwddesc sdt_probe+0x38 1031 0% 100% 0.00 6093 procid sdt_probe+0x38 875 0% 100% 0.00 115986 unp sdt_probe+0x38 814 0% 100% 0.00 9168 XPT topology lock sdt_probe+0x38 794 0% 100% 0.00 11043 global softdep sdt_probe+0x38 744 0% 100% 0.00 13367 CAM queue lock sdt_probe+0x38 663 0% 100% 0.00 14221 struct mount mtx sdt_probe+0x38 554 0% 100% 0.00 4848 resv obj lock sdt_probe+0x38 526 0% 100% 0.00 7630 process_exec sdt_probe+0x38 518 0% 100% 0.00 183789 CAM device lock sdt_probe+0x38 510 0% 100% 0.00 23208 mbuf_jumbo_page sdt_probe+0x38 484 0% 100% 0.00 4068 UMA Cross sdt_probe+0x38 434 0% 100% 0.00 9302 RADIX NODE sdt_probe+0x38 402 0% 100% 0.00 37523 struct mount vlist mtx sdt_probe+0x38 390 0% 100% 0.00 9658 devstat sdt_probe+0x38 366 0% 100% 0.00 11292 CAM doneq sdt_probe+0x38 361 0% 100% 0.00 10615 Syncer mtx sdt_probe+0x38 355 0% 100% 0.00 20099 UMA Slabs 0 sdt_probe+0x38 351 0% 100% 0.00 72862 ncvn sdt_probe+0x38 320 0% 100% 0.00 192691 umass1 sdt_probe+0x38 318 0% 100% 0.00 12024 chacha20_mtx sdt_probe+0x38 304 0% 100% 0.00 230404 umass2 sdt_probe+0x38 304 0% 100% 0.00 183317 umass0 sdt_probe+0x38 290 0% 100% 0.00 37193 dev mtx sdt_probe+0x38 268 0% 100% 0.00 7270 vm map (system) sdt_probe+0x38 256 0% 100% 0.00 4078 sleep mtxpool sdt_probe+0x38 256 0% 100% 0.00 3886 g_vfs sdt_probe+0x38 248 0% 100% 0.00 8065 SLB tree node sdt_probe+0x38 244 0% 100% 0.00 8136 bufq dirty lock sdt_probe+0x38 232 0% 100% 0.00 12066 jail mutex sdt_probe+0x38 204 0% 100% 0.00 94401 AHCI channel lock sdt_probe+0x38 194 0% 100% 0.00 14985 bufspace daemon run lock sdt_probe+0x38 189 0% 100% 0.00 8709 ncnegl sdt_probe+0x38 183 0% 100% 0.00 32644 ncbuc sdt_probe+0x38 168 0% 100% 0.00 12909 vm pageout lock sdt_probe+0x38 164 0% 100% 0.00 7025 malloc-4096 sdt_probe+0x38 155 0% 100% 0.00 44411 exec args kva sdt_probe+0x38 153 0% 100% 0.00 4316 bufq clean lock sdt_probe+0x38 142 0% 100% 0.00 7923 4 Bucket sdt_probe+0x38 131 0% 100% 0.00 14413 VM OBJECT sdt_probe+0x38 128 0% 100% 0.00 4403 g_disk_done sdt_probe+0x38 126 0% 100% 0.00 10387 bufq clean subqueue lock sdt_probe+0x38 118 0% 100% 0.00 16215 DEVCTL sdt_probe+0x38 113 0% 100% 0.00 9074 mbuf sdt_probe+0x38 100 0% 100% 0.00 170193 USB device mutex sdt_probe+0x38 100 0% 100% 0.00 7714 MAP ENTRY sdt_probe+0x38 91 0% 100% 0.00 10403 reseed mutex sdt_probe+0x38 91 0% 100% 0.00 6012 malloc-64 sdt_probe+0x38 70 0% 100% 0.00 11865 filedesc0 sdt_probe+0x38 69 0% 100% 0.00 44287 msgbuf lock sdt_probe+0x38 66 0% 100% 0.00 4436 dirhash list sdt_probe+0x38 64 0% 100% 0.00 7925 VMSPACE sdt_probe+0x38 60 0% 100% 0.00 7874 dqhlock sdt_probe+0x38 60 0% 100% 0.00 315791 Giant sdt_probe+0x38 59 0% 100% 0.00 8531 PROC sdt_probe+0x38 43 0% 100% 0.00 23426 itimer lock sdt_probe+0x38 43 0% 100% 0.00 24641 KNOTE sdt_probe+0x38 37 0% 100% 0.00 4556 malloc-384 sdt_probe+0x38 35 0% 100% 0.00 4502 malloc-128 sdt_probe+0x38 34 0% 100% 0.00 6456 umtxql sdt_probe+0x38 28 0% 100% 0.00 33842 vdbatch sdt_probe+0x38 28 0% 100% 0.00 21005 mld_mtx sdt_probe+0x38 28 0% 100% 0.00 18247 igmp_mtx sdt_probe+0x38 28 0% 100% 0.00 29263 buffer daemon lock sdt_probe+0x38 25 0% 100% 0.00 4136 malloc-512 sdt_probe+0x38 24 0% 100% 0.00 5074 malloc-16 sdt_probe+0x38 24 0% 100% 0.00 4453 S VFS Cache sdt_probe+0x38 22 0% 100% 0.00 3750 g_bio sdt_probe+0x38 21 0% 100% 0.00 8462 malloc-256 sdt_probe+0x38 20 0% 100% 0.00 227529 umass3 sdt_probe+0x38 20 0% 100% 0.00 4399 malloc-16384 sdt_probe+0x38 20 0% 100% 0.00 8156 SLB cache sdt_probe+0x38 18 0% 100% 0.00 22630 NAMEI sdt_probe+0x38 16 0% 100% 0.00 4228 malloc-8192 sdt_probe+0x38 16 0% 100% 0.00 4073 malloc-65536 sdt_probe+0x38 16 0% 100% 0.00 4262 malloc-32768 sdt_probe+0x38 16 0% 100% 0.00 4017 malloc-32 sdt_probe+0x38 16 0% 100% 0.00 4144 malloc-2048 sdt_probe+0x38 16 0% 100% 0.00 4457 malloc-1024 sdt_probe+0x38 15 0% 100% 0.00 8751 pipe sdt_probe+0x38 14 0% 100% 0.00 16809 vnode_list sdt_probe+0x38 14 0% 100% 0.00 11345 spacqtree sdt_probe+0x38 14 0% 100% 0.00 7040 runningbufspace lock sdt_probe+0x38 14 0% 100% 0.00 11153 dirty buf lock sdt_probe+0x38 14 0% 100% 0.00 24446 acqtree sdt_probe+0x38 13 0% 100% 0.00 19386383 vm object_list sdt_probe+0x38 11 0% 100% 0.00 7303 128 Bucket sdt_probe+0x38 10 0% 100% 0.00 7784 thread sdt_probe+0x38 8 0% 100% 0.00 2410 itimer sdt_probe+0x38 8 0% 100% 0.00 5679 VNODE sdt_probe+0x38 7 0% 100% 0.00 4258 64 Bucket sdt_probe+0x38 6 0% 100% 0.00 23433 mbuf_packet sdt_probe+0x38 6 0% 100% 0.00 4118 ada_ccb sdt_probe+0x38 4 0% 100% 0.00 29046 devfs interlock sdt_probe+0x38 4 0% 100% 0.00 4626 da_ccb sdt_probe+0x38 4 0% 100% 0.00 4169 buffer arena-40 sdt_probe+0x38 4 0% 100% 0.00 4745 Files sdt_probe+0x38 3 0% 100% 0.00 3704 clpbuf sdt_probe+0x38 3 0% 100% 0.00 4978 buffer arena-32 sdt_probe+0x38 3 0% 100% 0.00 5131 buf free cache sdt_probe+0x38 3 0% 100% 0.00 5947 FFS2 dinode sdt_probe+0x38 2 0% 100% 0.00 4010 vtnet_tx_hdr sdt_probe+0x38 2 0% 100% 0.00 3393 vnpbuf sdt_probe+0x38 2 0% 100% 0.00 4171 vmem btag sdt_probe+0x38 2 0% 100% 0.00 8356 vmem list lock sdt_probe+0x38 2 0% 100% 0.00 3696 vmem sdt_probe+0x38 2 0% 100% 0.00 3570 unpcb sdt_probe+0x38 2 0% 100% 0.00 3630 umtx pi sdt_probe+0x38 2 0% 100% 0.00 3882 umtx_shm sdt_probe+0x38 2 0% 100% 0.00 4552 tfo_ccache_entries sdt_probe+0x38 2 0% 100% 0.00 3842 tfo sdt_probe+0x38 2 0% 100% 0.00 3974 tcp_log_id_bucket sdt_probe+0x38 2 0% 100% 0.00 3972 tcp_log_id_node sdt_probe+0x38 2 0% 100% 0.00 3764 tcpreass sdt_probe+0x38 2 0% 100% 0.00 3875 ttyinq sdt_probe+0x38 2 0% 100% 0.00 3893 udp_inpcb sdt_probe+0x38 2 0% 100% 0.00 3729 ttyoutq sdt_probe+0x38 2 0% 100% 0.00 3958 udplite_inpcb sdt_probe+0x38 2 0% 100% 0.00 3727 tcp_log sdt_probe+0x38 2 0% 100% 0.00 3622 tcp_inpcb sdt_probe+0x38 2 0% 100% 0.00 3658 syncache sdt_probe+0x38 2 0% 100% 0.00 5767 taskq_zone sdt_probe+0x38 2 0% 100% 0.00 3936 swpctrie sdt_probe+0x38 2 0% 100% 0.00 3725 swrbuf sdt_probe+0x38 2 0% 100% 0.00 3635 swwbuf sdt_probe+0x38 2 0% 100% 0.00 4325 swblk sdt_probe+0x38 2 0% 100% 0.00 3701 sackhole sdt_probe+0x38 2 0% 100% 0.00 3523 rtentry sdt_probe+0x38 2 0% 100% 0.00 3530 ripcb sdt_probe+0x38 2 0% 100% 0.00 3841 rl_entry sdt_probe+0x38 2 0% 100% 0.00 3871 routing nhops sdt_probe+0x38 2 0% 100% 0.00 5334 skbuff sdt_probe+0x38 2 0% 100% 0.00 4094 pcpu-8 sdt_probe+0x38 2 0% 100% 0.00 7587 pcpu-64 sdt_probe+0x38 2 0% 100% 0.00 3738 pcpu-4 sdt_probe+0x38 2 0% 100% 0.00 3612 pbuf sdt_probe+0x38 2 0% 100% 0.00 3869 pcpu-16 sdt_probe+0x38 2 0% 100% 0.00 3711 pcpu-32 sdt_probe+0x38 2 0% 100% 0.00 4762 mlx5_fs_ftes sdt_probe+0x38 2 0% 100% 0.00 3574 nfspbuf sdt_probe+0x38 2 0% 100% 0.00 4170 rangeset pctrie nodes sdt_probe+0x38 2 0% 100% 0.00 39254 rib head lock sdt_probe+0x38 2 0% 100% 0.00 3869 mlx5_fs_fgs sdt_probe+0x38 2 0% 100% 0.00 3782 mbuf_cluster sdt_probe+0x38 2 0% 100% 0.00 3853 mbuf_jumbo_16k sdt_probe+0x38 2 0% 100% 0.00 3912 mbuf_jumbo_9k sdt_probe+0x38 2 0% 100% 0.00 3633 lkpimm sdt_probe+0x38 2 0% 100% 0.00 3930 linux_dma_object sdt_probe+0x38 2 0% 100% 0.00 4334 linux_dma_pctrie sdt_probe+0x38 2 0% 100% 0.00 3792 lkpicurr sdt_probe+0x38 2 0% 100% 0.00 3597 fakepg sdt_probe+0x38 2 0% 100% 0.00 4812 dtrace_state_cache sdt_probe+0x38 2 0% 100% 0.00 4183 epoch_record pcpu sdt_probe+0x38 2 0% 100% 0.00 3672 domainset sdt_probe+0x38 2 0% 100% 0.00 3787 ipq sdt_probe+0x38 2 0% 100% 0.00 4196 hostcache sdt_probe+0x38 2 0% 100% 0.00 4025 kenv sdt_probe+0x38 2 0% 100% 0.00 3848 ksiginfo sdt_probe+0x38 2 0% 100% 0.00 3941 kstack_cache sdt_probe+0x38 2 0% 100% 0.00 3825 buffer arena-28 sdt_probe+0x38 2 0% 100% 0.00 4823 buffer arena-24 sdt_probe+0x38 2 0% 100% 0.00 3868 buffer arena-16 sdt_probe+0x38 2 0% 100% 0.00 3868 buffer arena-20 sdt_probe+0x38 2 0% 100% 0.00 6179 buffer arena-12 sdt_probe+0x38 2 0% 100% 0.00 3594 audit_record sdt_probe+0x38 2 0% 100% 0.00 4149 UMA Kegs sdt_probe+0x38 2 0% 100% 0.00 3876 UMA Hash sdt_probe+0x38 2 0% 100% 0.00 3684 THREAD sdt_probe+0x38 2 0% 100% 0.00 3907 TMPFS node sdt_probe+0x38 2 0% 100% 0.00 3883 TURNSTILE sdt_probe+0x38 2 0% 100% 0.00 3798 UMA Zones sdt_probe+0x38 2 0% 100% 0.00 3921 UMA Slabs 1 sdt_probe+0x38 2 0% 100% 0.00 3647 buffer arena-81 sdt_probe+0x38 2 0% 100% 0.00 4327 buffer arena-57 sdt_probe+0x38 2 0% 100% 0.00 5091 buffer arena-61 sdt_probe+0x38 2 0% 100% 0.00 3934 buffer arena-65 sdt_probe+0x38 2 0% 100% 0.00 3816 buffer arena-36 sdt_probe+0x38 2 0% 100% 0.00 4501 buffer arena-45 sdt_probe+0x38 2 0% 100% 0.00 4159 buffer arena-49 sdt_probe+0x38 2 0% 100% 0.00 3939 buffer arena-53 sdt_probe+0x38 2 0% 100% 0.00 3561 cpuset sdt_probe+0x38 2 0% 100% 0.00 4565 debugnet_mbuf sdt_probe+0x38 2 0% 100% 0.00 5202 cryptop sdt_probe+0x38 2 0% 100% 0.00 3990 debugnet_mbuf_packet sdt_probe+0x38 2 0% 100% 0.00 4913 debugnet_mbuf_cluster sdt_probe+0x38 2 0% 100% 0.00 4003 FFS1 dinode sdt_probe+0x38 2 0% 100% 0.00 6769 FFS inode sdt_probe+0x38 2 0% 100% 0.00 3645 DIRHASH sdt_probe+0x38 2 0% 100% 0.00 3624 AIOLIO sdt_probe+0x38 2 0% 100% 0.00 3582 AIOCB sdt_probe+0x38 2 0% 100% 0.00 3563 AIO sdt_probe+0x38 2 0% 100% 0.00 6548 BUF TRIE sdt_probe+0x38 2 0% 100% 0.00 4683 16 Bucket sdt_probe+0x38 2 0% 100% 0.00 4308 2 Bucket sdt_probe+0x38 2 0% 100% 0.00 4094 8 Bucket sdt_probe+0x38 2 0% 100% 0.00 3783 OPAL Async-1 sdt_probe+0x38 2 0% 100% 0.00 3772 NCLNODE sdt_probe+0x38 2 0% 100% 0.00 3670 Mountpoints sdt_probe+0x38 2 0% 100% 0.00 4043 LTS VFS Cache sdt_probe+0x38 2 0% 100% 0.00 3939 MAC labels sdt_probe+0x38 2 0% 100% 0.00 3805 IPsec SA lft_c sdt_probe+0x38 2 0% 100% 0.00 3722 KMAP ENTRY sdt_probe+0x38 2 0% 100% 0.00 3940 L VFS Cache sdt_probe+0x38 2 0% 100% 0.00 3501 PGRP sdt_probe+0x38 2 0% 100% 0.00 3992 PWD sdt_probe+0x38 2 0% 100% 0.00 4982 SLEEPQUEUE sdt_probe+0x38 2 0% 100% 0.00 3736 SMR SHARED sdt_probe+0x38 2 0% 100% 0.00 4008 SMR CPU sdt_probe+0x38 2 0% 100% 0.00 4337 STS VFS Cache sdt_probe+0x38 ------------------------------------------------------------------------------- Spin lock hold: 3099015 events in 14.090 seconds (219940 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 2354176 76% 76% 0.00 5632 et_hw_mtx sdt_probe+0x38 228080 7% 83% 0.00 4117 witness lock sdt_probe+0x38 57499 2% 85% 0.00 21719 sleepq chain sdt_probe+0x38 22012 1% 86% 0.00 18200 callout sdt_probe+0x38 14834 0% 86% 0.00 31373 pstatl sdt_probe+0x38 14084 0% 87% 0.00 5662 tcsetc sdt_probe+0x38 13029 0% 87% 0.00 11634 sched lock 0 sdt_probe+0x38 4303 0% 87% 0.00 705524 smp rendezvous sdt_probe+0x38 3936 0% 88% 0.00 7820 sched lock 142 sdt_probe+0x38 3625 0% 88% 0.00 7316 sched lock 140 sdt_probe+0x38 3084 0% 88% 0.00 23447 bge_taskq sdt_probe+0x38 3067 0% 88% 0.00 7082 sched lock 136 sdt_probe+0x38 3034 0% 88% 0.00 7541 sched lock 110 sdt_probe+0x38 2988 0% 88% 0.00 6297 sched lock 105 sdt_probe+0x38 2950 0% 88% 0.00 11715 sched lock 24 sdt_probe+0x38 2944 0% 88% 0.00 5983 sched lock 158 sdt_probe+0x38 2912 0% 88% 0.00 6439 sched lock 159 sdt_probe+0x38 2891 0% 88% 0.00 9668 sched lock 6 sdt_probe+0x38 2869 0% 88% 0.00 7805 sched lock 76 sdt_probe+0x38 2865 0% 89% 0.00 6381 sched lock 156 sdt_probe+0x38 2815 0% 89% 0.00 6819 sched lock 155 sdt_probe+0x38 2799 0% 89% 0.00 9867 sched lock 31 sdt_probe+0x38 2772 0% 89% 0.00 8453 sched lock 28 sdt_probe+0x38 2755 0% 89% 0.00 6063 sched lock 2 sdt_probe+0x38 2755 0% 89% 0.00 6244 sched lock 113 sdt_probe+0x38 2753 0% 89% 0.00 8672 sched lock 134 sdt_probe+0x38 2751 0% 89% 0.00 5885 sched lock 141 sdt_probe+0x38 2732 0% 89% 0.00 7561 sched lock 132 sdt_probe+0x38 2689 0% 89% 0.00 6018 sched lock 4 sdt_probe+0x38 2670 0% 89% 0.00 8885 sched lock 34 sdt_probe+0x38 2666 0% 90% 0.00 5529 sched lock 7 sdt_probe+0x38 2621 0% 90% 0.00 6449 sched lock 107 sdt_probe+0x38 2607 0% 90% 0.00 5442 sched lock 157 sdt_probe+0x38 2593 0% 90% 0.00 7781 sched lock 68 sdt_probe+0x38 2591 0% 90% 0.00 5735 sched lock 124 sdt_probe+0x38 2583 0% 90% 0.00 9093 sched lock 88 sdt_probe+0x38 2578 0% 90% 0.00 6402 sched lock 139 sdt_probe+0x38 2559 0% 90% 0.00 5959 sched lock 13 sdt_probe+0x38 2559 0% 90% 0.00 6039 sched lock 11 sdt_probe+0x38 2551 0% 90% 0.00 5641 sched lock 131 sdt_probe+0x38 2546 0% 90% 0.00 7978 sched lock 60 sdt_probe+0x38 2542 0% 90% 0.00 6370 sched lock 98 sdt_probe+0x38 2539 0% 91% 0.00 5721 sched lock 18 sdt_probe+0x38 2516 0% 91% 0.00 6811 sched lock 20 sdt_probe+0x38 2507 0% 91% 0.00 6193 sched lock 99 sdt_probe+0x38 2504 0% 91% 0.00 5898 sched lock 137 sdt_probe+0x38 2482 0% 91% 0.00 10244 sched lock 48 sdt_probe+0x38 2480 0% 91% 0.00 5836 sched lock 25 sdt_probe+0x38 2478 0% 91% 0.00 5859 sched lock 53 sdt_probe+0x38 2472 0% 91% 0.00 5484 sched lock 152 sdt_probe+0x38 2465 0% 91% 0.00 5196 sched lock 5 sdt_probe+0x38 2463 0% 91% 0.00 6496 sched lock 55 sdt_probe+0x38 2460 0% 91% 0.00 5283 sched lock 130 sdt_probe+0x38 2458 0% 91% 0.00 5660 sched lock 19 sdt_probe+0x38 2452 0% 92% 0.00 6025 sched lock 71 sdt_probe+0x38 2452 0% 92% 0.00 9633 sched lock 63 sdt_probe+0x38 2452 0% 92% 0.00 5869 sched lock 146 sdt_probe+0x38 2452 0% 92% 0.00 5390 sched lock 108 sdt_probe+0x38 2450 0% 92% 0.00 6237 sched lock 39 sdt_probe+0x38 2449 0% 92% 0.00 5444 sched lock 21 sdt_probe+0x38 2446 0% 92% 0.00 5562 sched lock 153 sdt_probe+0x38 2443 0% 92% 0.00 7398 sched lock 135 sdt_probe+0x38 2432 0% 92% 0.00 7237 sched lock 89 sdt_probe+0x38 2432 0% 92% 0.00 5780 sched lock 54 sdt_probe+0x38 2430 0% 92% 0.00 6778 sched lock 72 sdt_probe+0x38 2424 0% 92% 0.00 8466 sched lock 66 sdt_probe+0x38 2417 0% 92% 0.00 5497 sched lock 114 sdt_probe+0x38 2416 0% 93% 0.00 6479 sched lock 23 sdt_probe+0x38 2413 0% 93% 0.00 5688 sched lock 97 sdt_probe+0x38 2407 0% 93% 0.00 7160 sched lock 81 sdt_probe+0x38 2405 0% 93% 0.00 5835 sched lock 12 sdt_probe+0x38 2402 0% 93% 0.00 6128 sched lock 120 sdt_probe+0x38 2400 0% 93% 0.00 5267 sched lock 67 sdt_probe+0x38 2400 0% 93% 0.00 5870 sched lock 30 sdt_probe+0x38 2400 0% 93% 0.00 5416 sched lock 106 sdt_probe+0x38 2396 0% 93% 0.00 5750 sched lock 92 sdt_probe+0x38 2391 0% 93% 0.00 10124 sched lock 32 sdt_probe+0x38 2391 0% 93% 0.00 6479 sched lock 127 sdt_probe+0x38 2390 0% 93% 0.00 6817 sched lock 49 sdt_probe+0x38 2385 0% 93% 0.00 7206 sched lock 29 sdt_probe+0x38 2378 0% 94% 0.00 5504 sched lock 1 sdt_probe+0x38 2372 0% 94% 0.00 6626 sched lock 119 sdt_probe+0x38 2368 0% 94% 0.00 5949 sched lock 9 sdt_probe+0x38 2368 0% 94% 0.00 5661 sched lock 77 sdt_probe+0x38 2363 0% 94% 0.00 6198 sched lock 116 sdt_probe+0x38 2360 0% 94% 0.00 8330 sched lock 56 sdt_probe+0x38 2359 0% 94% 0.00 4996 sched lock 3 sdt_probe+0x38 2358 0% 94% 0.00 6214 sched lock 104 sdt_probe+0x38 2354 0% 94% 0.00 5465 sched lock 138 sdt_probe+0x38 2352 0% 94% 0.00 6044 sched lock 58 sdt_probe+0x38 2348 0% 94% 0.00 7493 sched lock 95 sdt_probe+0x38 2347 0% 94% 0.00 6601 sched lock 93 sdt_probe+0x38 2346 0% 94% 0.00 5248 sched lock 126 sdt_probe+0x38 2345 0% 95% 0.00 5682 sched lock 85 sdt_probe+0x38 2343 0% 95% 0.00 6278 sched lock 86 sdt_probe+0x38 2342 0% 95% 0.00 6620 sched lock 42 sdt_probe+0x38 2341 0% 95% 0.00 5807 sched lock 118 sdt_probe+0x38 2339 0% 95% 0.00 5921 sched lock 96 sdt_probe+0x38 2334 0% 95% 0.00 6721 sched lock 51 sdt_probe+0x38 2334 0% 95% 0.00 5951 sched lock 144 sdt_probe+0x38 2333 0% 95% 0.00 5420 sched lock 150 sdt_probe+0x38 2330 0% 95% 0.00 5558 sched lock 61 sdt_probe+0x38 2326 0% 95% 0.00 5088 sched lock 109 sdt_probe+0x38 2325 0% 95% 0.00 9372 sched lock 103 sdt_probe+0x38 2324 0% 95% 0.00 5274 sched lock 147 sdt_probe+0x38 2321 0% 95% 0.00 5973 sched lock 115 sdt_probe+0x38 2320 0% 96% 0.00 5083 sched lock 133 sdt_probe+0x38 2317 0% 96% 0.00 5539 sched lock 46 sdt_probe+0x38 2316 0% 96% 0.00 6814 sched lock 70 sdt_probe+0x38 2316 0% 96% 0.00 5281 sched lock 154 sdt_probe+0x38 2316 0% 96% 0.00 5238 sched lock 101 sdt_probe+0x38 2315 0% 96% 0.00 6536 sched lock 79 sdt_probe+0x38 2315 0% 96% 0.00 5805 sched lock 65 sdt_probe+0x38 2315 0% 96% 0.00 5991 sched lock 128 sdt_probe+0x38 2314 0% 96% 0.00 5527 sched lock 145 sdt_probe+0x38 2313 0% 96% 0.00 6524 sched lock 40 sdt_probe+0x38 2313 0% 96% 0.00 5662 sched lock 123 sdt_probe+0x38 2307 0% 96% 0.00 5581 sched lock 149 sdt_probe+0x38 2290 0% 96% 0.00 6546 sched lock 33 sdt_probe+0x38 2286 0% 96% 0.00 5584 sched lock 52 sdt_probe+0x38 2285 0% 97% 0.00 5788 sched lock 44 sdt_probe+0x38 2284 0% 97% 0.00 5989 sched lock 83 sdt_probe+0x38 2283 0% 97% 0.00 5866 sched lock 73 sdt_probe+0x38 2280 0% 97% 0.00 6150 sched lock 91 sdt_probe+0x38 2270 0% 97% 0.00 5243 sched lock 57 sdt_probe+0x38 2267 0% 97% 0.00 8167 sched lock 74 sdt_probe+0x38 2267 0% 97% 0.00 6138 sched lock 112 sdt_probe+0x38 2264 0% 97% 0.00 6376 sched lock 84 sdt_probe+0x38 2263 0% 97% 0.00 5518 sched lock 64 sdt_probe+0x38 2262 0% 97% 0.00 6670 sched lock 87 sdt_probe+0x38 2262 0% 97% 0.00 6414 sched lock 62 sdt_probe+0x38 2261 0% 97% 0.00 6392 sched lock 78 sdt_probe+0x38 2261 0% 97% 0.00 5927 sched lock 102 sdt_probe+0x38 2259 0% 98% 0.00 5646 sched lock 148 sdt_probe+0x38 2253 0% 98% 0.00 5502 sched lock 22 sdt_probe+0x38 2241 0% 98% 0.00 5252 sched lock 75 sdt_probe+0x38 2240 0% 98% 0.00 5768 sched lock 10 sdt_probe+0x38 2236 0% 98% 0.00 5320 sched lock 143 sdt_probe+0x38 2236 0% 98% 0.00 5540 sched lock 111 sdt_probe+0x38 2232 0% 98% 0.00 6406 sched lock 37 sdt_probe+0x38 2229 0% 98% 0.00 6428 sched lock 47 sdt_probe+0x38 2228 0% 98% 0.00 6140 sched lock 82 sdt_probe+0x38 2225 0% 98% 0.00 7518 sched lock 8 sdt_probe+0x38 2216 0% 98% 0.00 5449 sched lock 69 sdt_probe+0x38 2211 0% 98% 0.00 5382 sched lock 117 sdt_probe+0x38 2200 0% 98% 0.00 6494 sched lock 14 sdt_probe+0x38 2196 0% 98% 0.00 5770 sched lock 43 sdt_probe+0x38 2195 0% 99% 0.00 8229 sched lock 80 sdt_probe+0x38 2192 0% 99% 0.00 5419 sched lock 50 sdt_probe+0x38 2189 0% 99% 0.00 6725 sched lock 121 sdt_probe+0x38 2180 0% 99% 0.00 5393 sched lock 122 sdt_probe+0x38 2179 0% 99% 0.00 6136 sched lock 15 sdt_probe+0x38 2176 0% 99% 0.00 5739 sched lock 38 sdt_probe+0x38 2172 0% 99% 0.00 5146 sched lock 27 sdt_probe+0x38 2170 0% 99% 0.00 5556 sched lock 41 sdt_probe+0x38 2169 0% 99% 0.00 6123 sched lock 16 sdt_probe+0x38 2168 0% 99% 0.00 5468 sched lock 90 sdt_probe+0x38 2166 0% 99% 0.00 5764 sched lock 35 sdt_probe+0x38 2164 0% 99% 0.00 5029 sched lock 129 sdt_probe+0x38 2163 0% 99% 0.00 5931 sched lock 100 sdt_probe+0x38 2159 0% 99% 0.00 5565 sched lock 36 sdt_probe+0x38 2156 0% 99% 0.00 5642 sched lock 125 sdt_probe+0x38 2154 0% 100% 0.00 5270 sched lock 26 sdt_probe+0x38 2152 0% 100% 0.00 6628 sched lock 45 sdt_probe+0x38 2143 0% 100% 0.00 5757 sched lock 59 sdt_probe+0x38 2134 0% 100% 0.00 5793 sched lock 151 sdt_probe+0x38 2086 0% 100% 0.00 5477 sched lock 94 sdt_probe+0x38 2036 0% 100% 0.00 5638 sched lock 17 sdt_probe+0x38 1784 0% 100% 0.00 34642 process slock sdt_probe+0x38 454 0% 100% 0.00 80521 turnstile lock sdt_probe+0x38 437 0% 100% 0.00 82498 turnstile chain sdt_probe+0x38 350 0% 100% 0.00 10332 td_contested sdt_probe+0x38 179 0% 100% 0.00 7644 entropy harvest mutex sdt_probe+0x38 14 0% 100% 0.00 4745 ntp sdt_probe+0x38 ------------------------------------------------------------------------------- R/W writer hold: 1338893 events in 14.090 seconds (95023 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 588495 44% 44% 0.00 65495 vmobject sdt_probe+0x38 54670 4% 48% 0.00 153893 page pv 229 sdt_probe+0x38 31097 2% 50% 0.00 77097 page pv 182 sdt_probe+0x38 26007 2% 52% 0.00 115224 page pv 23 sdt_probe+0x38 24915 2% 54% 0.00 87097 page pv 24 sdt_probe+0x38 24447 2% 56% 0.00 85577 page pv 25 sdt_probe+0x38 23946 2% 58% 0.00 75071 page pv 183 sdt_probe+0x38 22027 2% 59% 0.00 87559 page pv 120 sdt_probe+0x38 17607 1% 61% 0.00 117432 page pv 15 sdt_probe+0x38 15346 1% 62% 0.00 162190 page pv 228 sdt_probe+0x38 13738 1% 63% 0.00 334782 page pv 250 sdt_probe+0x38 7746 1% 63% 0.00 522457 page pv 249 sdt_probe+0x38 7103 1% 64% 0.00 487167 page pv 248 sdt_probe+0x38 6524 0% 65% 0.00 58094 page pv 224 sdt_probe+0x38 6506 0% 65% 0.00 169004 page pv 56 sdt_probe+0x38 6410 0% 65% 0.00 92259 page pv 240 sdt_probe+0x38 5879 0% 66% 0.00 95934 page pv 216 sdt_probe+0x38 5270 0% 66% 0.00 67080 page pv 128 sdt_probe+0x38 5232 0% 67% 0.00 71863 page pv 192 sdt_probe+0x38 5145 0% 67% 0.00 941062 page pv 251 sdt_probe+0x38 4952 0% 67% 0.00 688206 page pv 40 sdt_probe+0x38 4821 0% 68% 0.00 95529 page pv 184 sdt_probe+0x38 4786 0% 68% 0.00 68688 page pv 200 sdt_probe+0x38 4564 0% 69% 0.00 60016 page pv 168 sdt_probe+0x38 4560 0% 69% 0.00 69946 page pv 123 sdt_probe+0x38 4337 0% 69% 0.00 96566 page pv 136 sdt_probe+0x38 4292 0% 69% 0.00 513885 page pv 16 sdt_probe+0x38 4240 0% 70% 0.00 90291 page pv 241 sdt_probe+0x38 4223 0% 70% 0.00 64054 page pv 226 sdt_probe+0x38 4212 0% 70% 0.00 48102 page pv 246 sdt_probe+0x38 4085 0% 71% 0.00 79174 page pv 185 sdt_probe+0x38 4084 0% 71% 0.00 68297 page pv 208 sdt_probe+0x38 3999 0% 71% 0.00 708350 page pv 80 sdt_probe+0x38 3988 0% 72% 0.00 76533 page pv 144 sdt_probe+0x38 3955 0% 72% 0.00 81676 page pv 0 sdt_probe+0x38 3935 0% 72% 0.00 863313 page pv 48 sdt_probe+0x38 3860 0% 73% 0.00 351831 page pv 57 sdt_probe+0x38 3829 0% 73% 0.00 53888 page pv 181 sdt_probe+0x38 3811 0% 73% 0.00 69455 page pv 104 sdt_probe+0x38 3734 0% 73% 0.00 66127 page pv 118 sdt_probe+0x38 3702 0% 74% 0.00 227543 page pv 72 sdt_probe+0x38 3668 0% 74% 0.00 59391 page pv 247 sdt_probe+0x38 3657 0% 74% 0.00 773135 page pv 8 sdt_probe+0x38 3620 0% 74% 0.00 46645 page pv 92 sdt_probe+0x38 3508 0% 75% 0.00 999802 page pv 232 sdt_probe+0x38 3452 0% 75% 0.00 109101 page pv 152 sdt_probe+0x38 3385 0% 75% 0.00 122865 page pv 64 sdt_probe+0x38 3383 0% 75% 0.00 100488 page pv 88 sdt_probe+0x38 3362 0% 76% 0.00 16262 SUrw sdt_probe+0x38 3325 0% 76% 0.00 688837 page pv 32 sdt_probe+0x38 3285 0% 76% 0.00 80731 page pv 112 sdt_probe+0x38 3267 0% 76% 0.00 76691 page pv 96 sdt_probe+0x38 3177 0% 77% 0.00 62128 page pv 225 sdt_probe+0x38 3148 0% 77% 0.00 43824 page pv 188 sdt_probe+0x38 3078 0% 77% 0.00 1443196 page pv 53 sdt_probe+0x38 3052 0% 77% 0.00 62016 page pv 89 sdt_probe+0x38 3024 0% 78% 0.00 96337 page pv 217 sdt_probe+0x38 3015 0% 78% 0.00 55547 page pv 106 sdt_probe+0x38 2977 0% 78% 0.00 82783 page pv 244 sdt_probe+0x38 2893 0% 78% 0.00 10881 bufobj interlock sdt_probe+0x38 2886 0% 79% 0.00 178414 page pv 245 sdt_probe+0x38 2861 0% 79% 0.00 109036 page pv 201 sdt_probe+0x38 2856 0% 79% 0.00 39813 page pv 178 sdt_probe+0x38 2747 0% 79% 0.00 85553 page pv 176 sdt_probe+0x38 2632 0% 79% 0.00 79085 page pv 91 sdt_probe+0x38 2587 0% 80% 0.00 47432 page pv 227 sdt_probe+0x38 2574 0% 80% 0.00 63628 page pv 193 sdt_probe+0x38 2564 0% 80% 0.00 45878 page pv 169 sdt_probe+0x38 2560 0% 80% 0.00 118936 page pv 160 sdt_probe+0x38 2540 0% 80% 0.00 1374617 page pv 54 sdt_probe+0x38 2504 0% 80% 0.00 836543 page pv 17 sdt_probe+0x38 2484 0% 81% 0.00 62420 page pv 97 sdt_probe+0x38 2465 0% 81% 0.00 560529 page pv 73 sdt_probe+0x38 2430 0% 81% 0.00 71032 page pv 209 sdt_probe+0x38 2340 0% 81% 0.00 61653 page pv 186 sdt_probe+0x38 2263 0% 81% 0.00 48928 page pv 108 sdt_probe+0x38 2242 0% 82% 0.00 71846 page pv 189 sdt_probe+0x38 2224 0% 82% 0.00 1511469 page pv 41 sdt_probe+0x38 2215 0% 82% 0.00 61338 page pv 243 sdt_probe+0x38 2203 0% 82% 0.00 64106 page pv 230 sdt_probe+0x38 2203 0% 82% 0.00 1494925 page pv 20 sdt_probe+0x38 2201 0% 82% 0.00 1290274 page pv 82 sdt_probe+0x38 2186 0% 83% 0.00 1362004 page pv 52 sdt_probe+0x38 2162 0% 83% 0.00 73806 page pv 195 sdt_probe+0x38 2148 0% 83% 0.00 81422 page pv 113 sdt_probe+0x38 2144 0% 83% 0.00 54224 page pv 202 sdt_probe+0x38 2140 0% 83% 0.00 66706 page pv 107 sdt_probe+0x38 2134 0% 83% 0.00 1636938 page pv 49 sdt_probe+0x38 2113 0% 83% 0.00 64473 page pv 105 sdt_probe+0x38 2091 0% 84% 0.00 71368 page pv 101 sdt_probe+0x38 2076 0% 84% 0.00 57863 page pv 199 sdt_probe+0x38 2042 0% 84% 0.00 1039992 page pv 87 sdt_probe+0x38 2036 0% 84% 0.00 64080 page pv 203 sdt_probe+0x38 2028 0% 84% 0.00 1634590 page pv 83 sdt_probe+0x38 2025 0% 84% 0.00 64631 page pv 6 sdt_probe+0x38 2025 0% 85% 0.00 91576 page pv 153 sdt_probe+0x38 2024 0% 85% 0.00 298163 page pv 81 sdt_probe+0x38 2009 0% 85% 0.00 69042 page pv 99 sdt_probe+0x38 2009 0% 85% 0.00 62174 page pv 206 sdt_probe+0x38 1980 0% 85% 0.00 53538 page pv 110 sdt_probe+0x38 1973 0% 85% 0.00 81174 page pv 129 sdt_probe+0x38 1961 0% 85% 0.00 47331 page pv 171 sdt_probe+0x38 1953 0% 86% 0.00 67765 page pv 102 sdt_probe+0x38 1920 0% 86% 0.00 61279 page pv 207 sdt_probe+0x38 1916 0% 86% 0.00 61894 page pv 131 sdt_probe+0x38 1913 0% 86% 0.00 59934 page pv 132 sdt_probe+0x38 1910 0% 86% 0.00 47948 page pv 109 sdt_probe+0x38 1895 0% 86% 0.00 1009304 page pv 51 sdt_probe+0x38 1875 0% 86% 0.00 1592409 page pv 86 sdt_probe+0x38 1871 0% 87% 0.00 71824 page pv 196 sdt_probe+0x38 1850 0% 87% 0.00 1681016 page pv 19 sdt_probe+0x38 1842 0% 87% 0.00 59145 page pv 111 sdt_probe+0x38 1840 0% 87% 0.00 78980 page pv 198 sdt_probe+0x38 1818 0% 87% 0.00 1089955 page pv 78 sdt_probe+0x38 1813 0% 87% 0.00 63285 page pv 231 sdt_probe+0x38 1805 0% 87% 0.00 59633 page pv 133 sdt_probe+0x38 1781 0% 88% 0.00 56388 page pv 190 sdt_probe+0x38 1777 0% 88% 0.00 54389 page pv 3 sdt_probe+0x38 1775 0% 88% 0.00 52488 page pv 204 sdt_probe+0x38 1774 0% 88% 0.00 1316700 page pv 18 sdt_probe+0x38 1764 0% 88% 0.00 66602 page pv 242 sdt_probe+0x38 1742 0% 88% 0.00 63218 page pv 205 sdt_probe+0x38 1735 0% 88% 0.00 1019394 page pv 85 sdt_probe+0x38 1720 0% 88% 0.00 69127 page pv 98 sdt_probe+0x38 1691 0% 89% 0.00 263147 page pv 26 sdt_probe+0x38 1687 0% 89% 0.00 70567 page pv 177 sdt_probe+0x38 1669 0% 89% 0.00 77698 page pv 121 sdt_probe+0x38 1652 0% 89% 0.00 59622 page pv 187 sdt_probe+0x38 1643 0% 89% 0.00 67483 page pv 135 sdt_probe+0x38 1639 0% 89% 0.00 56934 page pv 197 sdt_probe+0x38 1639 0% 89% 0.00 63130 page pv 2 sdt_probe+0x38 1633 0% 89% 0.00 33623 page pv 172 sdt_probe+0x38 1627 0% 90% 0.00 1982431 page pv 21 sdt_probe+0x38 1619 0% 90% 0.00 44809 page pv 122 sdt_probe+0x38 1614 0% 90% 0.00 70968 page pv 223 sdt_probe+0x38 1602 0% 90% 0.00 71710 page pv 212 sdt_probe+0x38 1590 0% 90% 0.00 2273078 page pv 84 sdt_probe+0x38 1583 0% 90% 0.00 65891 page pv 103 sdt_probe+0x38 1558 0% 90% 0.00 60501 page pv 210 sdt_probe+0x38 1544 0% 90% 0.00 71386 page pv 194 sdt_probe+0x38 1542 0% 91% 0.00 315962 tcpinp sdt_probe+0x38 1531 0% 91% 0.00 1015447 page pv 77 sdt_probe+0x38 1527 0% 91% 0.00 49595 page pv 7 sdt_probe+0x38 1523 0% 91% 0.00 60894 page pv 211 sdt_probe+0x38 1508 0% 91% 0.00 91266 page pv 74 sdt_probe+0x38 1493 0% 91% 0.00 69488 page pv 100 sdt_probe+0x38 1491 0% 91% 0.00 1495441 page pv 76 sdt_probe+0x38 1463 0% 91% 0.00 62755 page pv 221 sdt_probe+0x38 1458 0% 91% 0.00 56782 page pv 140 sdt_probe+0x38 1442 0% 92% 0.00 1284183 page pv 9 sdt_probe+0x38 1424 0% 92% 0.00 635534 page pv 66 sdt_probe+0x38 1422 0% 92% 0.00 63832 page pv 214 sdt_probe+0x38 1403 0% 92% 0.00 50090 page pv 95 sdt_probe+0x38 1403 0% 92% 0.00 73439 page pv 156 sdt_probe+0x38 1399 0% 92% 0.00 69436 page pv 155 sdt_probe+0x38 1381 0% 92% 0.00 548854 page pv 55 sdt_probe+0x38 1381 0% 92% 0.00 74007 page pv 154 sdt_probe+0x38 1379 0% 92% 0.00 57454 page pv 130 sdt_probe+0x38 1377 0% 92% 0.00 60673 page pv 219 sdt_probe+0x38 1376 0% 93% 0.00 49566 page pv 94 sdt_probe+0x38 1376 0% 93% 0.00 40484 page pv 175 sdt_probe+0x38 1364 0% 93% 0.00 60034 page pv 215 sdt_probe+0x38 1353 0% 93% 0.00 44978 page pv 115 sdt_probe+0x38 1347 0% 93% 0.00 70570 page pv 1 sdt_probe+0x38 1339 0% 93% 0.00 126755 page pv 67 sdt_probe+0x38 1326 0% 93% 0.00 1242576 page pv 69 sdt_probe+0x38 1321 0% 93% 0.00 98973 page pv 33 sdt_probe+0x38 1315 0% 93% 0.00 516699 page pv 75 sdt_probe+0x38 1311 0% 93% 0.00 52037 page pv 162 sdt_probe+0x38 1309 0% 94% 0.00 78072 page pv 161 sdt_probe+0x38 1305 0% 94% 0.00 53111 page pv 134 sdt_probe+0x38 1294 0% 94% 0.00 244794 page pv 62 sdt_probe+0x38 1293 0% 94% 0.00 2858586 page pv 22 sdt_probe+0x38 1272 0% 94% 0.00 74580 page pv 65 sdt_probe+0x38 1271 0% 94% 0.00 72197 page pv 116 sdt_probe+0x38 1270 0% 94% 0.00 69692 page pv 157 sdt_probe+0x38 1269 0% 94% 0.00 65317 page pv 165 sdt_probe+0x38 1267 0% 94% 0.00 2550125 page pv 63 sdt_probe+0x38 1255 0% 94% 0.00 2560626 page pv 45 sdt_probe+0x38 1251 0% 95% 0.00 67611 page pv 159 sdt_probe+0x38 1248 0% 95% 0.00 226153 page pv 68 sdt_probe+0x38 1247 0% 95% 0.00 1787843 page pv 42 sdt_probe+0x38 1246 0% 95% 0.00 72513 page pv 220 sdt_probe+0x38 1237 0% 95% 0.00 1298596 page pv 44 sdt_probe+0x38 1233 0% 95% 0.00 121102 page pv 137 sdt_probe+0x38 1227 0% 95% 0.00 564910 page pv 60 sdt_probe+0x38 1222 0% 95% 0.00 49830 page pv 93 sdt_probe+0x38 1206 0% 95% 0.00 64606 page pv 218 sdt_probe+0x38 1205 0% 95% 0.00 2293240 page pv 233 sdt_probe+0x38 1204 0% 95% 0.00 180803 page pv 59 sdt_probe+0x38 1191 0% 96% 0.00 2780820 page pv 254 sdt_probe+0x38 1183 0% 96% 0.00 71909 page pv 146 sdt_probe+0x38 1181 0% 96% 0.00 1048864 page pv 255 sdt_probe+0x38 1150 0% 96% 0.00 62855 page pv 191 sdt_probe+0x38 1148 0% 96% 0.00 49443 page pv 149 sdt_probe+0x38 1138 0% 96% 0.00 64801 page pv 125 sdt_probe+0x38 1135 0% 96% 0.00 48367 page pv 5 sdt_probe+0x38 1120 0% 96% 0.00 1694659 page pv 43 sdt_probe+0x38 1120 0% 96% 0.00 50581 page pv 145 sdt_probe+0x38 1115 0% 96% 0.00 1722378 page pv 79 sdt_probe+0x38 1105 0% 96% 0.00 2105159 page pv 70 sdt_probe+0x38 1104 0% 96% 0.00 2946349 page pv 39 sdt_probe+0x38 1098 0% 97% 0.00 50727 page pv 90 sdt_probe+0x38 1096 0% 97% 0.00 1618689 page pv 71 sdt_probe+0x38 1094 0% 97% 0.00 51337 page pv 147 sdt_probe+0x38 1082 0% 97% 0.00 72746 page pv 222 sdt_probe+0x38 1074 0% 97% 0.00 297100 page pv 10 sdt_probe+0x38 1071 0% 97% 0.00 7795 tidhash sdt_probe+0x38 1065 0% 97% 0.00 3207985 page pv 37 sdt_probe+0x38 1064 0% 97% 0.00 4132692 page pv 253 sdt_probe+0x38 1058 0% 97% 0.00 1684755 page pv 58 sdt_probe+0x38 1054 0% 97% 0.00 65162 page pv 164 sdt_probe+0x38 1027 0% 97% 0.00 3881988 page pv 50 sdt_probe+0x38 1018 0% 97% 0.00 65415 page pv 213 sdt_probe+0x38 999 0% 97% 0.00 2086041 page pv 34 sdt_probe+0x38 978 0% 98% 0.00 2925756 page pv 35 sdt_probe+0x38 977 0% 98% 0.00 4418601 page pv 252 sdt_probe+0x38 973 0% 98% 0.00 74330 page pv 117 sdt_probe+0x38 972 0% 98% 0.00 68356 page pv 163 sdt_probe+0x38 966 0% 98% 0.00 51669 page pv 148 sdt_probe+0x38 950 0% 98% 0.00 45016 page pv 142 sdt_probe+0x38 942 0% 98% 0.00 413261 page pv 12 sdt_probe+0x38 915 0% 98% 0.00 2387381 page pv 46 sdt_probe+0x38 915 0% 98% 0.00 1343110 page pv 11 sdt_probe+0x38 897 0% 98% 0.00 53291 page pv 138 sdt_probe+0x38 888 0% 98% 0.00 61239 page pv 61 sdt_probe+0x38 885 0% 98% 0.00 56584 page pv 166 sdt_probe+0x38 884 0% 98% 0.00 50399 page pv 4 sdt_probe+0x38 883 0% 98% 0.00 50929 page pv 114 sdt_probe+0x38 873 0% 99% 0.00 1467415 page pv 239 sdt_probe+0x38 848 0% 99% 0.00 44568 page pv 173 sdt_probe+0x38 844 0% 99% 0.00 48358 page pv 119 sdt_probe+0x38 835 0% 99% 0.00 67620 page pv 167 sdt_probe+0x38 835 0% 99% 0.00 58884 page pv 127 sdt_probe+0x38 826 0% 99% 0.00 155576 page pv 14 sdt_probe+0x38 799 0% 99% 0.00 48985 page pv 170 sdt_probe+0x38 797 0% 99% 0.00 61388 page pv 158 sdt_probe+0x38 797 0% 99% 0.00 44163 page pv 141 sdt_probe+0x38 791 0% 99% 0.00 61255 page pv 150 sdt_probe+0x38 767 0% 99% 0.00 60126 page pv 139 sdt_probe+0x38 752 0% 99% 0.00 2016886 page pv 47 sdt_probe+0x38 725 0% 99% 0.00 62899 page pv 126 sdt_probe+0x38 722 0% 99% 0.00 59700 page pv 174 sdt_probe+0x38 714 0% 99% 0.00 3743941 page pv 36 sdt_probe+0x38 698 0% 99% 0.00 4426707 page pv 38 sdt_probe+0x38 681 0% 99% 0.00 2916353 page pv 238 sdt_probe+0x38 658 0% 100% 0.00 2943201 page pv 237 sdt_probe+0x38 639 0% 100% 0.00 4750216 page pv 236 sdt_probe+0x38 627 0% 100% 0.00 59359 page pv 124 sdt_probe+0x38 574 0% 100% 0.00 5865550 page pv 235 sdt_probe+0x38 556 0% 100% 0.00 62482 page pv 151 sdt_probe+0x38 541 0% 100% 0.00 47628 page pv 29 sdt_probe+0x38 519 0% 100% 0.00 528529 page pv 13 sdt_probe+0x38 502 0% 100% 0.00 89207 page pv 30 sdt_probe+0x38 474 0% 100% 0.00 73090 page pv 143 sdt_probe+0x38 390 0% 100% 0.00 57587 page pv 180 sdt_probe+0x38 383 0% 100% 0.00 8464595 page pv 234 sdt_probe+0x38 352 0% 100% 0.00 53243 page pv 27 sdt_probe+0x38 313 0% 100% 0.00 71678 page pv 179 sdt_probe+0x38 305 0% 100% 0.00 97085 page pv 28 sdt_probe+0x38 264 0% 100% 0.00 102693 page pv 31 sdt_probe+0x38 122 0% 100% 0.00 19955 vfs hash sdt_probe+0x38 28 0% 100% 0.00 17440 nd6 list sdt_probe+0x38 ------------------------------------------------------------------------------- R/W reader hold: 8102445 events in 14.090 seconds (575039 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 7888284 97% 97% 0.00 54767 pte eviction sdt_probe+0x38 213551 3% 100% 0.00 2599424 vmobject sdt_probe+0x38 208 0% 100% 0.00 34782 vnet_rwlock sdt_probe+0x38 168 0% 100% 0.00 14858 vfs hash sdt_probe+0x38 107 0% 100% 0.00 7684 bufobj interlock sdt_probe+0x38 34 0% 100% 0.00 6658 tidhash sdt_probe+0x38 8 0% 100% 0.00 4110 page pv 183 sdt_probe+0x38 7 0% 100% 0.00 3563 page pv 6 sdt_probe+0x38 6 0% 100% 0.00 410215 udpinp sdt_probe+0x38 5 0% 100% 0.00 50044 page pv 205 sdt_probe+0x38 5 0% 100% 0.00 4184 page pv 160 sdt_probe+0x38 3 0% 100% 0.00 3529 page pv 198 sdt_probe+0x38 3 0% 100% 0.00 24876 page pv 120 sdt_probe+0x38 2 0% 100% 0.00 8970 page pv 85 sdt_probe+0x38 2 0% 100% 0.00 4793 page pv 84 sdt_probe+0x38 2 0% 100% 0.00 7219 page pv 74 sdt_probe+0x38 2 0% 100% 0.00 5687 page pv 51 sdt_probe+0x38 2 0% 100% 0.00 13160 page pv 26 sdt_probe+0x38 2 0% 100% 0.00 5983 page pv 16 sdt_probe+0x38 2 0% 100% 0.00 12773 page pv 128 sdt_probe+0x38 2 0% 100% 0.00 4468 page pv 110 sdt_probe+0x38 2 0% 100% 0.00 4255 page pv 0 sdt_probe+0x38 1 0% 100% 0.00 6683 page pv 98 sdt_probe+0x38 1 0% 100% 0.00 6203 page pv 94 sdt_probe+0x38 1 0% 100% 0.00 6418 page pv 96 sdt_probe+0x38 1 0% 100% 0.00 22234 page pv 86 sdt_probe+0x38 1 0% 100% 0.00 5271 page pv 90 sdt_probe+0x38 1 0% 100% 0.00 19151 page pv 92 sdt_probe+0x38 1 0% 100% 0.00 9556 page pv 76 sdt_probe+0x38 1 0% 100% 0.00 9787 page pv 72 sdt_probe+0x38 1 0% 100% 0.00 6582 page pv 81 sdt_probe+0x38 1 0% 100% 0.00 4524 page pv 3 sdt_probe+0x38 1 0% 100% 0.00 18785 page pv 36 sdt_probe+0x38 1 0% 100% 0.00 5227 page pv 249 sdt_probe+0x38 1 0% 100% 0.00 4822 page pv 28 sdt_probe+0x38 1 0% 100% 0.00 4597 page pv 224 sdt_probe+0x38 1 0% 100% 0.00 4576 page pv 221 sdt_probe+0x38 1 0% 100% 0.00 28469 page pv 217 sdt_probe+0x38 1 0% 100% 0.00 4887 page pv 228 sdt_probe+0x38 1 0% 100% 0.00 4975 page pv 240 sdt_probe+0x38 1 0% 100% 0.00 5649 page pv 242 sdt_probe+0x38 1 0% 100% 0.00 4800 page pv 187 sdt_probe+0x38 1 0% 100% 0.00 4892 page pv 179 sdt_probe+0x38 1 0% 100% 0.00 6461 page pv 159 sdt_probe+0x38 1 0% 100% 0.00 19153 page pv 199 sdt_probe+0x38 1 0% 100% 0.00 5906 page pv 209 sdt_probe+0x38 1 0% 100% 0.00 4916 page pv 206 sdt_probe+0x38 1 0% 100% 0.00 5219 page pv 210 sdt_probe+0x38 1 0% 100% 0.00 44211 page pv 212 sdt_probe+0x38 1 0% 100% 0.00 8002512 UMA lock sdt_probe+0x38 1 0% 100% 0.00 3886 page pv 118 sdt_probe+0x38 1 0% 100% 0.00 4590 page pv 101 sdt_probe+0x38 1 0% 100% 0.00 9438 page pv 106 sdt_probe+0x38 1 0% 100% 0.00 4725 page pv 108 sdt_probe+0x38 1 0% 100% 0.00 4812 page pv 136 sdt_probe+0x38 1 0% 100% 0.00 5375 page pv 132 sdt_probe+0x38 1 0% 100% 0.00 55945 page pv 139 sdt_probe+0x38 1 0% 100% 0.00 4586 page pv 138 sdt_probe+0x38 1 0% 100% 0.00 69440 page pv 150 sdt_probe+0x38 1 0% 100% 0.00 14283 page pv 155 sdt_probe+0x38 ------------------------------------------------------------------------------- SX shared hold: 301678 events in 14.090 seconds (21410 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 292254 97% 97% 0.00 1336626 vm map (user) sdt_probe+0x38 3033 1% 98% 0.00 514005 pidhash sdt_probe+0x38 2979 1% 99% 0.00 559122 proctree sdt_probe+0x38 2706 1% 100% 0.00 15162 filedesc structure sdt_probe+0x38 390 0% 100% 0.00 3908965 killpg racer sdt_probe+0x38 232 0% 100% 0.00 15601 sysctl string handler sdt_probe+0x38 66 0% 100% 0.00 29232 dirhash sdt_probe+0x38 18 0% 100% 0.00 34338155 allproc sdt_probe+0x38 ------------------------------------------------------------------------------- SX exclusive hold: 47739 events in 14.090 seconds (3388 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 25274 53% 53% 0.00 17544344 vm map (user) sdt_probe+0x38 12658 27% 79% 0.00 8019 filedesc structure sdt_probe+0x38 2622 5% 85% 0.00 165346 proctree sdt_probe+0x38 2172 5% 89% 0.00 330541 dtrace_lock sdt_probe+0x38 1071 2% 92% 0.00 9774 allproc sdt_probe+0x38 1030 2% 94% 0.00 7678 pidhash sdt_probe+0x38 944 2% 96% 0.00 9590 fasttrap_provs.fth_table[i].ftb_mtx sdt_probe+0x38 782 2% 98% 0.00 421443 so_snd_sx sdt_probe+0x38 694 1% 99% 0.00 186507 so_rcv_sx sdt_probe+0x38 162 0% 99% 0.00 519544 killpg racer sdt_probe+0x38 116 0% 100% 0.00 1746422 CMDQ lock sdt_probe+0x38 88 0% 100% 0.00 656088 USB suspend and resume SX lock sdt_probe+0x38 52 0% 100% 0.00 973307 USB control transfer SX lock sdt_probe+0x38 36 0% 100% 0.00 2981437 USB config SX lock sdt_probe+0x38 16 0% 100% 0.00 6818 dirhash sdt_probe+0x38 14 0% 100% 0.00 149296 umareclaim sdt_probe+0x38 5 0% 100% 0.00 795799120 sysctl mem sdt_probe+0x38 3 0% 100% 0.00 13916 devfsmount sdt_probe+0x38 ------------------------------------------------------------------------------- lockmgr shared hold: 33999 events in 14.090 seconds (2413 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 33996 100% 100% 0.00 841416 ufs sdt_probe+0x38 3 0% 100% 0.00 914003 devfs sdt_probe+0x38 ------------------------------------------------------------------------------- lockmgr exclusive hold: 2307 events in 14.090 seconds (164 events/sec) Count indv cuml rcnt nsec Lock Caller ------------------------------------------------------------------------------- 1581 69% 69% 0.00 203204 bufwait sdt_probe+0x38 701 30% 99% 0.00 549829 ufs sdt_probe+0x38 15 1% 100% 0.00 1117460 rename sdt_probe+0x38 5 0% 100% 0.00 295993 pbufwait sdt_probe+0x38 3 0% 100% 0.00 31151 devfs sdt_probe+0x38 2 0% 100% 0.00 63432 syncer sdt_probe+0x38 -------------------------------------------------------------------------------