GENERIC HEAD from 2013-08-05 12:15:53 UTC, r253964, vmcore.5 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #3 r253964: Mon Aug 5 18:06:10 CEST 2013 pho@t1.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.23-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x206d7 Family = 0x6 Model = 0x2d Stepping = 7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 30998552576 (29562 MB) : Trying to mount root from ufs:/dev/da0p2 [rw]... Setting hostuuid: 3141f787-07e3-e111-b968-001e6756c168. Setting hostid: 0x564ac5b6. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/da0p2: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p2: clean, 93310112 free (93920 frags, 11652024 blocks, 0.1% fragmentation) /dev/da0p3: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p3: clean, 25282511 free (207 frags, 3160288 blocks, 0.0% fragmentation) Mounting local file systems:. Writing entropy file:. Setting hostname: t1.osted.lan. Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 igb0: flags=8843 metric 0 mtu 1500 options=401bb ether 00:1e:67:56:c1:68 inet 192.168.1.108 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::21e:67ff:fe56:c168%igb0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active igb1: flags=8c02 metric 0 mtu 1500 options=401bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Starting devd. Starting Network: igb1. igb1: flags=8c02 metric 0 mtu 1500 options=401bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Configuring keyboard: keymap. ums0: on usbus2 ums0: 3 buttons and [Z] coordinates ID=0 Starting ums0 moused. Expensive timeout(9) function: 0xffffffff8073dc30(0xffffffff815c6050) 0.013787625 s add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib 32-bit compatibility ldconfig path: /usr/lib32 Creating and/or trimming log files. Starting syslogd. No core dumps found. Starting rpcbind. NFS access cache time=60 rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered lock order reversal: 1st 0xffffff8785ead298 bufwait (bufwait) @ kern/vfs_bio.c:3061 2nd 0xfffffe00680c9400 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff881de28300 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff881de283b0 witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff881de28440 _sx_xlock() at _sx_xlock+0x75/frame 0xffffff881de28480 ufsdirhash_add() at ufsdirhash_add+0x4c/frame 0xffffff881de284c0 ufs_direnter() at ufs_direnter+0x688/frame 0xffffff881de28580 ufs_mkdir() at ufs_mkdir+0x863/frame 0xffffff881de28780 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x10e/frame 0xffffff881de287b0 kern_mkdirat() at kern_mkdirat+0x20e/frame 0xffffff881de289a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881de28ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881de28ab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x800931dba, rsp = 0x7fffffffd788, rbp = 0x7fffffffdc70 --- Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Configuring syscons: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Local package initialization: backup. sysctl: unknown oid 'debug.do_vmem_check' at line 10: No such file or directory Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Mon Aug 5 18:09:47 CEST 2013 FreeBSD/amd64 (t1.osted.lan) (console) login: pho Password: Last login: Mon Aug 5 17:29:35 from x2.osted.lan FreeBSD 10.0-CURRENT (PHO) #3 r253964: Mon Aug 5 18:06:10 CEST 2013 VT-d enabled in BIOS! Testing svn://svn.freebsd.org/base/user/attilio/vmobj-fullread $ cd stress2/testcases/udp $ export BLASTHOST=192.168.1.101 $ ./udp -t 2m -i 50 -h -v udp: run time 0+00:02:00, incarnations 50, load 100, verbose 1 $ ./udp -t 2m -i 50 -h -v udp: run time 0+00:02:00, incarnations 50, load 100, verbose 1 $ ./udp -t 2m -i 50 -h -v udp: run time 0+00:02:00, incarnations 50, load 100, verbose 1 panic: buf=0xfffffe01a8db2e00 already enqueue at 3923 prod=3922 cons=3923 cpuid = 12 KDB: enter: panic [ thread pid 1242 tid 100303 ] Stopped at kdb_enter+0x3e: movq $0,kdb_why db> run pho db:0:pho> bt Tracing pid 1242 tid 100303 td 0xfffffe03412d9000 kdb_enter() at kdb_enter+0x3e/frame 0xffffff881e15f490 vpanic() at vpanic+0x146/frame 0xffffff881e15f4d0 panic() at panic+0x43/frame 0xffffff881e15f530 buf_ring_enqueue() at buf_ring_enqueue+0x6f/frame 0xffffff881e15f570 drbr_enqueue() at drbr_enqueue+0x2b/frame 0xffffff881e15f5a0 igb_mq_start() at igb_mq_start+0xdb/frame 0xffffff881e15f600 ether_output() at ether_output+0x5b6/frame 0xffffff881e15f670 ip_output() at ip_output+0xf37/frame 0xffffff881e15f750 udp_send() at udp_send+0x82b/frame 0xffffff881e15f800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e15f880 soo_write() at soo_write+0x49/frame 0xffffff881e15f8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e15f910 kern_writev() at kern_writev+0x48/frame 0xffffff881e15f950 sys_write() at sys_write+0x63/frame 0xffffff881e15f9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e15fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e15fab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- db:0:bt> show allpcpu Current CPU: 12 cpuid = 0 dynamic pcpu = 0x5d3480 curthread = 0xfffffe0051670000: pid 0 "igb0 que" curpcb = 0xffffff881b722b80 fpcurthread = none idlethread = 0xfffffe0050035920: tid 100003 "idle: cpu0" curpmap = 0xffffffff81602528 tssp = 0xffffffff81619310 commontssp = 0xffffffff81619310 rsp0 = 0xffffff881b722b80 gs32p = 0xffffffff8161ad68 ldt = 0xffffffff8161ada8 tss = 0xffffffff8161ad98 spin locks held: cpuid = 1 dynamic pcpu = 0xffffff807ef04480 curthread = 0xfffffe005166f920: pid 12 "irq268: igb0:que 1" curpcb = 0xffffff881b727b80 fpcurthread = none idlethread = 0xfffffe0050035490: tid 100004 "idle: cpu1" curpmap = 0xffffffff81602528 tssp = 0xffffffff81619378 commontssp = 0xffffffff81619378 rsp0 = 0xffffff881b727b80 gs32p = 0xffffffff8161add0 ldt = 0xffffffff8161ae10 tss = 0xffffffff8161ae00 spin locks held: cpuid = 2 dynamic pcpu = 0xffffff807ef0b480 curthread = 0xfffffe019c11f000: pid 1213 "udp" curpcb = 0xffffff881e088b80 fpcurthread = none idlethread = 0xfffffe0050035000: tid 100005 "idle: cpu2" curpmap = 0xfffffe00681ee2c8 tssp = 0xffffffff816193e0 commontssp = 0xffffffff816193e0 rsp0 = 0xffffff881e088b80 gs32p = 0xffffffff8161ae38 ldt = 0xffffffff8161ae78 tss = 0xffffffff8161ae68 spin locks held: cpuid = 3 dynamic pcpu = 0xffffff807ef12480 curthread = 0xfffffe0051671920: pid 12 "irq270: igb0:que 3" curpcb = 0xffffff881b73bb80 fpcurthread = none idlethread = 0xfffffe005004b000: tid 100006 "idle: cpu3" curpmap = 0xffffffff81602528 tssp = 0xffffffff81619448 commontssp = 0xffffffff81619448 rsp0 = 0xffffff881b73bb80 gs32p = 0xffffffff8161aea0 ldt = 0xffffffff8161aee0 tss = 0xffffffff8161aed0 spin locks held: cpuid = 4 dynamic pcpu = 0xffffff807ef19480 curthread = 0xfffffe0051671000: pid 12 "irq271: igb0:que 4" curpcb = 0xffffff881b745b80 fpcurthread = none idlethread = 0xfffffe005004a920: tid 100007 "idle: cpu4" curpmap = 0xffffffff81602528 tssp = 0xffffffff816194b0 commontssp = 0xffffffff816194b0 rsp0 = 0xffffff881b745b80 gs32p = 0xffffffff8161af08 ldt = 0xffffffff8161af48 tss = 0xffffffff8161af38 spin locks held: cpuid = 5 dynamic pcpu = 0xffffff807ef20480 curthread = 0xfffffe0051673920: pid 12 "irq272: igb0:que 5" curpcb = 0xffffff881b74fb80 fpcurthread = none idlethread = 0xfffffe005004a490: tid 100008 "idle: cpu5" curpmap = 0xffffffff81602528 tssp = 0xffffffff81619518 commontssp = 0xffffffff81619518 rsp0 = 0xffffff881b74fb80 gs32p = 0xffffffff8161af70 ldt = 0xffffffff8161afb0 tss = 0xffffffff8161afa0 spin locks held: cpuid = 6 dynamic pcpu = 0xffffff807ef27480 curthread = 0xfffffe019c04d490: pid 1198 "swap" curpcb = 0xffffff881e04cb80 fpcurthread = none idlethread = 0xfffffe005004a000: tid 100009 "idle: cpu6" curpmap = 0xfffffe0050041138 tssp = 0xffffffff81619580 commontssp = 0xffffffff81619580 rsp0 = 0xffffff881e04cb80 gs32p = 0xffffffff8161afd8 ldt = 0xffffffff8161b018 tss = 0xffffffff8161b008 spin locks held: cpuid = 7 dynamic pcpu = 0xffffff807ef2e480 curthread = 0xfffffe03411f9920: pid 1239 "udp" curpcb = 0xffffff881e150b80 fpcurthread = none idlethread = 0xfffffe005003b920: tid 100010 "idle: cpu7" curpmap = 0xfffffe0341267c28 tssp = 0xffffffff816195e8 commontssp = 0xffffffff816195e8 rsp0 = 0xffffff881e150b80 gs32p = 0xffffffff8161b040 ldt = 0xffffffff8161b080 tss = 0xffffffff8161b070 spin locks held: cpuid = 8 dynamic pcpu = 0xffffff807ef35480 curthread = 0xfffffe0099f0b000: pid 1184 "swap" curpcb = 0xffffff881e006b80 fpcurthread = none idlethread = 0xfffffe005004c920: tid 100011 "idle: cpu8" curpmap = 0xfffffe0050042908 tssp = 0xffffffff81619650 commontssp = 0xffffffff81619650 rsp0 = 0xffffff881e006b80 gs32p = 0xffffffff8161b0a8 ldt = 0xffffffff8161b0e8 tss = 0xffffffff8161b0d8 spin locks held: cpuid = 9 dynamic pcpu = 0xffffff807ef3c480 curthread = 0xfffffe019c18e920: pid 1222 "udp" curpcb = 0xffffff881e0b5b80 fpcurthread = none idlethread = 0xfffffe005004c490: tid 100012 "idle: cpu9" curpmap = 0xfffffe0057922db8 tssp = 0xffffffff816196b8 commontssp = 0xffffffff816196b8 rsp0 = 0xffffff881e0b5b80 gs32p = 0xffffffff8161b110 ldt = 0xffffffff8161b150 tss = 0xffffffff8161b140 spin locks held: cpuid = 10 dynamic pcpu = 0xffffff807ef43480 curthread = 0xfffffe034118b000: pid 1230 "udp" curpcb = 0xffffff881e123b80 fpcurthread = none idlethread = 0xfffffe005004c000: tid 100013 "idle: cpu10" curpmap = 0xfffffe00681ee138 tssp = 0xffffffff81619720 commontssp = 0xffffffff81619720 rsp0 = 0xffffff881e123b80 gs32p = 0xffffffff8161b178 ldt = 0xffffffff8161b1b8 tss = 0xffffffff8161b1a8 spin locks held: cpuid = 11 dynamic pcpu = 0xffffff807ef4a480 curthread = 0xfffffe019c1f8000: pid 1221 "udp" curpcb = 0xffffff881e0b0b80 fpcurthread = none idlethread = 0xfffffe005004b920: tid 100014 "idle: cpu11" curpmap = 0xfffffe005799f138 tssp = 0xffffffff81619788 commontssp = 0xffffffff81619788 rsp0 = 0xffffff881e0b0b80 gs32p = 0xffffffff8161b1e0 ldt = 0xffffffff8161b220 tss = 0xffffffff8161b210 spin locks held: cpuid = 12 dynamic pcpu = 0xffffff807ef51480 curthread = 0xfffffe03412d9000: pid 1242 "udp" curpcb = 0xffffff881e15fb80 fpcurthread = none idlethread = 0xfffffe005004b490: tid 100015 "idle: cpu12" curpmap = 0xfffffe0341267778 tssp = 0xffffffff816197f0 commontssp = 0xffffffff816197f0 rsp0 = 0xffffff881e15fb80 gs32p = 0xffffffff8161b248 ldt = 0xffffffff8161b288 tss = 0xffffffff8161b278 spin locks held: cpuid = 13 dynamic pcpu = 0xffffff807ef58480 curthread = 0xfffffe0051671490: pid 0 "igb0 que" curpcb = 0xffffff881b740b80 fpcurthread = none idlethread = 0xfffffe005004e490: tid 100016 "idle: cpu13" curpmap = 0xffffffff81602528 tssp = 0xffffffff81619858 commontssp = 0xffffffff81619858 rsp0 = 0xffffff881b740b80 gs32p = 0xffffffff8161b2b0 ldt = 0xffffffff8161b2f0 tss = 0xffffffff8161b2e0 spin locks held: cpuid = 14 dynamic pcpu = 0xffffff807ef5f480 curthread = 0xfffffe019c04d920: pid 1197 "swap" curpcb = 0xffffff881e047b80 fpcurthread = 0xfffffe019c04d920: pid 1197 "swap" idlethread = 0xfffffe005004e000: tid 100017 "idle: cpu14" curpmap = 0xfffffe00500412c8 tssp = 0xffffffff816198c0 commontssp = 0xffffffff816198c0 rsp0 = 0xffffff881e047b80 gs32p = 0xffffffff8161b318 ldt = 0xffffffff8161b358 tss = 0xffffffff8161b348 spin locks held: cpuid = 15 dynamic pcpu = 0xffffff807ef66480 curthread = 0xfffffe0051672000: pid 0 "igb0 que" curpcb = 0xffffff881b736b80 fpcurthread = none idlethread = 0xfffffe005004d920: tid 100018 "idle: cpu15" curpmap = 0xffffffff81602528 tssp = 0xffffffff81619928 commontssp = 0xffffffff81619928 rsp0 = 0xffffff881b736b80 gs32p = 0xffffffff8161b380 ldt = 0xffffffff8161b3c0 tss = 0xffffffff8161b3b0 spin locks held: cpuid = 16 dynamic pcpu = 0xffffff807ef6d480 curthread = 0xfffffe01af22b490: pid 1174 "swap" curpcb = 0xffffff881e100b80 fpcurthread = none idlethread = 0xfffffe005004d490: tid 100019 "idle: cpu16" curpmap = 0xfffffe0057a97c28 tssp = 0xffffffff81619990 commontssp = 0xffffffff81619990 rsp0 = 0xffffff881e100b80 gs32p = 0xffffffff8161b3e8 ldt = 0xffffffff8161b428 tss = 0xffffffff8161b418 spin locks held: cpuid = 17 dynamic pcpu = 0xffffff807ef74480 curthread = 0xfffffe03412d8000: pid 1245 "udp" curpcb = 0xffffff881e16eb80 fpcurthread = none idlethread = 0xfffffe005004d000: tid 100020 "idle: cpu17" curpmap = 0xfffffe03412672c8 tssp = 0xffffffff816199f8 commontssp = 0xffffffff816199f8 rsp0 = 0xffffff881e16eb80 gs32p = 0xffffffff8161b450 ldt = 0xffffffff8161b490 tss = 0xffffffff8161b480 spin locks held: cpuid = 18 dynamic pcpu = 0xffffff807ef7b480 curthread = 0xfffffe00681a2490: pid 1170 "swap" curpcb = 0xffffff881dee1b80 fpcurthread = none idlethread = 0xfffffe0050050000: tid 100021 "idle: cpu18" curpmap = 0xfffffe00681a8778 tssp = 0xffffffff81619a60 commontssp = 0xffffffff81619a60 rsp0 = 0xffffff881dee1b80 gs32p = 0xffffffff8161b4b8 ldt = 0xffffffff8161b4f8 tss = 0xffffffff8161b4e8 spin locks held: cpuid = 19 dynamic pcpu = 0xffffff807ef82480 curthread = 0xfffffe0051679490: pid 0 "igb0 que" curpcb = 0xffffff881b768b80 fpcurthread = none idlethread = 0xfffffe005004f920: tid 100022 "idle: cpu19" curpmap = 0xffffffff81602528 tssp = 0xffffffff81619ac8 commontssp = 0xffffffff81619ac8 rsp0 = 0xffffff881b768b80 gs32p = 0xffffffff8161b520 ldt = 0xffffffff8161b560 tss = 0xffffffff8161b550 spin locks held: cpuid = 20 dynamic pcpu = 0xffffff807ef89480 curthread = 0xfffffe0051673490: pid 0 "igb0 que" curpcb = 0xffffff881b754b80 fpcurthread = none idlethread = 0xfffffe005004f490: tid 100023 "idle: cpu20" curpmap = 0xffffffff81602528 tssp = 0xffffffff81619b30 commontssp = 0xffffffff81619b30 rsp0 = 0xffffff881b754b80 gs32p = 0xffffffff8161b588 ldt = 0xffffffff8161b5c8 tss = 0xffffffff8161b5b8 spin locks held: cpuid = 21 dynamic pcpu = 0xffffff807ef90480 curthread = 0xfffffe005166f490: pid 0 "igb0 que" curpcb = 0xffffff881b72cb80 fpcurthread = none idlethread = 0xfffffe005004f000: tid 100024 "idle: cpu21" curpmap = 0xffffffff81602528 tssp = 0xffffffff81619b98 commontssp = 0xffffffff81619b98 rsp0 = 0xffffff881b72cb80 gs32p = 0xffffffff8161b5f0 ldt = 0xffffffff8161b630 tss = 0xffffffff8161b620 spin locks held: cpuid = 22 dynamic pcpu = 0xffffff807ef97480 curthread = 0xfffffe0057f73490: pid 1171 "swap" curpcb = 0xffffff881de64b80 fpcurthread = none idlethread = 0xfffffe005004e920: tid 100025 "idle: cpu22" curpmap = 0xfffffe00995d75e8 tssp = 0xffffffff81619c00 commontssp = 0xffffffff81619c00 rsp0 = 0xffffff881de64b80 gs32p = 0xffffffff8161b658 ldt = 0xffffffff8161b698 tss = 0xffffffff8161b688 spin locks held: cpuid = 23 dynamic pcpu = 0xffffff807ef9e480 curthread = 0xfffffe0051670920: pid 0 "igb0 que" curpcb = 0xffffff881b74ab80 fpcurthread = none idlethread = 0xfffffe0050051920: tid 100026 "idle: cpu23" curpmap = 0xffffffff81602528 tssp = 0xffffffff81619c68 commontssp = 0xffffffff81619c68 rsp0 = 0xffffff881b74ab80 gs32p = 0xffffffff8161b6c0 ldt = 0xffffffff8161b700 tss = 0xffffffff8161b6f0 spin locks held: db:0:allpcpu> show alllocks Process 1251 (udp) thread 0xfffffe03413b8920 (100312) shared rw udpinp (udpinp) r = 0 (0xfffffe00998f4910) locked @ netinet/udp_usrreq.c:976 Process 1250 (udp) thread 0xfffffe03412d9920 (100311) shared rw udpinp (udpinp) r = 0 (0xfffffe00998f4f30) locked @ netinet/udp_usrreq.c:976 Process 1249 (udp) thread 0xfffffe034134c000 (100310) shared rw udpinp (udpinp) r = 0 (0xfffffe0099618f30) locked @ netinet/udp_usrreq.c:976 Process 1248 (udp) thread 0xfffffe034134c490 (100309) shared rw udpinp (udpinp) r = 0 (0xfffffe00996dfa98) locked @ netinet/udp_usrreq.c:976 Process 1246 (udp) thread 0xfffffe034134d000 (100307) shared rw udpinp (udpinp) r = 0 (0xfffffe00681e4f30) locked @ netinet/udp_usrreq.c:976 Process 1245 (udp) thread 0xfffffe03412d8000 (100306) shared rw udpinp (udpinp) r = 0 (0xfffffe00997c5478) locked @ netinet/udp_usrreq.c:976 Process 1244 (udp) thread 0xfffffe03412d8490 (100305) shared rw udpinp (udpinp) r = 0 (0xfffffe00996fef30) locked @ netinet/udp_usrreq.c:976 Process 1243 (udp) thread 0xfffffe03412d8920 (100304) shared rw udpinp (udpinp) r = 0 (0xfffffe0099e18788) locked @ netinet/udp_usrreq.c:976 Process 1242 (udp) thread 0xfffffe03412d9000 (100303) shared rw udpinp (udpinp) r = 0 (0xfffffe00996f8910) locked @ netinet/udp_usrreq.c:976 Process 1241 (udp) thread 0xfffffe03412d9490 (100302) shared rw udpinp (udpinp) r = 0 (0xfffffe0068282a98) locked @ netinet/udp_usrreq.c:976 Process 1240 (udp) thread 0xfffffe03411f9490 (100301) shared rw udpinp (udpinp) r = 0 (0xfffffe00996dff30) locked @ netinet/udp_usrreq.c:976 Process 1238 (udp) thread 0xfffffe034125e000 (100299) shared rw udpinp (udpinp) r = 0 (0xfffffe0068214a98) locked @ netinet/udp_usrreq.c:976 Process 1237 (udp) thread 0xfffffe034125e490 (100298) shared rw udpinp (udpinp) r = 0 (0xfffffe00996c9788) locked @ netinet/udp_usrreq.c:976 Process 1236 (udp) thread 0xfffffe034125e920 (100297) shared rw udpinp (udpinp) r = 0 (0xfffffe019c2c7600) locked @ netinet/udp_usrreq.c:976 Process 1235 (udp) thread 0xfffffe034118c920 (100296) shared rw udpinp (udpinp) r = 0 (0xfffffe00996df910) locked @ netinet/udp_usrreq.c:976 Process 1234 (udp) thread 0xfffffe03411f8000 (100295) shared rw udpinp (udpinp) r = 0 (0xfffffe00996c9910) locked @ netinet/udp_usrreq.c:976 Process 1233 (udp) thread 0xfffffe03411f8490 (100294) shared rw udpinp (udpinp) r = 0 (0xfffffe00681e4910) locked @ netinet/udp_usrreq.c:976 Process 1232 (udp) thread 0xfffffe03411f8920 (100293) shared rw udpinp (udpinp) r = 0 (0xfffffe019c2c8910) locked @ netinet/udp_usrreq.c:976 Process 1231 (udp) thread 0xfffffe03411f9000 (100292) shared rw udpinp (udpinp) r = 0 (0xfffffe009991aa98) locked @ netinet/udp_usrreq.c:976 Process 1229 (udp) thread 0xfffffe034118b490 (100290) shared rw udpinp (udpinp) r = 0 (0xfffffe01ac58da98) locked @ netinet/udp_usrreq.c:976 Process 1228 (udp) thread 0xfffffe034118b920 (100289) shared rw udpinp (udpinp) r = 0 (0xfffffe00998ecf30) locked @ netinet/udp_usrreq.c:976 Process 1227 (udp) thread 0xfffffe034118c000 (100288) shared rw udpinp (udpinp) r = 0 (0xfffffe0099e1a478) locked @ netinet/udp_usrreq.c:976 Process 1226 (udp) thread 0xfffffe034118c490 (100287) shared rw udpinp (udpinp) r = 0 (0xfffffe009991bc20) locked @ netinet/udp_usrreq.c:976 Process 1225 (udp) thread 0xfffffe0099a3c920 (100203) shared rw udpinp (udpinp) r = 0 (0xfffffe00996792f0) locked @ netinet/udp_usrreq.c:976 Process 1224 (udp) thread 0xfffffe00681a2000 (100186) shared rw udpinp (udpinp) r = 0 (0xfffffe01bf414600) locked @ netinet/udp_usrreq.c:976 Process 1223 (udp) thread 0xfffffe019c18e490 (100270) shared rw udpinp (udpinp) r = 0 (0xfffffe009967ac20) locked @ netinet/udp_usrreq.c:976 Process 1222 (udp) thread 0xfffffe019c18e920 (100269) shared rw udpinp (udpinp) r = 0 (0xfffffe00682e1da8) locked @ netinet/udp_usrreq.c:976 Process 1220 (udp) thread 0xfffffe019c1f8490 (100267) shared rw udpinp (udpinp) r = 0 (0xfffffe00998edf30) locked @ netinet/udp_usrreq.c:976 Process 1219 (udp) thread 0xfffffe019c1f8920 (100266) shared rw udpinp (udpinp) r = 0 (0xfffffe00996fe600) locked @ netinet/udp_usrreq.c:976 Process 1218 (udp) thread 0xfffffe019c120920 (100265) shared rw udpinp (udpinp) r = 0 (0xfffffe0068282910) locked @ netinet/udp_usrreq.c:976 Process 1217 (udp) thread 0xfffffe019c18d000 (100264) shared rw udpinp (udpinp) r = 0 (0xfffffe00998ed168) locked @ netinet/udp_usrreq.c:976 Process 1216 (udp) thread 0xfffffe019c18d490 (100263) shared rw udpinp (udpinp) r = 0 (0xfffffe00998f4da8) locked @ netinet/udp_usrreq.c:976 Process 1215 (udp) thread 0xfffffe019c18d920 (100262) shared rw udpinp (udpinp) r = 0 (0xfffffe00681e6600) locked @ netinet/udp_usrreq.c:976 Process 1214 (udp) thread 0xfffffe019c18e000 (100261) shared rw udpinp (udpinp) r = 0 (0xfffffe00681e4168) locked @ netinet/udp_usrreq.c:976 Process 1212 (udp) thread 0xfffffe019c11f490 (100259) shared rw udpinp (udpinp) r = 0 (0xfffffe0099e1aa98) locked @ netinet/udp_usrreq.c:976 Process 1211 (udp) thread 0xfffffe019c11f920 (100258) shared rw udpinp (udpinp) r = 0 (0xfffffe00996c9c20) locked @ netinet/udp_usrreq.c:976 Process 1210 (udp) thread 0xfffffe019c120000 (100257) shared rw udpinp (udpinp) r = 0 (0xfffffe00998ec168) locked @ netinet/udp_usrreq.c:976 Process 1208 (udp) thread 0xfffffe019c04e490 (100255) shared rw udpinp (udpinp) r = 0 (0xfffffe01ac58e168) locked @ netinet/udp_usrreq.c:976 Process 1207 (udp) thread 0xfffffe019c04e920 (100254) shared rw udpinp (udpinp) r = 0 (0xfffffe0099687da8) locked @ netinet/udp_usrreq.c:976 Process 1206 (udp) thread 0xfffffe019c0b7000 (100253) shared rw udpinp (udpinp) r = 0 (0xfffffe00682e1f30) locked @ netinet/udp_usrreq.c:976 Process 1205 (udp) thread 0xfffffe00682c0490 (100173) shared rw udpinp (udpinp) r = 0 (0xfffffe019c2c7478) locked @ netinet/udp_usrreq.c:976 Process 1204 (udp) thread 0xfffffe0057a8b490 (100286) shared rw udpinp (udpinp) r = 0 (0xfffffe009991ba98) locked @ netinet/udp_usrreq.c:976 Process 1203 (udp) thread 0xfffffe0057a8b920 (100285) shared rw udpinp (udpinp) r = 0 (0xfffffe0099e1a600) locked @ netinet/udp_usrreq.c:976 Process 1202 (udp) thread 0xfffffe0068001000 (100214) shared rw udpinp (udpinp) r = 0 (0xfffffe0099679910) locked @ netinet/udp_usrreq.c:976 Process 1196 (swap) thread 0xfffffe019c04e000 (100246) exclusive sleep mutex vm page (vm page) r = 0 (0xffffffff81615800) locked @ vm/vm_fault.c:345 exclusive rw vm object (vm object) r = 0 (0xfffffe00578f9d20) locked @ vm/vm_fault.c:306 shared sx vm map (user) (vm map (user)) r = 0 (0xfffffe00500413a0) locked @ vm/vm_map.c:3821 Process 5 (pagedaemon) thread 0xfffffe0057014490 (100128) exclusive rw pmap pv global (pmap pv global) r = 0 (0xffffffff815b3680) locked @ amd64/amd64/pmap.c:4802 exclusive rw vm object (vm object) r = 0 (0xfffffe0099cc15a0) locked @ vm/vm_pageout.c:1293 exclusive sleep mutex vm page (vm page) r = 0 (0xffffffff81615580) locked @ vm/vm_pageout.c:307 exclusive sleep mutex vm active pagequeue (vm pagequeue) r = 0 (0xffffffff8135b300) locked @ vm/vm_pageout.c:317 Process 0 (kernel) thread 0xfffffe0051679490 (100091) exclusive sleep mutex igb0:tx(7) (igb0:tx(7)) r = 0 (0xfffffe005164a6a0) locked @ dev/e1000/if_igb.c:1042 Process 0 (kernel) thread 0xfffffe0051673490 (100087) exclusive sleep mutex igb0:tx(5) (igb0:tx(5)) r = 0 (0xfffffe005164a4c0) locked @ dev/e1000/if_igb.c:1042 Process 0 (kernel) thread 0xfffffe0051670920 (100085) exclusive sleep mutex igb0:tx(4) (igb0:tx(4)) r = 0 (0xfffffe005164a3d0) locked @ dev/e1000/if_igb.c:1042 Process 0 (kernel) thread 0xfffffe0051671490 (100083) exclusive sleep mutex igb0:tx(3) (igb0:tx(3)) r = 0 (0xfffffe005164a2e0) locked @ dev/e1000/if_igb.c:1042 Process 0 (kernel) thread 0xfffffe0051672000 (100081) exclusive sleep mutex igb0:tx(2) (igb0:tx(2)) r = 0 (0xfffffe005164a1f0) locked @ dev/e1000/if_igb.c:1042 Process 0 (kernel) thread 0xfffffe005166f490 (100079) exclusive sleep mutex igb0:tx(1) (igb0:tx(1)) r = 0 (0xfffffe005164a100) locked @ dev/e1000/if_igb.c:1042 db:0:alllocks> show lockedvnods Locked vnodes db:0:lockedvnods> show mount 0xfffffe0057526b58 /dev/da0p2 on / (ufs) 0xfffffe0057527000 devfs on /dev (devfs) 0xfffffe0057f973c8 /dev/da0p3 on /tmp (ufs) 0xfffffe0057fa6790 procfs on /proc (procfs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 1251 1201 1200 1001 R+ udp 1250 1201 1200 1001 R+ udp 1249 1201 1200 1001 R+ udp 1248 1201 1200 1001 R+ udp 1247 1201 1200 1001 R+ udp 1246 1201 1200 1001 R+ udp 1245 1201 1200 1001 R+ CPU 17 udp 1244 1201 1200 1001 R+ udp 1243 1201 1200 1001 R+ udp 1242 1201 1200 1001 R+ CPU 12 udp 1241 1201 1200 1001 R+ udp 1240 1201 1200 1001 R+ udp 1239 1201 1200 1001 R+ CPU 7 udp 1238 1201 1200 1001 R+ udp 1237 1201 1200 1001 R+ udp 1236 1201 1200 1001 R+ udp 1235 1201 1200 1001 R+ udp 1234 1201 1200 1001 R+ udp 1233 1201 1200 1001 R+ udp 1232 1201 1200 1001 R+ udp 1231 1201 1200 1001 R+ udp 1230 1201 1200 1001 R+ CPU 10 udp 1229 1201 1200 1001 R+ udp 1228 1201 1200 1001 R+ udp 1227 1201 1200 1001 R+ udp 1226 1201 1200 1001 R+ udp 1225 1201 1200 1001 R+ udp 1224 1201 1200 1001 R+ udp 1223 1201 1200 1001 R+ udp 1222 1201 1200 1001 R+ CPU 9 udp 1221 1201 1200 1001 R+ CPU 11 udp 1220 1201 1200 1001 R+ udp 1219 1201 1200 1001 R+ udp 1218 1201 1200 1001 R+ udp 1217 1201 1200 1001 R+ udp 1216 1201 1200 1001 R+ udp 1215 1201 1200 1001 R+ udp 1214 1201 1200 1001 R+ udp 1213 1201 1200 1001 R+ CPU 2 udp 1212 1201 1200 1001 R+ udp 1211 1201 1200 1001 R+ udp 1210 1201 1200 1001 R+ udp 1209 1201 1200 1001 R+ udp 1208 1201 1200 1001 R+ udp 1207 1201 1200 1001 R+ udp 1206 1201 1200 1001 R+ udp 1205 1201 1200 1001 R+ udp 1204 1201 1200 1001 R+ udp 1203 1201 1200 1001 R+ udp 1202 1201 1200 1001 R+ udp 1201 1200 1200 1001 S+ wait 0xfffffe0099fe6970 udp 1200 1045 1200 1001 S+ nanslp 0xffffffff813b78f4 udp 1199 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1198 1169 1168 1001 R+ CPU 6 swap 1197 1169 1168 1001 R+ CPU 14 swap 1196 1169 1168 1001 LL+ *vm activ 0xfffffe0057affc00 swap 1195 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1194 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1193 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1192 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1191 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1190 1169 1168 1001 R+ swap 1189 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1188 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1187 1169 1168 1001 R+ swap 1186 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1185 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1184 1169 1168 1001 R+ CPU 8 swap 1183 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1182 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1181 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1180 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1179 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1178 1169 1168 1001 R+ swap 1177 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1176 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1175 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1174 1169 1168 1001 R+ CPU 16 swap 1173 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1172 1169 1168 1001 DL+ pfault 0xffffffff81610cd0 swap 1171 1169 1168 1001 R+ CPU 22 swap 1170 1169 1168 1001 R+ CPU 18 swap 1169 1168 1168 1001 S+ wait 0xfffffe005759e970 swap 1168 1161 1168 1001 S+ nanslp 0xffffffff813b78f1 swap 1161 1160 1161 1001 Ss+ wait 0xfffffe0057a77000 bash 1160 1158 1158 1001 S select 0xfffffe0057beadc0 sshd 1158 952 1158 0 Ss select 0xfffffe0057e6ce40 sshd 1045 1035 1045 1001 S+ wait 0xfffffe0057b69000 bash 1043 1 1043 0 Ss+ ttyin 0xfffffe005012dca8 getty 1042 1 1042 0 Ss+ ttyin 0xfffffe005012e0a8 getty 1041 1 1041 0 Ss+ ttyin 0xfffffe005012e4a8 getty 1040 1 1040 0 Ss+ ttyin 0xfffffe005012e8a8 getty 1039 1 1039 0 Ss+ ttyin 0xfffffe005012eca8 getty 1038 1 1038 0 Ss+ ttyin 0xfffffe005012f0a8 getty 1037 1 1037 0 Ss+ ttyin 0xfffffe005012f4a8 getty 1036 1 1036 0 Ss+ ttyin 0xfffffe005012f8a8 getty 1035 1 1035 0 Ss+ wait 0xfffffe0057589000 login 962 1 962 0 Ss nanslp 0xffffffff813b78fa cron 958 1 958 25 Ss pause 0xfffffe0057c0c560 sendmail 955 1 955 0 Ss select 0xfffffe0057b418c0 sendmail 952 1 952 0 Ss select 0xfffffe0099aea6c0 sshd 924 1 924 0 Ss select 0xfffffe0057c40040 powerd 921 1 921 0 Ss select 0xfffffe009974d3c0 ntpd 883 881 881 0 S (threaded) nfsd 100202 S rpcsvc 0xfffffe00572780a0 nfsd: service 100201 S rpcsvc 0xfffffe0057278120 nfsd: service 100200 S rpcsvc 0xfffffe00572781a0 nfsd: service 100165 S rpcsvc 0xfffffe00996d67a0 nfsd: master 881 1 881 0 Ss select 0xfffffe0057d470c0 nfsd 875 1 875 0 Ss select 0xfffffe005729fc40 mountd 868 864 864 0 S select 0xfffffe00995b74c0 nfsuserd 867 864 864 0 S select 0xfffffe0057b41a40 nfsuserd 866 864 864 0 S select 0xfffffe00996003c0 nfsuserd 865 864 864 0 S select 0xfffffe00995b7540 nfsuserd 864 1 864 0 Ss pause 0xfffffe005718ba18 nfsuserd 834 1 834 0 Ss select 0xfffffe005713abc0 rpcbind 821 1 821 0 Ss select 0xfffffe005734d640 syslogd 692 1 692 0 Ss select 0xfffffe0057beaf40 devd 675 1 675 0 Ss select 0xfffffe00681ca340 moused 17 0 0 0 DL sdflush 0xffffffff815abc7c [softdepflush] 16 0 0 0 DL vlruwt 0xfffffe005718b4b8 [vnlru] 9 0 0 0 DL syncer 0xffffffff815a4fb0 [syncer] 8 0 0 0 DL psleep 0xffffffff815a4984 [bufdaemon] 7 0 0 0 DL pgzero 0xffffffff815ad77c [pagezero] 6 0 0 0 DL psleep 0xffffffff815ac9d0 [vmdaemon] 5 0 0 0 RL [pagedaemon] 4 0 0 0 DL idle 0xfffffe0050034970 [enc_daemon0] 3 0 0 0 DL ccb_scan 0xffffffff813819b0 [xpt_thrd] 2 0 0 0 DL waiting_ 0xffffffff8160d108 [sctp_iterator] 15 0 0 0 DL (threaded) [usb] 100119 D - 0xffffff8001161e18 [usbus2] 100118 D - 0xffffff8001161dc0 [usbus2] 100117 D - 0xffffff8001161d68 [usbus2] 100116 D - 0xffffff8001161d10 [usbus2] 100114 D - 0xffffff800115a1b0 [usbus1] 100113 D - 0xffffff800115a158 [usbus1] 100112 D - 0xffffff800115a100 [usbus1] 100111 D - 0xffffff800115a0a8 [usbus1] 100074 D - 0xffffff8000ea7e18 [usbus0] 100073 D - 0xffffff8000ea7dc0 [usbus0] 100072 D - 0xffffff8000ea7d68 [usbus0] 100071 D - 0xffffff8000ea7d10 [usbus0] 14 0 0 0 DL - 0xffffffff8139aba8 [yarrow] 13 0 0 0 DL (threaded) [geom] 100055 D - 0xffffffff816019c0 [g_down] 100054 D - 0xffffffff816019b8 [g_up] 100053 D - 0xffffffff816019b0 [g_event] 12 0 0 0 RL (threaded) [intr] 100122 I [swi0: uart] 100121 I [irq287: hdac1] 100120 I [irq286: ahci0] 100115 I [irq20: ehci1] 100110 I [irq285: xhci0] 100109 I [irq284: igb1:link] 100107 I [irq283: igb1:que 7] 100105 I [irq282: igb1:que 6] 100103 I [irq281: igb1:que 5] 100101 I [irq280: igb1:que 4] 100099 I [irq279: igb1:que 3] 100097 I [irq278: igb1:que 2] 100095 I [irq277: igb1:que 1] 100093 I [irq276: igb1:que 0] 100092 I [irq275: igb0:link] 100090 RunQ [irq274: igb0:que 7] 100088 I [irq273: igb0:que 6] 100086 Run CPU 5 [irq272: igb0:que 5] 100084 Run CPU 4 [irq271: igb0:que 4] 100082 Run CPU 3 [irq270: igb0:que 3] 100080 RunQ [irq269: igb0:que 2] 100078 Run CPU 1 [irq268: igb0:que 1] 100076 I [irq267: igb0:que 0] 100075 I [irq266: hdac0] 100070 I [irq22: ehci0] 100069 I [irq265: isci0] 100068 I [irq264: isci0] 100065 I [swi6: Giant taskq] 100064 I [swi6: task queue] 100063 I [swi2: cambio] 100058 I [swi5: fast taskq] 100052 I [swi3: vm] 100051 I [swi1: netisr 0] 100050 I [swi4: clock] 100049 I [swi4: clock] 100048 I [swi4: clock] 100047 I [swi4: clock] 100046 I [swi4: clock] 100045 I [swi4: clock] 100044 I [swi4: clock] 100043 I [swi4: clock] 100042 I [swi4: clock] 100041 I [swi4: clock] 100040 I [swi4: clock] 100039 I [swi4: clock] 100038 I [swi4: clock] 100037 I [swi4: clock] 100036 I [swi4: clock] 100035 I [swi4: clock] 100034 I [swi4: clock] 100033 I [swi4: clock] 100032 I [swi4: clock] 100031 I [swi4: clock] 100030 I [swi4: clock] 100029 I [swi4: clock] 100028 I [swi4: clock] 100027 I [swi4: clock] 11 0 0 0 RL (threaded) [idle] 100026 CanRun [idle: cpu23] 100025 CanRun [idle: cpu22] 100024 CanRun [idle: cpu21] 100023 CanRun [idle: cpu20] 100022 CanRun [idle: cpu19] 100021 CanRun [idle: cpu18] 100020 CanRun [idle: cpu17] 100019 CanRun [idle: cpu16] 100018 CanRun [idle: cpu15] 100017 CanRun [idle: cpu14] 100016 CanRun [idle: cpu13] 100015 CanRun [idle: cpu12] 100014 CanRun [idle: cpu11] 100013 CanRun [idle: cpu10] 100012 CanRun [idle: cpu9] 100011 CanRun [idle: cpu8] 100010 CanRun [idle: cpu7] 100009 CanRun [idle: cpu6] 100008 CanRun [idle: cpu5] 100007 CanRun [idle: cpu4] 100006 CanRun [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 CanRun [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xfffffe0050034000 [init] 10 0 0 0 DL audit_wo 0xffffffff81610878 [audit] 0 0 0 0 RLs (threaded) [kernel] 100124 D - 0xffffffff813b6756 [deadlkres] 100123 D - 0xfffffe0051692d00 [mca taskq] 100108 D - 0xfffffe0051694600 [igb1 que] 100106 D - 0xfffffe0051694900 [igb1 que] 100104 D - 0xfffffe0051694c00 [igb1 que] 100102 D - 0xfffffe0051695000 [igb1 que] 100100 D - 0xfffffe005002b100 [igb1 que] 100098 D - 0xfffffe005002b400 [igb1 que] 100096 D - 0xfffffe005002b700 [igb1 que] 100094 D - 0xfffffe005002ba00 [igb1 que] 100091 Run CPU 19 [igb0 que] 100089 D - 0xfffffe005020d200 [igb0 que] 100087 Run CPU 20 [igb0 que] 100085 Run CPU 23 [igb0 que] 100083 Run CPU 13 [igb0 que] 100081 Run CPU 15 [igb0 que] 100079 Run CPU 21 [igb0 que] 100077 Run - 0xfffffe005020e500 [igb0 que] 100067 D - 0xfffffe005020f200 [ffs_trim taskq] 100066 D - 0xfffffe005020f400 [thread taskq] 100062 D - 0xfffffe005020fe00 [acpi_task_2] 100061 D - 0xfffffe005020fe00 [acpi_task_1] 100060 D - 0xfffffe005020fe00 [acpi_task_0] 100059 D - 0xfffffe0050210100 [kqueue taskq] 100056 D - 0xfffffe0050027400 [firmware taskq] 100000 D swapin 0xffffffff81601ab8 [swapper] db:0:ps> allt Tracing command udp pid 1251 tid 100312 td 0xfffffe03413b8920 sched_switch() at sched_switch+0x482/frame 0xffffff881e18c4b0 mi_switch() at mi_switch+0x179/frame 0xffffff881e18c4f0 critical_exit() at critical_exit+0x8b/frame 0xffffff881e18c510 spinlock_exit() at spinlock_exit+0x14/frame 0xffffff881e18c530 __mtx_unlock_flags() at __mtx_unlock_flags+0xf0/frame 0xffffff881e18c570 taskqueue_enqueue() at taskqueue_enqueue+0x84/frame 0xffffff881e18c5a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e18c600 ether_output() at ether_output+0x5b6/frame 0xffffff881e18c670 ip_output() at ip_output+0xe0d/frame 0xffffff881e18c750 udp_send() at udp_send+0x82b/frame 0xffffff881e18c800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e18c880 soo_write() at soo_write+0x49/frame 0xffffff881e18c8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e18c910 kern_writev() at kern_writev+0x48/frame 0xffffff881e18c950 sys_write() at sys_write+0x63/frame 0xffffff881e18c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e18cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e18cab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1250 tid 100311 td 0xfffffe03412d9920 sched_switch() at sched_switch+0x482/frame 0xffffff881e1874b0 mi_switch() at mi_switch+0x179/frame 0xffffff881e1874f0 critical_exit() at critical_exit+0x8b/frame 0xffffff881e187510 spinlock_exit() at spinlock_exit+0x14/frame 0xffffff881e187530 __mtx_unlock_flags() at __mtx_unlock_flags+0xf0/frame 0xffffff881e187570 taskqueue_enqueue() at taskqueue_enqueue+0x84/frame 0xffffff881e1875a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e187600 ether_output() at ether_output+0x5b6/frame 0xffffff881e187670 ip_output() at ip_output+0xf37/frame 0xffffff881e187750 udp_send() at udp_send+0x82b/frame 0xffffff881e187800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e187880 soo_write() at soo_write+0x49/frame 0xffffff881e1878c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e187910 kern_writev() at kern_writev+0x48/frame 0xffffff881e187950 sys_write() at sys_write+0x63/frame 0xffffff881e1879a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e187ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e187ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1249 tid 100310 td 0xfffffe034134c000 sched_switch() at sched_switch+0x482/frame 0xffffff881e182420 mi_switch() at mi_switch+0x179/frame 0xffffff881e182460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e1824b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e182530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e182570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e1825a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e182600 ether_output() at ether_output+0x5b6/frame 0xffffff881e182670 ip_output() at ip_output+0xe0d/frame 0xffffff881e182750 udp_send() at udp_send+0x82b/frame 0xffffff881e182800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e182880 soo_write() at soo_write+0x49/frame 0xffffff881e1828c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e182910 kern_writev() at kern_writev+0x48/frame 0xffffff881e182950 sys_write() at sys_write+0x63/frame 0xffffff881e1829a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e182ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e182ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1248 tid 100309 td 0xfffffe034134c490 sched_switch() at sched_switch+0x482/frame 0xffffff881e17d420 mi_switch() at mi_switch+0x179/frame 0xffffff881e17d460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e17d4b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e17d530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e17d570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e17d5a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e17d600 ether_output() at ether_output+0x5b6/frame 0xffffff881e17d670 ip_output() at ip_output+0xe0d/frame 0xffffff881e17d750 udp_send() at udp_send+0x82b/frame 0xffffff881e17d800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e17d880 soo_write() at soo_write+0x49/frame 0xffffff881e17d8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e17d910 kern_writev() at kern_writev+0x48/frame 0xffffff881e17d950 sys_write() at sys_write+0x63/frame 0xffffff881e17d9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e17dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e17dab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1247 tid 100308 td 0xfffffe034134c920 sched_switch() at sched_switch+0x482/frame 0xffffff881e1784e0 mi_switch() at mi_switch+0x179/frame 0xffffff881e178520 critical_exit() at critical_exit+0x8b/frame 0xffffff881e178540 ipi_bitmap_handler() at ipi_bitmap_handler+0x7a/frame 0xffffff881e178580 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x9b/frame 0xffffff881e178580 --- interrupt, rip = 0xffffffff808d135e, rsp = 0xffffff881e178640, rbp = 0xffffff881e178680 --- __mtx_unlock_flags() at __mtx_unlock_flags+0xde/frame 0xffffff881e178680 uma_dbg_getslab() at uma_dbg_getslab+0xe4/frame 0xffffff881e1786b0 uma_dbg_alloc() at uma_dbg_alloc+0x36/frame 0xffffff881e1786e0 uma_zalloc_arg() at uma_zalloc_arg+0x549/frame 0xffffff881e178750 m_getm2() at m_getm2+0x10f/frame 0xffffff881e1787b0 m_uiotombuf() at m_uiotombuf+0x60/frame 0xffffff881e178800 sosend_dgram() at sosend_dgram+0x23c/frame 0xffffff881e178880 soo_write() at soo_write+0x49/frame 0xffffff881e1788c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e178910 kern_writev() at kern_writev+0x48/frame 0xffffff881e178950 sys_write() at sys_write+0x63/frame 0xffffff881e1789a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e178ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e178ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1246 tid 100307 td 0xfffffe034134d000 sched_switch() at sched_switch+0x482/frame 0xffffff881e173460 mi_switch() at mi_switch+0x179/frame 0xffffff881e1734a0 critical_exit() at critical_exit+0x8b/frame 0xffffff881e1734c0 intr_event_handle() at intr_event_handle+0x13d/frame 0xffffff881e173510 intr_execute_handlers() at intr_execute_handlers+0x48/frame 0xffffff881e173540 lapic_handle_intr() at lapic_handle_intr+0x73/frame 0xffffff881e173570 Xapic_isr1() at Xapic_isr1+0xa4/frame 0xffffff881e173570 --- interrupt, rip = 0xffffffff808d135e, rsp = 0xffffff881e173630, rbp = 0xffffff881e173670 --- __mtx_unlock_flags() at __mtx_unlock_flags+0xde/frame 0xffffff881e173670 ip_output() at ip_output+0xd9a/frame 0xffffff881e173750 udp_send() at udp_send+0x82b/frame 0xffffff881e173800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e173880 soo_write() at soo_write+0x49/frame 0xffffff881e1738c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e173910 kern_writev() at kern_writev+0x48/frame 0xffffff881e173950 sys_write() at sys_write+0x63/frame 0xffffff881e1739a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e173ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e173ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1245 tid 100306 td 0xfffffe03412d8000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002f3ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002f3d00 trap() at trap+0x42/frame 0xffffff80002f3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002f3f20 --- trap 0x13, rip = 0xffffffff8050488e, rsp = 0xffffff80002f3fe0, rbp = 0xffffff881e16e570 --- buf_ring_enqueue() at buf_ring_enqueue+0x3e/frame 0xffffff881e16e570 drbr_enqueue() at drbr_enqueue+0x2b/frame 0xffffff881e16e5a0 igb_mq_start() at igb_mq_start+0xdb/frame 0xffffff881e16e600 ether_output() at ether_output+0x5b6/frame 0xffffff881e16e670 ip_output() at ip_output+0xe0d/frame 0xffffff881e16e750 udp_send() at udp_send+0x82b/frame 0xffffff881e16e800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e16e880 soo_write() at soo_write+0x49/frame 0xffffff881e16e8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e16e910 kern_writev() at kern_writev+0x48/frame 0xffffff881e16e950 sys_write() at sys_write+0x63/frame 0xffffff881e16e9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e16eab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e16eab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1244 tid 100305 td 0xfffffe03412d8490 sched_switch() at sched_switch+0x482/frame 0xffffff881e169420 mi_switch() at mi_switch+0x179/frame 0xffffff881e169460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e1694b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e169530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e169570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e1695a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e169600 ether_output() at ether_output+0x5b6/frame 0xffffff881e169670 ip_output() at ip_output+0xe0d/frame 0xffffff881e169750 udp_send() at udp_send+0x82b/frame 0xffffff881e169800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e169880 soo_write() at soo_write+0x49/frame 0xffffff881e1698c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e169910 kern_writev() at kern_writev+0x48/frame 0xffffff881e169950 sys_write() at sys_write+0x63/frame 0xffffff881e1699a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e169ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e169ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1243 tid 100304 td 0xfffffe03412d8920 sched_switch() at sched_switch+0x482/frame 0xffffff881e164420 mi_switch() at mi_switch+0x179/frame 0xffffff881e164460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e1644b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e164530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e164570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e1645a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e164600 ether_output() at ether_output+0x5b6/frame 0xffffff881e164670 ip_output() at ip_output+0xe0d/frame 0xffffff881e164750 udp_send() at udp_send+0x82b/frame 0xffffff881e164800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e164880 soo_write() at soo_write+0x49/frame 0xffffff881e1648c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e164910 kern_writev() at kern_writev+0x48/frame 0xffffff881e164950 sys_write() at sys_write+0x63/frame 0xffffff881e1649a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e164ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e164ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1242 tid 100303 td 0xfffffe03412d9000 kdb_enter() at kdb_enter+0x3e/frame 0xffffff881e15f490 vpanic() at vpanic+0x146/frame 0xffffff881e15f4d0 panic() at panic+0x43/frame 0xffffff881e15f530 buf_ring_enqueue() at buf_ring_enqueue+0x6f/frame 0xffffff881e15f570 drbr_enqueue() at drbr_enqueue+0x2b/frame 0xffffff881e15f5a0 igb_mq_start() at igb_mq_start+0xdb/frame 0xffffff881e15f600 ether_output() at ether_output+0x5b6/frame 0xffffff881e15f670 ip_output() at ip_output+0xf37/frame 0xffffff881e15f750 udp_send() at udp_send+0x82b/frame 0xffffff881e15f800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e15f880 soo_write() at soo_write+0x49/frame 0xffffff881e15f8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e15f910 kern_writev() at kern_writev+0x48/frame 0xffffff881e15f950 sys_write() at sys_write+0x63/frame 0xffffff881e15f9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e15fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e15fab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1241 tid 100302 td 0xfffffe03412d9490 sched_switch() at sched_switch+0x482/frame 0xffffff881e15a420 mi_switch() at mi_switch+0x179/frame 0xffffff881e15a460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e15a4b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e15a530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e15a570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e15a5a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e15a600 ether_output() at ether_output+0x5b6/frame 0xffffff881e15a670 ip_output() at ip_output+0xf37/frame 0xffffff881e15a750 udp_send() at udp_send+0x82b/frame 0xffffff881e15a800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e15a880 soo_write() at soo_write+0x49/frame 0xffffff881e15a8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e15a910 kern_writev() at kern_writev+0x48/frame 0xffffff881e15a950 sys_write() at sys_write+0x63/frame 0xffffff881e15a9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e15aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e15aab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1240 tid 100301 td 0xfffffe03411f9490 sched_switch() at sched_switch+0x482/frame 0xffffff881e155350 mi_switch() at mi_switch+0x179/frame 0xffffff881e155390 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e1553e0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e155460 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e1554a0 uma_dbg_getslab() at uma_dbg_getslab+0x67/frame 0xffffff881e1554d0 uma_dbg_free() at uma_dbg_free+0x33/frame 0xffffff881e1554f0 uma_zfree_arg() at uma_zfree_arg+0x42/frame 0xffffff881e155550 m_freem() at m_freem+0x18/frame 0xffffff881e155570 drbr_enqueue() at drbr_enqueue+0x44/frame 0xffffff881e1555a0 igb_mq_start() at igb_mq_start+0xdb/frame 0xffffff881e155600 ether_output() at ether_output+0x5b6/frame 0xffffff881e155670 ip_output() at ip_output+0xe0d/frame 0xffffff881e155750 udp_send() at udp_send+0x82b/frame 0xffffff881e155800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e155880 soo_write() at soo_write+0x49/frame 0xffffff881e1558c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e155910 kern_writev() at kern_writev+0x48/frame 0xffffff881e155950 sys_write() at sys_write+0x63/frame 0xffffff881e1559a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e155ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e155ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1239 tid 100300 td 0xfffffe03411f9920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002adce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002add00 trap() at trap+0x42/frame 0xffffff80002adf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002adf20 --- trap 0x13, rip = 0xffffffff808d1199, rsp = 0xffffff80002adfe0, rbp = 0xffffff881e150640 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x2a9/frame 0xffffff881e150640 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e150680 uma_dbg_getslab() at uma_dbg_getslab+0x67/frame 0xffffff881e1506b0 uma_dbg_alloc() at uma_dbg_alloc+0x36/frame 0xffffff881e1506e0 uma_zalloc_arg() at uma_zalloc_arg+0x549/frame 0xffffff881e150750 m_getm2() at m_getm2+0x10f/frame 0xffffff881e1507b0 m_uiotombuf() at m_uiotombuf+0x60/frame 0xffffff881e150800 sosend_dgram() at sosend_dgram+0x23c/frame 0xffffff881e150880 soo_write() at soo_write+0x49/frame 0xffffff881e1508c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e150910 kern_writev() at kern_writev+0x48/frame 0xffffff881e150950 sys_write() at sys_write+0x63/frame 0xffffff881e1509a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e150ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e150ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1238 tid 100299 td 0xfffffe034125e000 sched_switch() at sched_switch+0x482/frame 0xffffff881e14b420 mi_switch() at mi_switch+0x179/frame 0xffffff881e14b460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e14b4b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e14b530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e14b570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e14b5a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e14b600 ether_output() at ether_output+0x5b6/frame 0xffffff881e14b670 ip_output() at ip_output+0xe0d/frame 0xffffff881e14b750 udp_send() at udp_send+0x82b/frame 0xffffff881e14b800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e14b880 soo_write() at soo_write+0x49/frame 0xffffff881e14b8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e14b910 kern_writev() at kern_writev+0x48/frame 0xffffff881e14b950 sys_write() at sys_write+0x63/frame 0xffffff881e14b9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e14bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e14bab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1237 tid 100298 td 0xfffffe034125e490 sched_switch() at sched_switch+0x482/frame 0xffffff881e146360 mi_switch() at mi_switch+0x179/frame 0xffffff881e1463a0 critical_exit() at critical_exit+0x8b/frame 0xffffff881e1463c0 intr_event_handle() at intr_event_handle+0x13d/frame 0xffffff881e146410 intr_execute_handlers() at intr_execute_handlers+0x48/frame 0xffffff881e146440 lapic_handle_intr() at lapic_handle_intr+0x73/frame 0xffffff881e146470 Xapic_isr1() at Xapic_isr1+0xa4/frame 0xffffff881e146470 --- interrupt, rip = 0xffffffff8050488e, rsp = 0xffffff881e146530, rbp = 0xffffff881e146570 --- buf_ring_enqueue() at buf_ring_enqueue+0x3e/frame 0xffffff881e146570 drbr_enqueue() at drbr_enqueue+0x2b/frame 0xffffff881e1465a0 igb_mq_start() at igb_mq_start+0xdb/frame 0xffffff881e146600 ether_output() at ether_output+0x5b6/frame 0xffffff881e146670 ip_output() at ip_output+0xe0d/frame 0xffffff881e146750 udp_send() at udp_send+0x82b/frame 0xffffff881e146800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e146880 soo_write() at soo_write+0x49/frame 0xffffff881e1468c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e146910 kern_writev() at kern_writev+0x48/frame 0xffffff881e146950 sys_write() at sys_write+0x63/frame 0xffffff881e1469a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e146ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e146ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1236 tid 100297 td 0xfffffe034125e920 sched_switch() at sched_switch+0x482/frame 0xffffff881e141420 mi_switch() at mi_switch+0x179/frame 0xffffff881e141460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e1414b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e141530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e141570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e1415a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e141600 ether_output() at ether_output+0x5b6/frame 0xffffff881e141670 ip_output() at ip_output+0xe0d/frame 0xffffff881e141750 udp_send() at udp_send+0x82b/frame 0xffffff881e141800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e141880 soo_write() at soo_write+0x49/frame 0xffffff881e1418c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e141910 kern_writev() at kern_writev+0x48/frame 0xffffff881e141950 sys_write() at sys_write+0x63/frame 0xffffff881e1419a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e141ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e141ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1235 tid 100296 td 0xfffffe034118c920 sched_switch() at sched_switch+0x482/frame 0xffffff881e13c360 mi_switch() at mi_switch+0x179/frame 0xffffff881e13c3a0 critical_exit() at critical_exit+0x8b/frame 0xffffff881e13c3c0 intr_event_handle() at intr_event_handle+0x13d/frame 0xffffff881e13c410 intr_execute_handlers() at intr_execute_handlers+0x48/frame 0xffffff881e13c440 lapic_handle_intr() at lapic_handle_intr+0x73/frame 0xffffff881e13c470 Xapic_isr1() at Xapic_isr1+0xa4/frame 0xffffff881e13c470 --- interrupt, rip = 0xffffffff805048bf, rsp = 0xffffff881e13c530, rbp = 0xffffff881e13c570 --- buf_ring_enqueue() at buf_ring_enqueue+0x6f/frame 0xffffff881e13c570 drbr_enqueue() at drbr_enqueue+0x2b/frame 0xffffff881e13c5a0 igb_mq_start() at igb_mq_start+0xdb/frame 0xffffff881e13c600 ether_output() at ether_output+0x5b6/frame 0xffffff881e13c670 ip_output() at ip_output+0xe0d/frame 0xffffff881e13c750 udp_send() at udp_send+0x82b/frame 0xffffff881e13c800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e13c880 soo_write() at soo_write+0x49/frame 0xffffff881e13c8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e13c910 kern_writev() at kern_writev+0x48/frame 0xffffff881e13c950 sys_write() at sys_write+0x63/frame 0xffffff881e13c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e13cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e13cab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1234 tid 100295 td 0xfffffe03411f8000 sched_switch() at sched_switch+0x482/frame 0xffffff881e137420 mi_switch() at mi_switch+0x179/frame 0xffffff881e137460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e1374b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e137530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e137570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e1375a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e137600 ether_output() at ether_output+0x5b6/frame 0xffffff881e137670 ip_output() at ip_output+0xe0d/frame 0xffffff881e137750 udp_send() at udp_send+0x82b/frame 0xffffff881e137800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e137880 soo_write() at soo_write+0x49/frame 0xffffff881e1378c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e137910 kern_writev() at kern_writev+0x48/frame 0xffffff881e137950 sys_write() at sys_write+0x63/frame 0xffffff881e1379a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e137ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e137ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1233 tid 100294 td 0xfffffe03411f8490 sched_switch() at sched_switch+0x482/frame 0xffffff881e132420 mi_switch() at mi_switch+0x179/frame 0xffffff881e132460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e1324b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e132530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e132570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e1325a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e132600 ether_output() at ether_output+0x5b6/frame 0xffffff881e132670 ip_output() at ip_output+0xe0d/frame 0xffffff881e132750 udp_send() at udp_send+0x82b/frame 0xffffff881e132800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e132880 soo_write() at soo_write+0x49/frame 0xffffff881e1328c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e132910 kern_writev() at kern_writev+0x48/frame 0xffffff881e132950 sys_write() at sys_write+0x63/frame 0xffffff881e1329a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e132ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e132ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1232 tid 100293 td 0xfffffe03411f8920 sched_switch() at sched_switch+0x482/frame 0xffffff881e12d420 mi_switch() at mi_switch+0x179/frame 0xffffff881e12d460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e12d4b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e12d530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e12d570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e12d5a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e12d600 ether_output() at ether_output+0x5b6/frame 0xffffff881e12d670 ip_output() at ip_output+0xe0d/frame 0xffffff881e12d750 udp_send() at udp_send+0x82b/frame 0xffffff881e12d800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e12d880 soo_write() at soo_write+0x49/frame 0xffffff881e12d8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e12d910 kern_writev() at kern_writev+0x48/frame 0xffffff881e12d950 sys_write() at sys_write+0x63/frame 0xffffff881e12d9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e12dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e12dab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1231 tid 100292 td 0xfffffe03411f9000 sched_switch() at sched_switch+0x482/frame 0xffffff881e1283b0 mi_switch() at mi_switch+0x179/frame 0xffffff881e1283f0 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e128440 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e1284c0 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e128500 uma_dbg_getslab() at uma_dbg_getslab+0x67/frame 0xffffff881e128530 uma_dbg_alloc() at uma_dbg_alloc+0x36/frame 0xffffff881e128560 uma_zalloc_arg() at uma_zalloc_arg+0x549/frame 0xffffff881e1285d0 ip_fragment() at ip_fragment+0x17d/frame 0xffffff881e128670 ip_output() at ip_output+0xecf/frame 0xffffff881e128750 udp_send() at udp_send+0x82b/frame 0xffffff881e128800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e128880 soo_write() at soo_write+0x49/frame 0xffffff881e1288c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e128910 kern_writev() at kern_writev+0x48/frame 0xffffff881e128950 sys_write() at sys_write+0x63/frame 0xffffff881e1289a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e128ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e128ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1230 tid 100291 td 0xfffffe034118b000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002c2ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002c2d00 trap() at trap+0x42/frame 0xffffff80002c2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002c2f20 --- trap 0x13, rip = 0xffffffff808d1199, rsp = 0xffffff80002c2fe0, rbp = 0xffffff881e123640 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x2a9/frame 0xffffff881e123640 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e123680 uma_dbg_getslab() at uma_dbg_getslab+0x67/frame 0xffffff881e1236b0 uma_dbg_alloc() at uma_dbg_alloc+0x36/frame 0xffffff881e1236e0 uma_zalloc_arg() at uma_zalloc_arg+0x549/frame 0xffffff881e123750 m_getm2() at m_getm2+0x10f/frame 0xffffff881e1237b0 m_uiotombuf() at m_uiotombuf+0x60/frame 0xffffff881e123800 sosend_dgram() at sosend_dgram+0x23c/frame 0xffffff881e123880 soo_write() at soo_write+0x49/frame 0xffffff881e1238c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e123910 kern_writev() at kern_writev+0x48/frame 0xffffff881e123950 sys_write() at sys_write+0x63/frame 0xffffff881e1239a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e123ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e123ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1229 tid 100290 td 0xfffffe034118b490 sched_switch() at sched_switch+0x482/frame 0xffffff881e11e420 mi_switch() at mi_switch+0x179/frame 0xffffff881e11e460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e11e4b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e11e530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e11e570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e11e5a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e11e600 ether_output() at ether_output+0x5b6/frame 0xffffff881e11e670 ip_output() at ip_output+0xe0d/frame 0xffffff881e11e750 udp_send() at udp_send+0x82b/frame 0xffffff881e11e800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e11e880 soo_write() at soo_write+0x49/frame 0xffffff881e11e8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e11e910 kern_writev() at kern_writev+0x48/frame 0xffffff881e11e950 sys_write() at sys_write+0x63/frame 0xffffff881e11e9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e11eab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e11eab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1228 tid 100289 td 0xfffffe034118b920 sched_switch() at sched_switch+0x482/frame 0xffffff881e119380 mi_switch() at mi_switch+0x179/frame 0xffffff881e1193c0 critical_exit() at critical_exit+0x8b/frame 0xffffff881e1193e0 ipi_bitmap_handler() at ipi_bitmap_handler+0x7a/frame 0xffffff881e119420 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x9b/frame 0xffffff881e119420 --- interrupt, rip = 0xffffffff808d1127, rsp = 0xffffff881e1194e0, rbp = 0xffffff881e119560 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x237/frame 0xffffff881e119560 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e1195a0 uma_dbg_getslab() at uma_dbg_getslab+0x67/frame 0xffffff881e1195d0 uma_dbg_free() at uma_dbg_free+0x33/frame 0xffffff881e1195f0 uma_zfree_arg() at uma_zfree_arg+0x42/frame 0xffffff881e119650 m_freem() at m_freem+0x45/frame 0xffffff881e119670 ip_output() at ip_output+0xf45/frame 0xffffff881e119750 udp_send() at udp_send+0x82b/frame 0xffffff881e119800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e119880 soo_write() at soo_write+0x49/frame 0xffffff881e1198c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e119910 kern_writev() at kern_writev+0x48/frame 0xffffff881e119950 sys_write() at sys_write+0x63/frame 0xffffff881e1199a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e119ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e119ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1227 tid 100288 td 0xfffffe034118c000 sched_switch() at sched_switch+0x482/frame 0xffffff881e114420 mi_switch() at mi_switch+0x179/frame 0xffffff881e114460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e1144b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e114530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e114570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e1145a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e114600 ether_output() at ether_output+0x5b6/frame 0xffffff881e114670 ip_output() at ip_output+0xe0d/frame 0xffffff881e114750 udp_send() at udp_send+0x82b/frame 0xffffff881e114800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e114880 soo_write() at soo_write+0x49/frame 0xffffff881e1148c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e114910 kern_writev() at kern_writev+0x48/frame 0xffffff881e114950 sys_write() at sys_write+0x63/frame 0xffffff881e1149a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e114ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e114ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1226 tid 100287 td 0xfffffe034118c490 sched_switch() at sched_switch+0x482/frame 0xffffff881e10f420 mi_switch() at mi_switch+0x179/frame 0xffffff881e10f460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e10f4b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e10f530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e10f570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e10f5a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e10f600 ether_output() at ether_output+0x5b6/frame 0xffffff881e10f670 ip_output() at ip_output+0xe0d/frame 0xffffff881e10f750 udp_send() at udp_send+0x82b/frame 0xffffff881e10f800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e10f880 soo_write() at soo_write+0x49/frame 0xffffff881e10f8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e10f910 kern_writev() at kern_writev+0x48/frame 0xffffff881e10f950 sys_write() at sys_write+0x63/frame 0xffffff881e10f9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e10fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e10fab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1225 tid 100203 td 0xfffffe0099a3c920 sched_switch() at sched_switch+0x482/frame 0xffffff881df6b380 mi_switch() at mi_switch+0x179/frame 0xffffff881df6b3c0 critical_exit() at critical_exit+0x8b/frame 0xffffff881df6b3e0 ipi_bitmap_handler() at ipi_bitmap_handler+0x7a/frame 0xffffff881df6b420 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x9b/frame 0xffffff881df6b420 --- interrupt, rip = 0xffffffff808d1199, rsp = 0xffffff881df6b4e0, rbp = 0xffffff881df6b560 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x2a9/frame 0xffffff881df6b560 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881df6b5a0 uma_dbg_getslab() at uma_dbg_getslab+0x67/frame 0xffffff881df6b5d0 uma_dbg_free() at uma_dbg_free+0x33/frame 0xffffff881df6b5f0 uma_zfree_arg() at uma_zfree_arg+0x42/frame 0xffffff881df6b650 m_freem() at m_freem+0x18/frame 0xffffff881df6b670 ip_output() at ip_output+0xf45/frame 0xffffff881df6b750 udp_send() at udp_send+0x82b/frame 0xffffff881df6b800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881df6b880 soo_write() at soo_write+0x49/frame 0xffffff881df6b8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881df6b910 kern_writev() at kern_writev+0x48/frame 0xffffff881df6b950 sys_write() at sys_write+0x63/frame 0xffffff881df6b9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881df6bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881df6bab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1224 tid 100186 td 0xfffffe00681a2000 sched_switch() at sched_switch+0x482/frame 0xffffff881df09350 mi_switch() at mi_switch+0x179/frame 0xffffff881df09390 critical_exit() at critical_exit+0x8b/frame 0xffffff881df093b0 ipi_bitmap_handler() at ipi_bitmap_handler+0x7a/frame 0xffffff881df093f0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x9b/frame 0xffffff881df093f0 --- interrupt, rip = 0xffffffff808d1195, rsp = 0xffffff881df094b0, rbp = 0xffffff881df09530 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x2a5/frame 0xffffff881df09530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881df09570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881df095a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881df09600 ether_output() at ether_output+0x5b6/frame 0xffffff881df09670 ip_output() at ip_output+0xe0d/frame 0xffffff881df09750 udp_send() at udp_send+0x82b/frame 0xffffff881df09800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881df09880 soo_write() at soo_write+0x49/frame 0xffffff881df098c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881df09910 kern_writev() at kern_writev+0x48/frame 0xffffff881df09950 sys_write() at sys_write+0x63/frame 0xffffff881df099a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881df09ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881df09ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1223 tid 100270 td 0xfffffe019c18e490 sched_switch() at sched_switch+0x482/frame 0xffffff881e0ba420 mi_switch() at mi_switch+0x179/frame 0xffffff881e0ba460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e0ba4b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e0ba530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e0ba570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e0ba5a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e0ba600 ether_output() at ether_output+0x5b6/frame 0xffffff881e0ba670 ip_output() at ip_output+0xe0d/frame 0xffffff881e0ba750 udp_send() at udp_send+0x82b/frame 0xffffff881e0ba800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e0ba880 soo_write() at soo_write+0x49/frame 0xffffff881e0ba8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e0ba910 kern_writev() at kern_writev+0x48/frame 0xffffff881e0ba950 sys_write() at sys_write+0x63/frame 0xffffff881e0ba9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0baab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0baab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1222 tid 100269 td 0xfffffe019c18e920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002bbce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002bbd00 trap() at trap+0x42/frame 0xffffff80002bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002bbf20 --- trap 0x13, rip = 0xffffffff808d11bf, rsp = 0xffffff80002bbfe0, rbp = 0xffffff881e0b5480 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x2cf/frame 0xffffff881e0b5480 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e0b54c0 uma_dbg_getslab() at uma_dbg_getslab+0x67/frame 0xffffff881e0b54f0 uma_dbg_alloc() at uma_dbg_alloc+0x36/frame 0xffffff881e0b5520 zone_alloc_item() at zone_alloc_item+0xf4/frame 0xffffff881e0b5560 uma_zalloc_arg() at uma_zalloc_arg+0x5d7/frame 0xffffff881e0b55d0 ip_fragment() at ip_fragment+0x17d/frame 0xffffff881e0b5670 ip_output() at ip_output+0xecf/frame 0xffffff881e0b5750 udp_send() at udp_send+0x82b/frame 0xffffff881e0b5800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e0b5880 soo_write() at soo_write+0x49/frame 0xffffff881e0b58c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e0b5910 kern_writev() at kern_writev+0x48/frame 0xffffff881e0b5950 sys_write() at sys_write+0x63/frame 0xffffff881e0b59a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0b5ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0b5ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1221 tid 100268 td 0xfffffe019c1f8000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002c9ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002c9d00 trap() at trap+0x42/frame 0xffffff80002c9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002c9f20 --- trap 0x13, rip = 0xffffffff808d1195, rsp = 0xffffff80002c9fe0, rbp = 0xffffff881e0b0640 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x2a5/frame 0xffffff881e0b0640 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e0b0680 uma_dbg_getslab() at uma_dbg_getslab+0x67/frame 0xffffff881e0b06b0 uma_dbg_alloc() at uma_dbg_alloc+0x36/frame 0xffffff881e0b06e0 uma_zalloc_arg() at uma_zalloc_arg+0x549/frame 0xffffff881e0b0750 m_getm2() at m_getm2+0x10f/frame 0xffffff881e0b07b0 m_uiotombuf() at m_uiotombuf+0x60/frame 0xffffff881e0b0800 sosend_dgram() at sosend_dgram+0x23c/frame 0xffffff881e0b0880 soo_write() at soo_write+0x49/frame 0xffffff881e0b08c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e0b0910 kern_writev() at kern_writev+0x48/frame 0xffffff881e0b0950 sys_write() at sys_write+0x63/frame 0xffffff881e0b09a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0b0ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0b0ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1220 tid 100267 td 0xfffffe019c1f8490 sched_switch() at sched_switch+0x482/frame 0xffffff881e0ab420 mi_switch() at mi_switch+0x179/frame 0xffffff881e0ab460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e0ab4b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e0ab530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e0ab570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e0ab5a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e0ab600 ether_output() at ether_output+0x5b6/frame 0xffffff881e0ab670 ip_output() at ip_output+0xe0d/frame 0xffffff881e0ab750 udp_send() at udp_send+0x82b/frame 0xffffff881e0ab800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e0ab880 soo_write() at soo_write+0x49/frame 0xffffff881e0ab8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e0ab910 kern_writev() at kern_writev+0x48/frame 0xffffff881e0ab950 sys_write() at sys_write+0x63/frame 0xffffff881e0ab9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0abab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0abab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1219 tid 100266 td 0xfffffe019c1f8920 sched_switch() at sched_switch+0x482/frame 0xffffff881e0a6420 mi_switch() at mi_switch+0x179/frame 0xffffff881e0a6460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e0a64b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e0a6530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e0a6570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e0a65a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e0a6600 ether_output() at ether_output+0x5b6/frame 0xffffff881e0a6670 ip_output() at ip_output+0xe0d/frame 0xffffff881e0a6750 udp_send() at udp_send+0x82b/frame 0xffffff881e0a6800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e0a6880 soo_write() at soo_write+0x49/frame 0xffffff881e0a68c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e0a6910 kern_writev() at kern_writev+0x48/frame 0xffffff881e0a6950 sys_write() at sys_write+0x63/frame 0xffffff881e0a69a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0a6ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0a6ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1218 tid 100265 td 0xfffffe019c120920 sched_switch() at sched_switch+0x482/frame 0xffffff881e0a1420 mi_switch() at mi_switch+0x179/frame 0xffffff881e0a1460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e0a14b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e0a1530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e0a1570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e0a15a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e0a1600 ether_output() at ether_output+0x5b6/frame 0xffffff881e0a1670 ip_output() at ip_output+0xf37/frame 0xffffff881e0a1750 udp_send() at udp_send+0x82b/frame 0xffffff881e0a1800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e0a1880 soo_write() at soo_write+0x49/frame 0xffffff881e0a18c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e0a1910 kern_writev() at kern_writev+0x48/frame 0xffffff881e0a1950 sys_write() at sys_write+0x63/frame 0xffffff881e0a19a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0a1ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0a1ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1217 tid 100264 td 0xfffffe019c18d000 sched_switch() at sched_switch+0x482/frame 0xffffff881e09c420 mi_switch() at mi_switch+0x179/frame 0xffffff881e09c460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e09c4b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e09c530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e09c570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e09c5a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e09c600 ether_output() at ether_output+0x5b6/frame 0xffffff881e09c670 ip_output() at ip_output+0xf37/frame 0xffffff881e09c750 udp_send() at udp_send+0x82b/frame 0xffffff881e09c800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e09c880 soo_write() at soo_write+0x49/frame 0xffffff881e09c8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e09c910 kern_writev() at kern_writev+0x48/frame 0xffffff881e09c950 sys_write() at sys_write+0x63/frame 0xffffff881e09c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e09cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e09cab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1216 tid 100263 td 0xfffffe019c18d490 sched_switch() at sched_switch+0x482/frame 0xffffff881e097420 mi_switch() at mi_switch+0x179/frame 0xffffff881e097460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e0974b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e097530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e097570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e0975a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e097600 ether_output() at ether_output+0x5b6/frame 0xffffff881e097670 ip_output() at ip_output+0xe0d/frame 0xffffff881e097750 udp_send() at udp_send+0x82b/frame 0xffffff881e097800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e097880 soo_write() at soo_write+0x49/frame 0xffffff881e0978c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e097910 kern_writev() at kern_writev+0x48/frame 0xffffff881e097950 sys_write() at sys_write+0x63/frame 0xffffff881e0979a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e097ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e097ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1215 tid 100262 td 0xfffffe019c18d920 sched_switch() at sched_switch+0x482/frame 0xffffff881e092420 mi_switch() at mi_switch+0x179/frame 0xffffff881e092460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e0924b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e092530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e092570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e0925a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e092600 ether_output() at ether_output+0x5b6/frame 0xffffff881e092670 ip_output() at ip_output+0xe0d/frame 0xffffff881e092750 udp_send() at udp_send+0x82b/frame 0xffffff881e092800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e092880 soo_write() at soo_write+0x49/frame 0xffffff881e0928c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e092910 kern_writev() at kern_writev+0x48/frame 0xffffff881e092950 sys_write() at sys_write+0x63/frame 0xffffff881e0929a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e092ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e092ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1214 tid 100261 td 0xfffffe019c18e000 sched_switch() at sched_switch+0x482/frame 0xffffff881e08d420 mi_switch() at mi_switch+0x179/frame 0xffffff881e08d460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e08d4b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e08d530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e08d570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e08d5a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e08d600 ether_output() at ether_output+0x5b6/frame 0xffffff881e08d670 ip_output() at ip_output+0xf37/frame 0xffffff881e08d750 udp_send() at udp_send+0x82b/frame 0xffffff881e08d800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e08d880 soo_write() at soo_write+0x49/frame 0xffffff881e08d8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e08d910 kern_writev() at kern_writev+0x48/frame 0xffffff881e08d950 sys_write() at sys_write+0x63/frame 0xffffff881e08d9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e08dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e08dab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1213 tid 100260 td 0xfffffe019c11f000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff800028ace0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff800028ad00 trap() at trap+0x42/frame 0xffffff800028af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff800028af20 --- trap 0x13, rip = 0xffffffff808d11bf, rsp = 0xffffff800028afe0, rbp = 0xffffff881e088640 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x2cf/frame 0xffffff881e088640 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e088680 uma_dbg_getslab() at uma_dbg_getslab+0x67/frame 0xffffff881e0886b0 uma_dbg_alloc() at uma_dbg_alloc+0x36/frame 0xffffff881e0886e0 uma_zalloc_arg() at uma_zalloc_arg+0x549/frame 0xffffff881e088750 m_getm2() at m_getm2+0x10f/frame 0xffffff881e0887b0 m_uiotombuf() at m_uiotombuf+0x60/frame 0xffffff881e088800 sosend_dgram() at sosend_dgram+0x23c/frame 0xffffff881e088880 soo_write() at soo_write+0x49/frame 0xffffff881e0888c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e088910 kern_writev() at kern_writev+0x48/frame 0xffffff881e088950 sys_write() at sys_write+0x63/frame 0xffffff881e0889a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e088ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e088ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1212 tid 100259 td 0xfffffe019c11f490 sched_switch() at sched_switch+0x482/frame 0xffffff881e083420 mi_switch() at mi_switch+0x179/frame 0xffffff881e083460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e0834b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e083530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e083570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e0835a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e083600 ether_output() at ether_output+0x5b6/frame 0xffffff881e083670 ip_output() at ip_output+0xe0d/frame 0xffffff881e083750 udp_send() at udp_send+0x82b/frame 0xffffff881e083800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e083880 soo_write() at soo_write+0x49/frame 0xffffff881e0838c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e083910 kern_writev() at kern_writev+0x48/frame 0xffffff881e083950 sys_write() at sys_write+0x63/frame 0xffffff881e0839a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e083ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e083ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1211 tid 100258 td 0xfffffe019c11f920 sched_switch() at sched_switch+0x482/frame 0xffffff881e07e280 mi_switch() at mi_switch+0x179/frame 0xffffff881e07e2c0 critical_exit() at critical_exit+0x8b/frame 0xffffff881e07e2e0 ipi_bitmap_handler() at ipi_bitmap_handler+0x7a/frame 0xffffff881e07e320 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x9b/frame 0xffffff881e07e320 --- interrupt, rip = 0xffffffff808d1862, rsp = 0xffffff881e07e3e0, rbp = 0xffffff881e07e450 --- _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0x182/frame 0xffffff881e07e450 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xe1/frame 0xffffff881e07e490 turnstile_trywait() at turnstile_trywait+0x34/frame 0xffffff881e07e4b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x254/frame 0xffffff881e07e530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e07e570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e07e5a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e07e600 ether_output() at ether_output+0x5b6/frame 0xffffff881e07e670 ip_output() at ip_output+0xe0d/frame 0xffffff881e07e750 udp_send() at udp_send+0x82b/frame 0xffffff881e07e800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e07e880 soo_write() at soo_write+0x49/frame 0xffffff881e07e8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e07e910 kern_writev() at kern_writev+0x48/frame 0xffffff881e07e950 sys_write() at sys_write+0x63/frame 0xffffff881e07e9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e07eab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e07eab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1210 tid 100257 td 0xfffffe019c120000 sched_switch() at sched_switch+0x482/frame 0xffffff881e079420 mi_switch() at mi_switch+0x179/frame 0xffffff881e079460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e0794b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e079530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e079570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e0795a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e079600 ether_output() at ether_output+0x5b6/frame 0xffffff881e079670 ip_output() at ip_output+0xe0d/frame 0xffffff881e079750 udp_send() at udp_send+0x82b/frame 0xffffff881e079800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e079880 soo_write() at soo_write+0x49/frame 0xffffff881e0798c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e079910 kern_writev() at kern_writev+0x48/frame 0xffffff881e079950 sys_write() at sys_write+0x63/frame 0xffffff881e0799a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e079ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e079ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1209 tid 100256 td 0xfffffe019c120490 sched_switch() at sched_switch+0x482/frame 0xffffff881e0743f0 mi_switch() at mi_switch+0x179/frame 0xffffff881e074430 critical_exit() at critical_exit+0x8b/frame 0xffffff881e074450 intr_event_handle() at intr_event_handle+0x13d/frame 0xffffff881e0744a0 intr_execute_handlers() at intr_execute_handlers+0x48/frame 0xffffff881e0744d0 lapic_handle_intr() at lapic_handle_intr+0x73/frame 0xffffff881e074500 Xapic_isr1() at Xapic_isr1+0xa4/frame 0xffffff881e074500 --- interrupt, rip = 0xffffffff808d1199, rsp = 0xffffff881e0745c0, rbp = 0xffffff881e074640 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x2a9/frame 0xffffff881e074640 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e074680 uma_dbg_getslab() at uma_dbg_getslab+0x67/frame 0xffffff881e0746b0 uma_dbg_alloc() at uma_dbg_alloc+0x36/frame 0xffffff881e0746e0 uma_zalloc_arg() at uma_zalloc_arg+0x549/frame 0xffffff881e074750 m_getm2() at m_getm2+0x10f/frame 0xffffff881e0747b0 m_uiotombuf() at m_uiotombuf+0x60/frame 0xffffff881e074800 sosend_dgram() at sosend_dgram+0x23c/frame 0xffffff881e074880 soo_write() at soo_write+0x49/frame 0xffffff881e0748c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e074910 kern_writev() at kern_writev+0x48/frame 0xffffff881e074950 sys_write() at sys_write+0x63/frame 0xffffff881e0749a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e074ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e074ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1208 tid 100255 td 0xfffffe019c04e490 sched_switch() at sched_switch+0x482/frame 0xffffff881e06f4b0 mi_switch() at mi_switch+0x179/frame 0xffffff881e06f4f0 critical_exit() at critical_exit+0x8b/frame 0xffffff881e06f510 spinlock_exit() at spinlock_exit+0x14/frame 0xffffff881e06f530 __mtx_unlock_flags() at __mtx_unlock_flags+0xf0/frame 0xffffff881e06f570 taskqueue_enqueue() at taskqueue_enqueue+0x84/frame 0xffffff881e06f5a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e06f600 ether_output() at ether_output+0x5b6/frame 0xffffff881e06f670 ip_output() at ip_output+0xe0d/frame 0xffffff881e06f750 udp_send() at udp_send+0x82b/frame 0xffffff881e06f800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e06f880 soo_write() at soo_write+0x49/frame 0xffffff881e06f8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e06f910 kern_writev() at kern_writev+0x48/frame 0xffffff881e06f950 sys_write() at sys_write+0x63/frame 0xffffff881e06f9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e06fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e06fab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1207 tid 100254 td 0xfffffe019c04e920 sched_switch() at sched_switch+0x482/frame 0xffffff881e06a3b0 mi_switch() at mi_switch+0x179/frame 0xffffff881e06a3f0 critical_exit() at critical_exit+0x8b/frame 0xffffff881e06a410 ipi_bitmap_handler() at ipi_bitmap_handler+0x7a/frame 0xffffff881e06a450 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x9b/frame 0xffffff881e06a450 --- interrupt, rip = 0xffffffff80cc400d, rsp = 0xffffff881e06a510, rbp = 0xffffff881e06a530 --- spinlock_exit() at spinlock_exit+0x2d/frame 0xffffff881e06a530 __mtx_unlock_flags() at __mtx_unlock_flags+0xf0/frame 0xffffff881e06a570 taskqueue_enqueue() at taskqueue_enqueue+0x84/frame 0xffffff881e06a5a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e06a600 ether_output() at ether_output+0x5b6/frame 0xffffff881e06a670 ip_output() at ip_output+0xe0d/frame 0xffffff881e06a750 udp_send() at udp_send+0x82b/frame 0xffffff881e06a800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e06a880 soo_write() at soo_write+0x49/frame 0xffffff881e06a8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e06a910 kern_writev() at kern_writev+0x48/frame 0xffffff881e06a950 sys_write() at sys_write+0x63/frame 0xffffff881e06a9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e06aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e06aab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1206 tid 100253 td 0xfffffe019c0b7000 sched_switch() at sched_switch+0x482/frame 0xffffff881e065420 mi_switch() at mi_switch+0x179/frame 0xffffff881e065460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e0654b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e065530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e065570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e0655a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e065600 ether_output() at ether_output+0x5b6/frame 0xffffff881e065670 ip_output() at ip_output+0xe0d/frame 0xffffff881e065750 udp_send() at udp_send+0x82b/frame 0xffffff881e065800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e065880 soo_write() at soo_write+0x49/frame 0xffffff881e0658c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e065910 kern_writev() at kern_writev+0x48/frame 0xffffff881e065950 sys_write() at sys_write+0x63/frame 0xffffff881e0659a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e065ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e065ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1205 tid 100173 td 0xfffffe00682c0490 sched_switch() at sched_switch+0x482/frame 0xffffff881dec8360 mi_switch() at mi_switch+0x179/frame 0xffffff881dec83a0 critical_exit() at critical_exit+0x8b/frame 0xffffff881dec83c0 ipi_bitmap_handler() at ipi_bitmap_handler+0x7a/frame 0xffffff881dec8400 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x9b/frame 0xffffff881dec8400 --- interrupt, rip = 0xffffffff808d0e31, rsp = 0xffffff881dec84c0, rbp = 0xffffff881dec8500 --- __mtx_lock_flags() at __mtx_lock_flags+0xa1/frame 0xffffff881dec8500 uma_dbg_getslab() at uma_dbg_getslab+0x67/frame 0xffffff881dec8530 uma_dbg_alloc() at uma_dbg_alloc+0x36/frame 0xffffff881dec8560 uma_zalloc_arg() at uma_zalloc_arg+0x549/frame 0xffffff881dec85d0 ip_fragment() at ip_fragment+0x17d/frame 0xffffff881dec8670 ip_output() at ip_output+0xecf/frame 0xffffff881dec8750 udp_send() at udp_send+0x82b/frame 0xffffff881dec8800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881dec8880 soo_write() at soo_write+0x49/frame 0xffffff881dec88c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881dec8910 kern_writev() at kern_writev+0x48/frame 0xffffff881dec8950 sys_write() at sys_write+0x63/frame 0xffffff881dec89a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881dec8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881dec8ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1204 tid 100286 td 0xfffffe0057a8b490 sched_switch() at sched_switch+0x482/frame 0xffffff881e10a420 mi_switch() at mi_switch+0x179/frame 0xffffff881e10a460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e10a4b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e10a530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e10a570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e10a5a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e10a600 ether_output() at ether_output+0x5b6/frame 0xffffff881e10a670 ip_output() at ip_output+0xe0d/frame 0xffffff881e10a750 udp_send() at udp_send+0x82b/frame 0xffffff881e10a800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e10a880 soo_write() at soo_write+0x49/frame 0xffffff881e10a8c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e10a910 kern_writev() at kern_writev+0x48/frame 0xffffff881e10a950 sys_write() at sys_write+0x63/frame 0xffffff881e10a9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e10aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e10aab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1203 tid 100285 td 0xfffffe0057a8b920 sched_switch() at sched_switch+0x482/frame 0xffffff881e105280 mi_switch() at mi_switch+0x179/frame 0xffffff881e1052c0 critical_exit() at critical_exit+0x8b/frame 0xffffff881e1052e0 ipi_bitmap_handler() at ipi_bitmap_handler+0x7a/frame 0xffffff881e105320 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x9b/frame 0xffffff881e105320 --- interrupt, rip = 0xffffffff808d1866, rsp = 0xffffff881e1053e0, rbp = 0xffffff881e105450 --- _mtx_lock_spin_cookie() at _mtx_lock_spin_cookie+0x186/frame 0xffffff881e105450 __mtx_lock_spin_flags() at __mtx_lock_spin_flags+0xe1/frame 0xffffff881e105490 turnstile_trywait() at turnstile_trywait+0x34/frame 0xffffff881e1054b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x254/frame 0xffffff881e105530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e105570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881e1055a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881e105600 ether_output() at ether_output+0x5b6/frame 0xffffff881e105670 ip_output() at ip_output+0xe0d/frame 0xffffff881e105750 udp_send() at udp_send+0x82b/frame 0xffffff881e105800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881e105880 soo_write() at soo_write+0x49/frame 0xffffff881e1058c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881e105910 kern_writev() at kern_writev+0x48/frame 0xffffff881e105950 sys_write() at sys_write+0x63/frame 0xffffff881e1059a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e105ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e105ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1202 tid 100214 td 0xfffffe0068001000 sched_switch() at sched_switch+0x482/frame 0xffffff881dfa2420 mi_switch() at mi_switch+0x179/frame 0xffffff881dfa2460 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881dfa24b0 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881dfa2530 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881dfa2570 taskqueue_enqueue() at taskqueue_enqueue+0x48/frame 0xffffff881dfa25a0 igb_mq_start() at igb_mq_start+0xf9/frame 0xffffff881dfa2600 ether_output() at ether_output+0x5b6/frame 0xffffff881dfa2670 ip_output() at ip_output+0xe0d/frame 0xffffff881dfa2750 udp_send() at udp_send+0x82b/frame 0xffffff881dfa2800 sosend_dgram() at sosend_dgram+0x36b/frame 0xffffff881dfa2880 soo_write() at soo_write+0x49/frame 0xffffff881dfa28c0 dofilewrite() at dofilewrite+0x85/frame 0xffffff881dfa2910 kern_writev() at kern_writev+0x48/frame 0xffffff881dfa2950 sys_write() at sys_write+0x63/frame 0xffffff881dfa29a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881dfa2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881dfa2ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b562ba, rsp = 0x7fffffffd8f8, rbp = 0x7fffffffd940 --- Tracing command udp pid 1201 tid 100250 td 0xfffffe0099fe8920 sched_switch() at sched_switch+0x482/frame 0xffffff881e056560 mi_switch() at mi_switch+0x179/frame 0xffffff881e0565a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0565e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e056650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e056680 _sleep() at _sleep+0x320/frame 0xffffff881e056710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff881e0567b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff881e0569a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e056ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e056ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800ab01fa, rsp = 0x7fffffffd948, rbp = 0x7fffffffd9f0 --- Tracing command udp pid 1200 tid 100228 td 0xfffffe0099888000 sched_switch() at sched_switch+0x482/frame 0xffffff881dfe8750 mi_switch() at mi_switch+0x179/frame 0xffffff881dfe8790 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dfe87d0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881dfe8840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881dfe8870 _sleep() at _sleep+0x300/frame 0xffffff881dfe8900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xffffff881dfe8960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xffffff881dfe89a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881dfe8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881dfe8ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b363ba, rsp = 0x7fffffffd8e8, rbp = 0x7fffffffd940 --- Tracing command swap pid 1199 tid 100249 td 0xfffffe019c04d000 sched_switch() at sched_switch+0x482/frame 0xffffff881e0513f0 mi_switch() at mi_switch+0x179/frame 0xffffff881e051430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e051470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881e0514a0 _sleep() at _sleep+0x33d/frame 0xffffff881e051530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881e051550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881e0517a0 vm_fault() at vm_fault+0x77/frame 0xffffff881e0517e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881e051890 trap() at trap+0x52b/frame 0xffffff881e051ab0 calltrap() at calltrap+0x8/frame 0xffffff881e051ab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1198 tid 100248 td 0xfffffe019c04d490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002a6ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002a6d00 trap() at trap+0x42/frame 0xffffff80002a6f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002a6f20 --- trap 0x13, rip = 0x401b7e, rsp = 0x7fffffffd8b0, rbp = 0x7fffffffd8d0 --- Tracing command swap pid 1197 tid 100247 td 0xfffffe019c04d920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002dece0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002ded00 trap() at trap+0x42/frame 0xffffff80002def20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002def20 --- trap 0x13, rip = 0x401b7e, rsp = 0x7fffffffd8b0, rbp = 0x7fffffffd8d0 --- Tracing command swap pid 1196 tid 100246 td 0xfffffe019c04e000 sched_switch() at sched_switch+0x482/frame 0xffffff881e0423d0 mi_switch() at mi_switch+0x179/frame 0xffffff881e042410 turnstile_wait() at turnstile_wait+0x3af/frame 0xffffff881e042460 __mtx_lock_sleep() at __mtx_lock_sleep+0x1f9/frame 0xffffff881e0424e0 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881e042520 vm_page_dequeue() at vm_page_dequeue+0x68/frame 0xffffff881e042550 vm_fault_hold() at vm_fault_hold+0x2d2/frame 0xffffff881e0427a0 vm_fault() at vm_fault+0x77/frame 0xffffff881e0427e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881e042890 trap() at trap+0x52b/frame 0xffffff881e042ab0 calltrap() at calltrap+0x8/frame 0xffffff881e042ab0 --- trap 0xc, rip = 0x401b79, rsp = 0x7fffffffd8b0, rbp = 0x7fffffffd8d0 --- Tracing command swap pid 1195 tid 100245 td 0xfffffe0099fe7000 sched_switch() at sched_switch+0x482/frame 0xffffff881e03d3f0 mi_switch() at mi_switch+0x179/frame 0xffffff881e03d430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e03d470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881e03d4a0 _sleep() at _sleep+0x33d/frame 0xffffff881e03d530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881e03d550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881e03d7a0 vm_fault() at vm_fault+0x77/frame 0xffffff881e03d7e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881e03d890 trap() at trap+0x52b/frame 0xffffff881e03dab0 calltrap() at calltrap+0x8/frame 0xffffff881e03dab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1194 tid 100244 td 0xfffffe0099fe7490 sched_switch() at sched_switch+0x482/frame 0xffffff881e0383f0 mi_switch() at mi_switch+0x179/frame 0xffffff881e038430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e038470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881e0384a0 _sleep() at _sleep+0x33d/frame 0xffffff881e038530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881e038550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881e0387a0 vm_fault() at vm_fault+0x77/frame 0xffffff881e0387e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881e038890 trap() at trap+0x52b/frame 0xffffff881e038ab0 calltrap() at calltrap+0x8/frame 0xffffff881e038ab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1193 tid 100243 td 0xfffffe0099fe7920 sched_switch() at sched_switch+0x482/frame 0xffffff881e0333f0 mi_switch() at mi_switch+0x179/frame 0xffffff881e033430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e033470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881e0334a0 _sleep() at _sleep+0x33d/frame 0xffffff881e033530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881e033550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881e0337a0 vm_fault() at vm_fault+0x77/frame 0xffffff881e0337e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881e033890 trap() at trap+0x52b/frame 0xffffff881e033ab0 calltrap() at calltrap+0x8/frame 0xffffff881e033ab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1192 tid 100242 td 0xfffffe0099fe8000 sched_switch() at sched_switch+0x482/frame 0xffffff881e02e3f0 mi_switch() at mi_switch+0x179/frame 0xffffff881e02e430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e02e470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881e02e4a0 _sleep() at _sleep+0x33d/frame 0xffffff881e02e530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881e02e550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881e02e7a0 vm_fault() at vm_fault+0x77/frame 0xffffff881e02e7e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881e02e890 trap() at trap+0x52b/frame 0xffffff881e02eab0 calltrap() at calltrap+0x8/frame 0xffffff881e02eab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1191 tid 100241 td 0xfffffe0099fe8490 sched_switch() at sched_switch+0x482/frame 0xffffff881e0293f0 mi_switch() at mi_switch+0x179/frame 0xffffff881e029430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e029470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881e0294a0 _sleep() at _sleep+0x33d/frame 0xffffff881e029530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881e029550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881e0297a0 vm_fault() at vm_fault+0x77/frame 0xffffff881e0297e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881e029890 trap() at trap+0x52b/frame 0xffffff881e029ab0 calltrap() at calltrap+0x8/frame 0xffffff881e029ab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1190 tid 100240 td 0xfffffe0099f17490 sched_switch() at sched_switch+0x482/frame 0xffffff881e024a10 mi_switch() at mi_switch+0x179/frame 0xffffff881e024a50 critical_exit() at critical_exit+0x8b/frame 0xffffff881e024a70 ipi_bitmap_handler() at ipi_bitmap_handler+0x7a/frame 0xffffff881e024ab0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x9b/frame 0xffffff881e024ab0 --- interrupt, rip = 0x401b7e, rsp = 0x7fffffffd8b0, rbp = 0x7fffffffd8d0 --- Tracing command swap pid 1189 tid 100239 td 0xfffffe0099f17920 sched_switch() at sched_switch+0x482/frame 0xffffff881e01f3f0 mi_switch() at mi_switch+0x179/frame 0xffffff881e01f430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e01f470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881e01f4a0 _sleep() at _sleep+0x33d/frame 0xffffff881e01f530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881e01f550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881e01f7a0 vm_fault() at vm_fault+0x77/frame 0xffffff881e01f7e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881e01f890 trap() at trap+0x52b/frame 0xffffff881e01fab0 calltrap() at calltrap+0x8/frame 0xffffff881e01fab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1188 tid 100238 td 0xfffffe0099f82000 sched_switch() at sched_switch+0x482/frame 0xffffff881e01a3f0 mi_switch() at mi_switch+0x179/frame 0xffffff881e01a430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e01a470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881e01a4a0 _sleep() at _sleep+0x33d/frame 0xffffff881e01a530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881e01a550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881e01a7a0 vm_fault() at vm_fault+0x77/frame 0xffffff881e01a7e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881e01a890 trap() at trap+0x52b/frame 0xffffff881e01aab0 calltrap() at calltrap+0x8/frame 0xffffff881e01aab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1187 tid 100237 td 0xfffffe0099f82490 sched_switch() at sched_switch+0x482/frame 0xffffff881e015a10 mi_switch() at mi_switch+0x179/frame 0xffffff881e015a50 critical_exit() at critical_exit+0x8b/frame 0xffffff881e015a70 ipi_bitmap_handler() at ipi_bitmap_handler+0x7a/frame 0xffffff881e015ab0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x9b/frame 0xffffff881e015ab0 --- interrupt, rip = 0x401b7e, rsp = 0x7fffffffd8b0, rbp = 0x7fffffffd8d0 --- Tracing command swap pid 1186 tid 100236 td 0xfffffe0099f82920 sched_switch() at sched_switch+0x482/frame 0xffffff881e0103f0 mi_switch() at mi_switch+0x179/frame 0xffffff881e010430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e010470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881e0104a0 _sleep() at _sleep+0x33d/frame 0xffffff881e010530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881e010550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881e0107a0 vm_fault() at vm_fault+0x77/frame 0xffffff881e0107e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881e010890 trap() at trap+0x52b/frame 0xffffff881e010ab0 calltrap() at calltrap+0x8/frame 0xffffff881e010ab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1185 tid 100235 td 0xfffffe0099e5c920 sched_switch() at sched_switch+0x482/frame 0xffffff881e00b3f0 mi_switch() at mi_switch+0x179/frame 0xffffff881e00b430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e00b470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881e00b4a0 _sleep() at _sleep+0x33d/frame 0xffffff881e00b530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881e00b550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881e00b7a0 vm_fault() at vm_fault+0x77/frame 0xffffff881e00b7e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881e00b890 trap() at trap+0x52b/frame 0xffffff881e00bab0 calltrap() at calltrap+0x8/frame 0xffffff881e00bab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1184 tid 100234 td 0xfffffe0099f0b000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002b4ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002b4d00 trap() at trap+0x42/frame 0xffffff80002b4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002b4f20 --- trap 0x13, rip = 0x401b7e, rsp = 0x7fffffffd8b0, rbp = 0x7fffffffd8d0 --- Tracing command swap pid 1183 tid 100233 td 0xfffffe0099f0b490 sched_switch() at sched_switch+0x482/frame 0xffffff881e0013f0 mi_switch() at mi_switch+0x179/frame 0xffffff881e001430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e001470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881e0014a0 _sleep() at _sleep+0x33d/frame 0xffffff881e001530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881e001550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881e0017a0 vm_fault() at vm_fault+0x77/frame 0xffffff881e0017e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881e001890 trap() at trap+0x52b/frame 0xffffff881e001ab0 calltrap() at calltrap+0x8/frame 0xffffff881e001ab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1182 tid 100232 td 0xfffffe0099f0b920 sched_switch() at sched_switch+0x482/frame 0xffffff881dffc3f0 mi_switch() at mi_switch+0x179/frame 0xffffff881dffc430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dffc470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881dffc4a0 _sleep() at _sleep+0x33d/frame 0xffffff881dffc530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881dffc550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881dffc7a0 vm_fault() at vm_fault+0x77/frame 0xffffff881dffc7e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881dffc890 trap() at trap+0x52b/frame 0xffffff881dffcab0 calltrap() at calltrap+0x8/frame 0xffffff881dffcab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1181 tid 100231 td 0xfffffe0099f17000 sched_switch() at sched_switch+0x482/frame 0xffffff881dff73f0 mi_switch() at mi_switch+0x179/frame 0xffffff881dff7430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dff7470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881dff74a0 _sleep() at _sleep+0x33d/frame 0xffffff881dff7530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881dff7550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881dff77a0 vm_fault() at vm_fault+0x77/frame 0xffffff881dff77e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881dff7890 trap() at trap+0x52b/frame 0xffffff881dff7ab0 calltrap() at calltrap+0x8/frame 0xffffff881dff7ab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1180 tid 100190 td 0xfffffe006818d000 sched_switch() at sched_switch+0x482/frame 0xffffff881df2a3f0 mi_switch() at mi_switch+0x179/frame 0xffffff881df2a430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881df2a470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881df2a4a0 _sleep() at _sleep+0x33d/frame 0xffffff881df2a530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881df2a550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881df2a7a0 vm_fault() at vm_fault+0x77/frame 0xffffff881df2a7e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881df2a890 trap() at trap+0x52b/frame 0xffffff881df2aab0 calltrap() at calltrap+0x8/frame 0xffffff881df2aab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1179 tid 100136 td 0xfffffe005783e000 sched_switch() at sched_switch+0x482/frame 0xffffff881de0f3f0 mi_switch() at mi_switch+0x179/frame 0xffffff881de0f430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881de0f470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881de0f4a0 _sleep() at _sleep+0x33d/frame 0xffffff881de0f530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881de0f550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881de0f7a0 vm_fault() at vm_fault+0x77/frame 0xffffff881de0f7e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881de0f890 trap() at trap+0x52b/frame 0xffffff881de0fab0 calltrap() at calltrap+0x8/frame 0xffffff881de0fab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1178 tid 100152 td 0xfffffe0057f73920 sched_switch() at sched_switch+0x482/frame 0xffffff881de5fa10 mi_switch() at mi_switch+0x179/frame 0xffffff881de5fa50 critical_exit() at critical_exit+0x8b/frame 0xffffff881de5fa70 ipi_bitmap_handler() at ipi_bitmap_handler+0x7a/frame 0xffffff881de5fab0 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x9b/frame 0xffffff881de5fab0 --- interrupt, rip = 0x401b7e, rsp = 0x7fffffffd8b0, rbp = 0x7fffffffd8d0 --- Tracing command swap pid 1177 tid 100167 td 0xfffffe0057c13490 sched_switch() at sched_switch+0x482/frame 0xffffff881deaa3f0 mi_switch() at mi_switch+0x179/frame 0xffffff881deaa430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881deaa470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881deaa4a0 _sleep() at _sleep+0x33d/frame 0xffffff881deaa530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881deaa550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881deaa7a0 vm_fault() at vm_fault+0x77/frame 0xffffff881deaa7e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881deaa890 trap() at trap+0x52b/frame 0xffffff881deaaab0 calltrap() at calltrap+0x8/frame 0xffffff881deaaab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1176 tid 100188 td 0xfffffe005783e490 sched_switch() at sched_switch+0x482/frame 0xffffff881df203f0 mi_switch() at mi_switch+0x179/frame 0xffffff881df20430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881df20470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881df204a0 _sleep() at _sleep+0x33d/frame 0xffffff881df20530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881df20550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881df207a0 vm_fault() at vm_fault+0x77/frame 0xffffff881df207e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881df20890 trap() at trap+0x52b/frame 0xffffff881df20ab0 calltrap() at calltrap+0x8/frame 0xffffff881df20ab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1175 tid 100185 td 0xfffffe006818d490 sched_switch() at sched_switch+0x482/frame 0xffffff881df043f0 mi_switch() at mi_switch+0x179/frame 0xffffff881df04430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881df04470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881df044a0 _sleep() at _sleep+0x33d/frame 0xffffff881df04530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881df04550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881df047a0 vm_fault() at vm_fault+0x77/frame 0xffffff881df047e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881df04890 trap() at trap+0x52b/frame 0xffffff881df04ab0 calltrap() at calltrap+0x8/frame 0xffffff881df04ab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1174 tid 100284 td 0xfffffe01af22b490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002ecce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002ecd00 trap() at trap+0x42/frame 0xffffff80002ecf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002ecf20 --- trap 0x13, rip = 0x401b7e, rsp = 0x7fffffffd8b0, rbp = 0x7fffffffd8d0 --- Tracing command swap pid 1173 tid 100283 td 0xfffffe01af22b920 sched_switch() at sched_switch+0x482/frame 0xffffff881e0fb3f0 mi_switch() at mi_switch+0x179/frame 0xffffff881e0fb430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0fb470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881e0fb4a0 _sleep() at _sleep+0x33d/frame 0xffffff881e0fb530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881e0fb550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881e0fb7a0 vm_fault() at vm_fault+0x77/frame 0xffffff881e0fb7e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881e0fb890 trap() at trap+0x52b/frame 0xffffff881e0fbab0 calltrap() at calltrap+0x8/frame 0xffffff881e0fbab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1172 tid 100282 td 0xfffffe0057015490 sched_switch() at sched_switch+0x482/frame 0xffffff881e0f63f0 mi_switch() at mi_switch+0x179/frame 0xffffff881e0f6430 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0f6470 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881e0f64a0 _sleep() at _sleep+0x33d/frame 0xffffff881e0f6530 vm_waitpfault() at vm_waitpfault+0x72/frame 0xffffff881e0f6550 vm_fault_hold() at vm_fault_hold+0xf49/frame 0xffffff881e0f67a0 vm_fault() at vm_fault+0x77/frame 0xffffff881e0f67e0 trap_pfault() at trap_pfault+0x1bb/frame 0xffffff881e0f6890 trap() at trap+0x52b/frame 0xffffff881e0f6ab0 calltrap() at calltrap+0x8/frame 0xffffff881e0f6ab0 --- trap 0xc, rip = 0x800b57984, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffd3e0 --- Tracing command swap pid 1171 tid 100153 td 0xfffffe0057f73490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff8000316ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff8000316d00 trap() at trap+0x42/frame 0xffffff8000316f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000316f20 --- trap 0x13, rip = 0x401b7e, rsp = 0x7fffffffd8b0, rbp = 0x7fffffffd8d0 --- Tracing command swap pid 1170 tid 100178 td 0xfffffe00681a2490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002face0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002fad00 trap() at trap+0x42/frame 0xffffff80002faf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002faf20 --- trap 0x13, rip = 0x401b7e, rsp = 0x7fffffffd8b0, rbp = 0x7fffffffd8d0 --- Tracing command swap pid 1169 tid 100281 td 0xfffffe0057805920 sched_switch() at sched_switch+0x482/frame 0xffffff881e0f1560 mi_switch() at mi_switch+0x179/frame 0xffffff881e0f15a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0f15e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e0f1650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e0f1680 _sleep() at _sleep+0x320/frame 0xffffff881e0f1710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff881e0f17b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff881e0f19a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0f1ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0f1ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800ab11fa, rsp = 0x7fffffffd8d8, rbp = 0x7fffffffd980 --- Tracing command swap pid 1168 tid 100219 td 0xfffffe0057b71000 sched_switch() at sched_switch+0x482/frame 0xffffff881dfbb750 mi_switch() at mi_switch+0x179/frame 0xffffff881dfbb790 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dfbb7d0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881dfbb840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881dfbb870 _sleep() at _sleep+0x300/frame 0xffffff881dfbb900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xffffff881dfbb960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xffffff881dfbb9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881dfbbab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881dfbbab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b373ba, rsp = 0x7fffffffd878, rbp = 0x7fffffffd8d0 --- Tracing command bash pid 1161 tid 100279 td 0xfffffe0057a7f490 sched_switch() at sched_switch+0x482/frame 0xffffff881e0e7560 mi_switch() at mi_switch+0x179/frame 0xffffff881e0e75a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881e0e75e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881e0e7650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881e0e7680 _sleep() at _sleep+0x320/frame 0xffffff881e0e7710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff881e0e77b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff881e0e79a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881e0e7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881e0e7ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80109c1fa, rsp = 0x7fffffffd4d8, rbp = 0x7fffffffd520 --- Tracing command sshd pid 1160 tid 100144 td 0xfffffe0057c24000 sched_switch() at sched_switch+0x482/frame 0xffffff881de37590 mi_switch() at mi_switch+0x179/frame 0xffffff881de375d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881de37610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881de37680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881de376b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881de37720 seltdwait() at seltdwait+0x78/frame 0xffffff881de37760 kern_select() at kern_select+0x892/frame 0xffffff881de37960 sys_select() at sys_select+0x54/frame 0xffffff881de379a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881de37ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881de37ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80257525a, rsp = 0x7fffffffd168, rbp = 0x7fffffffd1d0 --- Tracing command sshd pid 1158 tid 100229 td 0xfffffe0099e5c490 sched_switch() at sched_switch+0x482/frame 0xffffff881dfed630 mi_switch() at mi_switch+0x179/frame 0xffffff881dfed670 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dfed6b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881dfed720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881dfed750 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881dfed7c0 seltdwait() at seltdwait+0x78/frame 0xffffff881dfed800 sys_poll() at sys_poll+0x38c/frame 0xffffff881dfed9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881dfedab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881dfedab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80250d6ea, rsp = 0x7fffffffd1f8, rbp = 0x7fffffffd250 --- Tracing command bash pid 1045 tid 100218 td 0xfffffe0057b71490 sched_switch() at sched_switch+0x482/frame 0xffffff881dfb6560 mi_switch() at mi_switch+0x179/frame 0xffffff881dfb65a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dfb65e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881dfb6650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881dfb6680 _sleep() at _sleep+0x320/frame 0xffffff881dfb6710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff881dfb67b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff881dfb69a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881dfb6ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881dfb6ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80109c1fa, rsp = 0x7fffffffd558, rbp = 0x7fffffffd5a0 --- Tracing command getty pid 1043 tid 100227 td 0xfffffe0099d18000 sched_switch() at sched_switch+0x482/frame 0xffffff881dfe3620 mi_switch() at mi_switch+0x179/frame 0xffffff881dfe3660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dfe36a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881dfe3710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881dfe3740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881dfe37b0 tty_wait() at tty_wait+0x42/frame 0xffffff881dfe37e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881dfe3840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881dfe3870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881dfe38d0 dofileread() at dofileread+0x7b/frame 0xffffff881dfe3910 kern_readv() at kern_readv+0x48/frame 0xffffff881dfe3950 sys_read() at sys_read+0x63/frame 0xffffff881dfe39a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881dfe3ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881dfe3ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b582da, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1042 tid 100226 td 0xfffffe0099d18490 sched_switch() at sched_switch+0x482/frame 0xffffff881dfde620 mi_switch() at mi_switch+0x179/frame 0xffffff881dfde660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dfde6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881dfde710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881dfde740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881dfde7b0 tty_wait() at tty_wait+0x42/frame 0xffffff881dfde7e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881dfde840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881dfde870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881dfde8d0 dofileread() at dofileread+0x7b/frame 0xffffff881dfde910 kern_readv() at kern_readv+0x48/frame 0xffffff881dfde950 sys_read() at sys_read+0x63/frame 0xffffff881dfde9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881dfdeab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881dfdeab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b582da, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1041 tid 100225 td 0xfffffe0099d18920 sched_switch() at sched_switch+0x482/frame 0xffffff881dfd9620 mi_switch() at mi_switch+0x179/frame 0xffffff881dfd9660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dfd96a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881dfd9710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881dfd9740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881dfd97b0 tty_wait() at tty_wait+0x42/frame 0xffffff881dfd97e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881dfd9840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881dfd9870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881dfd98d0 dofileread() at dofileread+0x7b/frame 0xffffff881dfd9910 kern_readv() at kern_readv+0x48/frame 0xffffff881dfd9950 sys_read() at sys_read+0x63/frame 0xffffff881dfd99a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881dfd9ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881dfd9ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b582da, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1040 tid 100224 td 0xfffffe0099a4d920 sched_switch() at sched_switch+0x482/frame 0xffffff881dfd4620 mi_switch() at mi_switch+0x179/frame 0xffffff881dfd4660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dfd46a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881dfd4710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881dfd4740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881dfd47b0 tty_wait() at tty_wait+0x42/frame 0xffffff881dfd47e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881dfd4840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881dfd4870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881dfd48d0 dofileread() at dofileread+0x7b/frame 0xffffff881dfd4910 kern_readv() at kern_readv+0x48/frame 0xffffff881dfd4950 sys_read() at sys_read+0x63/frame 0xffffff881dfd49a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881dfd4ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881dfd4ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b582da, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1039 tid 100223 td 0xfffffe00575d7000 sched_switch() at sched_switch+0x482/frame 0xffffff881dfcf620 mi_switch() at mi_switch+0x179/frame 0xffffff881dfcf660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dfcf6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881dfcf710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881dfcf740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881dfcf7b0 tty_wait() at tty_wait+0x42/frame 0xffffff881dfcf7e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881dfcf840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881dfcf870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881dfcf8d0 dofileread() at dofileread+0x7b/frame 0xffffff881dfcf910 kern_readv() at kern_readv+0x48/frame 0xffffff881dfcf950 sys_read() at sys_read+0x63/frame 0xffffff881dfcf9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881dfcfab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881dfcfab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b582da, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1038 tid 100222 td 0xfffffe00575d7490 sched_switch() at sched_switch+0x482/frame 0xffffff881dfca620 mi_switch() at mi_switch+0x179/frame 0xffffff881dfca660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dfca6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881dfca710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881dfca740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881dfca7b0 tty_wait() at tty_wait+0x42/frame 0xffffff881dfca7e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881dfca840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881dfca870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881dfca8d0 dofileread() at dofileread+0x7b/frame 0xffffff881dfca910 kern_readv() at kern_readv+0x48/frame 0xffffff881dfca950 sys_read() at sys_read+0x63/frame 0xffffff881dfca9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881dfcaab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881dfcaab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b582da, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1037 tid 100221 td 0xfffffe00575d7920 sched_switch() at sched_switch+0x482/frame 0xffffff881dfc5620 mi_switch() at mi_switch+0x179/frame 0xffffff881dfc5660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dfc56a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881dfc5710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881dfc5740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881dfc57b0 tty_wait() at tty_wait+0x42/frame 0xffffff881dfc57e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881dfc5840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881dfc5870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881dfc58d0 dofileread() at dofileread+0x7b/frame 0xffffff881dfc5910 kern_readv() at kern_readv+0x48/frame 0xffffff881dfc5950 sys_read() at sys_read+0x63/frame 0xffffff881dfc59a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881dfc5ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881dfc5ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b582da, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1036 tid 100220 td 0xfffffe0057805000 sched_switch() at sched_switch+0x482/frame 0xffffff881dfc0620 mi_switch() at mi_switch+0x179/frame 0xffffff881dfc0660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dfc06a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881dfc0710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881dfc0740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881dfc07b0 tty_wait() at tty_wait+0x42/frame 0xffffff881dfc07e0 ttydisc_read() at ttydisc_read+0x353/frame 0xffffff881dfc0840 ttydev_read() at ttydev_read+0x6d/frame 0xffffff881dfc0870 devfs_read_f() at devfs_read_f+0x7f/frame 0xffffff881dfc08d0 dofileread() at dofileread+0x7b/frame 0xffffff881dfc0910 kern_readv() at kern_readv+0x48/frame 0xffffff881dfc0950 sys_read() at sys_read+0x63/frame 0xffffff881dfc09a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881dfc0ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881dfc0ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b582da, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command login pid 1035 tid 100135 td 0xfffffe0057592490 sched_switch() at sched_switch+0x482/frame 0xffffff881de0a560 mi_switch() at mi_switch+0x179/frame 0xffffff881de0a5a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881de0a5e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881de0a650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881de0a680 _sleep() at _sleep+0x320/frame 0xffffff881de0a710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff881de0a7b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff881de0a9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881de0aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881de0aab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800ed71fa, rsp = 0x7fffffffdc08, rbp = 0x7fffffffdd50 --- Tracing command cron pid 962 tid 100211 td 0xfffffe0099a3c490 sched_switch() at sched_switch+0x482/frame 0xffffff881df93750 mi_switch() at mi_switch+0x179/frame 0xffffff881df93790 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881df937d0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881df93840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881df93870 _sleep() at _sleep+0x300/frame 0xffffff881df93900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xffffff881df93960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xffffff881df939a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881df93ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881df93ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800d473ba, rsp = 0x7fffffffdb28, rbp = 0x7fffffffdd00 --- Tracing command sendmail pid 958 tid 100145 td 0xfffffe0057c13920 sched_switch() at sched_switch+0x482/frame 0xffffff881de3c760 mi_switch() at mi_switch+0x179/frame 0xffffff881de3c7a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881de3c7e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881de3c850 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881de3c880 _sleep() at _sleep+0x320/frame 0xffffff881de3c910 kern_sigsuspend() at kern_sigsuspend+0xcd/frame 0xffffff881de3c970 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xffffff881de3c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881de3cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881de3cab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x801392c1a, rsp = 0x7fffffffc818, rbp = 0x7fffffffc830 --- Tracing command sendmail pid 955 tid 100207 td 0xfffffe0057592920 sched_switch() at sched_switch+0x482/frame 0xffffff881df7f580 mi_switch() at mi_switch+0x179/frame 0xffffff881df7f5c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881df7f600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881df7f670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881df7f6a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881df7f720 seltdwait() at seltdwait+0x8b/frame 0xffffff881df7f760 kern_select() at kern_select+0x892/frame 0xffffff881df7f960 sys_select() at sys_select+0x54/frame 0xffffff881df7f9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881df7fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881df7fab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80145225a, rsp = 0x7fffffffbd18, rbp = 0x7fffffffc810 --- Tracing command sshd pid 952 tid 100208 td 0xfffffe006802d000 sched_switch() at sched_switch+0x482/frame 0xffffff881df84590 mi_switch() at mi_switch+0x179/frame 0xffffff881df845d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881df84610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881df84680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881df846b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881df84720 seltdwait() at seltdwait+0x78/frame 0xffffff881df84760 kern_select() at kern_select+0x892/frame 0xffffff881df84960 sys_select() at sys_select+0x54/frame 0xffffff881df849a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881df84ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881df84ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80257525a, rsp = 0x7fffffffd288, rbp = 0x7fffffffdd10 --- Tracing command powerd pid 924 tid 100175 td 0xfffffe006802d490 sched_switch() at sched_switch+0x482/frame 0xffffff881ded2580 mi_switch() at mi_switch+0x179/frame 0xffffff881ded25c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ded2600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881ded2670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881ded26a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881ded2720 seltdwait() at seltdwait+0x8b/frame 0xffffff881ded2760 kern_select() at kern_select+0x892/frame 0xffffff881ded2960 sys_select() at sys_select+0x54/frame 0xffffff881ded29a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881ded2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881ded2ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b5625a, rsp = 0x7fffffffdb88, rbp = 0x7fffffffdd00 --- Tracing command ntpd pid 921 tid 100206 td 0xfffffe0068199490 sched_switch() at sched_switch+0x482/frame 0xffffff881df7a590 mi_switch() at mi_switch+0x179/frame 0xffffff881df7a5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881df7a610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881df7a680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881df7a6b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881df7a720 seltdwait() at seltdwait+0x78/frame 0xffffff881df7a760 kern_select() at kern_select+0x892/frame 0xffffff881df7a960 sys_select() at sys_select+0x54/frame 0xffffff881df7a9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881df7aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881df7aab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8013c125a, rsp = 0x7fffffffdbc8, rbp = 0x7fffffffdc90 --- Tracing command nfsd pid 883 tid 100202 td 0xfffffe0099a1c490 sched_switch() at sched_switch+0x482/frame 0xffffff881df66730 mi_switch() at mi_switch+0x179/frame 0xffffff881df66770 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881df667b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881df66820 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881df66850 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881df668d0 svc_run_internal() at svc_run_internal+0x9c7/frame 0xffffff881df66a60 svc_thread_start() at svc_thread_start+0xb/frame 0xffffff881df66a70 fork_exit() at fork_exit+0x84/frame 0xffffff881df66ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881df66ab0 --- trap 0xc, rip = 0x80088687a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 883 tid 100201 td 0xfffffe0099a1c920 sched_switch() at sched_switch+0x482/frame 0xffffff881df61730 mi_switch() at mi_switch+0x179/frame 0xffffff881df61770 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881df617b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881df61820 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881df61850 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881df618d0 svc_run_internal() at svc_run_internal+0x9c7/frame 0xffffff881df61a60 svc_thread_start() at svc_thread_start+0xb/frame 0xffffff881df61a70 fork_exit() at fork_exit+0x84/frame 0xffffff881df61ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881df61ab0 --- trap 0xc, rip = 0x80088687a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 883 tid 100200 td 0xfffffe0099a28000 sched_switch() at sched_switch+0x482/frame 0xffffff881df5c730 mi_switch() at mi_switch+0x179/frame 0xffffff881df5c770 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881df5c7b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881df5c820 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881df5c850 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881df5c8d0 svc_run_internal() at svc_run_internal+0x9c7/frame 0xffffff881df5ca60 svc_thread_start() at svc_thread_start+0xb/frame 0xffffff881df5ca70 fork_exit() at fork_exit+0x84/frame 0xffffff881df5cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881df5cab0 --- trap 0xc, rip = 0x80088687a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 883 tid 100165 td 0xfffffe0068001490 sched_switch() at sched_switch+0x482/frame 0xffffff881de9fea0 mi_switch() at mi_switch+0x179/frame 0xffffff881de9fee0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881de9ff20 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881de9ff90 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881de9ffc0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881dea0040 svc_run_internal() at svc_run_internal+0x9c7/frame 0xffffff881dea01d0 svc_run() at svc_run+0xd4/frame 0xffffff881dea0210 nfsrvd_nfsd() at nfsrvd_nfsd+0x194/frame 0xffffff881dea0370 nfssvc_nfsd() at nfssvc_nfsd+0x103/frame 0xffffff881dea0970 sys_nfssvc() at sys_nfssvc+0xd2/frame 0xffffff881dea09a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881dea0ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881dea0ab0 --- syscall (155, FreeBSD ELF64, sys_nfssvc), rip = 0x80088687a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 881 tid 100199 td 0xfffffe00999fd490 sched_switch() at sched_switch+0x482/frame 0xffffff881df57590 mi_switch() at mi_switch+0x179/frame 0xffffff881df575d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881df57610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881df57680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881df576b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881df57720 seltdwait() at seltdwait+0x78/frame 0xffffff881df57760 kern_select() at kern_select+0x892/frame 0xffffff881df57960 sys_select() at sys_select+0x54/frame 0xffffff881df579a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881df57ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881df57ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094525a, rsp = 0x7fffffffd888, rbp = 0x7fffffffdce0 --- Tracing command mountd pid 875 tid 100198 td 0xfffffe00999d1920 sched_switch() at sched_switch+0x482/frame 0xffffff881df52590 mi_switch() at mi_switch+0x179/frame 0xffffff881df525d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881df52610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881df52680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881df526b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881df52720 seltdwait() at seltdwait+0x78/frame 0xffffff881df52760 kern_select() at kern_select+0x892/frame 0xffffff881df52960 sys_select() at sys_select+0x54/frame 0xffffff881df529a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881df52ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881df52ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b5d25a, rsp = 0x7fffffffdb88, rbp = 0x7fffffffdd00 --- Tracing command nfsuserd pid 868 tid 100197 td 0xfffffe00682b4000 sched_switch() at sched_switch+0x482/frame 0xffffff881df4d580 mi_switch() at mi_switch+0x179/frame 0xffffff881df4d5c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881df4d600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881df4d670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881df4d6a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881df4d720 seltdwait() at seltdwait+0x8b/frame 0xffffff881df4d760 kern_select() at kern_select+0x892/frame 0xffffff881df4d960 sys_select() at sys_select+0x54/frame 0xffffff881df4d9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881df4dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881df4dab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094425a, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 867 tid 100196 td 0xfffffe00682b4490 sched_switch() at sched_switch+0x482/frame 0xffffff881df48580 mi_switch() at mi_switch+0x179/frame 0xffffff881df485c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881df48600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881df48670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881df486a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881df48720 seltdwait() at seltdwait+0x8b/frame 0xffffff881df48760 kern_select() at kern_select+0x892/frame 0xffffff881df48960 sys_select() at sys_select+0x54/frame 0xffffff881df489a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881df48ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881df48ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094425a, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 866 tid 100195 td 0xfffffe00682b4920 sched_switch() at sched_switch+0x482/frame 0xffffff881df43580 mi_switch() at mi_switch+0x179/frame 0xffffff881df435c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881df43600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881df43670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881df436a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881df43720 seltdwait() at seltdwait+0x8b/frame 0xffffff881df43760 kern_select() at kern_select+0x892/frame 0xffffff881df43960 sys_select() at sys_select+0x54/frame 0xffffff881df439a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881df43ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881df43ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094425a, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 865 tid 100176 td 0xfffffe00682c0000 sched_switch() at sched_switch+0x482/frame 0xffffff881ded7580 mi_switch() at mi_switch+0x179/frame 0xffffff881ded75c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881ded7600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881ded7670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881ded76a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881ded7720 seltdwait() at seltdwait+0x8b/frame 0xffffff881ded7760 kern_select() at kern_select+0x892/frame 0xffffff881ded7960 sys_select() at sys_select+0x54/frame 0xffffff881ded79a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881ded7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881ded7ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094425a, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 864 tid 100194 td 0xfffffe005758a000 sched_switch() at sched_switch+0x482/frame 0xffffff881df3e760 mi_switch() at mi_switch+0x179/frame 0xffffff881df3e7a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881df3e7e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881df3e850 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881df3e880 _sleep() at _sleep+0x320/frame 0xffffff881df3e910 kern_sigsuspend() at kern_sigsuspend+0xcd/frame 0xffffff881df3e970 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xffffff881df3e9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881df3eab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881df3eab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800884c1a, rsp = 0x7fffffffdb38, rbp = 0x7fffffffdd00 --- Tracing command rpcbind pid 834 tid 100191 td 0xfffffe0068146920 sched_switch() at sched_switch+0x482/frame 0xffffff881df2f620 mi_switch() at mi_switch+0x179/frame 0xffffff881df2f660 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881df2f6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881df2f710 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881df2f740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881df2f7c0 seltdwait() at seltdwait+0x8b/frame 0xffffff881df2f800 sys_poll() at sys_poll+0x38c/frame 0xffffff881df2f9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881df2fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881df2fab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800cfd6ea, rsp = 0x7fffffffba68, rbp = 0x7fffffffdc80 --- Tracing command syslogd pid 821 tid 100184 td 0xfffffe0057977000 sched_switch() at sched_switch+0x482/frame 0xffffff881deff590 mi_switch() at mi_switch+0x179/frame 0xffffff881deff5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881deff610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881deff680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881deff6b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881deff720 seltdwait() at seltdwait+0x78/frame 0xffffff881deff760 kern_select() at kern_select+0x892/frame 0xffffff881deff960 sys_select() at sys_select+0x54/frame 0xffffff881deff9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881deffab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881deffab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b5b25a, rsp = 0x7fffffffcce8, rbp = 0x7fffffffdd00 --- Tracing command devd pid 692 tid 100169 td 0xfffffe00681a2920 sched_switch() at sched_switch+0x482/frame 0xffffff881deb4580 mi_switch() at mi_switch+0x179/frame 0xffffff881deb45c0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881deb4600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881deb4670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xffffff881deb46a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xffffff881deb4720 seltdwait() at seltdwait+0x8b/frame 0xffffff881deb4760 kern_select() at kern_select+0x892/frame 0xffffff881deb4960 sys_select() at sys_select+0x54/frame 0xffffff881deb49a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881deb4ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881deb4ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x44cb4a, rsp = 0x7fffffffbbb8, rbp = 0x7fffffffdd20 --- Tracing command moused pid 675 tid 100181 td 0xfffffe0068135920 sched_switch() at sched_switch+0x482/frame 0xffffff881def0590 mi_switch() at mi_switch+0x179/frame 0xffffff881def05d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881def0610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff881def0680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff881def06b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xffffff881def0720 seltdwait() at seltdwait+0x78/frame 0xffffff881def0760 kern_select() at kern_select+0x892/frame 0xffffff881def0960 sys_select() at sys_select+0x54/frame 0xffffff881def09a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff881def0ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff881def0ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800d8125a, rsp = 0x7fffffffd6f8, rbp = 0x7fffffffdca0 --- Tracing command softdepflush pid 17 tid 100134 td 0xfffffe0057015920 sched_switch() at sched_switch+0x482/frame 0xffffff881dc698f0 mi_switch() at mi_switch+0x179/frame 0xffffff881dc69930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dc69970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881dc699a0 _sleep() at _sleep+0x312/frame 0xffffff881dc69a30 softdep_flush() at softdep_flush+0x20c/frame 0xffffff881dc69a70 fork_exit() at fork_exit+0x84/frame 0xffffff881dc69ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dc69ab0 --- trap 0, rip = 0, rsp = 0xffffff881dc69b70, rbp = 0 --- Tracing command vnlru pid 16 tid 100133 td 0xfffffe0057181000 sched_switch() at sched_switch+0x482/frame 0xffffff881dc648b0 mi_switch() at mi_switch+0x179/frame 0xffffff881dc648f0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dc64930 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881dc64960 _sleep() at _sleep+0x312/frame 0xffffff881dc649f0 vnlru_proc() at vnlru_proc+0x48/frame 0xffffff881dc64a70 fork_exit() at fork_exit+0x84/frame 0xffffff881dc64ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dc64ab0 --- trap 0, rip = 0, rsp = 0xffffff881dc64b70, rbp = 0 --- Tracing command syncer pid 9 tid 100132 td 0xfffffe0057181490 sched_switch() at sched_switch+0x482/frame 0xffffff881dc5f8a0 mi_switch() at mi_switch+0x179/frame 0xffffff881dc5f8e0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dc5f920 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881dc5f950 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x1fe/frame 0xffffff881dc5f9d0 sched_sync() at sched_sync+0x5cb/frame 0xffffff881dc5fa70 fork_exit() at fork_exit+0x84/frame 0xffffff881dc5fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dc5fab0 --- trap 0, rip = 0, rsp = 0xffffff881dc5fb70, rbp = 0 --- Tracing command bufdaemon pid 8 tid 100131 td 0xfffffe0057181920 sched_switch() at sched_switch+0x482/frame 0xffffff881dc5a900 mi_switch() at mi_switch+0x179/frame 0xffffff881dc5a940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dc5a980 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881dc5a9b0 _sleep() at _sleep+0x312/frame 0xffffff881dc5aa40 buf_daemon() at buf_daemon+0x68/frame 0xffffff881dc5aa70 fork_exit() at fork_exit+0x84/frame 0xffffff881dc5aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dc5aab0 --- trap 0, rip = 0, rsp = 0xffffff881dc5ab70, rbp = 0 --- Tracing command pagezero pid 7 tid 100130 td 0xfffffe005179f920 sched_switch() at sched_switch+0x482/frame 0xffffff881dc55900 mi_switch() at mi_switch+0x179/frame 0xffffff881dc55940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dc55980 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881dc559b0 _sleep() at _sleep+0x312/frame 0xffffff881dc55a40 vm_pagezero() at vm_pagezero+0x88/frame 0xffffff881dc55a70 fork_exit() at fork_exit+0x84/frame 0xffffff881dc55ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dc55ab0 --- trap 0, rip = 0, rsp = 0xffffff881dc55b70, rbp = 0 --- Tracing command vmdaemon pid 6 tid 100129 td 0xfffffe0057014000 sched_switch() at sched_switch+0x482/frame 0xffffff881dc508c0 mi_switch() at mi_switch+0x179/frame 0xffffff881dc50900 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dc50940 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881dc50970 _sleep() at _sleep+0x33d/frame 0xffffff881dc50a00 vm_daemon() at vm_daemon+0x7e/frame 0xffffff881dc50a70 fork_exit() at fork_exit+0x84/frame 0xffffff881dc50ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dc50ab0 --- trap 0, rip = 0, rsp = 0xffffff881dc50b70, rbp = 0 --- Tracing command pagedaemon pid 5 tid 100128 td 0xfffffe0057014490 sched_switch() at sched_switch+0x482/frame 0xffffff881dc4b760 mi_switch() at mi_switch+0x179/frame 0xffffff881dc4b7a0 critical_exit() at critical_exit+0x8b/frame 0xffffff881dc4b7c0 ipi_bitmap_handler() at ipi_bitmap_handler+0x7a/frame 0xffffff881dc4b800 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x9b/frame 0xffffff881dc4b800 --- interrupt, rip = 0xffffffff808d0df6, rsp = 0xffffff881dc4b8c0, rbp = 0xffffff881dc4b900 --- __mtx_lock_flags() at __mtx_lock_flags+0x66/frame 0xffffff881dc4b900 pmap_ts_referenced() at pmap_ts_referenced+0x2e3/frame 0xffffff881dc4b970 vm_pageout() at vm_pageout+0x13a5/frame 0xffffff881dc4ba70 fork_exit() at fork_exit+0x84/frame 0xffffff881dc4bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dc4bab0 --- trap 0, rip = 0, rsp = 0xffffff881dc4bb70, rbp = 0 --- Tracing command enc_daemon0 pid 4 tid 100127 td 0xfffffe0057014920 sched_switch() at sched_switch+0x482/frame 0xffffff881dc468c0 mi_switch() at mi_switch+0x179/frame 0xffffff881dc46900 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881dc46940 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881dc46970 _sleep() at _sleep+0x33d/frame 0xffffff881dc46a00 enc_daemon() at enc_daemon+0x109/frame 0xffffff881dc46a70 fork_exit() at fork_exit+0x84/frame 0xffffff881dc46ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881dc46ab0 --- trap 0, rip = 0, rsp = 0xffffff881dc46b70, rbp = 0 --- Tracing command xpt_thrd pid 3 tid 100126 td 0xfffffe0057015000 sched_switch() at sched_switch+0x482/frame 0xffffff881da81900 mi_switch() at mi_switch+0x179/frame 0xffffff881da81940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881da81980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881da819b0 _sleep() at _sleep+0x33d/frame 0xffffff881da81a40 xpt_scanner_thread() at xpt_scanner_thread+0xdc/frame 0xffffff881da81a70 fork_exit() at fork_exit+0x84/frame 0xffffff881da81ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881da81ab0 --- trap 0, rip = 0, rsp = 0xffffff881da81b70, rbp = 0 --- Tracing command sctp_iterator pid 2 tid 100125 td 0xfffffe005179b000 sched_switch() at sched_switch+0x482/frame 0xffffff881da7c910 mi_switch() at mi_switch+0x179/frame 0xffffff881da7c950 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881da7c990 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881da7c9c0 _sleep() at _sleep+0x33d/frame 0xffffff881da7ca50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xffffff881da7ca70 fork_exit() at fork_exit+0x84/frame 0xffffff881da7cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881da7cab0 --- trap 0, rip = 0, rsp = 0xffffff881da7cb70, rbp = 0 --- Tracing command usb pid 15 tid 100119 td 0xfffffe00516a6920 sched_switch() at sched_switch+0x482/frame 0xffffff881b9d9920 mi_switch() at mi_switch+0x179/frame 0xffffff881b9d9960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b9d99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b9d99d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881b9d9a40 usb_process() at usb_process+0xd4/frame 0xffffff881b9d9a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b9d9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b9d9ab0 --- trap 0, rip = 0, rsp = 0xffffff881b9d9b70, rbp = 0 --- Tracing command usb pid 15 tid 100118 td 0xfffffe00516aa000 sched_switch() at sched_switch+0x482/frame 0xffffff881b9d4920 mi_switch() at mi_switch+0x179/frame 0xffffff881b9d4960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b9d49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b9d49d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881b9d4a40 usb_process() at usb_process+0xd4/frame 0xffffff881b9d4a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b9d4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b9d4ab0 --- trap 0, rip = 0, rsp = 0xffffff881b9d4b70, rbp = 0 --- Tracing command usb pid 15 tid 100117 td 0xfffffe00516aa490 sched_switch() at sched_switch+0x482/frame 0xffffff881b9cf920 mi_switch() at mi_switch+0x179/frame 0xffffff881b9cf960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b9cf9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b9cf9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881b9cfa40 usb_process() at usb_process+0xd4/frame 0xffffff881b9cfa70 fork_exit() at fork_exit+0x84/frame 0xffffff881b9cfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b9cfab0 --- trap 0, rip = 0, rsp = 0xffffff881b9cfb70, rbp = 0 --- Tracing command usb pid 15 tid 100116 td 0xfffffe00516aa920 sched_switch() at sched_switch+0x482/frame 0xffffff881b9ca920 mi_switch() at mi_switch+0x179/frame 0xffffff881b9ca960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b9ca9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b9ca9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881b9caa40 usb_process() at usb_process+0xd4/frame 0xffffff881b9caa70 fork_exit() at fork_exit+0x84/frame 0xffffff881b9caab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b9caab0 --- trap 0, rip = 0, rsp = 0xffffff881b9cab70, rbp = 0 --- Tracing command usb pid 15 tid 100114 td 0xfffffe00516a5000 sched_switch() at sched_switch+0x482/frame 0xffffff881b83d920 mi_switch() at mi_switch+0x179/frame 0xffffff881b83d960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b83d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b83d9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881b83da40 usb_process() at usb_process+0xd4/frame 0xffffff881b83da70 fork_exit() at fork_exit+0x84/frame 0xffffff881b83dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b83dab0 --- trap 0, rip = 0, rsp = 0xffffff881b83db70, rbp = 0 --- Tracing command usb pid 15 tid 100113 td 0xfffffe00516a5490 sched_switch() at sched_switch+0x482/frame 0xffffff881b838920 mi_switch() at mi_switch+0x179/frame 0xffffff881b838960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b8389a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b8389d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881b838a40 usb_process() at usb_process+0xd4/frame 0xffffff881b838a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b838ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b838ab0 --- trap 0, rip = 0, rsp = 0xffffff881b838b70, rbp = 0 --- Tracing command usb pid 15 tid 100112 td 0xfffffe00516a5920 sched_switch() at sched_switch+0x482/frame 0xffffff881b833920 mi_switch() at mi_switch+0x179/frame 0xffffff881b833960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b8339a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b8339d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881b833a40 usb_process() at usb_process+0xd4/frame 0xffffff881b833a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b833ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b833ab0 --- trap 0, rip = 0, rsp = 0xffffff881b833b70, rbp = 0 --- Tracing command usb pid 15 tid 100111 td 0xfffffe00516a6000 sched_switch() at sched_switch+0x482/frame 0xffffff881b82e920 mi_switch() at mi_switch+0x179/frame 0xffffff881b82e960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b82e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b82e9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881b82ea40 usb_process() at usb_process+0xd4/frame 0xffffff881b82ea70 fork_exit() at fork_exit+0x84/frame 0xffffff881b82eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b82eab0 --- trap 0, rip = 0, rsp = 0xffffff881b82eb70, rbp = 0 --- Tracing command usb pid 15 tid 100074 td 0xfffffe0050225920 sched_switch() at sched_switch+0x482/frame 0xffffff881b6c9920 mi_switch() at mi_switch+0x179/frame 0xffffff881b6c9960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b6c99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b6c99d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881b6c9a40 usb_process() at usb_process+0xd4/frame 0xffffff881b6c9a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b6c9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b6c9ab0 --- trap 0, rip = 0, rsp = 0xffffff881b6c9b70, rbp = 0 --- Tracing command usb pid 15 tid 100073 td 0xfffffe0051651000 sched_switch() at sched_switch+0x482/frame 0xffffff881b6c4920 mi_switch() at mi_switch+0x179/frame 0xffffff881b6c4960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b6c49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b6c49d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881b6c4a40 usb_process() at usb_process+0xd4/frame 0xffffff881b6c4a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b6c4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b6c4ab0 --- trap 0, rip = 0, rsp = 0xffffff881b6c4b70, rbp = 0 --- Tracing command usb pid 15 tid 100072 td 0xfffffe0051651490 sched_switch() at sched_switch+0x482/frame 0xffffff881b6bf920 mi_switch() at mi_switch+0x179/frame 0xffffff881b6bf960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b6bf9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b6bf9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881b6bfa40 usb_process() at usb_process+0xd4/frame 0xffffff881b6bfa70 fork_exit() at fork_exit+0x84/frame 0xffffff881b6bfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b6bfab0 --- trap 0, rip = 0, rsp = 0xffffff881b6bfb70, rbp = 0 --- Tracing command usb pid 15 tid 100071 td 0xfffffe0051651920 sched_switch() at sched_switch+0x482/frame 0xffffff881b6ba920 mi_switch() at mi_switch+0x179/frame 0xffffff881b6ba960 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b6ba9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b6ba9d0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff881b6baa40 usb_process() at usb_process+0xd4/frame 0xffffff881b6baa70 fork_exit() at fork_exit+0x84/frame 0xffffff881b6baab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b6baab0 --- trap 0, rip = 0, rsp = 0xffffff881b6bab70, rbp = 0 --- Tracing command yarrow pid 14 tid 100057 td 0xfffffe0050091490 sched_switch() at sched_switch+0x482/frame 0xffffff881b3e78f0 mi_switch() at mi_switch+0x179/frame 0xffffff881b3e7930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b3e7970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881b3e79a0 msleep_spin_sbt() at msleep_spin_sbt+0x1f0/frame 0xffffff881b3e7a30 random_kthread() at random_kthread+0x68/frame 0xffffff881b3e7a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b3e7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b3e7ab0 --- trap 0, rip = 0, rsp = 0xffffff881b3e7b70, rbp = 0 --- Tracing command geom pid 13 tid 100055 td 0xfffffe0050081920 sched_switch() at sched_switch+0x482/frame 0xffffff881b3dd8d0 mi_switch() at mi_switch+0x179/frame 0xffffff881b3dd910 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b3dd950 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b3dd980 _sleep() at _sleep+0x33d/frame 0xffffff881b3dda10 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xffffff881b3dda60 g_down_procbody() at g_down_procbody+0x7d/frame 0xffffff881b3dda70 fork_exit() at fork_exit+0x84/frame 0xffffff881b3ddab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b3ddab0 --- trap 0, rip = 0, rsp = 0xffffff881b3ddb70, rbp = 0 --- Tracing command geom pid 13 tid 100054 td 0xfffffe0050082000 sched_switch() at sched_switch+0x482/frame 0xffffff881b3d88f0 mi_switch() at mi_switch+0x179/frame 0xffffff881b3d8930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b3d8970 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b3d89a0 _sleep() at _sleep+0x33d/frame 0xffffff881b3d8a30 g_io_schedule_up() at g_io_schedule_up+0xbc/frame 0xffffff881b3d8a60 g_up_procbody() at g_up_procbody+0x7d/frame 0xffffff881b3d8a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b3d8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b3d8ab0 --- trap 0, rip = 0, rsp = 0xffffff881b3d8b70, rbp = 0 --- Tracing command geom pid 13 tid 100053 td 0xfffffe0050082490 sched_switch() at sched_switch+0x482/frame 0xffffff881b3d38f0 mi_switch() at mi_switch+0x179/frame 0xffffff881b3d3930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b3d3970 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b3d39a0 _sleep() at _sleep+0x33d/frame 0xffffff881b3d3a30 g_run_events() at g_run_events+0x4f4/frame 0xffffff881b3d3a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b3d3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b3d3ab0 --- trap 0, rip = 0, rsp = 0xffffff881b3d3b70, rbp = 0 --- Tracing command intr pid 12 tid 100122 td 0xfffffe005179f000 sched_switch() at sched_switch+0x482/frame 0xffffff881da689f0 mi_switch() at mi_switch+0x179/frame 0xffffff881da68a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881da68a70 fork_exit() at fork_exit+0x84/frame 0xffffff881da68ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881da68ab0 --- trap 0, rip = 0, rsp = 0xffffff881da68b70, rbp = 0 --- Tracing command intr pid 12 tid 100121 td 0xfffffe005179f490 sched_switch() at sched_switch+0x482/frame 0xffffff881da609f0 mi_switch() at mi_switch+0x179/frame 0xffffff881da60a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881da60a70 fork_exit() at fork_exit+0x84/frame 0xffffff881da60ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881da60ab0 --- trap 0, rip = 0, rsp = 0xffffff881da60b70, rbp = 0 --- Tracing command intr pid 12 tid 100120 td 0xfffffe00516a6490 sched_switch() at sched_switch+0x482/frame 0xffffff881b9de9f0 mi_switch() at mi_switch+0x179/frame 0xffffff881b9dea30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881b9dea70 fork_exit() at fork_exit+0x84/frame 0xffffff881b9deab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b9deab0 --- trap 0, rip = 0, rsp = 0xffffff881b9deb70, rbp = 0 --- Tracing command intr pid 12 tid 100115 td 0xfffffe0051698920 sched_switch() at sched_switch+0x482/frame 0xffffff881b9c59f0 mi_switch() at mi_switch+0x179/frame 0xffffff881b9c5a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881b9c5a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b9c5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b9c5ab0 --- trap 0, rip = 0, rsp = 0xffffff881b9c5b70, rbp = 0 --- Tracing command intr pid 12 tid 100110 td 0xfffffe0051697000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100109 td 0xfffffe0051697490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100107 td 0xfffffe0051698000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100105 td 0xfffffe0051691490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100103 td 0xfffffe0051696000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100101 td 0xfffffe0051696920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100099 td 0xfffffe0051690000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100097 td 0xfffffe0051690920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100095 td 0xfffffe0051674000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100093 td 0xfffffe0051674920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100092 td 0xfffffe0051679000 sched_switch() at sched_switch+0x482/frame 0xffffff881b76d9f0 mi_switch() at mi_switch+0x179/frame 0xffffff881b76da30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881b76da70 fork_exit() at fork_exit+0x84/frame 0xffffff881b76dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b76dab0 --- trap 0, rip = 0, rsp = 0xffffff881b76db70, rbp = 0 --- Tracing command intr pid 12 tid 100090 td 0xfffffe0051672490 sched_switch() at sched_switch+0x482/frame 0xffffff881b7639f0 mi_switch() at mi_switch+0x179/frame 0xffffff881b763a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881b763a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b763ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b763ab0 --- trap 0, rip = 0, rsp = 0xffffff881b763b70, rbp = 0 --- Tracing command intr pid 12 tid 100088 td 0xfffffe0051673000 sched_switch() at sched_switch+0x482/frame 0xffffff881b7599f0 mi_switch() at mi_switch+0x179/frame 0xffffff881b759a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881b759a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b759ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b759ab0 --- trap 0, rip = 0, rsp = 0xffffff881b759b70, rbp = 0 --- Tracing command intr pid 12 tid 100086 td 0xfffffe0051673920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff800029fce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff800029fd00 trap() at trap+0x42/frame 0xffffff800029ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff800029ff20 --- trap 0x13, rip = 0xffffffff808d1195, rsp = 0xffffff800029ffe0, rbp = 0xffffff881b74f900 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x2a5/frame 0xffffff881b74f900 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881b74f940 igb_msix_que() at igb_msix_que+0xf5/frame 0xffffff881b74f9f0 intr_event_execute_handlers() at intr_event_execute_handlers+0x93/frame 0xffffff881b74fa30 ithread_loop() at ithread_loop+0xa6/frame 0xffffff881b74fa70 fork_exit() at fork_exit+0x84/frame 0xffffff881b74fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b74fab0 --- trap 0, rip = 0, rsp = 0xffffff881b74fb70, rbp = 0 --- Tracing command intr pid 12 tid 100084 td 0xfffffe0051671000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff8000298ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff8000298d00 trap() at trap+0x42/frame 0xffffff8000298f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000298f20 --- trap 0x13, rip = 0xffffffff808d1199, rsp = 0xffffff8000298fe0, rbp = 0xffffff881b745900 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x2a9/frame 0xffffff881b745900 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881b745940 igb_msix_que() at igb_msix_que+0xf5/frame 0xffffff881b7459f0 intr_event_execute_handlers() at intr_event_execute_handlers+0x93/frame 0xffffff881b745a30 ithread_loop() at ithread_loop+0xa6/frame 0xffffff881b745a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b745ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b745ab0 --- trap 0, rip = 0, rsp = 0xffffff881b745b70, rbp = 0 --- Tracing command intr pid 12 tid 100082 td 0xfffffe0051671920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff8000291ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff8000291d00 trap() at trap+0x42/frame 0xffffff8000291f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000291f20 --- trap 0x13, rip = 0xffffffff808d11a2, rsp = 0xffffff8000291fe0, rbp = 0xffffff881b73b900 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x2b2/frame 0xffffff881b73b900 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881b73b940 igb_msix_que() at igb_msix_que+0xf5/frame 0xffffff881b73b9f0 intr_event_execute_handlers() at intr_event_execute_handlers+0x93/frame 0xffffff881b73ba30 ithread_loop() at ithread_loop+0xa6/frame 0xffffff881b73ba70 fork_exit() at fork_exit+0x84/frame 0xffffff881b73bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b73bab0 --- trap 0, rip = 0, rsp = 0xffffff881b73bb70, rbp = 0 --- Tracing command intr pid 12 tid 100080 td 0xfffffe005166f000 sched_switch() at sched_switch+0x482/frame 0xffffff881b7319f0 mi_switch() at mi_switch+0x179/frame 0xffffff881b731a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881b731a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b731ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b731ab0 --- trap 0, rip = 0, rsp = 0xffffff881b731b70, rbp = 0 --- Tracing command intr pid 12 tid 100078 td 0xfffffe005166f920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff8000283ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff8000283d00 trap() at trap+0x42/frame 0xffffff8000283f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000283f20 --- trap 0x13, rip = 0xffffffff808d1195, rsp = 0xffffff8000283fe0, rbp = 0xffffff881b727900 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x2a5/frame 0xffffff881b727900 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881b727940 igb_msix_que() at igb_msix_que+0xf5/frame 0xffffff881b7279f0 intr_event_execute_handlers() at intr_event_execute_handlers+0x93/frame 0xffffff881b727a30 ithread_loop() at ithread_loop+0xa6/frame 0xffffff881b727a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b727ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b727ab0 --- trap 0, rip = 0, rsp = 0xffffff881b727b70, rbp = 0 --- Tracing command intr pid 12 tid 100076 td 0xfffffe0051670490 sched_switch() at sched_switch+0x482/frame 0xffffff881b71d9f0 mi_switch() at mi_switch+0x179/frame 0xffffff881b71da30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881b71da70 fork_exit() at fork_exit+0x84/frame 0xffffff881b71dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b71dab0 --- trap 0, rip = 0, rsp = 0xffffff881b71db70, rbp = 0 --- Tracing command intr pid 12 tid 100075 td 0xfffffe0050225490 sched_switch() at sched_switch+0x482/frame 0xffffff881b6ce9f0 mi_switch() at mi_switch+0x179/frame 0xffffff881b6cea30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881b6cea70 fork_exit() at fork_exit+0x84/frame 0xffffff881b6ceab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b6ceab0 --- trap 0, rip = 0, rsp = 0xffffff881b6ceb70, rbp = 0 --- Tracing command intr pid 12 tid 100070 td 0xfffffe0050219920 sched_switch() at sched_switch+0x482/frame 0xffffff881b6b59f0 mi_switch() at mi_switch+0x179/frame 0xffffff881b6b5a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881b6b5a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b6b5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b6b5ab0 --- trap 0, rip = 0, rsp = 0xffffff881b6b5b70, rbp = 0 --- Tracing command intr pid 12 tid 100069 td 0xfffffe0050224000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100068 td 0xfffffe0050224490 sched_switch() at sched_switch+0x482/frame 0xffffff881b52b9f0 mi_switch() at mi_switch+0x179/frame 0xffffff881b52ba30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881b52ba70 fork_exit() at fork_exit+0x84/frame 0xffffff881b52bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b52bab0 --- trap 0, rip = 0, rsp = 0xffffff881b52bb70, rbp = 0 --- Tracing command intr pid 12 tid 100065 td 0xfffffe0050211000 sched_switch() at sched_switch+0x482/frame 0xffffff881b40f9f0 mi_switch() at mi_switch+0x179/frame 0xffffff881b40fa30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881b40fa70 fork_exit() at fork_exit+0x84/frame 0xffffff881b40fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b40fab0 --- trap 0, rip = 0, rsp = 0xffffff881b40fb70, rbp = 0 --- Tracing command intr pid 12 tid 100064 td 0xfffffe0050211490 sched_switch() at sched_switch+0x482/frame 0xffffff881b40a9f0 mi_switch() at mi_switch+0x179/frame 0xffffff881b40aa30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881b40aa70 fork_exit() at fork_exit+0x84/frame 0xffffff881b40aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b40aab0 --- trap 0, rip = 0, rsp = 0xffffff881b40ab70, rbp = 0 --- Tracing command intr pid 12 tid 100063 td 0xfffffe0050211920 sched_switch() at sched_switch+0x482/frame 0xffffff881b4059f0 mi_switch() at mi_switch+0x179/frame 0xffffff881b405a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881b405a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b405ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b405ab0 --- trap 0, rip = 0, rsp = 0xffffff881b405b70, rbp = 0 --- Tracing command intr pid 12 tid 100058 td 0xfffffe0050091000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffffe0050082920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffffe0050083000 sched_switch() at sched_switch+0x482/frame 0xffffff881b3c99f0 mi_switch() at mi_switch+0x179/frame 0xffffff881b3c9a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff881b3c9a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b3c9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b3c9ab0 --- trap 0, rip = 0, rsp = 0xffffff881b3c9b70, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffffe0050080000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffffe0050080490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffffe0050080920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffffe0050081000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100046 td 0xfffffe0050081490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffffe005007e490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100044 td 0xfffffe005007e920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100043 td 0xfffffe005007f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xfffffe005007f490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xfffffe005007f920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100040 td 0xfffffe005007b920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100039 td 0xfffffe005007d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100038 td 0xfffffe005007d490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100037 td 0xfffffe005007d920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100036 td 0xfffffe005007e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100035 td 0xfffffe005007a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100034 td 0xfffffe005007a490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100033 td 0xfffffe005007a920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100032 td 0xfffffe005007b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100031 td 0xfffffe005007b490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100030 td 0xfffffe0050050490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100029 td 0xfffffe0050050920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100028 td 0xfffffe0050051000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100027 td 0xfffffe0050051490 sched_switch() at sched_switch+0x482/frame 0xffffff80003a69f0 mi_switch() at mi_switch+0x179/frame 0xffffff80003a6a30 ithread_loop() at ithread_loop+0x1d2/frame 0xffffff80003a6a70 fork_exit() at fork_exit+0x84/frame 0xffffff80003a6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80003a6ab0 --- trap 0, rip = 0, rsp = 0xffffff80003a6b70, rbp = 0 --- Tracing command idle pid 11 tid 100026 td 0xfffffe0050051920 sched_switch() at sched_switch+0x482/frame 0xffffff80003a1980 mi_switch() at mi_switch+0x179/frame 0xffffff80003a19c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff80003a1a70 fork_exit() at fork_exit+0x84/frame 0xffffff80003a1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80003a1ab0 --- trap 0, rip = 0, rsp = 0xffffff80003a1b70, rbp = 0 --- Tracing command idle pid 11 tid 100025 td 0xfffffe005004e920 sched_switch() at sched_switch+0x482/frame 0xffffff800039c980 mi_switch() at mi_switch+0x179/frame 0xffffff800039c9c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff800039ca70 fork_exit() at fork_exit+0x84/frame 0xffffff800039cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800039cab0 --- trap 0, rip = 0, rsp = 0xffffff800039cb70, rbp = 0 --- Tracing command idle pid 11 tid 100024 td 0xfffffe005004f000 sched_switch() at sched_switch+0x482/frame 0xffffff8000397980 mi_switch() at mi_switch+0x179/frame 0xffffff80003979c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff8000397a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000397ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000397ab0 --- trap 0, rip = 0, rsp = 0xffffff8000397b70, rbp = 0 --- Tracing command idle pid 11 tid 100023 td 0xfffffe005004f490 sched_switch() at sched_switch+0x482/frame 0xffffff8000392980 mi_switch() at mi_switch+0x179/frame 0xffffff80003929c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff8000392a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000392ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000392ab0 --- trap 0, rip = 0, rsp = 0xffffff8000392b70, rbp = 0 --- Tracing command idle pid 11 tid 100022 td 0xfffffe005004f920 sched_switch() at sched_switch+0x482/frame 0xffffff800038d980 mi_switch() at mi_switch+0x179/frame 0xffffff800038d9c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff800038da70 fork_exit() at fork_exit+0x84/frame 0xffffff800038dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800038dab0 --- trap 0, rip = 0, rsp = 0xffffff800038db70, rbp = 0 --- Tracing command idle pid 11 tid 100021 td 0xfffffe0050050000 sched_switch() at sched_switch+0x482/frame 0xffffff8000388980 mi_switch() at mi_switch+0x179/frame 0xffffff80003889c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff8000388a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000388ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000388ab0 --- trap 0, rip = 0, rsp = 0xffffff8000388b70, rbp = 0 --- Tracing command idle pid 11 tid 100020 td 0xfffffe005004d000 sched_switch() at sched_switch+0x482/frame 0xffffff8000383980 mi_switch() at mi_switch+0x179/frame 0xffffff80003839c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff8000383a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000383ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000383ab0 --- trap 0, rip = 0, rsp = 0xffffff8000383b70, rbp = 0 --- Tracing command idle pid 11 tid 100019 td 0xfffffe005004d490 sched_switch() at sched_switch+0x482/frame 0xffffff800037e980 mi_switch() at mi_switch+0x179/frame 0xffffff800037e9c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff800037ea70 fork_exit() at fork_exit+0x84/frame 0xffffff800037eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800037eab0 --- trap 0, rip = 0, rsp = 0xffffff800037eb70, rbp = 0 --- Tracing command idle pid 11 tid 100018 td 0xfffffe005004d920 sched_switch() at sched_switch+0x482/frame 0xffffff8000379980 mi_switch() at mi_switch+0x179/frame 0xffffff80003799c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff8000379a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000379ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000379ab0 --- trap 0, rip = 0, rsp = 0xffffff8000379b70, rbp = 0 --- Tracing command idle pid 11 tid 100017 td 0xfffffe005004e000 sched_switch() at sched_switch+0x482/frame 0xffffff8000374980 mi_switch() at mi_switch+0x179/frame 0xffffff80003749c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff8000374a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000374ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000374ab0 --- trap 0, rip = 0, rsp = 0xffffff8000374b70, rbp = 0 --- Tracing command idle pid 11 tid 100016 td 0xfffffe005004e490 sched_switch() at sched_switch+0x482/frame 0xffffff800036f980 mi_switch() at mi_switch+0x179/frame 0xffffff800036f9c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff800036fa70 fork_exit() at fork_exit+0x84/frame 0xffffff800036fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800036fab0 --- trap 0, rip = 0, rsp = 0xffffff800036fb70, rbp = 0 --- Tracing command idle pid 11 tid 100015 td 0xfffffe005004b490 sched_switch() at sched_switch+0x482/frame 0xffffff800036a980 mi_switch() at mi_switch+0x179/frame 0xffffff800036a9c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff800036aa70 fork_exit() at fork_exit+0x84/frame 0xffffff800036aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800036aab0 --- trap 0, rip = 0, rsp = 0xffffff800036ab70, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe005004b920 sched_switch() at sched_switch+0x482/frame 0xffffff8000365980 mi_switch() at mi_switch+0x179/frame 0xffffff80003659c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff8000365a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000365ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000365ab0 --- trap 0, rip = 0, rsp = 0xffffff8000365b70, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe005004c000 sched_switch() at sched_switch+0x482/frame 0xffffff8000360980 mi_switch() at mi_switch+0x179/frame 0xffffff80003609c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff8000360a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000360ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000360ab0 --- trap 0, rip = 0, rsp = 0xffffff8000360b70, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe005004c490 sched_switch() at sched_switch+0x482/frame 0xffffff800035b980 mi_switch() at mi_switch+0x179/frame 0xffffff800035b9c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff800035ba70 fork_exit() at fork_exit+0x84/frame 0xffffff800035bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800035bab0 --- trap 0, rip = 0, rsp = 0xffffff800035bb70, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe005004c920 sched_switch() at sched_switch+0x482/frame 0xffffff8000356980 mi_switch() at mi_switch+0x179/frame 0xffffff80003569c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff8000356a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000356ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000356ab0 --- trap 0, rip = 0, rsp = 0xffffff8000356b70, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe005003b920 sched_switch() at sched_switch+0x482/frame 0xffffff8000351980 mi_switch() at mi_switch+0x179/frame 0xffffff80003519c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff8000351a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000351ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000351ab0 --- trap 0, rip = 0, rsp = 0xffffff8000351b70, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe005004a000 sched_switch() at sched_switch+0x482/frame 0xffffff800034c980 mi_switch() at mi_switch+0x179/frame 0xffffff800034c9c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff800034ca70 fork_exit() at fork_exit+0x84/frame 0xffffff800034cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800034cab0 --- trap 0, rip = 0, rsp = 0xffffff800034cb70, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe005004a490 sched_switch() at sched_switch+0x482/frame 0xffffff8000347980 mi_switch() at mi_switch+0x179/frame 0xffffff80003479c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff8000347a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000347ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000347ab0 --- trap 0, rip = 0, rsp = 0xffffff8000347b70, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe005004a920 sched_switch() at sched_switch+0x482/frame 0xffffff8000342980 mi_switch() at mi_switch+0x179/frame 0xffffff80003429c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff8000342a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000342ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000342ab0 --- trap 0, rip = 0, rsp = 0xffffff8000342b70, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe005004b000 sched_switch() at sched_switch+0x482/frame 0xffffff800033d980 mi_switch() at mi_switch+0x179/frame 0xffffff800033d9c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff800033da70 fork_exit() at fork_exit+0x84/frame 0xffffff800033dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800033dab0 --- trap 0, rip = 0, rsp = 0xffffff800033db70, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe0050035000 sched_switch() at sched_switch+0x482/frame 0xffffff8000338980 mi_switch() at mi_switch+0x179/frame 0xffffff80003389c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff8000338a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000338ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000338ab0 --- trap 0, rip = 0, rsp = 0xffffff8000338b70, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe0050035490 sched_switch() at sched_switch+0x482/frame 0xffffff8000333980 mi_switch() at mi_switch+0x179/frame 0xffffff80003339c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff8000333a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000333ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000333ab0 --- trap 0, rip = 0, rsp = 0xffffff8000333b70, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe0050035920 sched_switch() at sched_switch+0x482/frame 0xffffff800032e980 mi_switch() at mi_switch+0x179/frame 0xffffff800032e9c0 sched_idletd() at sched_idletd+0x3dd/frame 0xffffff800032ea70 fork_exit() at fork_exit+0x84/frame 0xffffff800032eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800032eab0 --- trap 0, rip = 0, rsp = 0xffffff800032eb70, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe005003b000 sched_switch() at sched_switch+0x482/frame 0xffffff8000329560 mi_switch() at mi_switch+0x179/frame 0xffffff80003295a0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff80003295e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xffffff8000329650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xffffff8000329680 _sleep() at _sleep+0x320/frame 0xffffff8000329710 kern_wait6() at kern_wait6+0x3e7/frame 0xffffff80003297b0 sys_wait4() at sys_wait4+0x76/frame 0xffffff80003299a0 amd64_syscall() at amd64_syscall+0x282/frame 0xffffff8000329ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff8000329ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x4131fa, rsp = 0x7fffffffd758, rbp = 0x7fffffffd7c0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe005003b490 sched_switch() at sched_switch+0x482/frame 0xffffff80003248f0 mi_switch() at mi_switch+0x179/frame 0xffffff8000324930 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff8000324970 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff80003249a0 _cv_wait() at _cv_wait+0x1df/frame 0xffffff8000324a10 audit_worker() at audit_worker+0xa3/frame 0xffffff8000324a70 fork_exit() at fork_exit+0x84/frame 0xffffff8000324ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000324ab0 --- trap 0, rip = 0, rsp = 0xffffff8000324b70, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffffe005179b490 sched_switch() at sched_switch+0x482/frame 0xffffff881da76890 mi_switch() at mi_switch+0x179/frame 0xffffff881da768d0 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881da76910 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffff881da76940 _sleep() at _sleep+0x312/frame 0xffffff881da769d0 pause_sbt() at pause_sbt+0x70/frame 0xffffff881da76a20 deadlkres() at deadlkres+0x66/frame 0xffffff881da76a70 fork_exit() at fork_exit+0x84/frame 0xffffff881da76ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881da76ab0 --- trap 0, rip = 0, rsp = 0xffffff881da76b70, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffffe005179b920 sched_switch() at sched_switch+0x482/frame 0xffffff881da71900 mi_switch() at mi_switch+0x179/frame 0xffffff881da71940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881da71980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881da719b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff881da71a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff881da71a70 fork_exit() at fork_exit+0x84/frame 0xffffff881da71ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881da71ab0 --- trap 0, rip = 0, rsp = 0xffffff881da71b70, rbp = 0 --- Tracing command kernel pid 0 tid 100108 td 0xfffffe0051697920 sched_switch() at sched_switch+0x482/frame 0xffffff881b7fd900 mi_switch() at mi_switch+0x179/frame 0xffffff881b7fd940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b7fd980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b7fd9b0 _sleep() at _sleep+0x33d/frame 0xffffff881b7fda40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881b7fda70 fork_exit() at fork_exit+0x84/frame 0xffffff881b7fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b7fdab0 --- trap 0, rip = 0, rsp = 0xffffff881b7fdb70, rbp = 0 --- Tracing command kernel pid 0 tid 100106 td 0xfffffe0051698490 sched_switch() at sched_switch+0x482/frame 0xffffff881b7f3900 mi_switch() at mi_switch+0x179/frame 0xffffff881b7f3940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b7f3980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b7f39b0 _sleep() at _sleep+0x33d/frame 0xffffff881b7f3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881b7f3a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b7f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b7f3ab0 --- trap 0, rip = 0, rsp = 0xffffff881b7f3b70, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffffe0051691920 sched_switch() at sched_switch+0x482/frame 0xffffff881b7e9900 mi_switch() at mi_switch+0x179/frame 0xffffff881b7e9940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b7e9980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b7e99b0 _sleep() at _sleep+0x33d/frame 0xffffff881b7e9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881b7e9a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b7e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b7e9ab0 --- trap 0, rip = 0, rsp = 0xffffff881b7e9b70, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffffe0051696490 sched_switch() at sched_switch+0x482/frame 0xffffff881b7df900 mi_switch() at mi_switch+0x179/frame 0xffffff881b7df940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b7df980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b7df9b0 _sleep() at _sleep+0x33d/frame 0xffffff881b7dfa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881b7dfa70 fork_exit() at fork_exit+0x84/frame 0xffffff881b7dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b7dfab0 --- trap 0, rip = 0, rsp = 0xffffff881b7dfb70, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffffe0051679920 sched_switch() at sched_switch+0x482/frame 0xffffff881b7d5900 mi_switch() at mi_switch+0x179/frame 0xffffff881b7d5940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b7d5980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b7d59b0 _sleep() at _sleep+0x33d/frame 0xffffff881b7d5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881b7d5a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b7d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b7d5ab0 --- trap 0, rip = 0, rsp = 0xffffff881b7d5b70, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffffe0051690490 sched_switch() at sched_switch+0x482/frame 0xffffff881b7cb900 mi_switch() at mi_switch+0x179/frame 0xffffff881b7cb940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b7cb980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b7cb9b0 _sleep() at _sleep+0x33d/frame 0xffffff881b7cba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881b7cba70 fork_exit() at fork_exit+0x84/frame 0xffffff881b7cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b7cbab0 --- trap 0, rip = 0, rsp = 0xffffff881b7cbb70, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffffe0051691000 sched_switch() at sched_switch+0x482/frame 0xffffff881b7c1900 mi_switch() at mi_switch+0x179/frame 0xffffff881b7c1940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b7c1980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b7c19b0 _sleep() at _sleep+0x33d/frame 0xffffff881b7c1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881b7c1a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b7c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b7c1ab0 --- trap 0, rip = 0, rsp = 0xffffff881b7c1b70, rbp = 0 --- Tracing command kernel pid 0 tid 100094 td 0xfffffe0051674490 sched_switch() at sched_switch+0x482/frame 0xffffff881b7b7900 mi_switch() at mi_switch+0x179/frame 0xffffff881b7b7940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b7b7980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b7b79b0 _sleep() at _sleep+0x33d/frame 0xffffff881b7b7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881b7b7a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b7b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b7b7ab0 --- trap 0, rip = 0, rsp = 0xffffff881b7b7b70, rbp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xfffffe0051679490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff8000301ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff8000301d00 trap() at trap+0x42/frame 0xffffff8000301f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000301f20 --- trap 0x13, rip = 0xffffffff808d1195, rsp = 0xffffff8000301fe0, rbp = 0xffffff881b7687f0 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x2a5/frame 0xffffff881b7687f0 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881b768830 uma_dbg_getslab() at uma_dbg_getslab+0x67/frame 0xffffff881b768860 uma_dbg_free() at uma_dbg_free+0x33/frame 0xffffff881b768880 uma_zfree_arg() at uma_zfree_arg+0x42/frame 0xffffff881b7688e0 m_freem() at m_freem+0x18/frame 0xffffff881b768900 igb_txeof() at igb_txeof+0x25f/frame 0xffffff881b768960 igb_mq_start_locked() at igb_mq_start_locked+0x2ce/frame 0xffffff881b7689b0 igb_deferred_mq_start() at igb_deferred_mq_start+0x7e/frame 0xffffff881b7689f0 taskqueue_run_locked() at taskqueue_run_locked+0xf0/frame 0xffffff881b768a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x9b/frame 0xffffff881b768a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b768ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b768ab0 --- trap 0, rip = 0, rsp = 0xffffff881b768b70, rbp = 0 --- Tracing command kernel pid 0 tid 100089 td 0xfffffe0051672920 sched_switch() at sched_switch+0x482/frame 0xffffff881b75e900 mi_switch() at mi_switch+0x179/frame 0xffffff881b75e940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b75e980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b75e9b0 _sleep() at _sleep+0x33d/frame 0xffffff881b75ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881b75ea70 fork_exit() at fork_exit+0x84/frame 0xffffff881b75eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b75eab0 --- trap 0, rip = 0, rsp = 0xffffff881b75eb70, rbp = 0 --- Tracing command kernel pid 0 tid 100087 td 0xfffffe0051673490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff8000308ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff8000308d00 trap() at trap+0x42/frame 0xffffff8000308f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff8000308f20 --- trap 0x13, rip = 0xffffffff808d1192, rsp = 0xffffff8000308fe0, rbp = 0xffffff881b7547f0 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x2a2/frame 0xffffff881b7547f0 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881b754830 uma_dbg_getslab() at uma_dbg_getslab+0x67/frame 0xffffff881b754860 uma_dbg_free() at uma_dbg_free+0x33/frame 0xffffff881b754880 uma_zfree_arg() at uma_zfree_arg+0x42/frame 0xffffff881b7548e0 m_freem() at m_freem+0x18/frame 0xffffff881b754900 igb_txeof() at igb_txeof+0x25f/frame 0xffffff881b754960 igb_mq_start_locked() at igb_mq_start_locked+0x2ce/frame 0xffffff881b7549b0 igb_deferred_mq_start() at igb_deferred_mq_start+0x7e/frame 0xffffff881b7549f0 taskqueue_run_locked() at taskqueue_run_locked+0xf0/frame 0xffffff881b754a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x9b/frame 0xffffff881b754a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b754ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b754ab0 --- trap 0, rip = 0, rsp = 0xffffff881b754b70, rbp = 0 --- Tracing command kernel pid 0 tid 100085 td 0xfffffe0051670920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff800031dce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff800031dd00 trap() at trap+0x42/frame 0xffffff800031df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff800031df20 --- trap 0x13, rip = 0xffffffff808d1195, rsp = 0xffffff800031dfe0, rbp = 0xffffff881b74a290 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x2a5/frame 0xffffff881b74a290 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881b74a2d0 zone_fetch_slab() at zone_fetch_slab+0x44/frame 0xffffff881b74a300 zone_import() at zone_import+0x42/frame 0xffffff881b74a370 zone_alloc_item() at zone_alloc_item+0x38/frame 0xffffff881b74a3b0 uma_zalloc_arg() at uma_zalloc_arg+0x5d7/frame 0xffffff881b74a420 m_pullup() at m_pullup+0x8a/frame 0xffffff881b74a470 igb_xmit() at igb_xmit+0x348/frame 0xffffff881b74a960 igb_mq_start_locked() at igb_mq_start_locked+0xc4/frame 0xffffff881b74a9b0 igb_deferred_mq_start() at igb_deferred_mq_start+0x7e/frame 0xffffff881b74a9f0 taskqueue_run_locked() at taskqueue_run_locked+0xf0/frame 0xffffff881b74aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0x9b/frame 0xffffff881b74aa70 fork_exit() at fork_exit+0x84/frame 0xffffff881b74aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b74aab0 --- trap 0, rip = 0, rsp = 0xffffff881b74ab70, rbp = 0 --- Tracing command kernel pid 0 tid 100083 td 0xfffffe0051671490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002d7ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002d7d00 trap() at trap+0x42/frame 0xffffff80002d7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002d7f20 --- trap 0x13, rip = 0xffffffff808d11bf, rsp = 0xffffff80002d7fe0, rbp = 0xffffff881b740310 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x2cf/frame 0xffffff881b740310 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881b740350 uma_dbg_getslab() at uma_dbg_getslab+0x67/frame 0xffffff881b740380 uma_dbg_alloc() at uma_dbg_alloc+0x36/frame 0xffffff881b7403b0 uma_zalloc_arg() at uma_zalloc_arg+0x549/frame 0xffffff881b740420 m_pullup() at m_pullup+0x8a/frame 0xffffff881b740470 igb_xmit() at igb_xmit+0x5d7/frame 0xffffff881b740960 igb_mq_start_locked() at igb_mq_start_locked+0xc4/frame 0xffffff881b7409b0 igb_deferred_mq_start() at igb_deferred_mq_start+0x7e/frame 0xffffff881b7409f0 taskqueue_run_locked() at taskqueue_run_locked+0xf0/frame 0xffffff881b740a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x9b/frame 0xffffff881b740a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b740ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b740ab0 --- trap 0, rip = 0, rsp = 0xffffff881b740b70, rbp = 0 --- Tracing command kernel pid 0 tid 100081 td 0xfffffe0051672000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff80002e5ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff80002e5d00 trap() at trap+0x42/frame 0xffffff80002e5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff80002e5f20 --- trap 0x13, rip = 0xffffffff808d1199, rsp = 0xffffff80002e5fe0, rbp = 0xffffff881b736310 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x2a9/frame 0xffffff881b736310 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881b736350 uma_dbg_getslab() at uma_dbg_getslab+0x67/frame 0xffffff881b736380 uma_dbg_alloc() at uma_dbg_alloc+0x36/frame 0xffffff881b7363b0 uma_zalloc_arg() at uma_zalloc_arg+0x549/frame 0xffffff881b736420 m_pullup() at m_pullup+0x8a/frame 0xffffff881b736470 igb_xmit() at igb_xmit+0x283/frame 0xffffff881b736960 igb_mq_start_locked() at igb_mq_start_locked+0xc4/frame 0xffffff881b7369b0 igb_deferred_mq_start() at igb_deferred_mq_start+0x7e/frame 0xffffff881b7369f0 taskqueue_run_locked() at taskqueue_run_locked+0xf0/frame 0xffffff881b736a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x9b/frame 0xffffff881b736a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b736ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b736ab0 --- trap 0, rip = 0, rsp = 0xffffff881b736b70, rbp = 0 --- Tracing command kernel pid 0 tid 100079 td 0xfffffe005166f490 cpustop_handler() at cpustop_handler+0x28/frame 0xffffff800030fce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffff800030fd00 trap() at trap+0x42/frame 0xffffff800030ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff800030ff20 --- trap 0x13, rip = 0xffffffff808d1195, rsp = 0xffffff800030ffe0, rbp = 0xffffff881b72c7f0 --- __mtx_lock_sleep() at __mtx_lock_sleep+0x2a5/frame 0xffffff881b72c7f0 __mtx_lock_flags() at __mtx_lock_flags+0xda/frame 0xffffff881b72c830 uma_dbg_getslab() at uma_dbg_getslab+0x67/frame 0xffffff881b72c860 uma_dbg_free() at uma_dbg_free+0x33/frame 0xffffff881b72c880 uma_zfree_arg() at uma_zfree_arg+0x42/frame 0xffffff881b72c8e0 m_freem() at m_freem+0x45/frame 0xffffff881b72c900 igb_txeof() at igb_txeof+0x25f/frame 0xffffff881b72c960 igb_mq_start_locked() at igb_mq_start_locked+0x2ce/frame 0xffffff881b72c9b0 igb_deferred_mq_start() at igb_deferred_mq_start+0x7e/frame 0xffffff881b72c9f0 taskqueue_run_locked() at taskqueue_run_locked+0xf0/frame 0xffffff881b72ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0x9b/frame 0xffffff881b72ca70 fork_exit() at fork_exit+0x84/frame 0xffffff881b72cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b72cab0 --- trap 0, rip = 0, rsp = 0xffffff881b72cb70, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffffe0051670000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff815b1a60 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffffff815b1a80 trap() at trap+0x42/frame 0xffffffff815b1ca0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff815b1ca0 --- trap 0x13, rip = 0xffffffff80928c00, rsp = 0xffffffff815b1d60, rbp = 0xffffff881b7229b0 --- sleepq_wait() at sleepq_wait+0x20/frame 0xffffff881b7229b0 _sleep() at _sleep+0x33d/frame 0xffffff881b722a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881b722a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b722ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b722ab0 --- trap 0, rip = 0, rsp = 0xffffff881b722b70, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe0050224920 sched_switch() at sched_switch+0x482/frame 0xffffff881b419900 mi_switch() at mi_switch+0x179/frame 0xffffff881b419940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b419980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b4199b0 _sleep() at _sleep+0x33d/frame 0xffffff881b419a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881b419a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b419ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b419ab0 --- trap 0, rip = 0, rsp = 0xffffff881b419b70, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe0050225000 sched_switch() at sched_switch+0x482/frame 0xffffff881b414900 mi_switch() at mi_switch+0x179/frame 0xffffff881b414940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b414980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b4149b0 _sleep() at _sleep+0x33d/frame 0xffffff881b414a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881b414a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b414ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b414ab0 --- trap 0, rip = 0, rsp = 0xffffff881b414b70, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffffe0050219000 sched_switch() at sched_switch+0x482/frame 0xffffff881b400900 mi_switch() at mi_switch+0x179/frame 0xffffff881b400940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b400980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b4009b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff881b400a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff881b400a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b400ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b400ab0 --- trap 0, rip = 0, rsp = 0xffffff881b400b70, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe0050219490 sched_switch() at sched_switch+0x482/frame 0xffffff881b3fb900 mi_switch() at mi_switch+0x179/frame 0xffffff881b3fb940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b3fb980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b3fb9b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff881b3fba40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff881b3fba70 fork_exit() at fork_exit+0x84/frame 0xffffff881b3fbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b3fbab0 --- trap 0, rip = 0, rsp = 0xffffff881b3fbb70, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffffe0050083490 sched_switch() at sched_switch+0x482/frame 0xffffff881b3f6900 mi_switch() at mi_switch+0x179/frame 0xffffff881b3f6940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b3f6980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b3f69b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xffffff881b3f6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xffffff881b3f6a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b3f6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b3f6ab0 --- trap 0, rip = 0, rsp = 0xffffff881b3f6b70, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffffe0050083920 sched_switch() at sched_switch+0x482/frame 0xffffff881b3f1900 mi_switch() at mi_switch+0x179/frame 0xffffff881b3f1940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b3f1980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b3f19b0 _sleep() at _sleep+0x33d/frame 0xffffff881b3f1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881b3f1a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b3f1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b3f1ab0 --- trap 0, rip = 0, rsp = 0xffffff881b3f1b70, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffffe0050091920 sched_switch() at sched_switch+0x482/frame 0xffffff881b3e2900 mi_switch() at mi_switch+0x179/frame 0xffffff881b3e2940 sleepq_switch() at sleepq_switch+0x185/frame 0xffffff881b3e2980 sleepq_wait() at sleepq_wait+0x43/frame 0xffffff881b3e29b0 _sleep() at _sleep+0x33d/frame 0xffffff881b3e2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xffffff881b3e2a70 fork_exit() at fork_exit+0x84/frame 0xffffff881b3e2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff881b3e2ab0 --- trap 0, rip = 0, rsp = 0xffffff881b3e2b70, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81601f80 sched_switch() at sched_switch+0x482/frame 0xffffffff819529e0 mi_switch() at mi_switch+0x179/frame 0xffffffff81952a20 sleepq_switch() at sleepq_switch+0x185/frame 0xffffffff81952a60 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffffff81952a90 _sleep() at _sleep+0x312/frame 0xffffffff81952b20 swapper() at swapper+0x211/frame 0xffffffff81952b70 btext() at btext+0x2c db:0:allt> call doadump Dumping 2430 out of 31644 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 12 (kgdb) bt #0 doadump (textdump=0xd) at pcpu.h:236 #1 0xffffffff8033bd95 in db_fncall (dummy1=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:578 #2 0xffffffff8033ba7d in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #3 0xffffffff8033fcdf in db_script_exec (scriptname=0xffffffff815fd400 "doadump", warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xffffffff8033ba7d in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #5 0xffffffff8033b7f4 in db_command_loop () at ../../../ddb/db_command.c:502 #6 0xffffffff8033e1a0 in db_trap (type=, code=0x0) at ../../../ddb/db_main.c:231 #7 0xffffffff8091c853 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:654 #8 0xffffffff80cd52db in trap (frame=0xffffff881e15f3c0) at ../../../amd64/amd64/trap.c:579 #9 0xffffffff80cbe1f2 in calltrap () at ../../../amd64/amd64/exception.S:232 #10 0xffffffff8091c02e in kdb_enter (why=0xffffffff80f9bf9b "panic", msg=) at cpufunc.h:63 #11 0xffffffff808e5d66 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:747 #12 0xffffffff808e5dd3 in panic (fmt=) at ../../../kern/kern_shutdown.c:683 #13 0xffffffff805048bf in buf_ring_enqueue (br=0xffffff8000eef000, buf=0xfffffe01a8db2e00) at buf_ring.h:74 #14 0xffffffff8050482b in drbr_enqueue (ifp=0xfffffe005165c000, br=0xffffff8000eef000, m=0xfffffe01a8db2e00) at if_var.h:622 #15 0xffffffff8050419b in igb_mq_start (ifp=0xfffffe005165c000, m=0xfffffe01a8db2e00) at ../../../dev/e1000/if_igb.c:974 #16 0xffffffff809aef76 in ether_output (ifp=0xfffffe005165c000, m=0xfffffe01a8db2e00, dst=0xffffff881e15f704, ro=) at ../../../net/if_ethersubr.c:437 #17 0xffffffff80a20687 in ip_output (m=0xfffffe019c6b2200, opt=, flags=, imo=0x0, inp=) at ../../../netinet/ip_output.c:659 #18 0xffffffff80a95b9b in udp_send (so=, flags=, m=, addr=0x0, control=, td=) at ../../../netinet/udp_usrreq.c:1246 #19 0xffffffff8095f4db in sosend_dgram (so=0xfffffe009966d2a8, addr=0x0, uio=, top=, control=0x0, flags=, td=) at ../../../kern/uipc_socket.c:1221 #20 0xffffffff80942eb9 in soo_write (fp=, uio=0xffffff881e15f970, active_cred=, flags=, td=) at ../../../kern/sys_socket.c:102 #21 0xffffffff8093b815 in dofilewrite (td=0xfffffe03412d9000, fd=0x3, fp=0xfffffe0057a62b90, auio=0xffffff881e15f970, offset=, flags=0x0) at file.h:290 #22 0xffffffff8093b538 in kern_writev (td=0xfffffe03412d9000, fd=0x3, auio=0xffffff881e15f970) at ../../../kern/sys_generic.c:460 #23 0xffffffff8093b4e3 in sys_write (td=, uap=) at ../../../kern/sys_generic.c:376 #24 0xffffffff80cd5f42 in amd64_syscall (td=0xfffffe03412d9000, traced=0x0) at subr_syscall.c:134 #25 0xffffffff80cbe4db in Xfast_syscall () at ../../../amd64/amd64/exception.S:391 #26 0x0000000800b562ba in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 13 #13 0xffffffff805048bf in buf_ring_enqueue (br=0xffffff8000eef000, buf=0xfffffe01a8db2e00) at buf_ring.h:74 74 panic("buf=%p already enqueue at %d prod=%d cons=%d", (kgdb) l 69 #ifdef DEBUG_BUFRING 70 int i; 71 for (i = br->br_cons_head; i != br->br_prod_head; 72 i = ((i + 1) & br->br_cons_mask)) 73 if(br->br_ring[i] == buf) 74 panic("buf=%p already enqueue at %d prod=%d cons=%d", 75 buf, i, br->br_prod_tail, br->br_cons_tail); 76 #endif 77 critical_enter(); 78 do { (kgdb) info loc prod_head = 0x0 prod_next = 0xe cons_tail = 0x0 i = 0xf53 (kgdb) p *br $1 = {br_prod_head = 0xf52, br_prod_tail = 0xf52, br_prod_size = 0x1000, br_prod_mask = 0xfff, br_drops = 0x320db8, br_cons_head = 0xf53, br_cons_tail = 0xf53, br_cons_size = 0x1000, br_cons_mask = 0xfff, br_lock = 0xfffffe005164a3d0, br_ring = 0xffffff8000eef100} (kgdb) f 14 #14 0xffffffff8050482b in drbr_enqueue (ifp=0xfffffe005165c000, br=0xffffff8000eef000, m=0xfffffe01a8db2e00) at if_var.h:622 622 error = buf_ring_enqueue(br, m); (kgdb) l 617 if (ALTQ_IS_ENABLED(&ifp->if_snd)) { 618 IFQ_ENQUEUE(&ifp->if_snd, m, error); 619 return (error); 620 } 621 #endif 622 error = buf_ring_enqueue(br, m); 623 if (error) 624 m_freem(m); 625 626 return (error); (kgdb) info loc error = 0x0 (kgdb) f 15 #15 0xffffffff8050419b in igb_mq_start (ifp=0xfffffe005165c000, m=0xfffffe01a8db2e00) at ../../../dev/e1000/if_igb.c:974 974 err = drbr_enqueue(ifp, txr->br, m); (kgdb) l 969 else 970 i = curcpu % adapter->num_queues; 971 txr = &adapter->tx_rings[i]; 972 que = &adapter->queues[i]; 973 974 err = drbr_enqueue(ifp, txr->br, m); 975 taskqueue_enqueue(que->tq, &txr->txq_task); 976 977 return (err); 978 } (kgdb) p *ifp $2 = {if_softc = 0xffffff8000eaa000, if_l2com = 0xfffffe0050fbf480, if_vnet = 0x0, if_link = {tqe_next = 0xfffffe005165b800, tqe_prev = 0xffffffff8160c538}, if_xname = "igb0", '\0' , if_dname = 0xfffffe004aaec7d8 "igb", if_dunit = 0x0, if_refcount = 0x1, if_addrhead = { tqh_first = 0xfffffe0051661000, tqh_last = 0xfffffe00681064c0}, if_pcount = 0x0, if_carp = 0x0, if_bpf = 0xfffffe0051625100, if_index = 0x1, if_index_reserved = 0x0, if_vlantrunk = 0x0, if_flags = 0x8803, if_capabilities = 0x505bb, if_capenable = 0x401bb, if_linkmib = 0x0, if_linkmiblen = 0x0, if_data = {ifi_type = 0x6, ifi_physical = 0x0, ifi_addrlen = 0x6, ifi_hdrlen = 0x12, ifi_link_state = 0x2, ifi_vhid = 0x0, ifi_baudrate_pf = 0x0, ifi_datalen = 0x98, ifi_mtu = 0x5dc, ifi_metric = 0x0, ifi_baudrate = 0x5f5e100, ifi_ipackets = 0xe87a, ifi_ierrors = 0x0, ifi_opackets = 0x7db702, ifi_oerrors = 0x0, ifi_collisions = 0x0, ifi_ibytes = 0x3fc529, ifi_obytes = 0xcd760c8b, ifi_imcasts = 0x2d6, ifi_omcasts = 0x0, ifi_iqdrops = 0x0, ifi_noproto = 0x0, ifi_hwassist = 0x26, ifi_epoch = 0x1, ifi_lastchange = {tv_sec = 0x51ffce45, tv_usec = 0x6251d}}, if_multiaddrs = { tqh_first = 0xfffffe0057124940, tqh_last = 0xfffffe0057c6a380}, if_amcount = 0x0, if_output = 0xffffffff809ae9c0 , if_input = 0xffffffff809af400 , if_start = 0, if_ioctl = 0xffffffff80503940 , if_init = 0xffffffff805038c0 , if_resolvemulti = 0xffffffff809af440 , if_qflush = 0xffffffff805041d0 , if_transmit = 0xffffffff805040c0 , if_reassign = 0, if_home_vnet = 0x0, if_addr = 0xfffffe0051661000, if_llsoftc = 0x0, if_drv_flags = 0x440, if_snd = {ifq_head = 0x0, ifq_tail = 0x0, ifq_len = 0x0, ifq_maxlen = 0x32, ifq_drops = 0x0, ifq_mtx = {lock_object = {lo_name = 0xfffffe005165c028 "igb0", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xffffff80006c3600}, mtx_lock = 0x4}, ifq_drv_head = 0x0, ifq_drv_tail = 0x0, ifq_drv_len = 0x0, ifq_drv_maxlen = 0x0, altq_type = 0x0, altq_flags = 0x0, altq_disc = 0x0, altq_ifp = 0xfffffe005165c000, altq_enqueue = 0, altq_dequeue = 0, altq_request = 0, altq_clfier = 0x0, altq_classify = 0, altq_tbr = 0x0, altq_cdnr = 0x0}, if_broadcastaddr = 0xffffffff80fb3170 "ÿÿÿÿÿÿ", if_bridge = 0x0, if_label = 0x0, if_unused = {0x0, 0x0}, if_afdata = {0x0, 0x0, 0xfffffe0051662dc0, 0x0 , 0xfffffe00500e3780, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}, if_afdata_initialized = 0x2, if_afdata_lock = {lock_object = {lo_name = 0xffffffff80fb24f6 "if_afdata", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xffffff80006c3580}, rw_lock = 0x1}, if_linktask = {ta_link = {stqe_next = 0x0}, ta_pending = 0x0, ta_priority = 0x0, ta_func = 0xffffffff809a70c0 , ta_context = 0xfffffe005165c000}, if_addr_lock = {lock_object = {lo_name = 0xffffffff80fa5373 "if_addr_lock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xffffff80006bab80}, rw_lock = 0x1}, if_clones = {le_next = 0x0, le_prev = 0x0}, if_groups = {tqh_first = 0xfffffe0051641ec0, tqh_last = 0xfffffe0051641ec8}, if_pf_kif = 0x0, if_lagg = 0x0, if_description = 0x0, if_fib = 0x0, if_alloctype = 0x6, if_hw_tsomax = 0xffff, if_cspare = "\000\000", if_ispare = {0x0, 0x0, 0x0, 0x0}, if_pspare = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}} (kgdb) p *txr $3 = {adapter = 0xffffff8000eaa000, me = 0x4, tx_mtx = {lock_object = {lo_name = 0xfffffe005164a3f0 "igb0:tx(4)", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xffffff80006c3300}, mtx_lock = 0xfffffe0051670920}, mtx_name = "igb0:tx(4)\000\000\000\000\000", txdma = {dma_paddr = 0x4fce9000, dma_vaddr = 0xffffff881b6e9000 "XFr\234\001", dma_tag = 0xfffffe0051626180, dma_map = 0xffffffff815c79c8, dma_seg = {ds_addr = 0x0, ds_len = 0x0}, dma_nseg = 0x0}, tx_base = 0xffffff881b6e9000, next_avail_desc = 0x349, next_to_clean = 0x34e, tx_avail = 0x5, tx_buffers = 0xffffff8000ee9000, br = 0xffffff8000eef000, txq_task = {ta_link = {stqe_next = 0x0}, ta_pending = 0x3, ta_priority = 0x0, ta_func = 0xffffffff80501810 , ta_context = 0xfffffe005164a3c0}, txtag = 0xfffffe0051626100, bytes = 0x0, packets = 0x0, queue_status = 0xb, watchdog_time = 0x665de, tdt = 0x0, tdh = 0x0, no_desc_avail = 0x1cd530, tx_packets = 0xfdf53} (kgdb) info loc adapter = (struct adapter *) 0xffffff8000eaa000 que = (struct igb_queue *) 0xfffffe00501b09a0 txr = (struct tx_ring *) 0xfffffe005164a3c0 i = 0x4 err = 0x0 (kgdb) $ svn diff -x -p /usr/src/sys -- Test scenario: export BLASTHOST=192.168.1.101 ./swap -t 2m -i 30 -h -v & ./udp -t 2m -i 50 -h -v