GENERIC HEAD from 2016-04-21 17:45:37 UTC, r298424M, vmcore.499 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2016 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-CURRENT #1 r298424M: Thu Apr 21 21:56:03 CEST 2016 pho@t1.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 3.8.0 (tags/RELEASE_380/final 262564) (based on LLVM 3.8.0) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. SRAT: Ignoring memory at addr 840000000 SRAT: No memory found for CPU 32 VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.24-MHz K8-class CPU) Origin="GenuineIntel" Id=0x206d7 Family=0x6 Model=0x2d Stepping=7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 32140410880 (30651 MB) : Trying to mount root from ufs:/dev/gpt/root [rw]... uhub1: 4 ports with 4 removable, self powered uhub0: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered Setting hostuuid: 3141f787-07e3-e111-b968-001e6756c168. Setting hostid: 0x564ac5b6. Starting ddb. Starting file system checks: ugen0.2: at usbus0 uhub3: on usbus0 ugen2.2: at usbus2 uhub4: on usbus2 /dev/gpt/root: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/gpt/root: clean, 53597823 free (657199 frags, 6617578 blocks, 0.7% fragmentation) /dev/ada0p2: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0p2: clean, 36227893 free (22549 frags, 4525668 blocks, 0.1% fragmentation) /dev/gpt/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/gpt/tmp: clean, 23362170 free (5954 frags, 2919527 blocks, 0.0% fragmentation) Mounting local file systems:. uhub3: 6 ports with 6 removable, self powered ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat /usr/local/lib/gcc48 /usr/local/lib/gcc49 /usr/local/lib/nss /usr/local/lib/qt4 /usr/local/lib/virtualbox /usr/local/llvm37/lib 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: t1.osted.lan. uhub4: 8 ports with 8 removable, self powered Setting up harvesting:[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy:. ugen2.3: at usbus2 uhub5: on usbus2 uhub5: MTT enabled uhub5: 4 ports with 4 removable, self powered ugen2.4: at usbus2 ukbd0: on usbus2 kbd2 at ukbd0 Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo igb0: flags=8843 metric 0 mtu 1500 options=6403bb ether 00:1e:67:56:c1:68 inet 192.168.1.108 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::21e:67ff:fe56:c168%igb0 prefixlen 64 scopeid 0x1 nd6 options=23 media: Ethernet autoselect (1000baseT ) status: active igb1: flags=8c02 metric 0 mtu 1500 options=6403bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Starting devd. Starting Network: igb1. igb1: flags=8c02 metric 0 mtu 1500 options=6403bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Configuring vt: keymap. ums0: on usbus2 ums0: 3 buttons and [Z] coordinates ID=0 add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Starting rtsold. Creating and/or trimming log files. Starting syslogd. Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Starting casperd. lock order reversal: 1st 0xfffffe0785699848 bufwait (bufwait) @ kern/vfs_bio.c:3513 2nd 0xfffff80053cd6800 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:281 stack backtrace: #0 0xffffffff80a8e5b0 at witness_debugger+0x70 #1 0xffffffff80a8e4b1 at witness_checkorder+0xe71 #2 0xffffffff80a39c82 at _sx_xlock+0x72 #3 0xffffffff80ce379d at ufsdirhash_add+0x4d #4 0xffffffff80ce830f at ufs_direnter+0x62f #5 0xffffffff80cf094a at ufs_mkdir+0x8ba #6 0xffffffff80fe6f85 at VOP_MKDIR_APV+0x115 #7 0xffffffff80afa7cd at kern_mkdirat+0x1fd #8 0xffffffff80e921c6 at amd64_syscall+0x2f6 #9 0xffffffff80e7168b at Xfast_syscall+0xfb Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Starting saslauthd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backup. Starting inetd. Thu Apr 21 22:00 FreeBSD/amd64 (t1.osted.lan) (ttyu1) login: Apr 21 22:00:55 t1 su: pho to root on /dev/pts/1 20160421 22:01:18 all (1/1): uma_zalloc_arg.sh 20160421 22:02:18 all (1/1): uma_zalloc_arg.sh 20160421 22:03:18 all (1/1): uma_zalloc_arg.sh 20160421 22:04:19 all (1/1): uma_zalloc_arg.sh 20160421 22:05:20 all (1/1): uma_zalloc_arg.sh 20160421 22:06:20 all (1/1): uma_zalloc_arg.sh 20160421 22:07:22 all (1/1): uma_zalloc_arg.sh 20160421 22:08:24 all (1/1): uma_zalloc_arg.sh 20160421 22:09:24 all (1/1): uma_zalloc_arg.sh 20160421 22:10:24 all (1/1): uma_zalloc_arg.sh 20160421 22:11:25 all (1/1): uma_zalloc_arg.sh 20160421 22:12:25 all (1/1): uma_zalloc_arg.sh 20160421 22:13:27 all (1/1): uma_zalloc_arg.sh 20160421 22:14:28 all (1/1): uma_zalloc_arg.sh 20160421 22:15:30 all (1/1): uma_zalloc_arg.sh 20160421 22:16:32 all (1/1): uma_zalloc_arg.sh 20160421 22:17:33 all (1/1): uma_zalloc_arg.sh lock order reversal: 1st 0xfffff80036044490 filedesc structure (filedesc structure) @ kern/kern_descrip.c:836 2nd 0xfffff80053bb9c98 ufs (ufs) @ kern/vfs_subr.c:4829 stack backtrace: #0 0xffffffff80a8e5b0 at witness_debugger+0x70 #1 0xffffffff80a8e4b1 at witness_checkorder+0xe71 #2 0xffffffff80a0a8d7 at __lockmgr_args+0xd47 #3 0xffffffff80cde740 at ffs_lock+0xb0 #4 0xffffffff80fe7b80 at VOP_LOCK1_APV+0x100 #5 0xffffffff80afd3b2 at _vn_lock+0xc2 #6 0xffffffff809eb34e at knlist_remove_kq+0x7e #7 0xffffffff80af4088 at filt_vfsdetach+0x28 #8 0xffffffff809ebc27 at knote_fdclose+0xc7 #9 0xffffffff809dfa65 at closefp+0x65 #10 0xffffffff809de3d7 at kern_dup+0x617 #11 0xffffffff80e921c6 at amd64_syscall+0x2f6 #12 0xffffffff80e7168b at Xfast_syscall+0xfb Apr 21 23:13:29 t1 su: pho to root on /dev/pts/2 Stopping inetd. Waiting for PIDS: 1516. 90 second watchdog timeout expired. Shutdown terminated. Thu Apr 21 23:15:05 CEST 2016 Apr 21 23:15:35 t1 syslogd: exiting on signal 15 Apr 21 23:15:35 Apr 21 23:15:55 init: some processes would not die; ps axl advised Enter full pathname of shell or RETURN for /bin/sh: # ps auxwwl USER PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND UID PPID CPU PRI NI MWCHAN root 11 2397.3 0.0 0 384 - RL 22:00 1875:29.64 [idle] 0 0 0 155 0 - root 0 0.0 0.0 0 432 - DLs 22:00 0:00.27 [kernel] 0 0 0 -16 0 swapin root 1 0.0 0.0 5376 1420 - ILs 22:00 0:00.13 /sbin/init -- 0 0 0 20 0 wait root 2 0.0 0.0 0 16 - DL 22:00 0:00.00 [crypto] 0 0 0 -16 0 crypto_w root 3 0.0 0.0 0 16 - DL 22:00 0:00.00 [crypto returns] 0 0 0 -16 0 crypto_r root 4 0.0 0.0 0 96 - DL 22:00 0:27.77 [cam] 0 0 0 -16 0 - root 5 0.0 0.0 0 16 - DL 22:00 0:00.00 [sctp_iterator] 0 0 0 -16 0 waiting_ root 6 0.0 0.0 0 16 - DL 22:00 0:00.31 [rand_harvestq] 0 0 0 -16 0 - root 7 0.0 0.0 0 16 - DL 22:00 0:00.00 [soaiod1] 0 0 0 -16 0 - root 8 0.0 0.0 0 16 - DL 22:00 0:00.00 [soaiod2] 0 0 0 -16 0 - root 9 0.0 0.0 0 16 - DL 22:00 0:00.00 [soaiod3] 0 0 0 -16 0 - root 10 0.0 0.0 0 16 - DL 22:00 0:00.00 [audit] 0 0 0 -16 0 audit_wo root 12 0.0 0.0 0 896 - WL 22:00 0:10.71 [intr] 0 0 0 -60 0 - root 13 0.0 0.0 0 48 - DL 22:00 0:00.09 [geom] 0 0 0 -8 0 - root 14 0.0 0.0 0 240 - DL 22:00 0:01.64 [usb] 0 0 0 -68 0 - root 15 0.0 0.0 0 16 - DL 22:00 0:00.00 [soaiod4] 0 0 0 -16 0 - root 16 0.0 0.0 0 16 - DL 22:00 0:00.01 [enc_daemon0] 0 0 0 -16 0 idle root 17 0.0 0.0 0 32 - DL 22:00 0:00.48 [pagedaemon] 0 0 0 -16 0 psleep root 18 0.0 0.0 0 16 - DL 22:00 0:00.00 [vmdaemon] 0 0 0 -16 0 psleep root 19 0.0 0.0 0 16 - DL 22:00 0:00.00 [pagezero] 0 0 0 155 0 pgzero root 20 0.0 0.0 0 16 - DL 22:00 0:00.04 [bufspacedaemon] 0 0 0 -16 0 - root 21 0.0 0.0 0 64 - DL 22:00 0:00.86 [bufdaemon] 0 0 0 -16 0 psleep root 22 0.0 0.0 0 16 - DL 22:00 0:00.04 [vnlru] 0 0 0 -16 0 vlruwt root 23 0.0 0.0 0 16 - DL 22:00 0:00.68 [syncer] 0 0 0 16 0 syncer pho 3120 0.0 0.0 0 16 - DE 22:01 0:00.09 /bin/sh /home/ph 1001 1 0 20 0 objde1 pho 3522 0.0 0.0 0 0 - Z 22:01 0:00.00 1001 3120 0 20 0 - pho 3523 0.0 0.0 13172 3024 - D 22:01 0:00.00 /bin/sh /home/ph 1001 1 0 20 0 vmpfw root 30749 0.0 0.0 13144 3576 u1 Ds 23:13 0:00.03 sh /etc/rc.shutd 0 1 0 20 0 vmpfw root 30752 0.0 0.0 0 0 u1 Z 23:13 0:00.01 0 30749 0 20 0 - root 30803 0.0 0.0 13144 3464 u1 Ss 23:15 0:00.01 -sh (sh) 0 1 0 20 0 wait root 30804 0.0 0.0 21156 2812 u1 R+ 23:18 0:00.00 ps auxwwl 0 30803 0 20 0 - root 30547 0.0 0.0 13164 2996 1- D+ 22:17 0:00.00 sh -c echo | cat 0 1 0 20 0 vmpfw # KDB: enter: Break to debugger [ thread pid 11 tid 100005 ] Stopped at kdb_alt_break_internal+0x190: movq $0,kdb_why db> run pho db:0:pho> bt Tracing pid 11 tid 100005 td 0xfffff800075844d0 kdb_alt_break_internal() at kdb_alt_break_internal+0x190/frame 0xfffffe07855296f0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe0785529700 uart_intr_rxready() at uart_intr_rxready+0x99/frame 0xfffffe0785529730 uart_intr() at uart_intr+0x121/frame 0xfffffe0785529770 intr_event_handle() at intr_event_handle+0x9c/frame 0xfffffe07855297c0 intr_execute_handlers() at intr_execute_handlers+0x48/frame 0xfffffe07855297f0 lapic_handle_intr() at lapic_handle_intr+0x68/frame 0xfffffe0785529830 Xapic_isr1() at Xapic_isr1+0xb7/frame 0xfffffe0785529830 --- interrupt, rip = 0xffffffff803a6fbb, rsp = 0xfffffe0785529900, rbp = 0xfffffe0785529940 --- acpi_cpu_idle() at acpi_cpu_idle+0x2bb/frame 0xfffffe0785529940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785529960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785529980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785529a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785529ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785529ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:bt> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x7cb580 curthread = 0xfffff80007585000: pid 11 "idle: cpu0" curpcb = 0xfffffe078551fb80 fpcurthread = none idlethread = 0xfffff80007585000: tid 100003 "idle: cpu0" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d60190 commontssp = 0xffffffff81d60190 rsp0 = 0xfffffe078551fb80 gs32p = 0xffffffff81d669e8 ldt = 0xffffffff81d66a28 tss = 0xffffffff81d66a18 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe0879e24580 curthread = 0xfffff800075849a0: pid 11 "idle: cpu1" curpcb = 0xfffffe0785524b80 fpcurthread = none idlethread = 0xfffff800075849a0: tid 100004 "idle: cpu1" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d601f8 commontssp = 0xffffffff81d601f8 rsp0 = 0xfffffe0785524b80 gs32p = 0xffffffff81d66a50 ldt = 0xffffffff81d66a90 tss = 0xffffffff81d66a80 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe0879e2c580 curthread = 0xfffff800075844d0: pid 11 "idle: cpu2" curpcb = 0xfffffe0785529b80 fpcurthread = none idlethread = 0xfffff800075844d0: tid 100005 "idle: cpu2" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d60260 commontssp = 0xffffffff81d60260 rsp0 = 0xfffffe0785529b80 gs32p = 0xffffffff81d66ab8 ldt = 0xffffffff81d66af8 tss = 0xffffffff81d66ae8 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe0879e34580 curthread = 0xfffff80007584000: pid 11 "idle: cpu3" curpcb = 0xfffffe078552eb80 fpcurthread = none idlethread = 0xfffff80007584000: tid 100006 "idle: cpu3" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d602c8 commontssp = 0xffffffff81d602c8 rsp0 = 0xfffffe078552eb80 gs32p = 0xffffffff81d66b20 ldt = 0xffffffff81d66b60 tss = 0xffffffff81d66b50 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe0879e3c580 curthread = 0xfffff800075839a0: pid 11 "idle: cpu4" curpcb = 0xfffffe0785533b80 fpcurthread = none idlethread = 0xfffff800075839a0: tid 100007 "idle: cpu4" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d60330 commontssp = 0xffffffff81d60330 rsp0 = 0xfffffe0785533b80 gs32p = 0xffffffff81d66b88 ldt = 0xffffffff81d66bc8 tss = 0xffffffff81d66bb8 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe0879e44580 curthread = 0xfffff800075834d0: pid 11 "idle: cpu5" curpcb = 0xfffffe0785538b80 fpcurthread = none idlethread = 0xfffff800075834d0: tid 100008 "idle: cpu5" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d60398 commontssp = 0xffffffff81d60398 rsp0 = 0xfffffe0785538b80 gs32p = 0xffffffff81d66bf0 ldt = 0xffffffff81d66c30 tss = 0xffffffff81d66c20 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe0879e4c580 curthread = 0xfffff80007583000: pid 11 "idle: cpu6" curpcb = 0xfffffe078553db80 fpcurthread = none idlethread = 0xfffff80007583000: tid 100009 "idle: cpu6" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d60400 commontssp = 0xffffffff81d60400 rsp0 = 0xfffffe078553db80 gs32p = 0xffffffff81d66c58 ldt = 0xffffffff81d66c98 tss = 0xffffffff81d66c88 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe0879e54580 curthread = 0xfffff800075959a0: pid 11 "idle: cpu7" curpcb = 0xfffffe0785542b80 fpcurthread = none idlethread = 0xfffff800075959a0: tid 100010 "idle: cpu7" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d60468 commontssp = 0xffffffff81d60468 rsp0 = 0xfffffe0785542b80 gs32p = 0xffffffff81d66cc0 ldt = 0xffffffff81d66d00 tss = 0xffffffff81d66cf0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe0879e5c580 curthread = 0xfffff800075954d0: pid 11 "idle: cpu8" curpcb = 0xfffffe0785547b80 fpcurthread = none idlethread = 0xfffff800075954d0: tid 100011 "idle: cpu8" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d604d0 commontssp = 0xffffffff81d604d0 rsp0 = 0xfffffe0785547b80 gs32p = 0xffffffff81d66d28 ldt = 0xffffffff81d66d68 tss = 0xffffffff81d66d58 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe0879e64580 curthread = 0xfffff80007595000: pid 11 "idle: cpu9" curpcb = 0xfffffe078554cb80 fpcurthread = none idlethread = 0xfffff80007595000: tid 100012 "idle: cpu9" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d60538 commontssp = 0xffffffff81d60538 rsp0 = 0xfffffe078554cb80 gs32p = 0xffffffff81d66d90 ldt = 0xffffffff81d66dd0 tss = 0xffffffff81d66dc0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe0879e6c580 curthread = 0xfffff800075949a0: pid 11 "idle: cpu10" curpcb = 0xfffffe0785551b80 fpcurthread = none idlethread = 0xfffff800075949a0: tid 100013 "idle: cpu10" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d605a0 commontssp = 0xffffffff81d605a0 rsp0 = 0xfffffe0785551b80 gs32p = 0xffffffff81d66df8 ldt = 0xffffffff81d66e38 tss = 0xffffffff81d66e28 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe0879e74580 curthread = 0xfffff800075944d0: pid 11 "idle: cpu11" curpcb = 0xfffffe0785556b80 fpcurthread = none idlethread = 0xfffff800075944d0: tid 100014 "idle: cpu11" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d60608 commontssp = 0xffffffff81d60608 rsp0 = 0xfffffe0785556b80 gs32p = 0xffffffff81d66e60 ldt = 0xffffffff81d66ea0 tss = 0xffffffff81d66e90 spin locks held: cpuid = 12 dynamic pcpu = 0xfffffe0879e7c580 curthread = 0xfffff80007594000: pid 11 "idle: cpu12" curpcb = 0xfffffe078555bb80 fpcurthread = none idlethread = 0xfffff80007594000: tid 100015 "idle: cpu12" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d60670 commontssp = 0xffffffff81d60670 rsp0 = 0xfffffe078555bb80 gs32p = 0xffffffff81d66ec8 ldt = 0xffffffff81d66f08 tss = 0xffffffff81d66ef8 spin locks held: cpuid = 13 dynamic pcpu = 0xfffffe0879e84580 curthread = 0xfffff800075939a0: pid 11 "idle: cpu13" curpcb = 0xfffffe0785560b80 fpcurthread = none idlethread = 0xfffff800075939a0: tid 100016 "idle: cpu13" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d606d8 commontssp = 0xffffffff81d606d8 rsp0 = 0xfffffe0785560b80 gs32p = 0xffffffff81d66f30 ldt = 0xffffffff81d66f70 tss = 0xffffffff81d66f60 spin locks held: cpuid = 14 dynamic pcpu = 0xfffffe0879e8c580 curthread = 0xfffff800075934d0: pid 11 "idle: cpu14" curpcb = 0xfffffe0785565b80 fpcurthread = none idlethread = 0xfffff800075934d0: tid 100017 "idle: cpu14" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d60740 commontssp = 0xffffffff81d60740 rsp0 = 0xfffffe0785565b80 gs32p = 0xffffffff81d66f98 ldt = 0xffffffff81d66fd8 tss = 0xffffffff81d66fc8 spin locks held: cpuid = 15 dynamic pcpu = 0xfffffe0879e94580 curthread = 0xfffff80007593000: pid 11 "idle: cpu15" curpcb = 0xfffffe078556ab80 fpcurthread = none idlethread = 0xfffff80007593000: tid 100018 "idle: cpu15" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d607a8 commontssp = 0xffffffff81d607a8 rsp0 = 0xfffffe078556ab80 gs32p = 0xffffffff81d67000 ldt = 0xffffffff81d67040 tss = 0xffffffff81d67030 spin locks held: cpuid = 16 dynamic pcpu = 0xfffffe0879e9c580 curthread = 0xfffff8000759c9a0: pid 11 "idle: cpu16" curpcb = 0xfffffe078556fb80 fpcurthread = none idlethread = 0xfffff8000759c9a0: tid 100019 "idle: cpu16" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d60810 commontssp = 0xffffffff81d60810 rsp0 = 0xfffffe078556fb80 gs32p = 0xffffffff81d67068 ldt = 0xffffffff81d670a8 tss = 0xffffffff81d67098 spin locks held: cpuid = 17 dynamic pcpu = 0xfffffe0879ea4580 curthread = 0xfffff8000759c4d0: pid 11 "idle: cpu17" curpcb = 0xfffffe0785574b80 fpcurthread = none idlethread = 0xfffff8000759c4d0: tid 100020 "idle: cpu17" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d60878 commontssp = 0xffffffff81d60878 rsp0 = 0xfffffe0785574b80 gs32p = 0xffffffff81d670d0 ldt = 0xffffffff81d67110 tss = 0xffffffff81d67100 spin locks held: cpuid = 18 dynamic pcpu = 0xfffffe0879eac580 curthread = 0xfffff8000759c000: pid 11 "idle: cpu18" curpcb = 0xfffffe0785579b80 fpcurthread = none idlethread = 0xfffff8000759c000: tid 100021 "idle: cpu18" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d608e0 commontssp = 0xffffffff81d608e0 rsp0 = 0xfffffe0785579b80 gs32p = 0xffffffff81d67138 ldt = 0xffffffff81d67178 tss = 0xffffffff81d67168 spin locks held: cpuid = 19 dynamic pcpu = 0xfffffe0879eb4580 curthread = 0xfffff8000759b9a0: pid 11 "idle: cpu19" curpcb = 0xfffffe078557eb80 fpcurthread = none idlethread = 0xfffff8000759b9a0: tid 100022 "idle: cpu19" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d60948 commontssp = 0xffffffff81d60948 rsp0 = 0xfffffe078557eb80 gs32p = 0xffffffff81d671a0 ldt = 0xffffffff81d671e0 tss = 0xffffffff81d671d0 spin locks held: cpuid = 20 dynamic pcpu = 0xfffffe0879ebc580 curthread = 0xfffff8000759b4d0: pid 11 "idle: cpu20" curpcb = 0xfffffe0785583b80 fpcurthread = none idlethread = 0xfffff8000759b4d0: tid 100023 "idle: cpu20" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d609b0 commontssp = 0xffffffff81d609b0 rsp0 = 0xfffffe0785583b80 gs32p = 0xffffffff81d67208 ldt = 0xffffffff81d67248 tss = 0xffffffff81d67238 spin locks held: cpuid = 21 dynamic pcpu = 0xfffffe0879ec4580 curthread = 0xfffff8000759b000: pid 11 "idle: cpu21" curpcb = 0xfffffe0785588b80 fpcurthread = none idlethread = 0xfffff8000759b000: tid 100024 "idle: cpu21" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d60a18 commontssp = 0xffffffff81d60a18 rsp0 = 0xfffffe0785588b80 gs32p = 0xffffffff81d67270 ldt = 0xffffffff81d672b0 tss = 0xffffffff81d672a0 spin locks held: cpuid = 22 dynamic pcpu = 0xfffffe0879ecc580 curthread = 0xfffff800075969a0: pid 11 "idle: cpu22" curpcb = 0xfffffe078558db80 fpcurthread = none idlethread = 0xfffff800075969a0: tid 100025 "idle: cpu22" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d60a80 commontssp = 0xffffffff81d60a80 rsp0 = 0xfffffe078558db80 gs32p = 0xffffffff81d672d8 ldt = 0xffffffff81d67318 tss = 0xffffffff81d67308 spin locks held: cpuid = 23 dynamic pcpu = 0xfffffe0803be0580 curthread = 0xfffff800075964d0: pid 11 "idle: cpu23" curpcb = 0xfffffe0785592b80 fpcurthread = none idlethread = 0xfffff800075964d0: tid 100026 "idle: cpu23" curpmap = 0xffffffff81d29490 tssp = 0xffffffff81d60ae8 commontssp = 0xffffffff81d60ae8 rsp0 = 0xfffffe0785592b80 gs32p = 0xffffffff81d67340 ldt = 0xffffffff81d67380 tss = 0xffffffff81d67370 spin locks held: db:0:allpcpu> show alllocks db:0:alllocks> show lockedvnods Locked vnodes db:0:lockedvnods> show mount 0xfffff800124d83c8 /dev/gpt/root on / (ufs) 0xfffff8001227b000 devfs on /dev (devfs) 0xfffff80012d71790 /dev/gpt/tmp on /tmp (ufs) 0xfffff80012d19b58 procfs on /proc (procfs) 0xfffff80012d19790 /dev/ada0p2 on /media (ufs) 0xfffff80012d193c8 fdescfs on /dev/fd (fdescfs) More info: show mount db:0:mount> show page vm_cnt.v_free_count: 7751492 vm_cnt.v_cache_count: 0 vm_cnt.v_inactive_count: 3042 vm_cnt.v_active_count: 2314 vm_cnt.v_wire_count: 128216 vm_cnt.v_free_reserved: 10317 vm_cnt.v_free_min: 49741 vm_cnt.v_free_target: 168013 vm_cnt.v_inactive_target: 252019 db:0:page> ps pid ppid pgrp uid state wmesg wchan cmd 30803 1 30803 0 Ss+ ttyin 0xfffff800075b00a8 sh 30749 1 30749 0 Ds+ vmpfw 0xfffff807d52ef328 sh 30547 1 2681 0 D+ vmpfw 0xfffff807d4515860 sh 3523 1 855 1001 D vmpfw 0xfffff807d4491e60 sh 3120 1 855 1001 DE objde1 0xfffff8016b43e318 sh 23 0 0 0 DL syncer 0xffffffff81ca42d0 [syncer] 22 0 0 0 DL vlruwt 0xfffff80012156558 [vnlru] 21 0 0 0 DL (threaded) [bufdaemon] 100145 D psleep 0xffffffff81ca2b04 [bufdaemon] 100162 D sdflush 0xfffff80012c622e8 [/ worker] 100168 D sdflush 0xfffff80012c620e8 [/tmp worker] 100170 D sdflush 0xfffff80012c61ce8 [/media worker] 20 0 0 0 DL - 0xffffffff81ca3804 [bufspacedaemon] 19 0 0 0 DL pgzero 0xffffffff81cb28e4 [pagezero] 18 0 0 0 DL psleep 0xffffffff81caed8c [vmdaemon] 17 0 0 0 DL (threaded) [pagedaemon] 100141 D psleep 0xffffffff81d5f584 [pagedaemon] 100148 D umarcl 0xffffffff81cac6b8 [uma] 16 0 0 0 DL idle 0xfffff80012032558 [enc_daemon0] 15 0 0 0 DL - 0xffffffff81ca239c [soaiod4] 9 0 0 0 DL - 0xffffffff81ca239c [soaiod3] 8 0 0 0 DL - 0xffffffff81ca239c [soaiod2] 7 0 0 0 DL - 0xffffffff81ca239c [soaiod1] 6 0 0 0 DL - 0xffffffff81a5ccc0 [rand_harvestq] 5 0 0 0 DL waiting_ 0xffffffff81d50680 [sctp_iterator] 14 0 0 0 DL (threaded) [usb] 100076 D - 0xfffffe00013c0d10 [usbus0] 100077 D - 0xfffffe00013c0d68 [usbus0] 100078 D - 0xfffffe00013c0dc0 [usbus0] 100079 D - 0xfffffe00013c0e18 [usbus0] 100080 D - 0xfffffe00013c0e70 [usbus0] 100117 D - 0xfffffe00017b5560 [usbus1] 100118 D - 0xfffffe00017b55b8 [usbus1] 100119 D - 0xfffffe00017b5610 [usbus1] 100120 D - 0xfffffe00017b5668 [usbus1] 100121 D - 0xfffffe00017b56c0 [usbus1] 100123 D - 0xfffffe0001423d10 [usbus2] 100124 D - 0xfffffe0001423d68 [usbus2] 100125 D - 0xfffffe0001423dc0 [usbus2] 100126 D - 0xfffffe0001423e18 [usbus2] 100127 D - 0xfffffe0001423e70 [usbus2] 4 0 0 0 DL (threaded) [cam] 100060 D - 0xffffffff8192fe00 [doneq0] 100061 D - 0xffffffff8192ff00 [doneq1] 100062 D - 0xffffffff81930000 [doneq2] 100063 D - 0xffffffff81930100 [doneq3] 100064 D - 0xffffffff81930200 [doneq4] 100135 D - 0xffffffff8192fc48 [scanner] 3 0 0 0 DL crypto_r 0xffffffff81cab198 [crypto returns] 2 0 0 0 DL crypto_w 0xffffffff81cab050 [crypto] 13 0 0 0 DL (threaded) [geom] 100053 D - 0xffffffff81d28910 [g_event] 100054 D - 0xffffffff81d28918 [g_up] 100055 D - 0xffffffff81d28920 [g_down] 12 0 0 0 WL (threaded) [intr] 100027 I [swi4: clock (0)] 100028 I [swi4: clock (1)] 100029 I [swi4: clock (2)] 100030 I [swi4: clock (3)] 100031 I [swi4: clock (4)] 100032 I [swi4: clock (5)] 100033 I [swi4: clock (6)] 100034 I [swi4: clock (7)] 100035 I [swi4: clock (8)] 100036 I [swi4: clock (9)] 100037 I [swi4: clock (10)] 100038 I [swi4: clock (11)] 100039 I [swi4: clock (12)] 100040 I [swi4: clock (13)] 100041 I [swi4: clock (14)] 100042 I [swi4: clock (15)] 100043 I [swi4: clock (16)] 100044 I [swi4: clock (17)] 100045 I [swi4: clock (18)] 100046 I [swi4: clock (19)] 100047 I [swi4: clock (20)] 100048 I [swi4: clock (21)] 100049 I [swi4: clock (22)] 100050 I [swi4: clock (23)] 100051 I [swi3: vm] 100052 I [swi1: netisr 0] 100069 I [swi6: task queue] 100070 I [swi6: Giant taskq] 100072 I [swi5: fast taskq] 100073 I [irq264: isci0] 100074 I [irq265: isci0] 100075 I [irq22: ehci0] 100081 I [irq266: hdac0] 100082 I [irq267: igb0:que 0] 100084 I [irq268: igb0:que 1] 100086 I [irq269: igb0:que 2] 100088 I [irq270: igb0:que 3] 100090 I [irq271: igb0:que 4] 100092 I [irq272: igb0:que 5] 100094 I [irq273: igb0:que 6] 100096 I [irq274: igb0:que 7] 100098 I [irq275: igb0:link] 100099 I [irq276: igb1:que 0] 100101 I [irq277: igb1:que 1] 100103 I [irq278: igb1:que 2] 100105 I [irq279: igb1:que 3] 100107 I [irq280: igb1:que 4] 100109 I [irq281: igb1:que 5] 100111 I [irq282: igb1:que 6] 100113 I [irq283: igb1:que 7] 100115 I [irq284: igb1:link] 100116 I [irq285: xhci0] 100122 I [irq20: ehci1] 100128 I [irq286: ahci0] 100129 I [irq287: hdac1] 100130 I [swi0: uart] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 100015 Run CPU 12 [idle: cpu12] 100016 Run CPU 13 [idle: cpu13] 100017 Run CPU 14 [idle: cpu14] 100018 Run CPU 15 [idle: cpu15] 100019 Run CPU 16 [idle: cpu16] 100020 Run CPU 17 [idle: cpu17] 100021 Run CPU 18 [idle: cpu18] 100022 Run CPU 19 [idle: cpu19] 100023 Run CPU 20 [idle: cpu20] 100024 Run CPU 21 [idle: cpu21] 100025 Run CPU 22 [idle: cpu22] 100026 Run CPU 23 [idle: cpu23] 1 0 1 0 SLs wait 0xfffff80007581558 [init] 10 0 0 0 DL audit_wo 0xffffffff81d55d10 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81d28948 [swapper] 100056 D - 0xfffff80007572300 [firmware taskq] 100059 D - 0xfffff800075e2400 [aiod_kick taskq] 100065 D - 0xfffff800075e1900 [kqueue taskq] 100066 D - 0xfffff800075e1700 [acpi_task_0] 100067 D - 0xfffff800075e1700 [acpi_task_1] 100068 D - 0xfffff800075e1700 [acpi_task_2] 100071 D - 0xfffff800075e0e00 [thread taskq] 100083 D - 0xfffff80007576d00 [igb0 que (qid 0)] 100085 D - 0xfffff80007576a00 [igb0 que (qid 1)] 100087 D - 0xfffff80007576700 [igb0 que (qid 2)] 100089 D - 0xfffff80007576400 [igb0 que (qid 3)] 100091 D - 0xfffff80007576100 [igb0 que (qid 4)] 100093 D - 0xfffff8000dbfc000 [igb0 que (qid 5)] 100095 D - 0xfffff8000dbfbc00 [igb0 que (qid 6)] 100097 D - 0xfffff8000dbfb900 [igb0 que (qid 7)] 100100 D - 0xfffff8000dbfb500 [igb1 que (qid 8)] 100102 D - 0xfffff8000dbfb200 [igb1 que (qid 9)] 100104 D - 0xfffff8000dbfae00 [igb1 que (qid 10)] 100106 D - 0xfffff8000dbfab00 [igb1 que (qid 11)] 100108 D - 0xfffff8000dbfa800 [igb1 que (qid 12)] 100110 D - 0xfffff8000dbfa500 [igb1 que (qid 13)] 100112 D - 0xfffff8000dbfa200 [igb1 que (qid 14)] 100114 D - 0xfffff8000dbf9e00 [igb1 que (qid 15)] 100131 D - 0xfffff800075e3400 [mca taskq] 100134 D - 0xfffff800075e2200 [CAM taskq] 100169 D - 0xfffff800122c1900 [/media trim] 3522 3120 855 1001 Z sh 30752 30749 30749 0 Z+ sh db:0:ps> allt Tracing command sh pid 30803 tid 100150 td 0xfffff8001261a9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081d14a610 mi_switch() at mi_switch+0x176/frame 0xfffffe081d14a640 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d14a680 sleepq_catch_signals() at sleepq_catch_signals+0x2dc/frame 0xfffffe081d14a6f0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081d14a720 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe081d14a790 tty_wait() at tty_wait+0x42/frame 0xfffffe081d14a7c0 ttydisc_read() at ttydisc_read+0x368/frame 0xfffffe081d14a820 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe081d14a850 devfs_read_f() at devfs_read_f+0xe7/frame 0xfffffe081d14a8b0 dofileread() at dofileread+0x98/frame 0xfffffe081d14a900 kern_readv() at kern_readv+0x68/frame 0xfffffe081d14a950 sys_read() at sys_read+0x84/frame 0xfffffe081d14a9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe081d14aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081d14aab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800bd33ca, rsp = 0x7fffffffea68, rbp = 0x7fffffffeac0 --- Tracing command sh pid 30749 tid 100602 td 0xfffff80172b389a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081dbd5560 mi_switch() at mi_switch+0x176/frame 0xfffffe081dbd5590 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081dbd55d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081dbd5600 _sleep() at _sleep+0x338/frame 0xfffffe081dbd56a0 vm_page_busy_sleep() at vm_page_busy_sleep+0xad/frame 0xfffffe081dbd56d0 vm_page_sleep_if_busy() at vm_page_sleep_if_busy+0xae/frame 0xfffffe081dbd5700 vm_fault_hold() at vm_fault_hold+0xb94/frame 0xfffffe081dbd5800 vm_fault() at vm_fault+0x78/frame 0xfffffe081dbd5840 trap_pfault() at trap_pfault+0x115/frame 0xfffffe081dbd58a0 trap() at trap+0x57d/frame 0xfffffe081dbd5ab0 calltrap() at calltrap+0x8/frame 0xfffffe081dbd5ab0 --- trap 0xc, rip = 0x408f44, rsp = 0x7fffffffe920, rbp = 0x7fffffffe960 --- Tracing command sh pid 30547 tid 100578 td 0xfffff80172b394d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081db5d560 mi_switch() at mi_switch+0x176/frame 0xfffffe081db5d590 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081db5d5d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081db5d600 _sleep() at _sleep+0x338/frame 0xfffffe081db5d6a0 vm_page_busy_sleep() at vm_page_busy_sleep+0xad/frame 0xfffffe081db5d6d0 vm_page_sleep_if_busy() at vm_page_sleep_if_busy+0xae/frame 0xfffffe081db5d700 vm_fault_hold() at vm_fault_hold+0xb94/frame 0xfffffe081db5d800 vm_fault() at vm_fault+0x78/frame 0xfffffe081db5d840 trap_pfault() at trap_pfault+0x115/frame 0xfffffe081db5d8a0 trap() at trap+0x57d/frame 0xfffffe081db5dab0 calltrap() at calltrap+0x8/frame 0xfffffe081db5dab0 --- trap 0xc, rip = 0x40ddff, rsp = 0x7fffffffe470, rbp = 0x7fffffffe480 --- Tracing command sh pid 3523 tid 100469 td 0xfffff80012a84000 sched_switch() at sched_switch+0x495/frame 0xfffffe081d93a560 mi_switch() at mi_switch+0x176/frame 0xfffffe081d93a590 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d93a5d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d93a600 _sleep() at _sleep+0x338/frame 0xfffffe081d93a6a0 vm_page_busy_sleep() at vm_page_busy_sleep+0xad/frame 0xfffffe081d93a6d0 vm_page_sleep_if_busy() at vm_page_sleep_if_busy+0xae/frame 0xfffffe081d93a700 vm_fault_hold() at vm_fault_hold+0xb94/frame 0xfffffe081d93a800 vm_fault() at vm_fault+0x78/frame 0xfffffe081d93a840 trap_pfault() at trap_pfault+0x115/frame 0xfffffe081d93a8a0 trap() at trap+0x57d/frame 0xfffffe081d93aab0 calltrap() at calltrap+0x8/frame 0xfffffe081d93aab0 --- trap 0xc, rip = 0x408f44, rsp = 0x7fffffffdf80, rbp = 0x7fffffffdfc0 --- Tracing command sh pid 3120 tid 100553 td 0xfffff80172a9d4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081dae0400 mi_switch() at mi_switch+0x176/frame 0xfffffe081dae0430 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081dae0470 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081dae04a0 _sleep() at _sleep+0x338/frame 0xfffffe081dae0540 vm_object_pip_wait() at vm_object_pip_wait+0xbe/frame 0xfffffe081dae0590 vm_object_deallocate() at vm_object_deallocate+0x48c/frame 0xfffffe081dae0610 vm_map_process_deferred() at vm_map_process_deferred+0x89/frame 0xfffffe081dae0640 vm_map_remove() at vm_map_remove+0xc8/frame 0xfffffe081dae0670 vmspace_exit() at vmspace_exit+0xc9/frame 0xfffffe081dae06b0 exit1() at exit1+0x58b/frame 0xfffffe081dae0710 sigexit() at sigexit+0xb6a/frame 0xfffffe081dae09a0 postsig() at postsig+0x2b7/frame 0xfffffe081dae0a70 ast() at ast+0x357/frame 0xfffffe081dae0ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe520 Tracing command syncer pid 23 tid 100147 td 0xfffff80012161000 sched_switch() at sched_switch+0x495/frame 0xfffffe081d13b8c0 mi_switch() at mi_switch+0x176/frame 0xfffffe081d13b8f0 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d13b930 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d13b960 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x21f/frame 0xfffffe081d13b9e0 sched_sync() at sched_sync+0x5c5/frame 0xfffffe081d13ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d13bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d13bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 22 tid 100146 td 0xfffff800121614d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081d1368a0 mi_switch() at mi_switch+0x176/frame 0xfffffe081d1368d0 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d136910 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d136940 _sleep() at _sleep+0x318/frame 0xfffffe081d1369e0 vnlru_proc() at vnlru_proc+0x95/frame 0xfffffe081d136a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d136ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d136ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 21 tid 100145 td 0xfffff800121619a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081d131900 mi_switch() at mi_switch+0x176/frame 0xfffffe081d131930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d131970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d1319a0 _sleep() at _sleep+0x318/frame 0xfffffe081d131a40 buf_daemon() at buf_daemon+0x68/frame 0xfffffe081d131a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d131ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d131ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 21 tid 100162 td 0xfffff8001267b4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081d254900 mi_switch() at mi_switch+0x176/frame 0xfffffe081d254930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d254970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d2549a0 _sleep() at _sleep+0x318/frame 0xfffffe081d254a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe081d254a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d254ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d254ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 21 tid 100168 td 0xfffff8001267b000 sched_switch() at sched_switch+0x495/frame 0xfffffe081d272900 mi_switch() at mi_switch+0x176/frame 0xfffffe081d272930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d272970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d2729a0 _sleep() at _sleep+0x318/frame 0xfffffe081d272a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe081d272a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d272ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d272ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 21 tid 100170 td 0xfffff800126734d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081d27c900 mi_switch() at mi_switch+0x176/frame 0xfffffe081d27c930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d27c970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d27c9a0 _sleep() at _sleep+0x318/frame 0xfffffe081d27ca40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe081d27ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d27cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d27cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufspacedaemon pid 20 tid 100144 td 0xfffff800120a0000 sched_switch() at sched_switch+0x495/frame 0xfffffe081d12c910 mi_switch() at mi_switch+0x176/frame 0xfffffe081d12c940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d12c980 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d12c9b0 _sleep() at _sleep+0x318/frame 0xfffffe081d12ca50 bufspace_daemon() at bufspace_daemon+0x1b7/frame 0xfffffe081d12ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d12cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d12cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagezero pid 19 tid 100143 td 0xfffff800120a04d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081d127900 mi_switch() at mi_switch+0x176/frame 0xfffffe081d127930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d127970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d1279a0 _sleep() at _sleep+0x318/frame 0xfffffe081d127a40 vm_pagezero() at vm_pagezero+0x85/frame 0xfffffe081d127a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d127ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d127ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 18 tid 100142 td 0xfffff800120a09a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081d1228c0 mi_switch() at mi_switch+0x176/frame 0xfffffe081d1228f0 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d122930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d122960 _sleep() at _sleep+0x338/frame 0xfffffe081d122a00 vm_daemon() at vm_daemon+0x96/frame 0xfffffe081d122a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d122ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d122ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 17 tid 100141 td 0xfffff800120a1000 sched_switch() at sched_switch+0x495/frame 0xfffffe081d11d820 mi_switch() at mi_switch+0x176/frame 0xfffffe081d11d850 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d11d890 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d11d8c0 _sleep() at _sleep+0x318/frame 0xfffffe081d11d960 vm_pageout() at vm_pageout+0x22a/frame 0xfffffe081d11da70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d11dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d11dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 17 tid 100148 td 0xfffff800121d89a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081d140910 mi_switch() at mi_switch+0x176/frame 0xfffffe081d140940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d140980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d1409b0 _sleep() at _sleep+0x338/frame 0xfffffe081d140a50 uma_reclaim_worker() at uma_reclaim_worker+0x71/frame 0xfffffe081d140a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d140ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d140ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 16 tid 100140 td 0xfffff800120a14d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081d1188c0 mi_switch() at mi_switch+0x176/frame 0xfffffe081d1188f0 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d118930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d118960 _sleep() at _sleep+0x338/frame 0xfffffe081d118a00 enc_daemon() at enc_daemon+0x269/frame 0xfffffe081d118a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d118ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d118ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 15 tid 100139 td 0xfffff800120a19a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081d1138f0 mi_switch() at mi_switch+0x176/frame 0xfffffe081d113920 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d113960 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d113990 _sleep() at _sleep+0x318/frame 0xfffffe081d113a30 soaio_kproc_loop() at soaio_kproc_loop+0x13e/frame 0xfffffe081d113a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d113ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d113ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 9 tid 100138 td 0xfffff800120a2000 sched_switch() at sched_switch+0x495/frame 0xfffffe081d10e8f0 mi_switch() at mi_switch+0x176/frame 0xfffffe081d10e920 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d10e960 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d10e990 _sleep() at _sleep+0x318/frame 0xfffffe081d10ea30 soaio_kproc_loop() at soaio_kproc_loop+0x13e/frame 0xfffffe081d10ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d10eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d10eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 8 tid 100137 td 0xfffff800120a24d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081d1098f0 mi_switch() at mi_switch+0x176/frame 0xfffffe081d109920 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d109960 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d109990 _sleep() at _sleep+0x318/frame 0xfffffe081d109a30 soaio_kproc_loop() at soaio_kproc_loop+0x13e/frame 0xfffffe081d109a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d109ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d109ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 7 tid 100136 td 0xfffff800120a29a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081d1048f0 mi_switch() at mi_switch+0x176/frame 0xfffffe081d104920 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d104960 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081d104990 _sleep() at _sleep+0x318/frame 0xfffffe081d104a30 soaio_kproc_loop() at soaio_kproc_loop+0x13e/frame 0xfffffe081d104a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d104ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d104ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 6 tid 100133 td 0xfffff8000dc669a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081cf318d0 mi_switch() at mi_switch+0x176/frame 0xfffffe081cf31900 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081cf31940 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081cf31970 _sleep() at _sleep+0x318/frame 0xfffffe081cf31a10 random_kthread() at random_kthread+0x230/frame 0xfffffe081cf31a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cf31ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cf31ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 5 tid 100132 td 0xfffff8000dc67000 sched_switch() at sched_switch+0x495/frame 0xfffffe081cf2c910 mi_switch() at mi_switch+0x176/frame 0xfffffe081cf2c940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081cf2c980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081cf2c9b0 _sleep() at _sleep+0x338/frame 0xfffffe081cf2ca50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe081cf2ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cf2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cf2cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100076 td 0xfffff8000dbbd9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0000386940 mi_switch() at mi_switch+0x176/frame 0xfffffe0000386970 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe00003869b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003869e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe0000386a40 usb_process() at usb_process+0x13b/frame 0xfffffe0000386a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000386ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000386ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100077 td 0xfffff8000dbbd4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe000038b940 mi_switch() at mi_switch+0x176/frame 0xfffffe000038b970 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe000038b9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000038b9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe000038ba40 usb_process() at usb_process+0x13b/frame 0xfffffe000038ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000038bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000038bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100078 td 0xfffff8000dbbd000 sched_switch() at sched_switch+0x495/frame 0xfffffe0000390940 mi_switch() at mi_switch+0x176/frame 0xfffffe0000390970 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe00003909b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003909e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe0000390a40 usb_process() at usb_process+0x13b/frame 0xfffffe0000390a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000390ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000390ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100079 td 0xfffff8000dbbc9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0000395940 mi_switch() at mi_switch+0x176/frame 0xfffffe0000395970 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe00003959b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003959e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe0000395a40 usb_process() at usb_process+0x13b/frame 0xfffffe0000395a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000395ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000395ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100080 td 0xfffff8000dbbc4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe000039a940 mi_switch() at mi_switch+0x176/frame 0xfffffe000039a970 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe000039a9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000039a9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe000039aa40 usb_process() at usb_process+0x13b/frame 0xfffffe000039aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000039aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000039aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100117 td 0xfffff8000dc17000 sched_switch() at sched_switch+0x495/frame 0xfffffe081acdf940 mi_switch() at mi_switch+0x176/frame 0xfffffe081acdf970 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081acdf9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081acdf9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe081acdfa40 usb_process() at usb_process+0x13b/frame 0xfffffe081acdfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081acdfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081acdfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100118 td 0xfffff8000dc4f9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ace4940 mi_switch() at mi_switch+0x176/frame 0xfffffe081ace4970 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ace49b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ace49e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe081ace4a40 usb_process() at usb_process+0x13b/frame 0xfffffe081ace4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ace4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ace4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100119 td 0xfffff8000dc4f4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ace9940 mi_switch() at mi_switch+0x176/frame 0xfffffe081ace9970 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ace99b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ace99e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe081ace9a40 usb_process() at usb_process+0x13b/frame 0xfffffe081ace9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ace9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ace9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100120 td 0xfffff8000dc4f000 sched_switch() at sched_switch+0x495/frame 0xfffffe081acee940 mi_switch() at mi_switch+0x176/frame 0xfffffe081acee970 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081acee9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081acee9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe081aceea40 usb_process() at usb_process+0x13b/frame 0xfffffe081aceea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081aceeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081aceeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100121 td 0xfffff8000dc4b9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081acf3940 mi_switch() at mi_switch+0x176/frame 0xfffffe081acf3970 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081acf39b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081acf39e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe081acf3a40 usb_process() at usb_process+0x13b/frame 0xfffffe081acf3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081acf3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081acf3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100123 td 0xfffff8000dc4b000 sched_switch() at sched_switch+0x495/frame 0xfffffe081ae80940 mi_switch() at mi_switch+0x176/frame 0xfffffe081ae80970 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ae809b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ae809e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe081ae80a40 usb_process() at usb_process+0x13b/frame 0xfffffe081ae80a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ae80ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ae80ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100124 td 0xfffff8000dc4a9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ae85940 mi_switch() at mi_switch+0x176/frame 0xfffffe081ae85970 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ae859b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ae859e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe081ae85a40 usb_process() at usb_process+0x13b/frame 0xfffffe081ae85a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ae85ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ae85ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100125 td 0xfffff8000dc4a4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ae8a940 mi_switch() at mi_switch+0x176/frame 0xfffffe081ae8a970 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ae8a9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ae8a9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe081ae8aa40 usb_process() at usb_process+0x13b/frame 0xfffffe081ae8aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ae8aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ae8aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100126 td 0xfffff8000dc4a000 sched_switch() at sched_switch+0x495/frame 0xfffffe081ae8f940 mi_switch() at mi_switch+0x176/frame 0xfffffe081ae8f970 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ae8f9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ae8f9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe081ae8fa40 usb_process() at usb_process+0x13b/frame 0xfffffe081ae8fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ae8fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ae8fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100127 td 0xfffff8000dc689a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ae94940 mi_switch() at mi_switch+0x176/frame 0xfffffe081ae94970 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ae949b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ae949e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe081ae94a40 usb_process() at usb_process+0x13b/frame 0xfffffe081ae94a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ae94ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ae94ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100060 td 0xfffff800075d9000 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e5b8e0 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e5b910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e5b950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e5b980 _sleep() at _sleep+0x338/frame 0xfffffe0789e5ba20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0789e5ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e5bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e5bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100061 td 0xfffff800075d89a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e608e0 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e60910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e60950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e60980 _sleep() at _sleep+0x338/frame 0xfffffe0789e60a20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0789e60a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e60ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e60ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100062 td 0xfffff800075d84d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e658e0 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e65910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e65950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e65980 _sleep() at _sleep+0x338/frame 0xfffffe0789e65a20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0789e65a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e65ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e65ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100063 td 0xfffff800075d8000 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e6a8e0 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e6a910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e6a950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e6a980 _sleep() at _sleep+0x338/frame 0xfffffe0789e6aa20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0789e6aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e6aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e6aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100064 td 0xfffff800077759a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e6f8e0 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e6f910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e6f950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e6f980 _sleep() at _sleep+0x338/frame 0xfffffe0789e6fa20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0789e6fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e6fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e6fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100135 td 0xfffff8000dc66000 sched_switch() at sched_switch+0x495/frame 0xfffffe081cf3b8e0 mi_switch() at mi_switch+0x176/frame 0xfffffe081cf3b910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081cf3b950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081cf3b980 _sleep() at _sleep+0x338/frame 0xfffffe081cf3ba20 xpt_scanner_thread() at xpt_scanner_thread+0xa4/frame 0xfffffe081cf3ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cf3bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cf3bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns pid 3 tid 100058 td 0xfffff800075d99a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e518f0 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e51920 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e51960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e51990 _sleep() at _sleep+0x338/frame 0xfffffe0789e51a30 crypto_ret_proc() at crypto_ret_proc+0x1da/frame 0xfffffe0789e51a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e51ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e51ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100057 td 0xfffff800075da000 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e4c8f0 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e4c920 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e4c960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e4c990 _sleep() at _sleep+0x338/frame 0xfffffe0789e4ca30 crypto_proc() at crypto_proc+0x394/frame 0xfffffe0789e4ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e4cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e4cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100053 td 0xfffff800075c54d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e388f0 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e38920 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e38960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e38990 _sleep() at _sleep+0x338/frame 0xfffffe0789e38a30 g_run_events() at g_run_events+0x50/frame 0xfffffe0789e38a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e38ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e38ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100054 td 0xfffff800075c5000 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e3d8f0 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e3d920 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e3d960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e3d990 _sleep() at _sleep+0x338/frame 0xfffffe0789e3da30 g_io_schedule_up() at g_io_schedule_up+0xf7/frame 0xfffffe0789e3da60 g_up_procbody() at g_up_procbody+0x7d/frame 0xfffffe0789e3da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e3dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e3dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100055 td 0xfffff800075da9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e428e0 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e42910 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e42950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e42980 _sleep() at _sleep+0x338/frame 0xfffffe0789e42a20 g_io_schedule_down() at g_io_schedule_down+0x12c/frame 0xfffffe0789e42a60 g_down_procbody() at g_down_procbody+0x7d/frame 0xfffffe0789e42a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e42ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e42ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100027 td 0xfffff80007596000 sched_switch() at sched_switch+0x495/frame 0xfffffe07855979f0 mi_switch() at mi_switch+0x176/frame 0xfffffe0785597a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0785597a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785597ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785597ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100028 td 0xfffff800075bb9a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100029 td 0xfffff800075bb4d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100030 td 0xfffff800075bb000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100031 td 0xfffff800075ba9a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100032 td 0xfffff800075ba4d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100033 td 0xfffff800075ba000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100034 td 0xfffff800075b99a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100035 td 0xfffff800075b94d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100036 td 0xfffff800075b9000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100037 td 0xfffff800075c29a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100038 td 0xfffff800075c24d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100039 td 0xfffff800075c2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100040 td 0xfffff800075c19a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xfffff800075c14d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xfffff800075c1000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100043 td 0xfffff800075c09a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100044 td 0xfffff800075c04d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffff800075c0000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100046 td 0xfffff800075c79a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff800075c74d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffff800075c7000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff800075c69a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff800075c64d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff800075c6000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100052 td 0xfffff800075c59a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e339f0 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e33a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0789e33a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e33ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e33ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100069 td 0xfffff80007774000 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e889f0 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e88a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0789e88a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e88ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e88ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100070 td 0xfffff800077739a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e8d9f0 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e8da20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0789e8da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e8dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e8dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100072 td 0xfffff80007773000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100073 td 0xfffff8000dbbe9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789f979f0 mi_switch() at mi_switch+0x176/frame 0xfffffe0789f97a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0789f97a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789f97ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789f97ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100074 td 0xfffff8000dbbe4d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100075 td 0xfffff8000dbbe000 sched_switch() at sched_switch+0x495/frame 0xfffffe00003819f0 mi_switch() at mi_switch+0x176/frame 0xfffffe0000381a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe0000381a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000381ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000381ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100081 td 0xfffff8000dbbc000 sched_switch() at sched_switch+0x495/frame 0xfffffe000039f9f0 mi_switch() at mi_switch+0x176/frame 0xfffffe000039fa20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe000039fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000039fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000039fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100082 td 0xfffff8000dbee9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe00003ee9f0 mi_switch() at mi_switch+0x176/frame 0xfffffe00003eea20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe00003eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100084 td 0xfffff8000dbee000 sched_switch() at sched_switch+0x495/frame 0xfffffe00003f89f0 mi_switch() at mi_switch+0x176/frame 0xfffffe00003f8a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe00003f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100086 td 0xfffff8000dbed4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac049f0 mi_switch() at mi_switch+0x176/frame 0xfffffe081ac04a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081ac04a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac04ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100088 td 0xfffff8000dbec9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac0e9f0 mi_switch() at mi_switch+0x176/frame 0xfffffe081ac0ea20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081ac0ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac0eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac0eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100090 td 0xfffff8000dbec000 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac189f0 mi_switch() at mi_switch+0x176/frame 0xfffffe081ac18a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081ac18a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac18ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac18ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100092 td 0xfffff8000dbf84d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac229f0 mi_switch() at mi_switch+0x176/frame 0xfffffe081ac22a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081ac22a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac22ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac22ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100094 td 0xfffff8000dbf79a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac2c9f0 mi_switch() at mi_switch+0x176/frame 0xfffffe081ac2ca20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081ac2ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac2cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100096 td 0xfffff8000dbf7000 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac369f0 mi_switch() at mi_switch+0x176/frame 0xfffffe081ac36a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081ac36a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac36ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100098 td 0xfffff8000dbf64d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac409f0 mi_switch() at mi_switch+0x176/frame 0xfffffe081ac40a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081ac40a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac40ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac40ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100099 td 0xfffff8000dbf6000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100101 td 0xfffff8000dc164d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100103 td 0xfffff8000dc159a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100105 td 0xfffff8000dc15000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100107 td 0xfffff8000dc144d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100109 td 0xfffff8000dc199a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100111 td 0xfffff8000dc19000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff8000dc184d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100115 td 0xfffff8000dc179a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100116 td 0xfffff8000dc174d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100122 td 0xfffff8000dc4b4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ae7b9f0 mi_switch() at mi_switch+0x176/frame 0xfffffe081ae7ba20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081ae7ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ae7bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ae7bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100128 td 0xfffff8000dc684d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ae999f0 mi_switch() at mi_switch+0x176/frame 0xfffffe081ae99a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081ae99a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ae99ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ae99ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100129 td 0xfffff8000dc68000 sched_switch() at sched_switch+0x495/frame 0xfffffe081cf159f0 mi_switch() at mi_switch+0x176/frame 0xfffffe081cf15a20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081cf15a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cf15ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cf15ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100130 td 0xfffff8000dc679a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081cf1d9f0 mi_switch() at mi_switch+0x176/frame 0xfffffe081cf1da20 ithread_loop() at ithread_loop+0x1d1/frame 0xfffffe081cf1da70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cf1dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cf1dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff80007585000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81cb6b30 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xffffffff81cb6b50 trap() at trap+0x3a/frame 0xffffffff81cb6d60 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81cb6d60 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe078551f8e0, rbp = 0xfffffe078551f8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe078551f8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe078551f940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078551f960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe078551f980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe078551fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078551fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078551fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff800075849a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb751cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb751d10 trap() at trap+0x3a/frame 0xfffffe07fb751f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb751f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe07855248e0, rbp = 0xfffffe07855248f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855248f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785524940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785524960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785524980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785524a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785524ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785524ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff800075844d0 kdb_alt_break_internal() at kdb_alt_break_internal+0x190/frame 0xfffffe07855296f0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe0785529700 uart_intr_rxready() at uart_intr_rxready+0x99/frame 0xfffffe0785529730 uart_intr() at uart_intr+0x121/frame 0xfffffe0785529770 intr_event_handle() at intr_event_handle+0x9c/frame 0xfffffe07855297c0 intr_execute_handlers() at intr_execute_handlers+0x48/frame 0xfffffe07855297f0 lapic_handle_intr() at lapic_handle_intr+0x68/frame 0xfffffe0785529830 Xapic_isr1() at Xapic_isr1+0xb7/frame 0xfffffe0785529830 --- interrupt, rip = 0xffffffff803a6fbb, rsp = 0xfffffe0785529900, rbp = 0xfffffe0785529940 --- acpi_cpu_idle() at acpi_cpu_idle+0x2bb/frame 0xfffffe0785529940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785529960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785529980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785529a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785529ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785529ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff80007584000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb761cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb761d10 trap() at trap+0x3a/frame 0xfffffe07fb761f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb761f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe078552e8e0, rbp = 0xfffffe078552e8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe078552e8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe078552e940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078552e960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe078552e980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe078552ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe078552eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078552eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff800075839a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb769cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb769d10 trap() at trap+0x3a/frame 0xfffffe07fb769f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb769f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe07855338e0, rbp = 0xfffffe07855338f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855338f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785533940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785533960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785533980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785533a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785533ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785533ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff800075834d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb771cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb771d10 trap() at trap+0x3a/frame 0xfffffe07fb771f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb771f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe07855388e0, rbp = 0xfffffe07855388f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855388f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785538940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785538960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785538980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785538a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785538ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785538ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff80007583000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb779cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb779d10 trap() at trap+0x3a/frame 0xfffffe07fb779f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb779f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe078553d8e0, rbp = 0xfffffe078553d8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe078553d8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe078553d940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078553d960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe078553d980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe078553da70 fork_exit() at fork_exit+0x84/frame 0xfffffe078553dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078553dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff800075959a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb781cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb781d10 trap() at trap+0x3a/frame 0xfffffe07fb781f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb781f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe07855428e0, rbp = 0xfffffe07855428f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855428f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785542940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785542960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785542980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785542a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785542ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785542ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff800075954d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb789cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb789d10 trap() at trap+0x3a/frame 0xfffffe07fb789f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb789f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe07855478e0, rbp = 0xfffffe07855478f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855478f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785547940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785547960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785547980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785547a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785547ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785547ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff80007595000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb791cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb791d10 trap() at trap+0x3a/frame 0xfffffe07fb791f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb791f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe078554c8e0, rbp = 0xfffffe078554c8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe078554c8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe078554c940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078554c960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe078554c980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe078554ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe078554cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078554cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff800075949a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb799cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb799d10 trap() at trap+0x3a/frame 0xfffffe07fb799f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb799f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe07855518e0, rbp = 0xfffffe07855518f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855518f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785551940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785551960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785551980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785551a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785551ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785551ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff800075944d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7a1cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7a1d10 trap() at trap+0x3a/frame 0xfffffe07fb7a1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7a1f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe07855568e0, rbp = 0xfffffe07855568f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855568f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785556940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785556960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785556980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785556a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785556ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785556ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100015 td 0xfffff80007594000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7a9cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7a9d10 trap() at trap+0x3a/frame 0xfffffe07fb7a9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7a9f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe078555b8e0, rbp = 0xfffffe078555b8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe078555b8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe078555b940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078555b960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe078555b980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe078555ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe078555bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078555bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100016 td 0xfffff800075939a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7b1cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7b1d10 trap() at trap+0x3a/frame 0xfffffe07fb7b1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7b1f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe07855608e0, rbp = 0xfffffe07855608f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855608f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785560940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785560960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785560980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785560a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785560ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785560ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100017 td 0xfffff800075934d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7b9cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7b9d10 trap() at trap+0x3a/frame 0xfffffe07fb7b9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7b9f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe07855658e0, rbp = 0xfffffe07855658f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855658f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785565940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785565960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785565980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785565a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785565ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785565ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100018 td 0xfffff80007593000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7c1cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7c1d10 trap() at trap+0x3a/frame 0xfffffe07fb7c1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7c1f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe078556a8e0, rbp = 0xfffffe078556a8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe078556a8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe078556a940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078556a960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe078556a980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe078556aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078556aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078556aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100019 td 0xfffff8000759c9a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7c9cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7c9d10 trap() at trap+0x3a/frame 0xfffffe07fb7c9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7c9f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe078556f8e0, rbp = 0xfffffe078556f8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe078556f8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe078556f940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078556f960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe078556f980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe078556fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078556fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078556fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100020 td 0xfffff8000759c4d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7d1cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7d1d10 trap() at trap+0x3a/frame 0xfffffe07fb7d1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7d1f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe07855748e0, rbp = 0xfffffe07855748f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855748f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785574940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785574960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785574980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785574a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785574ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785574ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100021 td 0xfffff8000759c000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7d9cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7d9d10 trap() at trap+0x3a/frame 0xfffffe07fb7d9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7d9f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe07855798e0, rbp = 0xfffffe07855798f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855798f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785579940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785579960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785579980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785579a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785579ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785579ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100022 td 0xfffff8000759b9a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7e1cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7e1d10 trap() at trap+0x3a/frame 0xfffffe07fb7e1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7e1f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe078557e8e0, rbp = 0xfffffe078557e8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe078557e8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe078557e940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078557e960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe078557e980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe078557ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe078557eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078557eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100023 td 0xfffff8000759b4d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7e9cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7e9d10 trap() at trap+0x3a/frame 0xfffffe07fb7e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7e9f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe07855838e0, rbp = 0xfffffe07855838f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855838f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785583940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785583960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785583980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785583a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785583ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785583ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100024 td 0xfffff8000759b000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7f1cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7f1d10 trap() at trap+0x3a/frame 0xfffffe07fb7f1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7f1f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe07855888e0, rbp = 0xfffffe07855888f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855888f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785588940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785588960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785588980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785588a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785588ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785588ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100025 td 0xfffff800075969a0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fb7f9cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe07fb7f9d10 trap() at trap+0x3a/frame 0xfffffe07fb7f9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fb7f9f20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe078558d8e0, rbp = 0xfffffe078558d8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe078558d8f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe078558d940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078558d960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe078558d980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe078558da70 fork_exit() at fork_exit+0x84/frame 0xfffffe078558dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078558dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100026 td 0xfffff800075964d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe078550dcf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe078550dd10 trap() at trap+0x3a/frame 0xfffffe078550df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe078550df20 --- trap 0x13, rip = 0xffffffff80fd052f, rsp = 0xfffffe07855928e0, rbp = 0xfffffe07855928f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe07855928f0 acpi_cpu_idle() at acpi_cpu_idle+0x1ee/frame 0xfffffe0785592940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0785592960 cpu_idle() at cpu_idle+0x97/frame 0xfffffe0785592980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0785592a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785592ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785592ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff800075854d0 sched_switch() at sched_switch+0x495/frame 0xfffffe078551a550 mi_switch() at mi_switch+0x176/frame 0xfffffe078551a580 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe078551a5c0 sleepq_catch_signals() at sleepq_catch_signals+0x2dc/frame 0xfffffe078551a630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe078551a660 _sleep() at _sleep+0x32b/frame 0xfffffe078551a700 kern_wait6() at kern_wait6+0x410/frame 0xfffffe078551a7b0 sys_wait4() at sys_wait4+0x73/frame 0xfffffe078551a9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe078551aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe078551aab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x41f94a, rsp = 0x7fffffffe728, rbp = 0x7fffffffe810 --- Tracing command audit pid 10 tid 100001 td 0xfffff800075859a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0785515910 mi_switch() at mi_switch+0x176/frame 0xfffffe0785515940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0785515980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe07855159b0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe0785515a10 audit_worker() at audit_worker+0xa3/frame 0xfffffe0785515a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0785515ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0785515ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81d28eb0 sched_switch() at sched_switch+0x495/frame 0xffffffff820f89e0 mi_switch() at mi_switch+0x176/frame 0xffffffff820f8a10 sleepq_switch() at sleepq_switch+0xf6/frame 0xffffffff820f8a50 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffffff820f8a80 _sleep() at _sleep+0x318/frame 0xffffffff820f8b20 swapper() at swapper+0x248/frame 0xffffffff820f8b70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100056 td 0xfffff800075da4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e47900 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e47930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e47970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e479a0 _sleep() at _sleep+0x338/frame 0xfffffe0789e47a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0789e47a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e47ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e47ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffff800075d94d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e56900 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e56930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e56970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e569a0 _sleep() at _sleep+0x338/frame 0xfffffe0789e56a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0789e56a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e56ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e56ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffff800077754d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e74900 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e74930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e74970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e749a0 _sleep() at _sleep+0x338/frame 0xfffffe0789e74a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0789e74a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e74ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e74ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff80007775000 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e79910 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e79940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e79980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e799b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe0789e79a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0789e79a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e79ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e79ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff800077749a0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e7e910 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e7e940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e7e980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e7e9b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe0789e7ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0789e7ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e7eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e7eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff800077744d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e83910 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e83940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e83980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e839b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe0789e83a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0789e83a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e83ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e83ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff800077734d0 sched_switch() at sched_switch+0x495/frame 0xfffffe0789e92900 mi_switch() at mi_switch+0x176/frame 0xfffffe0789e92930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe0789e92970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0789e929a0 _sleep() at _sleep+0x338/frame 0xfffffe0789e92a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0789e92a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0789e92ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0789e92ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100083 td 0xfffff8000dbee4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe00003f3900 mi_switch() at mi_switch+0x176/frame 0xfffffe00003f3930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe00003f3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003f39a0 _sleep() at _sleep+0x338/frame 0xfffffe00003f3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00003f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100085 td 0xfffff8000dbed9a0 sched_switch() at sched_switch+0x495/frame 0xfffffe00003fd900 mi_switch() at mi_switch+0x176/frame 0xfffffe00003fd930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe00003fd970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003fd9a0 _sleep() at _sleep+0x338/frame 0xfffffe00003fda40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00003fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100087 td 0xfffff8000dbed000 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac09900 mi_switch() at mi_switch+0x176/frame 0xfffffe081ac09930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ac09970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ac099a0 _sleep() at _sleep+0x338/frame 0xfffffe081ac09a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ac09a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac09ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100089 td 0xfffff8000dbec4d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac13900 mi_switch() at mi_switch+0x176/frame 0xfffffe081ac13930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ac13970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ac139a0 _sleep() at _sleep+0x338/frame 0xfffffe081ac13a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ac13a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac13ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac13ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xfffff8000dbf89a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac1d900 mi_switch() at mi_switch+0x176/frame 0xfffffe081ac1d930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ac1d970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ac1d9a0 _sleep() at _sleep+0x338/frame 0xfffffe081ac1da40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ac1da70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac1dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac1dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100093 td 0xfffff8000dbf8000 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac27900 mi_switch() at mi_switch+0x176/frame 0xfffffe081ac27930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ac27970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ac279a0 _sleep() at _sleep+0x338/frame 0xfffffe081ac27a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ac27a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac27ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac27ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100095 td 0xfffff8000dbf74d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac31900 mi_switch() at mi_switch+0x176/frame 0xfffffe081ac31930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ac31970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ac319a0 _sleep() at _sleep+0x338/frame 0xfffffe081ac31a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ac31a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac31ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac31ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100097 td 0xfffff8000dbf69a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac3b900 mi_switch() at mi_switch+0x176/frame 0xfffffe081ac3b930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ac3b970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ac3b9a0 _sleep() at _sleep+0x338/frame 0xfffffe081ac3ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ac3ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac3bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac3bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffff8000dc169a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac8a900 mi_switch() at mi_switch+0x176/frame 0xfffffe081ac8a930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ac8a970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ac8a9a0 _sleep() at _sleep+0x338/frame 0xfffffe081ac8aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ac8aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac8aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac8aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffff8000dc16000 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac94900 mi_switch() at mi_switch+0x176/frame 0xfffffe081ac94930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ac94970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ac949a0 _sleep() at _sleep+0x338/frame 0xfffffe081ac94a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ac94a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac94ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac94ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffff8000dc154d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081ac9e900 mi_switch() at mi_switch+0x176/frame 0xfffffe081ac9e930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081ac9e970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ac9e9a0 _sleep() at _sleep+0x338/frame 0xfffffe081ac9ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081ac9ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ac9eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ac9eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100106 td 0xfffff8000dc149a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081aca8900 mi_switch() at mi_switch+0x176/frame 0xfffffe081aca8930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081aca8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081aca89a0 _sleep() at _sleep+0x338/frame 0xfffffe081aca8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081aca8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081aca8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081aca8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100108 td 0xfffff8000dc14000 sched_switch() at sched_switch+0x495/frame 0xfffffe081acb2900 mi_switch() at mi_switch+0x176/frame 0xfffffe081acb2930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081acb2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081acb29a0 _sleep() at _sleep+0x338/frame 0xfffffe081acb2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081acb2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081acb2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081acb2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100110 td 0xfffff8000dc194d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081acbc900 mi_switch() at mi_switch+0x176/frame 0xfffffe081acbc930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081acbc970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081acbc9a0 _sleep() at _sleep+0x338/frame 0xfffffe081acbca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081acbca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081acbcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081acbcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100112 td 0xfffff8000dc189a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081acc6900 mi_switch() at mi_switch+0x176/frame 0xfffffe081acc6930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081acc6970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081acc69a0 _sleep() at _sleep+0x338/frame 0xfffffe081acc6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081acc6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081acc6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081acc6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff8000dc18000 sched_switch() at sched_switch+0x495/frame 0xfffffe081acd0900 mi_switch() at mi_switch+0x176/frame 0xfffffe081acd0930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081acd0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081acd09a0 _sleep() at _sleep+0x338/frame 0xfffffe081acd0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081acd0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081acd0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081acd0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100131 td 0xfffff8000dc674d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081cf26910 mi_switch() at mi_switch+0x176/frame 0xfffffe081cf26940 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081cf26980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081cf269b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe081cf26a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe081cf26a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cf26ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cf26ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100134 td 0xfffff8000dc664d0 sched_switch() at sched_switch+0x495/frame 0xfffffe081cf36900 mi_switch() at mi_switch+0x176/frame 0xfffffe081cf36930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081cf36970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081cf369a0 _sleep() at _sleep+0x338/frame 0xfffffe081cf36a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081cf36a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081cf36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081cf36ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100169 td 0xfffff800126739a0 sched_switch() at sched_switch+0x495/frame 0xfffffe081d277900 mi_switch() at mi_switch+0x176/frame 0xfffffe081d277930 sleepq_switch() at sleepq_switch+0xf6/frame 0xfffffe081d277970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081d2779a0 _sleep() at _sleep+0x338/frame 0xfffffe081d277a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe081d277a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081d277ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081d277ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:allt> call doadump Dumping 1358 out of 31636 MB:..2%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 $ svnlite diff -x -p /usr/src/sys Index: /usr/src/sys/kern/kern_malloc.c =================================================================== --- /usr/src/sys/kern/kern_malloc.c (revision 298424) +++ /usr/src/sys/kern/kern_malloc.c (working copy) @@ -50,6 +50,7 @@ __FBSDID("$FreeBSD$"); #include #include +#include #include #include #include @@ -472,6 +473,19 @@ malloc(unsigned long size, struct malloc_type *mtp } } #endif + if (flags & M_NOWAIT) { + KFAIL_POINT_CODE(DEBUG_FP, malloc, { + if (uma_dbg_nowait_fail_enabled_malloc( + mtp->ks_shortdesc)) { + /* XXX record call stack */ +#ifdef MALLOC_MAKE_FAILURES + atomic_add_int(&malloc_failure_count, 1); + t_malloc_fail = time_uptime; +#endif + return (NULL); + } + }); + } if (flags & M_WAITOK) KASSERT(curthread->td_intr_nesting_level == 0, ("malloc(M_WAITOK) in interrupt context")); Index: /usr/src/sys/vm/uma_core.c =================================================================== --- /usr/src/sys/vm/uma_core.c (revision 298424) +++ /usr/src/sys/vm/uma_core.c (working copy) @@ -64,6 +64,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include #include @@ -2104,6 +2105,23 @@ uma_zalloc_arg(uma_zone_t zone, void *udata, int f if (flags & M_WAITOK) { WITNESS_WARN(WARN_GIANTOK | WARN_SLEEPOK, NULL, "uma_zalloc_arg: zone \"%s\"", zone->uz_name); + } else { + KFAIL_POINT_CODE(DEBUG_FP, uma_zalloc_arg, { + /* + * XXX hack. Setting the fail point to 0 (default) + * causes it to ignore malloc zones, nonzero causes it + * to inject failures for malloc zones regardless of + * the malloc black/white lists. + */ + if (((zone->uz_flags & UMA_ZONE_MALLOC) == 0 || + RETURN_VALUE != 0) && + uma_dbg_nowait_fail_enabled_zalloc( + zone->uz_name)) { + /* XXX record call stack */ + atomic_add_long(&zone->uz_fails, 1); + return NULL; + } + }); } KASSERT(curthread->td_critnest == 0 || SCHEDULER_STOPPED(), ("uma_zalloc_arg: called with spinlock or critical section held")); Index: /usr/src/sys/vm/uma_dbg.c =================================================================== --- /usr/src/sys/vm/uma_dbg.c (revision 298424) +++ /usr/src/sys/vm/uma_dbg.c (working copy) @@ -42,6 +42,8 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include +#include #include #include @@ -184,7 +186,146 @@ mtrash_init(void *mem, int size, int flags) return (0); } +/* XXX explain */ +struct rwlock g_uma_dbg_nowait_lock; +RW_SYSINIT(uma_dbg_nowait, &g_uma_dbg_nowait_lock, "uma dbg nowait"); + +#define NOWAIT_FAIL_LIST_BUFSIZE 4096 +char malloc_fail_blacklist[NOWAIT_FAIL_LIST_BUFSIZE] = "kobj"; +char malloc_fail_whitelist[NOWAIT_FAIL_LIST_BUFSIZE] = ""; +char zalloc_fail_blacklist[NOWAIT_FAIL_LIST_BUFSIZE] = + "BUF TRIE,ata_request,sackhole"; +char zalloc_fail_whitelist[NOWAIT_FAIL_LIST_BUFSIZE] = ""; + +static bool +str_in_list(const char *list, char delim, const char *str) +{ + const char *b, *e; + size_t blen, slen; + + b = list; + slen = strlen(str); + for (;;) { + e = strchr(b, delim); + blen = e == NULL ? strlen(b) : e - b; + if (blen == slen && strncmp(b, str, slen) == 0) + return true; + if (e == NULL) + break; + b = e + 1; + } + return false; +} + +static bool +uma_dbg_nowait_fail_enabled_internal(const char *blacklist, + const char *whitelist, const char *name) +{ + bool fail; + + /* Protect ourselves from the sysctl handlers. */ + rw_rlock(&g_uma_dbg_nowait_lock); + if (whitelist[0] == '\0') + fail = !str_in_list(blacklist, ',', name); + else + fail = str_in_list(whitelist, ',', name); + rw_runlock(&g_uma_dbg_nowait_lock); + + return fail; +} + +bool +uma_dbg_nowait_fail_enabled_malloc(const char *name) +{ + return uma_dbg_nowait_fail_enabled_internal(malloc_fail_blacklist, + malloc_fail_whitelist, name); +} + +bool +uma_dbg_nowait_fail_enabled_zalloc(const char *name) +{ + return uma_dbg_nowait_fail_enabled_internal(zalloc_fail_blacklist, + zalloc_fail_whitelist, name); +} + /* + * XXX provide SYSCTL_STRING_LOCKED / sysctl_string_locked_handler? + * This is basically just a different sysctl_string_handler. This one wraps + * the string manipulation in a lock and in a way that will not cause a sleep + * under that lock. + */ +static int +sysctl_debug_mnowait_failure_list(SYSCTL_HANDLER_ARGS) +{ + char *newbuf = NULL; + int error, newlen; + bool have_lock = false; + + if (req->newptr != NULL) { + newlen = req->newlen - req->newidx; + if (newlen >= arg2) { + error = EINVAL; + goto out; + } + newbuf = malloc(newlen, M_TEMP, M_WAITOK); + error = SYSCTL_IN(req, newbuf, newlen); + if (error != 0) + goto out; + } + + error = sysctl_wire_old_buffer(req, arg2); + if (error != 0) + goto out; + + rw_wlock(&g_uma_dbg_nowait_lock); + have_lock = true; + + error = SYSCTL_OUT(req, arg1, strnlen(arg1, arg2 - 1) + 1); + if (error != 0) + goto out; + + if (newbuf == NULL) + goto out; + + bcopy(newbuf, arg1, newlen); + ((char *)arg1)[newlen] = '\0'; + out: + if (have_lock) + rw_wunlock(&g_uma_dbg_nowait_lock); + free(newbuf, M_TEMP); + return error; +} + +SYSCTL_NODE(_debug, OID_AUTO, mnowait_failure, CTLFLAG_RW, 0, + "Control of M_NOWAIT memory allocation failure injection."); + +SYSCTL_PROC(_debug_mnowait_failure, OID_AUTO, malloc_blacklist, + CTLTYPE_STRING | CTLFLAG_RW | CTLFLAG_MPSAFE, malloc_fail_blacklist, + sizeof(malloc_fail_blacklist), sysctl_debug_mnowait_failure_list, "A", + "With debug.fail_point.malloc and with an empty whitelist, CSV list of " + "zones which remain unaffected."); + +SYSCTL_PROC(_debug_mnowait_failure, OID_AUTO, malloc_whitelist, + CTLTYPE_STRING | CTLFLAG_RW | CTLFLAG_MPSAFE, malloc_fail_whitelist, + sizeof(malloc_fail_whitelist), sysctl_debug_mnowait_failure_list, "A", + "With debug.fail_point.malloc, CSV list of zones exclusively affected. " + "With an empty whitelist, all zones but those on the blacklist" + "are affected."); + +SYSCTL_PROC(_debug_mnowait_failure, OID_AUTO, zalloc_blacklist, + CTLTYPE_STRING | CTLFLAG_RW | CTLFLAG_MPSAFE, zalloc_fail_blacklist, + sizeof(zalloc_fail_blacklist), sysctl_debug_mnowait_failure_list, "A", + "With debug.fail_point.uma_zalloc_arg and with an empty whitelist, CSV " + "list of zones which remain unaffected."); + +SYSCTL_PROC(_debug_mnowait_failure, OID_AUTO, zalloc_whitelist, + CTLTYPE_STRING | CTLFLAG_RW | CTLFLAG_MPSAFE, zalloc_fail_whitelist, + sizeof(zalloc_fail_whitelist), sysctl_debug_mnowait_failure_list, "A", + "With debug.fail_point.uma_zalloc_arg, CSV list of zones exclusively " + "affected. With an empty whitelist, all zones but those on the blacklist" + "are affected."); + +/* * Checks an item to make sure it hasn't been overwritten since it was freed, * prior to freeing it back to available memory. * Index: /usr/src/sys/vm/uma_int.h =================================================================== --- /usr/src/sys/vm/uma_int.h (revision 298424) +++ /usr/src/sys/vm/uma_int.h (working copy) @@ -421,6 +421,9 @@ vsetslab(vm_offset_t va, uma_slab_t slab) void *uma_small_alloc(uma_zone_t zone, vm_size_t bytes, uint8_t *pflag, int wait); void uma_small_free(void *mem, vm_size_t size, uint8_t flags); + +bool uma_dbg_nowait_fail_enabled_malloc(const char *name); +bool uma_dbg_nowait_fail_enabled_zalloc(const char *name); #endif /* _KERNEL */ #endif /* VM_UMA_INT_H */ Index: /usr/src/sys/vm/vm_object.c =================================================================== --- /usr/src/sys/vm/vm_object.c (revision 298424) +++ /usr/src/sys/vm/vm_object.c (working copy) @@ -1669,11 +1669,12 @@ vm_object_qcollapse(vm_object_t object) void vm_object_collapse(vm_object_t object) { + vm_object_t backing_object, new_backing_object; + VM_OBJECT_ASSERT_WLOCKED(object); - + + vm_object_pip_add(object, 1); while (TRUE) { - vm_object_t backing_object; - /* * Verify that the conditions are right for collapse: * @@ -1699,14 +1700,14 @@ vm_object_collapse(vm_object_t object) break; } - if ( - object->paging_in_progress != 0 || - backing_object->paging_in_progress != 0 - ) { + if (object->paging_in_progress > 1 /* one ref is from us */ || + backing_object->paging_in_progress != 0) { vm_object_qcollapse(object); VM_OBJECT_WUNLOCK(backing_object); break; } + vm_object_pip_add(backing_object, 1); + /* * We know that we can either collapse the backing object (if * the parent is the only reference to it) or (perhaps) have @@ -1789,6 +1790,7 @@ vm_object_collapse(vm_object_t object) KASSERT(backing_object->ref_count == 1, ( "backing_object %p was somehow re-referenced during collapse!", backing_object)); + vm_object_pip_wakeup(backing_object); backing_object->type = OBJT_DEAD; backing_object->ref_count = 0; VM_OBJECT_WUNLOCK(backing_object); @@ -1796,8 +1798,6 @@ vm_object_collapse(vm_object_t object) object_collapses++; } else { - vm_object_t new_backing_object; - /* * If we do not entirely shadow the backing object, * there is nothing we can do so we give up. @@ -1804,6 +1804,7 @@ vm_object_collapse(vm_object_t object) */ if (object->resident_page_count != object->size && !vm_object_scan_all_shadowed(object)) { + vm_object_pip_wakeup(backing_object); VM_OBJECT_WUNLOCK(backing_object); break; } @@ -1836,6 +1837,7 @@ vm_object_collapse(vm_object_t object) * its ref_count was at least 2, it will not vanish. */ backing_object->ref_count--; + vm_object_pip_wakeup(backing_object); VM_OBJECT_WUNLOCK(backing_object); object_bypasses++; } @@ -1844,6 +1846,7 @@ vm_object_collapse(vm_object_t object) * Try again with this object's new backing object. */ } + vm_object_pip_wakeup(object); } /* -- Test scenario: misc/uma_zalloc_arg.sh