GENERIC HEAD from 2019-07-30 05:14:28 UTC, r350437M, vmcore.1155 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #0 r350437M: Tue Jul 30 07:48:56 CEST 2019 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 8.0.1 (branches/release_80 363030) (based on LLVM 8.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 9 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Hash", 6 boot pages left startup_alloc from "vmem btag", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "MAP", 3 boot pages left startup_alloc from "KMAP ENTRY", 2 boot pages left startup_alloc from "vmem", 1 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.01-MHz 686-class CPU) Origin="AuthenticAMD" Id=0x100f23 Family=0x10 Model=0x2 Stepping=3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff SVM: NP,NAsids=64 TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3520126976 (3357 MB) : Trying to mount root from ufs:/dev/ada0s1a [rw]... WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. uhub0: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered uhub5: 2 ports with 2 removable, self powered Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. warning: total configured swap (4194304 pages) exceeds maximum recommended amount (2009920 pages). warning: increase kern.maxswzone or reduce amount of swap. Starting file system checks: /dev/ada0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1a: clean, 604838 free (2310 frags, 75316 blocks, 0.2% fragmentation) /dev/ada0s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1f: clean, 748951 free (11111 frags, 92230 blocks, 1.1% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 28194125 free (36277 frags, 3519731 blocks, 0.0% fragmentation) /dev/ada0s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1d: clean, 1282495 free (244335 frags, 129770 blocks, 2.4% fragmentation) /dev/ada0s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1e: clean, 6868652 free (166748 frags, 837738 blocks, 0.7% fragmentation) Mounting local filesystems:. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/arduino/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc7 /usr/local/lib/gcc8 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/perl5/5.28/mach/CORE /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/lib/qt5 /usr/local/llvm37/lib /usr/local/llvm39/lib a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Setting hostname: x4.osted.lan. Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: uhub1: 10 ports with 10 removable, self powered . lo0: link state changed to UP re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 media: Ethernet autoselect (none) status: no carrier nd6 options=29 Starting devd. re0: link state changed to UP add host 127.0.0.1: gateway lo0 fib 0: route already in table add net default: gateway 192.168.1.1 add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. lock order reversal: 1st 0x9661fe4 bufwait (bufwait) @ kern/vfs_bio.c:3872 2nd 0x189ee000 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0x1031761 at witness_debugger+0x61 #1 0x1031539 at witness_checkorder+0x8a9 #2 0xfd979d at _sx_xlock+0x4d #3 0x12a6b45 at ufsdirhash_add+0x45 #4 0x12a93be at ufs_direnter+0x3fe #5 0x12b0ebc at ufs_mkdir+0x78c #6 0x156551d at VOP_MKDIR_APV+0x6d #7 0x109c863 at kern_mkdirat+0x173 #8 0x109c6e9 at sys_mkdir+0x19 #9 0x1534ec4 at syscall+0x304 #10 0xffc033b7 at _end+0xfdc4aec7 Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Starting statd. Starting lockd. Recovering vi editor sessions:. Updating motd:. Mounting late filesystems:. Starting ntpd. Starting powerd. Starting smartd. Jul 30 08:06:26 x4 smartd[632]: Device: /dev/ada0, WARNING: A firmware update for this drive may be available, Jul 30 08:06:26 x4 smartd[632]: see the following Seagate web pages: Jul 30 08:06:26 x4 smartd[632]: http://knowledge.seagate.com/articles/en_US/FAQ/207931en Jul 30 08:06:26 x4 smartd[632]: http://knowledge.seagate.com/articles/en_US/FAQ/213891en Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backup. Starting nfscbd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Starting inetd. Tue Jul 30 08:06 FreeBSD/i386 (x4.osted.lan) (ttyu0) login: Jul 30 08:07:41 x4 su[884]: pho to root on /dev/pts/0 witness_lock_list_get: witness exhausted Expensive timeout(9) function: 0xfe6390(0x21c449fc) 0.017935774 s 20190730 08:15:21 all (1/650): kpti.sh 20190730 08:15:25 all (2/650): mac_chkexec.sh 20190730 08:15:29 all (3/650): mac.sh 20190730 08:15:32 all (4/650): numa.sh 20190730 08:15:36 all (5/650): parallelmount2.sh 20190730 08:15:39 all (6/650): pathconf2.sh 20190730 08:15:43 all (7/650): quota5.sh 20190730 08:15:47 all (8/650): 256m.sh 20190730 08:15:50 all (9/650): cpuset.sh 20190730 08:15:54 all (10/650): execi386.sh 20190730 08:15:57 all (11/650): fsck2.sh 20190730 08:16:01 all (12/650): holdcnt0.sh 20190730 08:16:05 all (13/650): holdcnt02.sh 20190730 08:16:08 all (14/650): holdcnt03.sh 20190730 08:16:12 all (15/650): holdcnt04.sh 20190730 08:16:15 all (16/650): ldt2.sh 20190730 08:16:19 all (17/650): linux.sh 20190730 08:16:23 all (18/650): machipc.sh 20190730 08:16:27 all (19/650): machipc2.sh 20190730 08:16:30 all (20/650): nfs14.sh 20190730 08:16:34 all (21/650): pcatch.sh 20190730 08:16:38 all (22/650): pcatch2.sh 20190730 08:16:41 all (23/650): pkru.sh 20190730 08:16:45 all (24/650): pkru2.sh 20190730 08:16:48 all (25/650): pmc6.sh 20190730 08:16:52 all (26/650): ruby.sh 20190730 08:16:56 all (27/650): schedfuzz.sh 20190730 08:16:59 all (28/650): select3.sh 20190730 08:17:03 all (29/650): tmpfs12.sh 20190730 08:17:07 all (30/650): trim6.sh 20190730 08:17:10 all (31/650): trim7.sh 20190730 08:17:14 all (32/650): trim8.sh 20190730 08:17:18 all (33/650): md4.sh 20190730 08:17:21 all (34/650): nullfs4.sh 20190730 08:17:27 all (35/650): pfl4.sh 20190730 08:17:33 all (36/650): suj7.sh Failed to find journal. Use tunefs to create one Failed to start journal: 2 mount leak: 1/98 20190730 08:17:38 all (37/650): uma_zalloc_arg.sh 20190730 08:17:44 all (38/650): 1st.sh 20190730 08:17:51 all (39/650): audit.sh 20190730 08:17:57 all (40/650): buildworld2.sh 20190730 08:18:02 all (41/650): datagram2.sh 20190730 08:18:14 all (42/650): devfs5.sh 20190730 08:18:20 all (43/650): dumpfs.sh freework leak: 4/17. newblk leak: 617/634. mount leak: 1/99 20190730 08:18:26 all (44/650): extattrctl.sh 20190730 08:18:33 all (45/650): isofs2.sh mount leak: 1/100 20190730 08:18:39 all (46/650): maxmemdom.sh 20190730 08:18:45 all (47/650): md6.sh 20190730 08:18:50 all (48/650): mdconfig.sh 20190730 08:18:56 all (49/650): mdconfig3.sh 20190730 08:19:02 all (50/650): mmap31.sh 20190730 08:19:08 all (51/650): mmap35.sh mount leak: 1/101 20190730 08:19:14 all (52/650): msdos2.sh mount leak: 1/102 20190730 08:19:20 all (53/650): msdos3.sh 20190730 08:19:26 all (54/650): msetdomain.sh 20190730 08:19:32 all (55/650): nullfs10.sh mount leak: 1/103 20190730 08:19:38 all (56/650): nullfs13.sh mount leak: 1/104 20190730 08:19:44 all (57/650): nullfs14.sh mount leak: 1/105 20190730 08:19:50 all (58/650): nullfs21.sh mount leak: 1/106 20190730 08:19:56 all (59/650): nullfs6.sh mount leak: 1/107 20190730 08:20:02 all (60/650): nullfs9.sh 20190730 08:20:07 all (61/650): rename13.sh mount leak: 1/108 20190730 08:20:13 all (62/650): segnp.sh freework leak: 3/20. 20190730 08:20:19 all (63/650): snap12.sh mount leak: 1/109 20190730 08:20:25 all (64/650): swap5.sh 20190730 08:20:31 all (65/650): tmpfs15.sh mount leak: 1/110 20190730 08:20:37 all (66/650): trim5.sh mount leak: 1/111 20190730 08:20:42 all (67/650): truncate4.sh pts leak: 1/3 mount leak: 2/113 20190730 08:20:48 all (68/650): tvnlru.sh 20190730 08:20:54 all (69/650): fsck3.sh mount leak: 1/114 20190730 08:21:00 all (70/650): geomleak.sh 20190730 08:21:07 all (71/650): nullfs12.sh Jul 30 08:21:10 x4 mountd[556]: getvfsbyname() failed for ufs mount leak: 1/115 20190730 08:21:14 all (72/650): nullfs15.sh mount leak: 1/116 20190730 08:21:20 all (73/650): nullfs3.sh mount leak: 1/117 20190730 08:21:27 all (74/650): nullfs7.sh mount leak: 1/118 20190730 08:21:34 all (75/650): pagefault.sh freework leak: 3/23. 20190730 08:21:37 all (76/650): rdgsbase.sh 20190730 08:21:41 all (77/650): snap10.sh mount leak: 1/119 20190730 08:21:48 all (78/650): suj35.sh Jul 30 08:21:52 x4 kernel: pid 99911 (mkdir), uid 0 inumber 255 on /mnt: out of inodes mount leak: 1/120 20190730 08:21:54 all (79/650): tmpfs4.sh mount leak: 1/121 20190730 08:22:01 all (80/650): umtx_suspend.sh 20190730 08:22:08 all (81/650): gnop5.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. mount leak: 4/125 20190730 08:22:15 all (82/650): ptrace3.sh 20190730 08:22:20 all (83/650): suj8.sh Jul 30 08:22:25 x4 kernel: pid 3481 (dd), uid 0 inumber 4 on /mnt: filesystem full Jul 30 08:22:25 x4 kernel: pid 4043 (dd), uid 0 inumber 5 on /mnt: filesystem full mount leak: 2/127 20190730 08:22:28 all (84/650): kern_umtx_inf_loop.sh 20190730 08:22:34 all (85/650): md5.sh 20190730 08:22:40 all (86/650): mmap8.sh 20190730 08:22:47 all (87/650): mountro3.sh newblk leak: 3459/4093. mount leak: 1/128 20190730 08:22:54 all (88/650): rename4.sh 20190730 08:23:00 all (89/650): shm_super.sh 20190730 08:23:04 all (90/650): devfs2.sh 20190730 08:23:10 all (91/650): dtrace_fault.sh 20190730 08:23:16 all (92/650): jail2.sh 20190730 08:23:22 all (93/650): mkfifo7.sh mount leak: 17/145 20190730 08:23:28 all (94/650): mmap.sh 20190730 08:23:33 all (95/650): mmap26.sh 20190730 08:23:40 all (96/650): mmap36.sh 20190730 08:23:46 all (97/650): mountro4.sh 20190730 08:23:55 all (98/650): setuid.sh 20190730 08:24:01 all (99/650): truncate5.sh 20190730 08:24:10 all (100/650): beneath2.sh 20190730 08:24:15 all (101/650): datagram3.sh 20190730 08:24:21 all (102/650): mlockall5.sh 20190730 08:24:27 all (103/650): mmap12.sh 20190730 08:24:33 all (104/650): mmap23.sh 20190730 08:24:41 all (105/650): mmap25.sh 20190730 08:24:48 all (106/650): mmap30.sh 20190730 08:24:54 all (107/650): mmap33.sh 20190730 08:25:00 all (108/650): mprotect.sh 20190730 08:25:05 all (109/650): msdos8.sh 20190730 08:25:11 all (110/650): nanosleep.sh 20190730 08:25:17 all (111/650): openlock.sh 20190730 08:25:24 all (112/650): ptrace8.sh 20190730 08:25:31 all (113/650): pts2.sh 20190730 08:25:37 all (114/650): sendfile13.sh 20190730 08:25:43 all (115/650): sendfile4.sh 20190730 08:25:49 all (116/650): socketpair.sh 20190730 08:25:55 all (117/650): unload2.sh 20190730 08:26:01 all (118/650): jail3.sh 20190730 08:26:07 all (119/650): kevent3.sh 20190730 08:26:14 all (120/650): ldt.sh 20190730 08:26:21 all (121/650): mmap16.sh 20190730 08:26:27 all (122/650): mmap20.sh 20190730 08:26:32 all (123/650): mmap24.sh 20190730 08:26:38 all (124/650): posix_fadvise.sh 20190730 08:26:44 all (125/650): posix_fadvise2.sh 20190730 08:26:50 all (126/650): procfs2.sh 20190730 08:27:01 all (127/650): recursiveflushes.sh 20190730 08:27:11 all (128/650): sendfile6.sh 20190730 08:27:17 all (129/650): sigstop.sh 20190730 08:27:24 all (130/650): socketpair2.sh 20190730 08:27:30 all (131/650): suj32.sh 20190730 08:27:37 all (132/650): tmpfs7.sh 20190730 08:27:43 all (133/650): truncate6.sh 20190730 08:27:49 all (134/650): unlink.sh 20190730 08:27:56 all (135/650): unload.sh 20190730 08:28:02 all (136/650): vfork.sh 20190730 08:28:08 all (137/650): datamove.sh freework leak: 42/65. 20190730 08:28:14 all (138/650): extattr_set_fd.sh 20190730 08:28:20 all (139/650): killpg.sh 20190730 08:28:27 all (140/650): md9.sh Jul 30 08:28:30 x4 mountd[556]: can't change attributes for /: MNT_DEFEXPORTED already set for mount 0x187ed000 20190730 08:28:38 all (141/650): mmap9.sh 20190730 08:28:45 all (142/650): nullfs16.sh mount leak: 1/146 20190730 08:28:56 all (143/650): pmc5.sh hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 K8/16/48/0x1ff 20190730 08:29:02 all (144/650): proccontrol.sh 20190730 08:29:15 all (145/650): quota9.sh mount leak: 1/147 20190730 08:29:23 all (146/650): revoke.sh 20190730 08:29:30 all (147/650): spin.sh mount leak: 1/148 20190730 08:29:36 all (148/650): tmpfs6.sh mount leak: 1/149 20190730 08:29:44 all (149/650): datagram.sh 20190730 08:29:51 all (150/650): mmap4.sh vnode_pager_putpages: I/O error 28 0x2eb17b60: tag ufs, type VREG usecount 0, writecount 0, refcount 2624 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0x2a483a5c ref 0 pages 25608 cleanbuf 2621 dirtybuf 1 lock type ufs: EXCL by thread 0x252e5380 (pid 61217, mmap4, tid 102680) #0 0xfa9097 at lockmgr_xlock_hard+0x317 #1 0xfa9536 at __lockmgr_args+0x376 #2 0x12a15af at ffs_lock+0x6f #3 0x1565ec8 at VOP_LOCK1_APV+0x58 #4 0x109ffe8 at _vn_lock+0x58 #5 0x108f219 at vputx+0x179 #6 0x12d0b49 at vm_object_deallocate+0x489 #7 0x12c5e5e at vm_map_process_deferred+0x6e #8 0x12caef6 at vm_map_remove+0xa6 #9 0x12c5a6c at vmspace_exit+0xcc #10 0xf900a5 at exit1+0xab5 Jul 30 08:29:55 #11 0xf8f5e5 at sys_sys_exit+0x35 x4 kernel: pid 6#12 0x1534ec4 at syscall+0x304 1217 (mmap4), ui#13 0xffc033b7 at _DYNAMIC+0xd16003b7 nlink=1, effnlink=1, size=104857600, extsize 0 generation=161e8bd6, uid=0d 0 inumber 4 on /mnt: filesyste, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpages: residual I/O 32768 at 9760 0x2eb17b60: tag ufs, type VREG usecount 0, writecount 0, refcount 2624 flags (VI_ACTIVE|VI_DOINGINACT) v_object 0x2a483a5c ref 0 pages 25608 cleanbuf 2621 dirtybuf 1 lock type ufs: EXCL by thread 0x252e5380 (pid 61217, mmap4, tid 102680) m full #0 0xfa9097 at lockmgr_xlock_hard+0x317 #1 0xfa9536 at __lockmgr_args+0x376 #2 0x12a15af at ffs_lock+0x6f #3 0x1565ec8 at VOP_LOCK1_APV+0x58 #4 0x109ffe8 at _vn_lock+0x58 #5 0x108f219 at vputx+0x179 #6 0x12d0b49 at vm_object_deallocate+0x489 #7 0x12c5e5e at vm_map_process_deferred+0x6e #8 0x12caef6 at vm_map_remove+0xa6 #9 0x12c5a6c at vmspace_exit+0xcc #10 0xf900a5 at exit1+0xab5 #11 0xf8f5e5 at sys_sys_exit+0x35 #12 0x1534ec4 at syscall+0x304 #13 0xffc033b7 at _DYNAMIC+0xd16003b7 nlink=1, effnlink=1, size=104857600, extsize 0 generation=161e8bd6, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpages: zero-length write at 40075264 resid 131072 0x2eb17b60: tag ufs, type VREG usecount 1, writecount 0, refcount 2587 flags (VI_ACTIVE) v_object 0x2a483a5c ref 0 pages 25608 cleanbuf 2585 dirtybuf 0 lock type ufs: EXCL by thread 0x27e08380 (pid 61225, umount, tid 101099) #0 0xfa9097 at lockmgr_xlock_hard+0x317 #1 0xfa9536 at __lockmgr_args+0x376 #2 0x12a15af at ffs_lock+0x6f #3 0x1565ec8 at VOP_LOCK1_APV+0x58 #4 0x109ffe8 at _vn_lock+0x58 #5 0x108e9db at vget+0x7b #6 0x10908f2 at vfs_msync+0x92 #7 0x1087b7c at dounmount+0x39c #8 0x10876eb at sys_unmount+0x26b #9 0x1534ec4 at syscall+0x304 #10 0xffc033b7 at _DYNAMIC+0xd16003b7 nlink=1, effnlink=1, size=104857600, extsize 0 generation=161e8bd6, uid=0, gid=0, flags=0x0 ino 4, on dev md10a Jul 30 08:29:57 x4 kernel: pid 61225 (umount), uid 0 inumber 4 on /mnt: filesystem full mount leak: 1/150 20190730 08:29:59 all (151/650): procfs5.sh 20190730 08:30:05 all (152/650): unix_socket.sh 20190730 08:30:13 all (153/650): sigaltstack.sh 20190730 08:30:17 all (154/650): kevent10.sh 20190730 08:30:23 all (155/650): nfsdelegation.sh 20190730 08:30:28 all (156/650): pthread.sh 20190730 08:30:41 all (157/650): dup.sh 20190730 08:30:59 all (158/650): fcntl.sh 20190730 08:31:10 all (159/650): fork.sh 20190730 08:31:21 all (160/650): mmap28.sh Jul 30 08:31:30 x4 kernel: Failed to fully fault in a core file segment at VA 0x50a00000 with size 0x83a5000 to be written at offset 0x25b000 for process mmap28 20190730 08:31:32 all (161/650): ptrace9.sh 20190730 08:31:43 all (162/650): symlink2.sh mount leak: 2/152 20190730 08:31:55 all (163/650): extattr.sh mount leak: 1/153 20190730 08:32:06 all (164/650): jail4.sh 20190730 08:32:12 all (165/650): mkfifo5.sh mount leak: 1/154 20190730 08:32:18 all (166/650): msdos9.sh mount leak: 1/155 20190730 08:32:30 all (167/650): newfs5.sh mount leak: 1/156 20190730 08:32:42 all (168/650): ptrace.sh 20190730 08:32:54 all (169/650): thr.sh 20190730 08:33:09 all (170/650): umountf11.sh mount leak: 1/157 20190730 08:33:27 all (171/650): umountf12.sh mount leak: 1/158 20190730 08:33:45 all (172/650): jail.sh 20190730 08:33:51 all (173/650): mmap13.sh 20190730 08:34:07 all (174/650): ptrace2.sh 20190730 08:34:23 all (175/650): sysctl.sh 20190730 08:34:37 all (176/650): trim2.sh mount leak: 1/159 20190730 08:34:50 all (177/650): mountro2.sh mount leak: 1/160 20190730 08:34:58 all (178/650): rwlock_ronly.sh 20190730 08:35:04 all (179/650): sendfile14.sh 20190730 08:35:10 all (180/650): sigreturn.sh 20190730 08:35:16 all (181/650): suj2.sh mount leak: 1/161 20190730 08:35:22 all (182/650): truncate7.sh mount leak: 1/162 20190730 08:35:37 all (183/650): datamove3.sh 20190730 08:35:43 all (184/650): msdos7.sh mount leak: 1/163 20190730 08:35:49 all (185/650): ptrace11.sh 20190730 08:35:56 all (186/650): isofs.sh freework leak: 4603/4668. mount leak: 1/164 20190730 08:36:10 all (187/650): pmc4.sh hwpmc: SOFT/16/64/0x67 TSC/1/64/0x20 K8/16/48/0x1ff 20190730 08:36:16 all (188/650): sndstat.sh 20190730 08:36:22 all (189/650): tmpfs14.sh mount leak: 1/165 20190730 08:36:39 all (190/650): vm_fault_dontneed.sh 20190730 08:36:47 all (191/650): devfd.sh mount leak: 1/166 20190730 08:37:02 all (192/650): tmpfs5.sh mount leak: 1/167 20190730 08:37:18 all (193/650): maxproc.sh maxproc limit exceeded by uid 65534 (pid 21581); see tuning(7) and login.conf(5) 20190730 08:37:27 all (194/650): pshared.sh 20190730 08:37:43 all (195/650): mlockall4.sh mount leak: 1/168 20190730 08:37:54 all (196/650): mountro6.sh mount leak: 1/169 20190730 08:38:19 all (197/650): seekdir.sh mount leak: 1/170 20190730 08:38:25 all (198/650): rename6.sh mount leak: 1/171 20190730 08:38:35 all (199/650): dup2.sh 20190730 08:38:41 all (200/650): ext2fs3.sh mount leak: 1/172 20190730 08:38:50 all (201/650): ufssuspend.sh 20190730 08:38:57 all (202/650): contigmalloc2.sh 20190730 08:39:25 all (203/650): mmap17.sh 20190730 08:39:31 all (204/650): core4.sh Jul 30 08:39:35 x4 kernel: Failed to write core file for process core4 (error 5) mount leak: 1/173 20190730 08:39:58 all (205/650): datamove5.sh mount leak: 1/174 20190730 08:40:20 all (206/650): kevent2.sh Jul 30 08:39:56 x4 syslogd: last message repeated 59 times 20190730 08:40:34 all (207/650): sendfile2.sh 20190730 08:40:40 all (208/650): contigmalloc3.sh 20190730 08:40:49 all (209/650): mmap29.sh mount leak: 1/175 20190730 08:40:59 all (210/650): overcommit2.sh Jul 30 08:41:16 x4 kernel: pid 50279 (dd), uid 0 inumber 11 on /mnt: filesystem full mount leak: 1/176 20190730 08:41:21 all (211/650): procfs3.sh 20190730 08:41:53 all (212/650): multicast.sh 20190730 08:42:25 all (213/650): truncate3.sh mount leak: 1/177 20190730 08:42:40 all (214/650): ffs_blkfree.sh newblk leak: 61504/65597. mount leak: 11/188 20190730 08:43:03 all (215/650): mlockall.sh 20190730 08:43:19 all (216/650): shm_open.sh 20190730 08:43:49 all (217/650): datamove4.sh mount leak: 1/189 20190730 08:44:01 all (218/650): sparse.sh mount leak: 1/190 20190730 08:44:17 all (219/650): forkbomb.sh 20190730 08:44:23 all (220/650): fsck5.sh mount leak: 1/191 20190730 08:45:00 all (221/650): compare.sh 20190730 08:45:36 all (222/650): mmap37.sh mount leak: 1/192 20190730 08:46:12 all (223/650): umountf5.sh Jul 30 08:46:24 x4 kernel: pid 85332 (mkdir), uid 0 inumber 1535 on /mnt: out of inodes Jul 30 08:46:27 x4 kernel: pid 85368 (creat), uid 0 inumber 385 on /mnt: out of inodes Jul 30 08:46:31 x4 syslogd: last message repeated 1 times Jul 30 08:47:00 x4 kernel: pid 85367 (creat), uid 0 inumber 1153 on /mnt: out of inodes mount leak: 1/193 20190730 08:48:34 all (224/650): mkfifo6.sh mount leak: 1/194 20190730 08:48:49 all (225/650): fpclone2.sh 20190730 08:49:19 all (226/650): linger2.sh Jul 30 08:49:24 x4 kernel: pid 92507 (linger2), uid 1004 inumber 890 on /mnt: filesystem full mount leak: 1/195 20190730 08:49:30 all (227/650): sendmsg2.sh 20190730 08:49:42 all (228/650): radix.sh 20190730 08:50:12 all (229/650): quota11.sh mount leak: 1/196 20190730 08:50:53 all (230/650): rename8.sh mount leak: 1/197 20190730 08:51:38 all (231/650): growfs.sh g_access(958): provider ufsid/5d3fe8fe6793ed64 has error 6 set g_access(958): provider ufsid/5d3fe8fe6793ed64 has error 6 set g_access(958): provider ufsid/5d3fe8fe6793ed64 has error 6 set g_access(958): provider gptid/7d1c8bc3-b296-11e9-b64c-00218515337d has error 6 set g_access(958): provider gptid/7d1c8bc3-b296-11e9-b64c-00218515337d has error 6 set g_access(958): provider gptid/7d1c8bc3-b296-11e9-b64c-00218515337d has error 6 set g_dev_taste: make_dev_p() failed (gp->name=gptid/7d1c8bc3-b296-11e9-b64c-00218515337d, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/7d1c8bc3-b296-11e9-b64c-00218515337d, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5d3fe8fe6793ed64, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/7d1c8bc3-b296-11e9-b64c-00218515337d, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5d3fe8fe6793ed64, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/7d1c8bc3-b296-11e9-b64c-00218515337d, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5d3fe8fe6793ed64, error=17) mount leak: 1/198 GEOM leak: 14/267 20190730 08:52:00 all (232/650): tmpfs18.sh mount leak: 1/199 20190730 08:52:06 all (233/650): mdconfig2.sh 20190730 08:53:11 all (234/650): beneath3.sh mount leak: 1/200 20190730 08:53:17 all (235/650): libMicro.sh 20190730 08:54:23 all (236/650): pts3.sh 20190730 08:55:28 all (237/650): routetbl.sh mount leak: 4/204 20190730 08:56:33 all (238/650): posix_openpt.sh 20190730 08:57:33 all (239/650): symlink4.sh mount leak: 1/205 20190730 08:57:51 all (240/650): sigstop2.sh 20190730 08:58:57 all (241/650): pread.sh Jul 30 08:59:06 x4 mountd[556]: can't export /mnt mount leak: 3/208 20190730 08:59:50 all (242/650): sendfile9.sh Jul 30 08:59:18 x4 syslogd: last message repeated 2 times mount leak: 1/209 20190730 09:00:57 all (243/650): truss2.sh 20190730 09:02:06 all (244/650): sendfile8.sh mount leak: 1/210 20190730 09:03:18 all (245/650): credleak.sh mount leak: 163/373 20190730 09:04:27 all (246/650): crossmp8.sh mount leak: 1/374 20190730 09:05:37 all (247/650): tcp3.sh 20190730 09:06:52 all (248/650): vmstat.sh 20190730 09:08:07 all (249/650): mknod.sh 20190730 09:09:13 all (250/650): nfssillyrename.sh 20190730 09:09:19 all (251/650): fsgs.sh 20190730 09:10:24 all (252/650): rename10.sh mount leak: 1/375 20190730 09:11:36 all (253/650): advlock.sh mount leak: 1/376 20190730 09:12:42 all (254/650): tmpfs19.sh mount leak: 1/377 20190730 09:13:59 all (255/650): flock.sh mount leak: 1/378 20190730 09:15:11 all (256/650): suj6.sh mount leak: 1/379 20190730 09:16:46 all (257/650): tmpfs8.sh mount leak: 1/380 20190730 09:17:39 all (258/650): suj10.sh mount leak: 1/381 20190730 09:18:52 all (259/650): fts2.sh mount leak: 1/382 20190730 09:20:00 all (260/650): fullpath.sh 20190730 09:21:06 all (261/650): socketpair3.sh 20190730 09:22:12 all (262/650): pthread5.sh vm_thread_new: kstack allocation failed vm_thread_new: kstack allocation failed vm_thread_new: kstack allocation failed vm_thread_new: kstack allocation failed vm_thread_new: kstack allocation failed : : vm_thread_new: kstack allocation failed vm_thread_new: kstack allocation failed vm_thread_new: kstack allocation failed vm_thread_new: kstack allocation failed vm_thread_new: kstack allocation failed 20190730 09:23:19 all (263/650): tmpfs10.sh mount leak: 1/383 20190730 09:23:37 all (264/650): pipe2.sh 20190730 09:23:55 all (265/650): mkfifo3.sh 20190730 09:25:01 all (266/650): sendfile3.sh newblk leak: 14431/80028. 20190730 09:26:30 all (267/650): fsck4.sh mount leak: 1/384 20190730 09:27:23 all (268/650): rename9.sh mount leak: 1/385 20190730 09:28:11 all (269/650): kevent8.sh mount leak: 1/386 20190730 09:28:51 all (270/650): ptrace10.sh 20190730 09:30:42 all (271/650): sem.sh 20190730 09:31:48 all (272/650): snap2-1.sh mount leak: 1/387 20190730 09:32:22 all (273/650): umountf.sh mount leak: 1/388 20190730 09:34:03 all (274/650): snap2.sh mount leak: 1/389 20190730 09:34:39 all (275/650): rename11.sh 20190730 09:35:35 all (276/650): kevent6.sh mount leak: 2/391 20190730 09:36:40 all (277/650): kevent.sh 20190730 09:38:45 all (278/650): kevent14.sh 20190730 09:40:48 all (279/650): vm_map.sh 20190730 09:42:55 all (280/650): vmstat2.sh 20190730 09:45:06 all (281/650): fifo2.sh mount leak: 1/392 20190730 09:47:12 all (282/650): segregs.sh 20190730 09:49:18 all (283/650): snap11.sh mount leak: 1/393 20190730 09:51:28 all (284/650): overflow3.sh 20190730 09:53:35 all (285/650): shm2.sh 20190730 09:55:46 all (286/650): stack_guard_page.sh mount leak: 1/394 20190730 09:57:16 all (287/650): swappedout.sh 20190730 09:57:20 all (288/650): multicast2.sh Jul 30 09:58:13 x4 mDNSResponder[54519]: mDNSResponder (Engineering Build) (Jan 5 2019 05:28:44) starting if_delmulti_locked: detaching ifnet instance 0x94d5400 if_delmulti_locked: detaching ifnet instance 0x94d5400 if_delmulti_locked: detaching ifnet instance 0x94d5400 if_delmulti_locked: detaching ifnet instance 0x94d5400 if_delmulti_locked: detaching ifnet instance 0x94d5400 if_delmulti_locked: detaching ifnet instance 0x94d5400 Jul 30 09:58:21 x4 mDNSResponder[54519]: mDNS_AddDNSServer: Lock not held! mDNS_busy (0) mDNS_reentrancy (0) Jul 30 09:58:21 x4 syslogd: last message repeated 2 times Jul 30 09:58:21 x4 mDNSResponder[54519]: CheckNATMappings: Failed to allocate port 5350 UDP multicast socket for PCP & NAT-PMP announcements 20190730 09:58:23 all (289/650): tmpfs13.sh mount leak: 1/395 20190730 10:00:36 all (290/650): nullfs19.sh 20190730 10:02:50 all (291/650): mmap27.sh 20190730 10:05:04 all (292/650): rename7.sh mount leak: 1/396 20190730 10:06:19 all (293/650): crossmp5.sh mount leak: 1/397 20190730 10:07:25 all (294/650): rdwr.sh 20190730 10:08:53 all (295/650): scp.sh 20190730 10:09:01 all (296/650): fts3.sh 20190730 10:11:11 all (297/650): sendfile10.sh mount leak: 1/398 20190730 10:13:21 all (298/650): procfs.sh mount leak: 1/399 20190730 10:14:20 all (299/650): sendfile_shm.sh 20190730 10:15:03 all (300/650): sendfile.sh 20190730 10:15:10 all (301/650): sendfile5.sh mount leak: 2/401 20190730 10:17:15 all (302/650): shm.sh 20190730 10:18:27 all (303/650): graid1_3.sh g_access(958): provider ufsid/5d3fe8fe6793ed64 has error 6 set g_access(958): provider gptid/7d1c8bc3-b296-11e9-b64c-00218515337d has error 6 set 20190730 10:20:41 all (304/650): mmap32.sh 20190730 10:23:06 all (305/650): graid1_10.sh g_access(958): provider ufsid/5d3fe8fe6793ed64 has error 6 set g_access(958): provider gptid/7d1c8bc3-b296-11e9-b64c-00218515337d has error 6 set mount leak: 1/402 20190730 10:25:16 all (306/650): execve.sh 20190730 10:27:42 all (307/650): procstat.sh mount leak: 1/403 20190730 10:30:14 all (308/650): core2.sh mount leak: 1/404 20190730 10:32:23 all (309/650): mmap7.sh 20190730 10:33:51 all (310/650): sort.sh 20190730 10:35:41 all (311/650): suj5.sh mount leak: 1/405 20190730 10:37:39 all (312/650): mmap5.sh 20190730 10:39:04 all (313/650): syscall4.sh mount leak: 1/406 20190730 10:41:10 all (314/650): jumbo.sh 20190730 10:42:56 all (315/650): fpclone.sh 20190730 10:45:29 all (316/650): fpu.sh 20190730 10:48:11 all (317/650): racct.sh Expensive timeout(9) function: 0x926850(0x17ac9b00) 0.035509868 s 20190730 10:50:27 all (318/650): sysctl4.sh 20190730 10:53:32 all (319/650): nfs_halfpage2.sh 20190730 10:53:44 all (320/650): sem_wait.sh 20190730 10:54:50 all (321/650): pthread8.sh 20190730 10:57:56 all (322/650): db.sh 20190730 11:01:01 all (323/650): ftruncate.sh 20190730 11:04:12 all (324/650): tmpfs16.sh mount leak: 1/407 20190730 11:07:18 all (325/650): nfs_halfpage.sh 20190730 11:07:25 all (326/650): pty2.sh 20190730 11:10:30 all (327/650): msdos5.sh GEOM leak: 19/286 20190730 11:13:52 all (328/650): msync.sh 20190730 11:17:04 all (329/650): kevent4.sh 20190730 11:19:40 all (330/650): vmio.sh warning: total configured swap (4194304 pages) exceeds maximum recommended amount (2009920 pages). warning: increase kern.maxswzone or reduce amount of swap. newblk leak: 38972/119000. 20190730 11:22:33 all (331/650): thr3.sh 20190730 11:25:45 all (332/650): watchman.sh Jul 30 11:27:33 x4 kernel: pid 77996 (swap), jid 0, uid 0, was killed: out of swap space 20190730 11:28:58 all (333/650): quota8.sh mount leak: 16/423 GEOM leak: 4/290 20190730 11:30:39 all (334/650): ftruncate2.sh 20190730 11:33:46 all (335/650): fdatasync.sh 20190730 11:36:54 all (336/650): mlockall3.sh 20190730 11:40:01 all (337/650): fifo3.sh 20190730 11:43:01 all (338/650): setsockopt.sh 20190730 11:46:30 all (339/650): mlockall7.sh 20190730 11:49:46 all (340/650): ffs_sync.sh 20190730 11:52:54 all (341/650): nfs3.sh 20190730 11:53:00 all (342/650): sethostname.sh 20190730 11:56:06 all (343/650): f_offset.sh 20190730 11:57:29 all (344/650): nullfs22.sh 20190730 11:59:14 all (345/650): contigmalloc.sh 20190730 12:02:43 all (346/650): tcp4.sh 20190730 12:04:07 all (347/650): beneath.sh 20190730 12:07:14 all (348/650): linger3.sh 20190730 12:07:37 all (349/650): mountro.sh 20190730 12:11:46 all (350/650): mountro5.sh Jul 30 12:13:42 x4 kernel: pid 34815 (swap), jid 0, uid 0, was killed: out of swap space 20190730 12:15:15 all (351/650): core.sh 20190730 12:18:04 all (352/650): mmap14.sh 20190730 12:21:56 all (353/650): umountf8.sh 20190730 12:24:56 all (354/650): fcntl2.sh 20190730 12:28:53 all (355/650): ptrace6.sh 20190730 12:33:00 all (356/650): link2.sh Jul 30 12:35:16 x4 kernel: pid 37669 (swap), jid 0, uid 0, was killed: out of swap space 20190730 12:36:12 all (357/650): mountu.sh 20190730 12:36:34 all (358/650): rename12.sh mount leak: 1/424 20190730 12:40:06 all (359/650): sctp.sh 20190730 12:41:14 all (360/650): umountf3.sh mount leak: 1/425 20190730 12:45:31 all (361/650): ptrace7.sh 20190730 12:49:37 all (362/650): umount.sh mount leak: 1/426 20190730 12:54:02 all (363/650): ufsbench.sh mount leak: 5/431 20190730 12:57:27 all (364/650): kevent11.sh mount leak: 1/432 20190730 13:00:40 all (365/650): ptrace4.sh mount leak: 1/433 20190730 13:05:06 all (366/650): umountf4.sh mount leak: 1/434 20190730 13:06:46 all (367/650): umountf6.sh 20190730 13:08:29 all (368/650): swapoff.sh warning: total configured swap (4194304 pages) exceeds maximum recommended amount (2009920 pages). warning: increase kern.maxswzone or reduce amount of swap. 20190730 13:11:16 all (369/650): umount3.sh Jul 30 13:11:19 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:11:20 x4 syslogd: last message repeated 4 times Jul 30 13:11:21 x4 mountd[556]: can't export /mnt Jul 30 13:11:21 x4 syslogd: last message repeated 1 times Jul 30 13:11:22 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:11:22 x4 mountd[556]: can't export /mnt Jul 30 13:11:22 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:11:22 x4 syslogd: last message repeated 2 times Jul 30 13:11:22 x4 mountd[556]: can't export /mnt Jul 30 13:11:23 x4 syslogd: last message repeated 1 times Jul 30 13:11:23 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:11:23 x4 syslogd: last message repeated 1 times Jul 30 13:11:24 x4 mountd[556]: can't export /mnt Jul 30 13:11:24 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:11:32 x4 syslogd: last message repeated 28 times Jul 30 13:11:33 x4 mountd[556]: can't export /mnt Jul 30 13:11:33 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:11:42 x4 syslogd: last message repeated 22 times Jul 30 13:11:43 x4 mountd[556]: can't export /mnt Jul 30 13:11:43 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:11:43 x4 mountd[556]: bad exports list line '/mnt': symbolic link in export path or statfs failed Jul 30 13:11:43 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:11:56 x4 syslogd: last message repeated 43 times Jul 30 13:11:56 x4 mountd[556]: can't export /mnt Jul 30 13:11:57 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:12:05 x4 syslogd: last message repeated 18 times Jul 30 13:12:06 x4 mountd[556]: can't export /mnt Jul 30 13:12:06 x4 syslogd: last message repeated 1 times Jul 30 13:12:06 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:12:13 x4 syslogd: last message repeated 19 times Jul 30 13:12:14 x4 mountd[556]: can't export /mnt Jul 30 13:12:14 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:12:19 x4 syslogd: last message repeated 12 times Jul 30 13:12:19 x4 mountd[556]: can't export /mnt Jul 30 13:12:19 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:12:26 x4 syslogd: last message repeated 21 times Jul 30 13:12:26 x4 mountd[556]: can't export /mnt Jul 30 13:12:26 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:12:28 x4 syslogd: last message repeated 7 times Jul 30 13:12:28 x4 mountd[556]: can't export /mnt Jul 30 13:12:28 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:12:39 x4 syslogd: last message repeated 27 times Jul 30 13:12:40 x4 mountd[556]: can't export /mnt Jul 30 13:12:40 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:12:45 x4 syslogd: last message repeated 15 times Jul 30 13:12:46 x4 mountd[556]: can't export /mnt Jul 30 13:12:46 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:12:51 x4 syslogd: last message repeated 8 times Jul 30 13:12:51 x4 mountd[556]: can't export /mnt Jul 30 13:12:51 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:12:55 x4 syslogd: last message repeated 20 times Jul 30 13:12:56 x4 mountd[556]: can't export /mnt Jul 30 13:12:56 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:13:01 x4 syslogd: last message repeated 15 times Jul 30 13:13:01 x4 mountd[556]: can't export /mnt Jul 30 13:13:01 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:13:02 x4 syslogd: last message repeated 1 times Jul 30 13:13:02 x4 mountd[556]: can't export /mnt Jul 30 13:13:02 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:13:05 x4 syslogd: last message repeated 14 times Jul 30 13:13:05 x4 mountd[556]: can't export /mnt Jul 30 13:13:06 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:13:08 x4 syslogd: last message repeated 8 times Jul 30 13:13:08 x4 mountd[556]: can't export /mnt Jul 30 13:13:08 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:13:08 x4 syslogd: last message repeated 1 times Jul 30 13:13:08 x4 mountd[556]: can't export /mnt Jul 30 13:13:09 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:13:11 x4 syslogd: last message repeated 8 times Jul 30 13:13:11 x4 mountd[556]: can't export /mnt Jul 30 13:13:11 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:13:17 x4 syslogd: last message repeated 17 times Jul 30 13:13:17 x4 mountd[556]: can't export /mnt Jul 30 13:13:18 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:13:30 x4 syslogd: last message repeated 33 times Jul 30 13:13:30 x4 mountd[556]: can't export /mnt Jul 30 13:13:30 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:13:31 x4 syslogd: last message repeated 4 times Jul 30 13:13:31 x4 mountd[556]: can't export /mnt Jul 30 13:13:33 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:13:44 x4 syslogd: last message repeated 24 times Jul 30 13:13:44 x4 mountd[556]: can't export /mnt Jul 30 13:13:44 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:13:58 x4 syslogd: last message repeated 38 times Jul 30 13:13:59 x4 mountd[556]: can't export /mnt Jul 30 13:13:59 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:14:05 x4 syslogd: last message repeated 8 times Jul 30 13:14:05 x4 mountd[556]: can't export /mnt Jul 30 13:14:05 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:14:13 x4 syslogd: last message repeated 20 times Jul 30 13:14:15 x4 mountd[556]: bad exports list line '/mnt': symbolic link in export path or statfs failed Jul 30 13:14:15 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:14:18 x4 syslogd: last message repeated 12 times Jul 30 13:14:19 x4 mountd[556]: can't export /mnt Jul 30 13:14:19 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:14:20 x4 syslogd: last message repeated 3 times Jul 30 13:14:20 x4 mountd[556]: can't export /mnt Jul 30 13:14:21 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:14:21 x4 syslogd: last message repeated 2 times Jul 30 13:14:21 x4 mountd[556]: can't export /mnt Jul 30 13:14:22 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:14:22 x4 mountd[556]: bad exports list line '/mnt': symbolic link in export path or statfs failed Jul 30 13:14:23 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:14:27 x4 syslogd: last message repeated 12 times Jul 30 13:14:27 x4 mountd[556]: can't export /mnt Jul 30 13:14:29 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:14:34 x4 syslogd: last message repeated 20 times Jul 30 13:14:34 x4 mountd[556]: can't export /mnt Jul 30 13:14:34 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:14:37 x4 syslogd: last message repeated 3 times Jul 30 13:14:37 x4 mountd[556]: can't export /mnt Jul 30 13:14:38 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:14:40 x4 syslogd: last message repeated 8 times Jul 30 13:14:41 x4 mountd[556]: can't export /mnt Jul 30 13:14:41 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:14:44 x4 syslogd: last message repeated 8 times Jul 30 13:14:45 x4 mountd[556]: can't export /mnt Jul 30 13:14:45 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:14:51 x4 syslogd: last message repeated 18 times Jul 30 13:14:52 x4 mountd[556]: can't export /mnt Jul 30 13:14:53 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:14:56 x4 syslogd: last message repeated 12 times Jul 30 13:14:56 x4 mountd[556]: can't export /mnt Jul 30 13:14:56 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:14:57 x4 syslogd: last message repeated 3 times Jul 30 13:14:57 x4 mountd[556]: can't export /mnt Jul 30 13:14:58 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:15:01 x4 syslogd: last message repeated 8 times Jul 30 13:15:01 x4 mountd[556]: can't export /mnt Jul 30 13:15:02 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:15:04 x4 syslogd: last message repeated 6 times Jul 30 13:15:04 x4 mountd[556]: can't export /mnt Jul 30 13:15:04 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:15:06 x4 syslogd: last message repeated 5 times Jul 30 13:15:06 x4 mountd[556]: can't export /mnt Jul 30 13:15:06 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:15:13 x4 syslogd: last message repeated 18 times Jul 30 13:15:13 x4 mountd[556]: bad exports list line '/mnt': symbolic link in export path or statfs failed Jul 30 13:15:13 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:15:18 x4 syslogd: last message repeated 13 times Jul 30 13:15:19 x4 mountd[556]: can't export /mnt Jul 30 13:15:19 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:15:21 x4 syslogd: last message repeated 8 times Jul 30 13:15:22 x4 mountd[556]: can't export /mnt Jul 30 13:15:23 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:15:23 x4 syslogd: last message repeated 1 times Jul 30 13:15:23 x4 mountd[556]: can't export /mnt Jul 30 13:15:23 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:15:30 x4 syslogd: last message repeated 15 times Jul 30 13:15:31 x4 mountd[556]: can't export /mnt Jul 30 13:15:32 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:15:36 x4 syslogd: last message repeated 12 times Jul 30 13:15:36 x4 mountd[556]: can't export /mnt Jul 30 13:15:37 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:15:41 x4 syslogd: last message repeated 13 times Jul 30 13:15:42 x4 mountd[556]: can't export /mnt Jul 30 13:15:42 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:15:50 x4 syslogd: last message repeated 27 times Jul 30 13:15:50 x4 mountd[556]: can't export /mnt Jul 30 13:15:51 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:16:03 x4 syslogd: last message repeated 34 times Jul 30 13:16:03 x4 mountd[556]: can't export /mnt Jul 30 13:16:03 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:16:05 x4 syslogd: last message repeated 4 times Jul 30 13:16:05 x4 mountd[556]: can't export /mnt Jul 30 13:16:06 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:16:06 x4 syslogd: last message repeated 1 times Jul 30 13:16:07 x4 mountd[556]: can't export /mnt Jul 30 13:16:08 x4 syslogd: last message repeated 1 times Jul 30 13:16:08 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:16:09 x4 syslogd: last message repeated 5 times Jul 30 13:16:09 x4 mountd[556]: can't export /mnt Jul 30 13:16:10 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 Jul 30 13:16:17 x4 syslogd: last message repeated 14 times Jul 30 13:16:17 x4 mountd[556]: can't export /mnt Jul 30 13:16:17 x4 syslogd: last message repeated 1 times Jul 30 13:16:17 x4 mountd[556]: can't change attributes for /mnt: MNT_DEFEXPORTED already set for mount 0x187ed000 mount leak: 385/819 20190730 13:16:21 all (370/650): wire_no_page.sh Jul 30 13:16:19 x4 syslogd: last message repeated 6 times 20190730 13:21:26 all (371/650): nullfs25.sh root Password: Jul 30 13:26:33 x4 login[780]: ROOT LOGIN (root) ON ttyu0 Last login: Thu Jul 18 21:39:50 on ttyu0 FreeBSD 13.0-CURRENT (PHO) #0 r350437M: Tue Jul 30 07:48:56 CEST 2019 You have new mail. root@x4:~ # 20190730 13:26:34 all (372/650): devfs.sh uptime 1:26PM up 5:20, 4 users, load averages: 15.31, 16.32, 18.44 root@x4:~ # shutdown -p now Shutdown NOW! shutdown: [pid 22636] root@x4:~ # *** FINAL System shutdown message from root@x4.osted.lan *** System going down IMMEDIATELY System shutdown time has arrived Jul 30 13:26:55 x4 shutdown[22636]: power-down by root: Stopping inetd. Stopping nfscbd. Waiting for PIDS: 720 721. Shutting down local packages:. Stopping cron. Stopping sshd. Waiting for PIDS: 674. Stopping mdnsd. Waiting for PIDS: 54519Jul 30 13:27:04 x4 mDNSResponder[54519]: mDNSResponder (Engineering Build) (Jan 5 2019 05:28:44) stopping . Stopping smartd. Waiting for PIDS: 634. Stopping powerd. Waiting for PIDS: 610. Stopping ntpd. Stopping lockd. Stopping statd. Stopping nfsd. Waiting for PIDS: 562 565. Stopping mountd. Waiting for PIDS: 556. Stopping nfsuserd. Waiting for PIDS: 545 546 547 548 550. Stopping watchdogd. Waiting for PIDS: 502. Stopping rpcbind. Waiting for PIDS: 417if_delmulti_locked: detaching ifnet instance 0x185f9800 . Stopping devd. Waiting for PIDS: 336. Writing entropy file:. Writing early boot entropy file:. Terminated . Jul 30 13:27:21 x4 syslogd: exiting on signal 15 panic: vm_fault_hold: fault on nofault entry, addr: 0x83326000 cpuid = 0 time = 1564486041 KDB: stack backtrace: db_trace_self_wrapper(e6666d,1bdcda4,0,23a17534,bd2eb1,...) at db_trace_self_wrapper+0x2a/frame 0x23a17508 kdb_backtrace(e,0,0,2b06100,2db5000,...) at kdb_backtrace+0x2e/frame 0x23a17568 vpanic(163709e,23a175b0,23a175b0,23a17680,12c2044,...) at vpanic+0x121/frame 0x23a17590 panic(163709e,158dad9,83326000,4895800,7000004,...) at panic+0x14/frame 0x23a175a4 vm_fault_hold(2db5000,83326000,2,0,0) at vm_fault_hold+0x2474/frame 0x23a17680 vm_fault(2db5000,83326000,2,0) at vm_fault+0x4a/frame 0x23a176a8 trap_pfault(8332680c) at trap_pfault+0xf3/frame 0x23a176f4 trap(23a177bc,8,28,28,83df8640,...) at trap+0x3c0/frame 0x23a177b0 calltrap() at 0xffc0316d/frame 0x23a177b0 --- trap 0xc, eip = 0xf7f255, esp = 0x23a177fc, ebp = 0x23a17814 --- funsetownlst(27e5ea50) at funsetownlst+0xa5/frame 0x23a17814 pgdelete(27e5ea6c,23c00a80,1651842,36,23a178f8,...) at pgdelete+0x60/frame 0x23a17834 leavepgrp(298d46a8,0,1651842,396,44c,...) at leavepgrp+0xd5/frame 0x23a1784c proc_reap(23c00a80,298d46a8,23a17ba4,36,1edeb50,...) at proc_reap+0x714/frame 0x23a178f8 proc_to_reap(23c00a80,298d46a8,7,0,0,...) at proc_to_reap+0x718/frame 0x23a17998 kern_wait6(23c00a80,7,0,0,23a17ba4,...) at kern_wait6+0x37a/frame 0x23a17a78 kern_wait(23c00a80,ffffffff,23a17ba4,36,0,...) at kern_wait+0x119/frame 0x23a17b80 sys_wait4(23c00a80,23c00d0c) at sys_wait4+0x68/frame 0x23a17c08 syscall(23a17ce8,3b,3b,3b,0,...) at syscall+0x304/frame 0x23a17cdc Xint0x80_syscall() at 0xffc033b7/frame 0x23a17cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x20686553, esp = 0xffbfe778, ebp = 0xffbfe790 --- __bss_end() at 0x20686553 KDB: enter: panic [ thread pid 886 tid 100204 ] Stopped at kdb_enter+0x35: movl $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 886 tid 100204 td 0x23c00a80 kdb_enter(16562a0,16562a0) at kdb_enter+0x35/frame 0x23a17560 vpanic(163709e,23a175b0,23a175b0,23a17680,12c2044,...) at vpanic+0x139/frame 0x23a17590 panic(163709e,158dad9,83326000,4895800,7000004,...) at panic+0x14/frame 0x23a175a4 vm_fault_hold(2db5000,83326000,2,0,0) at vm_fault_hold+0x2474/frame 0x23a17680 vm_fault(2db5000,83326000,2,0) at vm_fault+0x4a/frame 0x23a176a8 trap_pfault(8332680c) at trap_pfault+0xf3/frame 0x23a176f4 trap(23a177bc,8,28,28,83df8640,...) at trap+0x3c0/frame 0x23a177b0 calltrap() at 0xffc0316d/frame 0x23a177b0 --- trap 0xc, eip = 0xf7f255, esp = 0x23a177fc, ebp = 0x23a17814 --- funsetownlst(27e5ea50) at funsetownlst+0xa5/frame 0x23a17814 pgdelete(27e5ea6c,23c00a80,1651842,36,23a178f8,...) at pgdelete+0x60/frame 0x23a17834 leavepgrp(298d46a8,0,1651842,396,44c,...) at leavepgrp+0xd5/frame 0x23a1784c proc_reap(23c00a80,298d46a8,23a17ba4,36,1edeb50,...) at proc_reap+0x714/frame 0x23a178f8 proc_to_reap(23c00a80,298d46a8,7,0,0,...) at proc_to_reap+0x718/frame 0x23a17998 kern_wait6(23c00a80,7,0,0,23a17ba4,...) at kern_wait6+0x37a/frame 0x23a17a78 kern_wait(23c00a80,ffffffff,23a17ba4,36,0,...) at kern_wait+0x119/frame 0x23a17b80 sys_wait4(23c00a80,23c00d0c) at sys_wait4+0x68/frame 0x23a17c08 syscall(23a17ce8,3b,3b,3b,0,...) at syscall+0x304/frame 0x23a17cdc Xint0x80_syscall() at 0xffc033b7/frame 0x23a17cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x20686553, esp = 0xffbfe778, ebp = 0xffbfe790 --- __bss_end() at 0x20686553 db:1:pho1> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x8b8900 curthread = 0x23c00a80: pid 886 tid 100204 "bash" curpcb = 0x23a17d40 fpcurthread = 0x23c00a80: pid 886 "bash" idlethread = 0x99e1700: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 trampstk = 0xffc07ff0 kesp0 = 0x23a17d30 common_tssp = 0xffc01260 tlb gen = 382133320 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0x7c1f900 curthread = 0x23c01000: pid 871 tid 100203 "sshd" curpcb = 0x23a12d40 fpcurthread = 0x23c01000: pid 871 "sshd" idlethread = 0x99e1380: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 trampstk = 0xffc0aff0 kesp0 = 0x23a12d30 common_tssp = 0xffc012c8 tlb gen = 382133320 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0x7c24900 curthread = 0x99e1000: pid 11 tid 100005 "idle: cpu2" curpcb = 0x1252bd40 fpcurthread = none idlethread = 0x99e1000: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 trampstk = 0xffc0bff0 kesp0 = 0x1252bd30 common_tssp = 0xffc01330 tlb gen = 382133319 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0x7c29900 curthread = 0x99e0a80: pid 11 tid 100006 "idle: cpu3" curpcb = 0x12530d40 fpcurthread = none idlethread = 0x99e0a80: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 trampstk = 0xffc0dff0 kesp0 = 0x12530d30 common_tssp = 0xffc01398 tlb gen = 382133320 curvnet = 0 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes vnode 0x222f4b60: tag ufs, type VREG usecount 10, writecount -6, refcount 31 flags (VI_ACTIVE) v_object 0x21e07b94 ref 7 pages 80 cleanbuf 20 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xfa8d21 at lockmgr_slock_hard+0x2c1 #1 0xfa92e6 at __lockmgr_args+0x126 #2 0x12a15af at ffs_lock+0x6f #3 0x1565ec8 at VOP_LOCK1_APV+0x58 #4 0x109ffe8 at _vn_lock+0x58 #5 0x108e9db at vget+0x7b #6 0x12c1456 at vm_fault_hold+0x1886 #7 0x12bfb8a at vm_fault+0x4a #8 0x1534893 at trap_pfault+0xf3 #9 0x153406b at trap+0x57b #10 0xffc0316d at exit_tag+0xd15f613d nlink=1, effnlink=1, size=620992, extsize 0 generation=5661b93a, uid=0, gid=25, flags=0x0 ino 1719460, on dev ada0s1d vnode 0x238f0444: tag ufs, type VREG usecount 14, writecount -9, refcount 18 flags (VI_ACTIVE) v_object 0x24648c30 ref 10 pages 12 cleanbuf 3 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xfa8d21 at lockmgr_slock_hard+0x2c1 #1 0xfa92e6 at __lockmgr_args+0x126 #2 0x12a15af at ffs_lock+0x6f #3 0x1565ec8 at VOP_LOCK1_APV+0x58 #4 0x109ffe8 at _vn_lock+0x58 #5 0x108e9db at vget+0x7b #6 0x12c1456 at vm_fault_hold+0x1886 #7 0x12bfb8a at vm_fault+0x4a #8 0x1534893 at trap_pfault+0xf3 #9 0x153406b at trap+0x57b #10 0xffc0316d at exit_tag+0xd15f613d nlink=1, effnlink=1, size=940420, extsize 0 generation=347fec1a, uid=0, gid=0, flags=0x0 ino 1342668, on dev ada0s1d db:1:pho1> show allchains chain 1: thread 100214 (pid 40420, aiod4) sleeping on 0x21e306a8 "aiordy" chain 2: thread 106096 (pid 40419, aiod3) sleeping on 0x295f89fc "aiordy" chain 3: thread 103299 (pid 40418, aiod2) sleeping on 0x796d4000 "aiordy" chain 4: thread 107093 (pid 40417, aiod1) sleeping on 0x276236a8 "aiordy" chain 5: thread 102803 (pid 91667, bash) sleeping on 0x970ead4 "biord" chain 6: thread 101963 (pid 91489, sshd) sleeping on 0x277f370c "swread" chain 7: thread 101561 (pid 42777, sshd) sleeping on 0x27fbc8e0 "swread" chain 8: thread 100887 (pid 42776, sshd) sleeping on 0x28f41ef8 "swread" chain 9: thread 100304 (pid 42759, sshd) sleeping on 0x27f8549c "swread" chain 10: thread 100123 (pid 884, csh) sleeping on 0x95b7a60 "pause" chain 11: thread 100111 (pid 874, bash) sleeping on 0x24b5370c "swread" chain 12: thread 100172 (pid 680, sendmail) sleeping on 0x215dac88 "swread" chain 13: thread 100166 (pid 677, sendmail) sleeping on 0x98051cc "biord" chain 14: thread 100121 (pid 408, syslogd) sleeping on 0x215dbab4 "swread" chain 15: thread 100104 (pid 25, syncer) sleeping on 0x1f4c064 "syncer" chain 16: thread 100103 (pid 24, vnlru) sleeping on 0x17e52354 "vlruwt" chain 17: thread 100100 (pid 23, bufdaemon) sleeping on 0x1f4b9fc "qsleep" chain 18: thread 100102 (pid 23, bufspacedaemon-0) sleeping on 0x1bfff40 "-" chain 19: thread 100113 (pid 23, /home worker) sleeping on 0x21098c84 "sdflush" chain 20: thread 100114 (pid 23, /tmp worker) sleeping on 0x185b8684 "sdflush" chain 21: thread 100115 (pid 23, /usr worker) sleeping on 0x185b8484 "sdflush" chain 22: thread 100116 (pid 23, /var worker) sleeping on 0x185b8284 "sdflush" chain 23: thread 100098 (pid 22, vmdaemon) sleeping on 0x1f61478 "psleep" chain 24: thread 100097 (pid 21, dom0) sleeping on 0x1f95a1c "psleep" chain 25: thread 100099 (pid 21, laundry: dom0) sleeping on 0x1f95a28 "launds" chain 26: thread 100101 (pid 21, uma) sleeping on 0x12bcae0 "umarcl" chain 27: thread 100094 (pid 20, rand_harvestq) sleeping on 0x1d36f04 "-" chain 28: thread 100090 (pid 19, sctp_iterator) sleeping on 0x1f94afc "waiting_for_work" chain 29: thread 100089 (pid 18, soaiod4) sleeping on 0x1f4b628 "-" chain 30: thread 100088 (pid 17, soaiod3) sleeping on 0x1f4b628 "-" chain 31: thread 100087 (pid 16, soaiod2) sleeping on 0x1f4b628 "-" chain 32: thread 100086 (pid 9, soaiod1) sleeping on 0x1f4b628 "-" chain 33: thread 100083 (pid 8, fdc0) sleeping on 0x17b4a23c "-" chain 34: thread 100048 (pid 15, usbus0) sleeping on 0x17b8bacc "-" chain 35: thread 100049 (pid 15, usbus0) sleeping on 0x17b8bafc "-" chain 36: thread 100050 (pid 15, usbus0) sleeping on 0x17b8bb2c "-" chain 37: thread 100051 (pid 15, usbus0) sleeping on 0x17b8bb5c "-" chain 38: thread 100052 (pid 15, usbus0) sleeping on 0x17b8bb8c "-" chain 39: thread 100054 (pid 15, usbus1) sleeping on 0x17e5facc "-" chain 40: thread 100055 (pid 15, usbus1) sleeping on 0x17e5fafc "-" chain 41: thread 100056 (pid 15, usbus1) sleeping on 0x17e5fb2c "-" chain 42: thread 100057 (pid 15, usbus1) sleeping on 0x17e5fb5c "-" chain 43: thread 100058 (pid 15, usbus1) sleeping on 0x17e5fb8c "-" chain 44: thread 100060 (pid 15, usbus2) sleeping on 0x17e66acc "-" chain 45: thread 100061 (pid 15, usbus2) sleeping on 0x17e66afc "-" chain 46: thread 100062 (pid 15, usbus2) sleeping on 0x17e66b2c "-" chain 47: thread 100063 (pid 15, usbus2) sleeping on 0x17e66b5c "-" chain 48: thread 100064 (pid 15, usbus2) sleeping on 0x17e66b8c "-" chain 49: thread 100065 (pid 15, usbus3) sleeping on 0x17e6aacc "-" chain 50: thread 100066 (pid 15, usbus3) sleeping on 0x17e6aafc "-" chain 51: thread 100067 (pid 15, usbus3) sleeping on 0x17e6ab2c "-" chain 52: thread 100068 (pid 15, usbus3) sleeping on 0x17e6ab5c "-" chain 53: thread 100069 (pid 15, usbus3) sleeping on 0x17e6ab8c "-" chain 54: thread 100070 (pid 15, usbus4) sleeping on 0x17e71acc "-" chain 55: thread 100071 (pid 15, usbus4) sleeping on 0x17e71afc "-" chain 56: thread 100072 (pid 15, usbus4) sleeping on 0x17e71b2c "-" chain 57: thread 100073 (pid 15, usbus4) sleeping on 0x17e71b5c "-" chain 58: thread 100074 (pid 15, usbus4) sleeping on 0x17e71b8c "-" chain 59: thread 100076 (pid 15, usbus5) sleeping on 0x17b85ca4 "-" chain 60: thread 100077 (pid 15, usbus5) sleeping on 0x17b85cd4 "-" chain 61: thread 100078 (pid 15, usbus5) sleeping on 0x17b85d04 "-" chain 62: thread 100079 (pid 15, usbus5) sleeping on 0x17b85d34 "-" chain 63: thread 100080 (pid 15, usbus5) sleeping on 0x17b85d64 "-" chain 64: thread 100043 (pid 7, doneq0) sleeping on 0x1c703c0 "-" chain 65: thread 100096 (pid 7, scanner) sleeping on 0x1c702ec "-" chain 66: thread 100042 (pid 6, crypto returns 3) sleeping on 0x95180c4 "crypto_ret_wait" chain 67: thread 100041 (pid 5, crypto returns 2) sleeping on 0x951808c "crypto_ret_wait" chain 68: thread 100040 (pid 4, crypto returns 1) sleeping on 0x9518054 "crypto_ret_wait" chain 69: thread 100039 (pid 3, crypto returns 0) sleeping on 0x951801c "crypto_ret_wait" chain 70: thread 100038 (pid 2, crypto) sleeping on 0x1f60278 "crypto_wait" chain 71: thread 100033 (pid 14, sequencer 00) sleeping on 0x958544c "seqstate" chain 72: thread 100030 (pid 13, g_event) sleeping on 0x1f84aa4 "-" chain 73: thread 100031 (pid 13, g_up) sleeping on 0x1f84aac "-" chain 74: thread 100032 (pid 13, g_down) sleeping on 0x1f84aa0 "-" chain 75: thread 100002 (pid 1, init) sleeping on 0x99d89fc "wait" chain 76: thread 100001 (pid 10, audit) sleeping on 0x1f952e0 "audit_worker_cv" chain 77: thread 100000 (pid 0, swapper) sleeping on 0x1f84ac4 "swapin" chain 78: thread 100007 (pid 0, aiod_kick taskq) sleeping on 0x947f180 "-" chain 79: thread 100010 (pid 0, thread taskq) sleeping on 0x947f000 "-" chain 80: thread 100012 (pid 0, config_0) sleeping on 0x947ee80 "-" chain 81: thread 100013 (pid 0, kqueue_ctx taskq) sleeping on 0x947ee00 "-" chain 82: thread 100014 (pid 0, if_config_tqg_0) sleeping on 0x947ed80 "-" chain 83: thread 100015 (pid 0, if_io_tqg_0) sleeping on 0x947ed00 "-" chain 84: thread 100016 (pid 0, if_io_tqg_1) sleeping on 0x947ec80 "-" chain 85: thread 100017 (pid 0, if_io_tqg_2) sleeping on 0x947ec00 "-" chain 86: thread 100018 (pid 0, if_io_tqg_3) sleeping on 0x947eb80 "-" chain 87: thread 100019 (pid 0, softirq_0) sleeping on 0x947eb00 "-" chain 88: thread 100020 (pid 0, softirq_1) sleeping on 0x947ea80 "-" chain 89: thread 100021 (pid 0, softirq_2) sleeping on 0x947ea00 "-" chain 90: thread 100022 (pid 0, softirq_3) sleeping on 0x947e980 "-" chain 91: thread 100029 (pid 0, firmware taskq) sleeping on 0x9590080 "-" chain 92: thread 100034 (pid 0, crypto_0) sleeping on 0x958fe00 "-" chain 93: thread 100035 (pid 0, crypto_1) sleeping on 0x958fe00 "-" chain 94: thread 100036 (pid 0, crypto_2) sleeping on 0x958fe00 "-" chain 95: thread 100037 (pid 0, crypto_3) sleeping on 0x958fe00 "-" chain 96: thread 100085 (pid 0, mca taskq) sleeping on 0x17b99f00 "-" chain 97: thread 100091 (pid 0, acpi_task_0) sleeping on 0x18100180 "-" chain 98: thread 100092 (pid 0, acpi_task_1) sleeping on 0x18100180 "-" chain 99: thread 100093 (pid 0, acpi_task_2) sleeping on 0x18100180 "-" chain 100: thread 100095 (pid 0, CAM taskq) sleeping on 0x958fc80 "-" db:1:pho1> show mount 0x187ed000 /dev/ada0s1a on / (ufs) 0x187ee000 devfs on /dev (devfs) 0x187ec000 /dev/ada0s1f on /home (ufs) 0x2118b000 /dev/label/tmp on /tmp (ufs) 0x2118a000 /dev/ada0s1d on /usr (ufs) 0x21189000 /dev/ada0s1e on /var (ufs) 0x211e3000 procfs on /proc (procfs) 0x23c08000 devfs on /mnt11 (devfs) 0x23cfd000 devfs on /mnt13 (devfs) 0x23f77000 devfs on /mnt1 (devfs) 0x24094000 devfs on /mnt2 (devfs) More info: show mount db:1:pho1> show bufqueues bqempty: 0 Buf domain 0 freebufs 454 lofreebufs 311 hifreebufs 466 bufspace 81045504 maxbufspace 94683136 hibufspace 94027776 lobufspace 89326372 bufspacethresh 91677074 numdirtybuffers 27 lodirtybuffers 732 hidirtybuffers 1464 dirtybufthresh 1317 cleanq count 5263 (80144384) dirtyq count 27 (428032) wakeup 0 lim 28 CPU 3, 7, 7, 15, Locked buffers: 3 space 49152 Total buffers: 5779 space 81045504 db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 40420 0 0 0 DL aiordy 0x21e306a8 [aiod4] 40419 0 0 0 DL aiordy 0x295f89fc [aiod3] 40418 0 0 0 DL aiordy 0x796d4000 [aiod2] 40417 0 0 0 DL aiordy 0x276236a8 [aiod1] 91667 1 91667 1001 Ds+ biord 0x970ead4 bash 91489 1 91489 0 Ds swread 0x277f370c sshd 42777 1 42777 0 Ds swread 0x27fbc8e0 sshd 42776 1 42776 0 Ds swread 0x28f41ef8 sshd 42759 1 42759 0 Ds swread 0x27f8549c sshd 886 884 886 0 R+ CPU 0 bash 884 1 884 0 SW+ pause 0x95b7a60 csh 874 1 874 1001 Ds+ swread 0x24b5370c bash 871 1 871 0 Rs CPU 1 sshd 680 1 680 25 Ds swread 0x215dac88 sendmail 677 1 677 0 Ds biord 0x98051cc sendmail 408 1 408 0 Ds swread 0x215dbab4 syslogd 25 0 0 0 DL syncer 0x1f4c064 [syncer] 24 0 0 0 DL vlruwt 0x17e52354 [vnlru] 23 0 0 0 DL (threaded) [bufdaemon] 100100 D qsleep 0x1f4b9fc [bufdaemon] 100102 D - 0x1bfff40 [bufspacedaemon-0] 100113 D sdflush 0x21098c84 [/home worker] 100114 D sdflush 0x185b8684 [/tmp worker] 100115 D sdflush 0x185b8484 [/usr worker] 100116 D sdflush 0x185b8284 [/var worker] 22 0 0 0 DL psleep 0x1f61478 [vmdaemon] 21 0 0 0 DL (threaded) [pagedaemon] 100097 D psleep 0x1f95a1c [dom0] 100099 D launds 0x1f95a28 [laundry: dom0] 100101 D umarcl 0x12bcae0 [uma] 20 0 0 0 DL - 0x1d36f04 [rand_harvestq] 19 0 0 0 DL waiting 0x1f94afc [sctp_iterator] 18 0 0 0 DL - 0x1f4b628 [soaiod4] 17 0 0 0 DL - 0x1f4b628 [soaiod3] 16 0 0 0 DL - 0x1f4b628 [soaiod2] 9 0 0 0 DL - 0x1f4b628 [soaiod1] 8 0 0 0 DL - 0x17b4a23c [fdc0] 15 0 0 0 DL (threaded) [usb] 100048 D - 0x17b8bacc [usbus0] 100049 D - 0x17b8bafc [usbus0] 100050 D - 0x17b8bb2c [usbus0] 100051 D - 0x17b8bb5c [usbus0] 100052 D - 0x17b8bb8c [usbus0] 100054 D - 0x17e5facc [usbus1] 100055 D - 0x17e5fafc [usbus1] 100056 D - 0x17e5fb2c [usbus1] 100057 D - 0x17e5fb5c [usbus1] 100058 D - 0x17e5fb8c [usbus1] 100060 D - 0x17e66acc [usbus2] 100061 D - 0x17e66afc [usbus2] 100062 D - 0x17e66b2c [usbus2] 100063 D - 0x17e66b5c [usbus2] 100064 D - 0x17e66b8c [usbus2] 100065 D - 0x17e6aacc [usbus3] 100066 D - 0x17e6aafc [usbus3] 100067 D - 0x17e6ab2c [usbus3] 100068 D - 0x17e6ab5c [usbus3] 100069 D - 0x17e6ab8c [usbus3] 100070 D - 0x17e71acc [usbus4] 100071 D - 0x17e71afc [usbus4] 100072 D - 0x17e71b2c [usbus4] 100073 D - 0x17e71b5c [usbus4] 100074 D - 0x17e71b8c [usbus4] 100076 D - 0x17b85ca4 [usbus5] 100077 D - 0x17b85cd4 [usbus5] 100078 D - 0x17b85d04 [usbus5] 100079 D - 0x17b85d34 [usbus5] 100080 D - 0x17b85d64 [usbus5] 7 0 0 0 DL (threaded) [cam] 100043 D - 0x1c703c0 [doneq0] 100096 D - 0x1c702ec [scanner] 6 0 0 0 DL crypto_ 0x95180c4 [crypto returns 3] 5 0 0 0 DL crypto_ 0x951808c [crypto returns 2] 4 0 0 0 DL crypto_ 0x9518054 [crypto returns 1] 3 0 0 0 DL crypto_ 0x951801c [crypto returns 0] 2 0 0 0 DL crypto_ 0x1f60278 [crypto] 14 0 0 0 DL seqstat 0x958544c [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100030 D - 0x1f84aa4 [g_event] 100031 D - 0x1f84aac [g_up] 100032 D - 0x1f84aa0 [g_down] 12 0 0 0 WL (threaded) [intr] 100008 I [swi6: task queue] 100009 I [swi6: Giant taskq] 100011 I [swi5: fast taskq] 100023 I [swi4: clock (0)] 100024 I [swi4: clock (1)] 100025 I [swi4: clock (2)] 100026 I [swi4: clock (3)] 100027 I [swi1: netisr 0] 100028 I [swi3: vm] 100044 I [irq24: hdac0] 100045 I [irq25: re0] 100046 I [irq22: ahci0] 100047 I [irq16: hdac1 ohci0] 100053 I [irq17: ohci1 ohci3] 100059 I [irq18: ohci2 ohci4] 100075 I [irq19: ehci0] 100081 I [irq14: ata0] 100082 I [swi0: uart] 100084 I [irq1: atkbd0] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 1 0 1 0 SLs wait 0x99d89fc [init] 10 0 0 0 DL audit_w 0x1f952e0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0x1f84ac4 [swapper] 100007 D - 0x947f180 [aiod_kick taskq] 100010 D - 0x947f000 [thread taskq] 100012 D - 0x947ee80 [config_0] 100013 D - 0x947ee00 [kqueue_ctx taskq] 100014 D - 0x947ed80 [if_config_tqg_0] 100015 D - 0x947ed00 [if_io_tqg_0] 100016 D - 0x947ec80 [if_io_tqg_1] 100017 D - 0x947ec00 [if_io_tqg_2] 100018 D - 0x947eb80 [if_io_tqg_3] 100019 D - 0x947eb00 [softirq_0] 100020 D - 0x947ea80 [softirq_1] 100021 D - 0x947ea00 [softirq_2] 100022 D - 0x947e980 [softirq_3] 100029 D - 0x9590080 [firmware taskq] 100034 D - 0x958fe00 [crypto_0] 100035 D - 0x958fe00 [crypto_1] 100036 D - 0x958fe00 [crypto_2] 100037 D - 0x958fe00 [crypto_3] 100085 D - 0x17b99f00 [mca taskq] 100091 D - 0x18100180 [acpi_task_0] 100092 D - 0x18100180 [acpi_task_1] 100093 D - 0x18100180 [acpi_task_2] 100095 D - 0x958fc80 [CAM taskq] 42969 42777 42777 1001 Z sshd 873 871 871 1001 Z sshd 91626 91489 91489 1001 Z sshd 42972 42759 42759 1001 Z sshd 42971 42776 42776 1001 Z sshd 883 874 883 1001 Z+ su 42969 42777 42777 1001 Z sshd db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 09 (002048K) | 000000 08 (001024K) | 000000 07 (000512K) | 000000 06 (000256K) | 000000 05 (000128K) | 000000 04 (000064K) | 000000 03 (000032K) | 000000 02 (000016K) | 000000 01 (000008K) | 000000 00 (000004K) | 000000 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 09 (002048K) | 000005 08 (001024K) | 000003 07 (000512K) | 000132 06 (000256K) | 001171 05 (000128K) | 004008 04 (000064K) | 007814 03 (000032K) | 010405 02 (000016K) | 015617 01 (000008K) | 021318 00 (000004K) | 029638 FREE LIST 2: ORDER (SIZE) | NUMBER | POOL 0 -- -- -- -- 09 (002048K) | 000000 08 (001024K) | 000000 07 (000512K) | 000000 06 (000256K) | 000001 05 (000128K) | 000001 04 (000064K) | 000001 03 (000032K) | 000002 02 (000016K) | 000003 01 (000008K) | 000003 00 (000004K) | 000001 db:0:pho> acttrace Tracing command bash pid 886 tid 100204 td 0x23c00a80 (CPU 0) kdb_enter(16562a0,16562a0) at kdb_enter+0x35/frame 0x23a17560 vpanic(163709e,23a175b0,23a175b0,23a17680,12c2044,...) at vpanic+0x139/frame 0x23a17590 panic(163709e,158dad9,83326000,4895800,7000004,...) at panic+0x14/frame 0x23a175a4 vm_fault_hold(2db5000,83326000,2,0,0) at vm_fault_hold+0x2474/frame 0x23a17680 vm_fault(2db5000,83326000,2,0) at vm_fault+0x4a/frame 0x23a176a8 trap_pfault(8332680c) at trap_pfault+0xf3/frame 0x23a176f4 trap(23a177bc,8,28,28,83df8640,...) at trap+0x3c0/frame 0x23a177b0 calltrap() at 0xffc0316d/frame 0x23a177b0 --- trap 0xc, eip = 0xf7f255, esp = 0x23a177fc, ebp = 0x23a17814 --- funsetownlst(27e5ea50) at funsetownlst+0xa5/frame 0x23a17814 pgdelete(27e5ea6c,23c00a80,1651842,36,23a178f8,...) at pgdelete+0x60/frame 0x23a17834 leavepgrp(298d46a8,0,1651842,396,44c,...) at leavepgrp+0xd5/frame 0x23a1784c proc_reap(23c00a80,298d46a8,23a17ba4,36,1edeb50,...) at proc_reap+0x714/frame 0x23a178f8 proc_to_reap(23c00a80,298d46a8,7,0,0,...) at proc_to_reap+0x718/frame 0x23a17998 kern_wait6(23c00a80,7,0,0,23a17ba4,...) at kern_wait6+0x37a/frame 0x23a17a78 kern_wait(23c00a80,ffffffff,23a17ba4,36,0,...) at kern_wait+0x119/frame 0x23a17b80 sys_wait4(23c00a80,23c00d0c) at sys_wait4+0x68/frame 0x23a17c08 syscall(23a17ce8,3b,3b,3b,0,...) at syscall+0x304/frame 0x23a17cdc Xint0x80_syscall() at 0xffc033b7/frame 0x23a17cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x20686553, esp = 0xffbfe778, ebp = 0xffbfe790 --- __bss_end() at 0x20686553 Tracing command sshd pid 871 tid 100203 td 0x23c01000 (CPU 1) cpustop_handler(1,ffc0afa8,ffc0af9c,1533bb2,0,...) at cpustop_handler+0x27/frame 0xffc0aed8 ipi_nmi_handler(0,0,23c01000,0,2242a354,...) at ipi_nmi_handler+0x34/frame 0xffc0aee8 trap(ffc0afa8,3b,3b,3b,20460405,...) at trap+0xc2/frame 0xffc0af9c calltrap() at 0xffc0316d/frame 0xffc0af9c --- trap 0x13, eip = 0x20a4ee21, esp = 0xffbfdff4, ebp = 0xffbfe008 --- __bss_end() at 0x20a4ee21 Tracing command idle pid 11 tid 100005 td 0x99e1000 (CPU 2) cpustop_handler(2,1252bbbc,1252bbb0,1533bb2,986add0,...) at cpustop_handler+0x27/frame 0x1252bae8 ipi_nmi_handler(986add0,0,99e1000,e0,99d86a8,...) at ipi_nmi_handler+0x34/frame 0x1252baf8 trap(1252bbbc,8,28,28,17b0b400,...) at trap+0xc2/frame 0x1252bbb0 calltrap() at 0xffc0316d/frame 0x1252bbb0 --- trap 0x13, eip = 0x1549ba5, esp = 0x1252bbfc, ebp = 0x1252bbfc --- acpi_cpu_c1(0,2,1fa2,9b753356,986adc0,...) at acpi_cpu_c1+0x5/frame 0x1252bbfc acpi_cpu_idle(7964bf5,0) at acpi_cpu_idle+0x230/frame 0x1252bc2c cpu_idle_acpi(7964bf5,0) at cpu_idle_acpi+0x35/frame 0x1252bc40 cpu_idle(0) at cpu_idle+0xa3/frame 0x1252bc5c sched_idletd(0,1252bce8) at sched_idletd+0x3ee/frame 0x1252bcb4 fork_exit(ffcf30,0,1252bce8,0,0,...) at fork_exit+0x6c/frame 0x1252bcd4 fork_trampoline() at 0xffc033ca/frame 0x1252bcd4 --- trap 0, eip = 0, esp = 0x1252bd20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100006 td 0x99e0a80 (CPU 3) cpustop_handler(3,12530bbc,12530bb0,1533bb2,1f92600,...) at cpustop_handler+0x27/frame 0x12530ae8 ipi_nmi_handler(1f92600,30,99e0a80,1f92670,99d86a8,...) at ipi_nmi_handler+0x34/frame 0x12530af8 trap(12530bbc,8,28,28,17b0b200,...) at trap+0xc2/frame 0x12530bb0 calltrap() at 0xffc0316d/frame 0x12530bb0 --- trap 0x13, eip = 0x1549ba5, esp = 0x12530bfc, ebp = 0x12530bfc --- acpi_cpu_c1(0,3,1fa2,9bb276ce,986fdc0,...) at acpi_cpu_c1+0x5/frame 0x12530bfc acpi_cpu_idle(be15d73,0) at acpi_cpu_idle+0x230/frame 0x12530c2c cpu_idle_acpi(be15d73,0) at cpu_idle_acpi+0x35/frame 0x12530c40 cpu_idle(0) at cpu_idle+0xa3/frame 0x12530c5c sched_idletd(0,12530ce8) at sched_idletd+0x3ee/frame 0x12530cb4 fork_exit(ffcf30,0,12530ce8,0,0,...) at fork_exit+0x6c/frame 0x12530cd4 fork_trampoline() at 0xffc033ca/frame 0x12530cd4 --- trap 0, eip = 0, esp = 0x12530d20, ebp = 0 --- (null)() at 0 db:0:pho> alltrace Tracing command aiod4 pid 40420 tid 100214 td 0x24cbb700 sched_switch(24cbb700,0,104) at sched_switch+0x598/frame 0x2e0e0bac mi_switch(104,0) at mi_switch+0x1de/frame 0x2e0e0bdc sleepq_switch(1,24cbb700,177,24cbb700,0,...) at sleepq_switch+0xe1/frame 0x2e0e0c00 sleepq_timedwait(21e306a8,5c,3,3,246e9030,...) at sleepq_timedwait+0x47/frame 0x2e0e0c30 _sleep(21e306a8,1f4b970,5c,15c3f06,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0x2e0e0c70 aio_daemon(4,2e0e0ce8) at aio_daemon+0x297/frame 0x2e0e0cb4 fork_exit(106ce60,4,2e0e0ce8,0,0,...) at fork_exit+0x6c/frame 0x2e0e0cd4 fork_trampoline() at 0xffc033ca/frame 0x2e0e0cd4 --- trap 0, eip = 0, esp = 0x2e0e0d20, ebp = 0 --- (null)() at 0 Tracing command aiod3 pid 40419 tid 106096 td 0x21eec380 sched_switch(21eec380,0,104) at sched_switch+0x598/frame 0x2830dbac mi_switch(104,0) at mi_switch+0x1de/frame 0x2830dbdc sleepq_switch(1,21eec380,177,21eec380,0,...) at sleepq_switch+0xe1/frame 0x2830dc00 sleepq_timedwait(295f89fc,5c,ffc04f45,8,28,...) at sleepq_timedwait+0x47/frame 0x2830dc30 _sleep(295f89fc,1f4b970,5c,15c3f06,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0x2830dc70 aio_daemon(3,2830dce8) at aio_daemon+0x297/frame 0x2830dcb4 fork_exit(106ce60,3,2830dce8,0,0,...) at fork_exit+0x6c/frame 0x2830dcd4 fork_trampoline() at 0xffc033ca/frame 0x2830dcd4 --- trap 0, eip = 0, esp = 0x2830dd20, ebp = 0 --- (null)() at 0 Tracing command aiod2 pid 40418 tid 103299 td 0x28b13a80 sched_switch(28b13a80,0,104) at sched_switch+0x598/frame 0xb25a6bac mi_switch(104,0) at mi_switch+0x1de/frame 0xb25a6bdc sleepq_switch(2,28b13a80,177,28b13a80,0,...) at sleepq_switch+0xe1/frame 0xb25a6c00 sleepq_timedwait(796d4000,5c,0,b25a6c68,fb3367,...) at sleepq_timedwait+0x47/frame 0xb25a6c30 _sleep(796d4000,1f4b970,5c,15c3f06,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0xb25a6c70 aio_daemon(2,b25a6ce8) at aio_daemon+0x297/frame 0xb25a6cb4 fork_exit(106ce60,2,b25a6ce8,0,0,...) at fork_exit+0x6c/frame 0xb25a6cd4 fork_trampoline() at 0xffc033ca/frame 0xb25a6cd4 --- trap 0, eip = 0, esp = 0xb25a6d20, ebp = 0 --- (null)() at 0 Tracing command aiod1 pid 40417 tid 107093 td 0x25b54700 sched_switch(25b54700,0,104) at sched_switch+0x598/frame 0x2e41bbac mi_switch(104,0) at mi_switch+0x1de/frame 0x2e41bbdc sleepq_switch(0,25b54700,177,25b54700,0,...) at sleepq_switch+0xe1/frame 0x2e41bc00 sleepq_timedwait(276236a8,5c,2c616950,41bc68,8bba7020,...) at sleepq_timedwait+0x47/frame 0x2e41bc30 _sleep(276236a8,1f4b970,5c,15c3f06,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0x2e41bc70 aio_daemon(1,2e41bce8) at aio_daemon+0x297/frame 0x2e41bcb4 fork_exit(106ce60,1,2e41bce8,0,0,...) at fork_exit+0x6c/frame 0x2e41bcd4 fork_trampoline() at 0xffc033ca/frame 0x2e41bcd4 --- trap 0, eip = 0, esp = 0x2e41bd20, ebp = 0 --- (null)() at 0 Tracing command bash pid 91667 tid 102803 td 0x1816d380 sched_switch(1816d380,0,104) at sched_switch+0x598/frame 0x2d20d884 mi_switch(104,0) at mi_switch+0x1de/frame 0x2d20d8b8 sleepq_switch(1816d380,0,970ead4,2d20d930,fdb4a7,...) at sleepq_switch+0xe1/frame 0x2d20d8dc sleepq_wait(970ead4,5c) at sleepq_wait+0x3a/frame 0x2d20d8f0 _sleep(970ead4,9439790,5c,15a77fe,0,0,0,0,100) at _sleep+0x307/frame 0x2d20d930 bufwait(970ead4) at bufwait+0x6b/frame 0x2d20d96c breadn_flags(238f0444,34,0,4000,0,0,0,219aa800,8,0,2d20d9d0) at breadn_flags+0x168/frame 0x2d20d98c vfs_bio_getpages(238f0444,2d20daf0,1,2d20db6c,2d20db70,12a3120,12a3150) at vfs_bio_getpages+0x40c/frame 0x2d20da20 ffs_getpages(2d20da68,2d20daf0,24648c40,2d20da98,12e922a,...) at ffs_getpages+0x5e/frame 0x2d20da44 VOP_GETPAGES_APV(1c2ad50,2d20da68) at VOP_GETPAGES_APV+0x6f/frame 0x2d20da58 vnode_pager_getpages(24648c30,2d20daf0,1,2d20db6c,2d20db70) at vnode_pager_getpages+0x5a/frame 0x2d20da98 vm_pager_get_pages(24648c30,2d20daf0,1,2d20db6c,2d20db70) at vm_pager_get_pages+0x44/frame 0x2d20dacc vm_fault_hold(2a8abbac,4d1000,4,0,0) at vm_fault_hold+0x1938/frame 0x2d20dbb0 vm_fault(2a8abbac,4d1000,4,0) at vm_fault+0x4a/frame 0x2d20dbd8 trap_pfault(4d14b0,17adeaa4,4d14b0,1816d380,4d14b0,...) at trap_pfault+0xf3/frame 0x2d20dc24 trap(2d20dce8,3b,3b,3b,ffbfe048,...) at trap+0x57b/frame 0x2d20dcdc calltrap() at 0xffc0316d/frame 0x2d20dcdc --- trap 0xc, eip = 0x4d14b0, esp = 0xffbfdc5c, ebp = 0xffbfe020 --- (null)() at 0x4d14b0 Tracing command sshd pid 91489 tid 101963 td 0x2a9a9700 sched_switch(2a9a9700,0,104) at sched_switch+0x598/frame 0x2b0bc96c mi_switch(104,0) at mi_switch+0x1de/frame 0x2b0bc99c sleepq_switch(3,2a9a9700,2a9a9700,0,277f370c,...) at sleepq_switch+0xe1/frame 0x2b0bc9c0 sleepq_timedwait(277f370c,50,1597102,0,1,...) at sleepq_timedwait+0x47/frame 0x2b0bc9ec _sleep(277f370c,277f36b4,50,15a936b,ffffe8e0,13,0,0,100) at _sleep+0x23c/frame 0x2b0bca2c swap_pager_getpages(277f36b4,2b0bcaf0,1,2b0bcb6c,2b0bcb70) at swap_pager_getpages+0x5e3/frame 0x2b0bca98 vm_pager_get_pages(277f36b4,2b0bcaf0,1,2b0bcb6c,2b0bcb70) at vm_pager_get_pages+0x44/frame 0x2b0bcacc vm_fault_hold(254103e4,43f000,1,0,0) at vm_fault_hold+0x1938/frame 0x2b0bcbb0 vm_fault(254103e4,43f000,1,0) at vm_fault+0x4a/frame 0x2b0bcbd8 trap_pfault(43f73c,299300a8,43cc20,2a9a9700,43f73c,...) at trap_pfault+0xf3/frame 0x2b0bcc24 trap(2b0bcce8,3b,3b,3b,ffbfe430,...) at trap+0x57b/frame 0x2b0bccdc calltrap() at 0xffc0316d/frame 0x2b0bccdc --- trap 0xc, eip = 0x43cc20, esp = 0xffbfe0a8, ebp = 0xffbfe0b4 --- (null)() at 0x43cc20 Tracing command sshd pid 42777 tid 101561 td 0x2990c700 sched_switch(2990c700,0,104) at sched_switch+0x598/frame 0x297f596c mi_switch(104,0) at mi_switch+0x1de/frame 0x297f599c sleepq_switch(2,2990c700,2990c700,0,27fbc8e0,...) at sleepq_switch+0xe1/frame 0x297f59c0 sleepq_timedwait(27fbc8e0,50,1597102,0,1,...) at sleepq_timedwait+0x47/frame 0x297f59ec _sleep(27fbc8e0,27fbc888,50,15a936b,ffffe8e0,13,0,0,100) at _sleep+0x23c/frame 0x297f5a2c swap_pager_getpages(27fbc888,297f5af0,1,297f5b6c,297f5b70) at swap_pager_getpages+0x5e3/frame 0x297f5a98 vm_pager_get_pages(27fbc888,297f5af0,1,297f5b6c,297f5b70) at vm_pager_get_pages+0x44/frame 0x297f5acc vm_fault_hold(986e914,442000,1,0,0) at vm_fault_hold+0x1938/frame 0x297f5bb0 vm_fault(986e914,442000,1,0) at vm_fault+0x4a/frame 0x297f5bd8 trap_pfault(4427a0,294093fc,430ef6,2990c700,4427a0,...) at trap_pfault+0xf3/frame 0x297f5c24 trap(297f5ce8,3b,3b,3b,ffbfe430,...) at trap+0x57b/frame 0x297f5cdc calltrap() at 0xffc0316d/frame 0x297f5cdc --- trap 0xc, eip = 0x430ef6, esp = 0xffbfe0b0, ebp = 0xffbfe0b4 --- (null)() at 0x430ef6 Tracing command sshd pid 42776 tid 100887 td 0x27612a80 sched_switch(27612a80,0,104) at sched_switch+0x598/frame 0x274e996c mi_switch(104,0) at mi_switch+0x1de/frame 0x274e999c sleepq_switch(2,27612a80,27612a80,0,28f41ef8,...) at sleepq_switch+0xe1/frame 0x274e99c0 sleepq_timedwait(28f41ef8,50,1597102,0,1,...) at sleepq_timedwait+0x47/frame 0x274e99ec _sleep(28f41ef8,28f41ea0,50,15a936b,ffffe8e0,13,0,0,100) at _sleep+0x23c/frame 0x274e9a2c swap_pager_getpages(28f41ea0,274e9af0,1,274e9b6c,274e9b70) at swap_pager_getpages+0x5e3/frame 0x274e9a98 vm_pager_get_pages(28f41ea0,274e9af0,1,274e9b6c,274e9b70) at vm_pager_get_pages+0x44/frame 0x274e9acc vm_fault_hold(2a5f014c,43f000,1,0,0) at vm_fault_hold+0x1938/frame 0x274e9bb0 vm_fault(2a5f014c,43f000,1,0) at vm_fault+0x4a/frame 0x274e9bd8 trap_pfault(43f73c,27623aa4,43cc20,27612a80,43f73c,...) at trap_pfault+0xf3/frame 0x274e9c24 trap(274e9ce8,3b,3b,3b,ffbfe430,...) at trap+0x57b/frame 0x274e9cdc calltrap() at 0xffc0316d/frame 0x274e9cdc --- trap 0xc, eip = 0x43cc20, esp = 0xffbfe0a8, ebp = 0xffbfe0b4 --- (null)() at 0x43cc20 Tracing command sshd pid 42759 tid 100304 td 0x25646a80 sched_switch(25646a80,0,104) at sched_switch+0x598/frame 0x2585696c mi_switch(104,0) at mi_switch+0x1de/frame 0x2585699c sleepq_switch(0,25646a80,25646a80,0,27f8549c,...) at sleepq_switch+0xe1/frame 0x258569c0 sleepq_timedwait(27f8549c,50,1597102,0,1,...) at sleepq_timedwait+0x47/frame 0x258569ec _sleep(27f8549c,27f85444,50,15a936b,ffffe8e0,13,0,0,100) at _sleep+0x23c/frame 0x25856a2c swap_pager_getpages(27f85444,25856af0,1,25856b6c,25856b70) at swap_pager_getpages+0x5e3/frame 0x25856a98 vm_pager_get_pages(27f85444,25856af0,1,25856b6c,25856b70) at vm_pager_get_pages+0x44/frame 0x25856acc vm_fault_hold(2464b14c,442000,1,0,0) at vm_fault_hold+0x1938/frame 0x25856bb0 vm_fault(2464b14c,442000,1,0) at vm_fault+0x4a/frame 0x25856bd8 trap_pfault(4427a0,256bc750,430ef6,25646a80,4427a0,...) at trap_pfault+0xf3/frame 0x25856c24 trap(25856ce8,3b,3b,3b,ffbfe430,...) at trap+0x57b/frame 0x25856cdc calltrap() at 0xffc0316d/frame 0x25856cdc --- trap 0xc, eip = 0x430ef6, esp = 0xffbfe0b0, ebp = 0xffbfe0b4 --- (null)() at 0x430ef6 Tracing command bash pid 886 tid 100204 td 0x23c00a80 (CPU 0) kdb_enter(16562a0,16562a0) at kdb_enter+0x35/frame 0x23a17560 vpanic(163709e,23a175b0,23a175b0,23a17680,12c2044,...) at vpanic+0x139/frame 0x23a17590 panic(163709e,158dad9,83326000,4895800,7000004,...) at panic+0x14/frame 0x23a175a4 vm_fault_hold(2db5000,83326000,2,0,0) at vm_fault_hold+0x2474/frame 0x23a17680 vm_fault(2db5000,83326000,2,0) at vm_fault+0x4a/frame 0x23a176a8 trap_pfault(8332680c) at trap_pfault+0xf3/frame 0x23a176f4 trap(23a177bc,8,28,28,83df8640,...) at trap+0x3c0/frame 0x23a177b0 calltrap() at 0xffc0316d/frame 0x23a177b0 --- trap 0xc, eip = 0xf7f255, esp = 0x23a177fc, ebp = 0x23a17814 --- funsetownlst(27e5ea50) at funsetownlst+0xa5/frame 0x23a17814 pgdelete(27e5ea6c,23c00a80,1651842,36,23a178f8,...) at pgdelete+0x60/frame 0x23a17834 leavepgrp(298d46a8,0,1651842,396,44c,...) at leavepgrp+0xd5/frame 0x23a1784c proc_reap(23c00a80,298d46a8,23a17ba4,36,1edeb50,...) at proc_reap+0x714/frame 0x23a178f8 proc_to_reap(23c00a80,298d46a8,7,0,0,...) at proc_to_reap+0x718/frame 0x23a17998 kern_wait6(23c00a80,7,0,0,23a17ba4,...) at kern_wait6+0x37a/frame 0x23a17a78 kern_wait(23c00a80,ffffffff,23a17ba4,36,0,...) at kern_wait+0x119/frame 0x23a17b80 sys_wait4(23c00a80,23c00d0c) at sys_wait4+0x68/frame 0x23a17c08 syscall(23a17ce8,3b,3b,3b,0,...) at syscall+0x304/frame 0x23a17cdc Xint0x80_syscall() at 0xffc033b7/frame 0x23a17cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x20686553, esp = 0xffbfe778, ebp = 0xffbfe790 --- __bss_end() at 0x20686553 Tracing command csh pid 884 tid 100123 td 0x211dfa80 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(23a17064,10275ac,1bdce18,0,1595255,...) at db_trace_self_wrapper+0x2a/frame 0x23a17028 kdb_backtrace(23a17148,1533bc4,a045e0,0,23c00a80,...) at kdb_backtrace+0x2e/frame 0x23a17088 kdb_reenter(a045e0,0,23c00a80,1018955,2242a000,...) at kdb_reenter+0x28/frame 0x23a17090 trap(23a17154,8,28,28,ffffffff,...) at trap+0xd4/frame 0x23a17148 calltrap() at 0xffc0316d/frame 0x23a17148 --- trap 0xc, eip = 0x15115e9, esp = 0x23a17194, ebp = 0x23a171a0 --- db_trace_thread(211dfa80,ffffffff) at db_trace_thread+0x29/frame 0x23a171a0 _db_stack_trace_all(1013d65,0,ffffffff,23a1722c) at _db_stack_trace_all+0xc4/frame 0x23a17200 db_command(1c72db2) at db_command+0x26f/frame 0x23a172b4 db_script_exec(bd20b0,0,1f65e68,23a17340) at db_script_exec+0x166/frame 0x23a17314 db_command(23a17418,a044aa,163ec31,0,23c00a80,...) at db_command+0x26f/frame 0x23a173c8 db_command_loop(163ec31,0,23c00a80,23a173d0,23a17418,...) at db_command_loop+0x52/frame 0x23a173d0 db_trap(3,0) at db_trap+0xfa/frame 0x23a17418 kdb_trap(3,0,23a1751c) at kdb_trap+0x12a/frame 0x23a1744c trap(23a1751c,8,28,28,100,...) at trap+0x3a6/frame 0x23a17510 calltrap() at 0xffc0316d/frame 0x23a17510 --- trap 0x3, eip = 0x1013d65, esp = 0x23a1755c, ebp = 0x23a17560 --- kdb_enter(16562a0,16562a0) at kdb_enter+0x35/frame 0x23a17560 vpanic(163709e,23a175b0,23a175b0,23a17680,12c2044,...) at vpanic+0x139/frame 0x23a17590 panic(163709e,158dad9,83326000,4895800,7000004,...) at panic+0x14/frame 0x23a175a4 vm_fault_hold(2db5000,83326000,2,0,0) at vm_fault_hold+0x2474/frame 0x23a17680 vm_fault(2db5000,83326000,2,0) at vm_fault+0x4a/frame 0x23a176a8 trap_pfault(8332680c) at trap_pfault+0xf3/frame 0x23a176f4 trap(23a177bc,8,28,28,83df8640,...) at trap+0x3c0/frame 0x23a177b0 calltrap() at 0xffc0316d/frame 0x23a177b0 --- trap 0xc, eip = 0xf7f255, esp = 0x23a177fc, ebp = 0x23a17814 --- funsetownlst(27e5ea50) at funsetownlst+0xa5/frame 0x23a17814 pgdelete(27e5ea6c,23c00a80,1651842,36,23a178f8,...) at pgdelete+0x60/frame 0x23a17834 leavepgrp(298d46a8,0,1651842,396,44c,...) at leavepgrp+0xd5/frame 0x23a1784c proc_reap(23c00a80,298d46a8,23a17ba4,36,1edeb50,...) at proc_reap+0x714/frame 0x23a178f8 proc_to_reap(23c00a80,298d46a8,7,0,0,...) at proc_to_reap+0x718/frame 0x23a17998 kern_wait6(23c00a80,7,0,0,23a17ba4,...) at kern_wait6+0x37a/frame 0x23a17a78 kern_wait(23c00a80,ffffffff,23a17ba4,36,0,...) at kern_wait+0x119/frame 0x23a17b80 sys_wait4(23c00a80,23c00d0c) at sys_wait4+0x68/frame 0x23a17c08 syscall(23a17ce8,3b,3b,3b,0,...) at syscall+0x304/frame 0x23a17cdc Xint0x80_syscall() at 0xffc033b7/frame 0x23a17cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x20686553, esp = 0xffbfe778, ebp = 0xffbfe790 --- __bss_end() at 0x20686553 Tracing command bash pid 874 tid 100111 td 0x17edc700 sched_switch(17edc700,0,104) at sched_switch+0x598/frame 0x2124c96c mi_switch(104,0) at mi_switch+0x1de/frame 0x2124c99c sleepq_switch(1,17edc700,17edc700,0,24b5370c,...) at sleepq_switch+0xe1/frame 0x2124c9c0 sleepq_timedwait(24b5370c,50,1597102,0,1,...) at sleepq_timedwait+0x47/frame 0x2124c9ec _sleep(24b5370c,24b536b4,50,15a936b,ffffe8e0,13,0,0,100) at _sleep+0x23c/frame 0x2124ca2c swap_pager_getpages(24b536b4,2124caf0,1,2124cb6c,2124cb70) at swap_pager_getpages+0x5e3/frame 0x2124ca98 vm_pager_get_pages(24b536b4,2124caf0,1,2124cb6c,2124cb70) at vm_pager_get_pages+0x44/frame 0x2124cacc vm_fault_hold(99e9a60,4eb000,2,0,0) at vm_fault_hold+0x1938/frame 0x2124cbb0 vm_fault(99e9a60,4eb000,2,0) at vm_fault+0x4a/frame 0x2124cbd8 trap_pfault(4eb7bc,17e4d750,482da3,17edc700,4eb7bc,...) at trap_pfault+0xf3/frame 0x2124cc24 trap(2124cce8,3b,3b,3b,0,...) at trap+0x57b/frame 0x2124ccdc calltrap() at 0xffc0316d/frame 0x2124ccdc --- trap 0xc, eip = 0x482da3, esp = 0xffbfe5c8, ebp = 0xffbfe5c8 --- (null)() at 0x482da3 Tracing command sshd pid 871 tid 100203 td 0x23c01000 (CPU 1) cpustop_handler(1,ffc0afa8,ffc0af9c,1533bb2,0,...) at cpustop_handler+0x27/frame 0xffc0aed8 ipi_nmi_handler(0,0,23c01000,0,2242a354,...) at ipi_nmi_handler+0x34/frame 0xffc0aee8 trap(ffc0afa8,3b,3b,3b,20460405,...) at trap+0xc2/frame 0xffc0af9c calltrap() at 0xffc0316d/frame 0xffc0af9c --- trap 0x13, eip = 0x20a4ee21, esp = 0xffbfdff4, ebp = 0xffbfe008 --- __bss_end() at 0x20a4ee21 Tracing command sendmail pid 680 tid 100172 td 0x21eac700 sched_switch(21eac700,0,104) at sched_switch+0x598/frame 0x2214a96c mi_switch(104,0) at mi_switch+0x1de/frame 0x2214a99c sleepq_switch(3,21eac700,21eac700,0,215dac88,...) at sleepq_switch+0xe1/frame 0x2214a9c0 sleepq_timedwait(215dac88,50,1597102,0,1,...) at sleepq_timedwait+0x47/frame 0x2214a9ec _sleep(215dac88,215dac30,50,15a936b,ffffe8e0,13,0,0,100) at _sleep+0x23c/frame 0x2214aa2c swap_pager_getpages(215dac30,2214aaf0,1,2214ab6c,2214ab70) at swap_pager_getpages+0x5e3/frame 0x2214aa98 vm_pager_get_pages(215dac30,2214aaf0,1,2214ab6c,2214ab70) at vm_pager_get_pages+0x44/frame 0x2214aacc vm_fault_hold(21b13000,496000,1,0,0) at vm_fault_hold+0x1938/frame 0x2214abb0 vm_fault(21b13000,496000,1,0) at vm_fault+0x4a/frame 0x2214abd8 trap_pfault(496270,21effaa4,493d40,21eac700,496270,...) at trap_pfault+0xf3/frame 0x2214ac24 trap(2214ace8,3b,3b,3b,f,...) at trap+0x57b/frame 0x2214acdc calltrap() at 0xffc0316d/frame 0x2214acdc --- trap 0xc, eip = 0x493d40, esp = 0xffbfd348, ebp = 0xffbfd354 --- (null)() at 0x493d40 Tracing command sendmail pid 677 tid 100166 td 0x21eaca80 sched_switch(21eaca80,0,104) at sched_switch+0x598/frame 0x2212c884 mi_switch(104,0) at mi_switch+0x1de/frame 0x2212c8b8 sleepq_switch(21eaca80,0,98051cc,2212c930,fdb4a7,...) at sleepq_switch+0xe1/frame 0x2212c8dc sleepq_wait(98051cc,5c) at sleepq_wait+0x3a/frame 0x2212c8f0 _sleep(98051cc,943c030,5c,15a77fe,0,0,0,0,100) at _sleep+0x307/frame 0x2212c930 bufwait(98051cc) at bufwait+0x6b/frame 0x2212c96c breadn_flags(222f4b60,11,0,4000,0,0,0,1811b600,8,0,2212c9d0) at breadn_flags+0x168/frame 0x2212c98c vfs_bio_getpages(222f4b60,2212caf0,1,2212cb6c,2212cb70,12a3120,12a3150) at vfs_bio_getpages+0x40c/frame 0x2212ca20 ffs_getpages(2212ca68,2212caf0,21e07ba4,2212ca98,12e922a,...) at ffs_getpages+0x5e/frame 0x2212ca44 VOP_GETPAGES_APV(1c2ad50,2212ca68) at VOP_GETPAGES_APV+0x6f/frame 0x2212ca58 vnode_pager_getpages(21e07b94,2212caf0,1,2212cb6c,2212cb70) at vnode_pager_getpages+0x5a/frame 0x2212ca98 vm_pager_get_pages(21e07b94,2212caf0,1,2212cb6c,2212cb70) at vm_pager_get_pages+0x44/frame 0x2212cacc vm_fault_hold(210a4bac,446000,4,0,0) at vm_fault_hold+0x1938/frame 0x2212cbb0 vm_fault(210a4bac,446000,4,0) at vm_fault+0x4a/frame 0x2212cbd8 trap_pfault(446cd0,21f000a8,446cd0,21eaca80,446cd0,...) at trap_pfault+0xf3/frame 0x2212cc24 trap(2212cce8,3b,3b,3b,f,...) at trap+0x57b/frame 0x2212ccdc calltrap() at 0xffc0316d/frame 0x2212ccdc --- trap 0xc, eip = 0x446cd0, esp = 0xffbfc974, ebp = 0xffbfc984 --- (null)() at 0x446cd0 Tracing command syslogd pid 408 tid 100121 td 0x2196e700 sched_switch(2196e700,0,104) at sched_switch+0x598/frame 0x213fa96c mi_switch(104,0) at mi_switch+0x1de/frame 0x213fa99c sleepq_switch(2,2196e700,2196e700,0,215dbab4,...) at sleepq_switch+0xe1/frame 0x213fa9c0 sleepq_timedwait(215dbab4,50,1597102,0,1,...) at sleepq_timedwait+0x47/frame 0x213fa9ec _sleep(215dbab4,215dba5c,50,15a936b,ffffe8e0,13,0,0,100) at _sleep+0x23c/frame 0x213faa2c swap_pager_getpages(215dba5c,213faaf0,1,213fab6c,213fab70) at swap_pager_getpages+0x5e3/frame 0x213faa98 vm_pager_get_pages(215dba5c,213faaf0,1,213fab6c,213fab70) at vm_pager_get_pages+0x44/frame 0x213faacc vm_fault_hold(99e914c,2045c000,1,0,0) at vm_fault_hold+0x1938/frame 0x213fabb0 vm_fault(99e914c,2045c000,1,0) at vm_fault+0x4a/frame 0x213fabd8 trap_pfault(2045c11c,17ff3aa4,2045b320,2196e700,2045c11c,...) at trap_pfault+0xf3/frame 0x213fac24 trap(213face8,3b,3b,3b,1,...) at trap+0x57b/frame 0x213facdc calltrap() at 0xffc0316d/frame 0x213facdc --- trap 0xc, eip = 0x2045b320, esp = 0xffbfe7e4, ebp = 0xffbfe8e8 --- __bss_end() at 0x2045b320 Tracing command syncer pid 25 tid 100104 td 0x17edd000 sched_switch(17edd000,0,104) at sched_switch+0x598/frame 0x1c5f6b8c mi_switch(104,0) at mi_switch+0x1de/frame 0x1c5f6bbc sleepq_switch(cb,17edd000,1bf25f8,17edd000,1c5f6c14,...) at sleepq_switch+0xe1/frame 0x1c5f6be0 sleepq_timedwait(1f4c064,0) at sleepq_timedwait+0x47/frame 0x1c5f6c10 _cv_timedwait_sbt(1f4c064,1f4c044,fffffed8,0,0,0,100) at _cv_timedwait_sbt+0x157/frame 0x1c5f6c4c sched_sync(0,1c5f6ce8) at sched_sync+0x5e3/frame 0x1c5f6cb4 fork_exit(1093500,0,1c5f6ce8,0,0,...) at fork_exit+0x6c/frame 0x1c5f6cd4 fork_trampoline() at 0xffc033ca/frame 0x1c5f6cd4 --- trap 0, eip = 0, esp = 0x1c5f6d20, ebp = 0 --- (null)() at 0 Tracing command vnlru pid 24 tid 100103 td 0x17edd380 sched_switch(17edd380,0,104) at sched_switch+0x598/frame 0x93fdb74 mi_switch(104,0) at mi_switch+0x1de/frame 0x93fdba4 sleepq_switch(2,17edd380,17edd380,0,17e52354,...) at sleepq_switch+0xe1/frame 0x93fdbc8 sleepq_timedwait(17e52354,60,93fdc28,fb3ab5,1eed304,...) at sleepq_timedwait+0x47/frame 0x93fdbf4 _sleep(17e52354,1f4c010,260,16813d4,fffffed8,0,0,0,100) at _sleep+0x23c/frame 0x93fdc34 vnlru_proc(0,93fdce8) at vnlru_proc+0x8f/frame 0x93fdcb4 fork_exit(1092cc0,0,93fdce8,0,0,...) at fork_exit+0x6c/frame 0x93fdcd4 fork_trampoline() at 0xffc033ca/frame 0x93fdcd4 --- trap 0, eip = 0, esp = 0x93fdd20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100100 td 0x17edd700 sched_switch(17edd700,0,104) at sched_switch+0x598/frame 0xb3f4bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3f4be4 sleepq_switch(2,17edd700,17edd700,0,1f4b9fc,...) at sleepq_switch+0xe1/frame 0xb3f4c08 sleepq_timedwait(1f4b9fc,54,17e52750,17e52760,0,...) at sleepq_timedwait+0x47/frame 0xb3f4c34 _sleep(1f4b9fc,1bfec40,54,15a786b,1999997c,0,0,0,100) at _sleep+0x23c/frame 0xb3f4c74 buf_daemon(0,b3f4ce8) at buf_daemon+0xb1/frame 0xb3f4cb4 fork_exit(1074950,0,b3f4ce8,0,0,...) at fork_exit+0x6c/frame 0xb3f4cd4 fork_trampoline() at 0xffc033ca/frame 0xb3f4cd4 --- trap 0, eip = 0, esp = 0xb3f4d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100102 td 0x185ae380 sched_switch(185ae380,0,104) at sched_switch+0x598/frame 0xb3feba4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3febd4 sleepq_switch(0,185ae380,177,185ae380,0,...) at sleepq_switch+0xe1/frame 0xb3febf8 sleepq_timedwait(1bfff40,5c,1bfef50,97ef158,97ef1b4,...) at sleepq_timedwait+0x47/frame 0xb3fec28 _sleep(1bfff40,1bffe80,25c,15aafcf,fffffed8,0,0,0,100) at _sleep+0x23c/frame 0xb3fec68 bufspace_daemon(1bfed40,b3fece8) at bufspace_daemon+0x2cb/frame 0xb3fecb4 fork_exit(1074c80,1bfed40,b3fece8,0,0,...) at fork_exit+0x6c/frame 0xb3fecd4 fork_trampoline() at 0xffc033ca/frame 0xb3fecd4 --- trap 0, eip = 0, esp = 0xb3fed20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100113 td 0x9515a80 sched_switch(9515a80,0,104) at sched_switch+0x598/frame 0x21276bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x21276be4 sleepq_switch(3,9515a80,177,9515a80,0,...) at sleepq_switch+0xe1/frame 0x21276c08 sleepq_timedwait(21098c84,54,21276c6c,fcc720,21098c00,...) at sleepq_timedwait+0x47/frame 0x21276c38 _sleep(21098c84,21098c00,54,15d83cd,7fffff6c,0,0,0,100) at _sleep+0x23c/frame 0x21276c78 softdep_flush(187ec000,21276ce8) at softdep_flush+0x15c/frame 0x21276cb4 fork_exit(1285000,187ec000,21276ce8,0,0,...) at fork_exit+0x6c/frame 0x21276cd4 fork_trampoline() at 0xffc033ca/frame 0x21276cd4 --- trap 0, eip = 0, esp = 0x21276d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100114 td 0x17edc000 sched_switch(17edc000,0,104) at sched_switch+0x598/frame 0x2127bbb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x2127bbe4 sleepq_switch(3,17edc000,177,17edc000,0,...) at sleepq_switch+0xe1/frame 0x2127bc08 sleepq_timedwait(185b8684,54,2127bc6c,fcc720,185b8600,...) at sleepq_timedwait+0x47/frame 0x2127bc38 _sleep(185b8684,185b8600,54,15d83cd,7fffff6c,0,0,0,100) at _sleep+0x23c/frame 0x2127bc78 softdep_flush(2118b000,2127bce8) at softdep_flush+0x15c/frame 0x2127bcb4 fork_exit(1285000,2118b000,2127bce8,0,0,...) at fork_exit+0x6c/frame 0x2127bcd4 fork_trampoline() at 0xffc033ca/frame 0x2127bcd4 --- trap 0, eip = 0, esp = 0x2127bd20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100115 td 0x17e77a80 sched_switch(17e77a80,0,104) at sched_switch+0x598/frame 0x21280bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x21280be4 sleepq_switch(3,17e77a80,177,17e77a80,0,...) at sleepq_switch+0xe1/frame 0x21280c08 sleepq_timedwait(185b8484,54,21280c6c,fcc720,185b8400,...) at sleepq_timedwait+0x47/frame 0x21280c38 _sleep(185b8484,185b8400,54,15d83cd,7fffff6c,0,0,0,100) at _sleep+0x23c/frame 0x21280c78 softdep_flush(2118a000,21280ce8) at softdep_flush+0x15c/frame 0x21280cb4 fork_exit(1285000,2118a000,21280ce8,0,0,...) at fork_exit+0x6c/frame 0x21280cd4 fork_trampoline() at 0xffc033ca/frame 0x21280cd4 --- trap 0, eip = 0, esp = 0x21280d20, ebp = 0 --- (null)() at 0 Tracing command bufdaemon pid 23 tid 100116 td 0x211e0380 sched_switch(211e0380,0,104) at sched_switch+0x598/frame 0x21285bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0x21285be4 sleepq_switch(1,211e0380,177,211e0380,0,...) at sleepq_switch+0xe1/frame 0x21285c08 sleepq_timedwait(185b8284,54,21285c6c,fcc720,185b8200,...) at sleepq_timedwait+0x47/frame 0x21285c38 _sleep(185b8284,185b8200,54,15d83cd,7fffff6c,0,0,0,100) at _sleep+0x23c/frame 0x21285c78 softdep_flush(21189000,21285ce8) at softdep_flush+0x15c/frame 0x21285cb4 fork_exit(1285000,21189000,21285ce8,0,0,...) at fork_exit+0x6c/frame 0x21285cd4 fork_trampoline() at 0xffc033ca/frame 0x21285cd4 --- trap 0, eip = 0, esp = 0x21285d20, ebp = 0 --- (null)() at 0 Tracing command vmdaemon pid 22 tid 100098 td 0x17edda80 sched_switch(17edda80,0,104) at sched_switch+0x598/frame 0xb3eab94 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3eabc4 sleepq_switch(17edda80,0,1f61478,b3eac3c,fdb4a7,...) at sleepq_switch+0xe1/frame 0xb3eabe8 sleepq_wait(1f61478,74) at sleepq_wait+0x3a/frame 0xb3eabfc _sleep(1f61478,1f61464,74,15a7864,0,0,0,0,100) at _sleep+0x307/frame 0xb3eac3c vm_daemon(0,b3eace8) at vm_daemon+0xa88/frame 0xb3eacb4 fork_exit(12e7870,0,b3eace8,0,0,...) at fork_exit+0x6c/frame 0xb3eacd4 fork_trampoline() at 0xffc033ca/frame 0xb3eacd4 --- trap 0, eip = 0, esp = 0xb3ead20, ebp = 0 --- (null)() at 0 Tracing command pagedaemon pid 21 tid 100097 td 0x17ede000 sched_switch(17ede000,0,104) at sched_switch+0x598/frame 0xb3e59d4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3e5a04 sleepq_switch(2,17ede000,17ede000,0,1f95a1c,...) at sleepq_switch+0xe1/frame 0xb3e5a28 sleepq_timedwait(1f95a1c,54,1f95640,8,15c5666,...) at sleepq_timedwait+0x47/frame 0xb3e5a54 _sleep(1f95a1c,1f95740,254,15a7864,1999997c,0,0,0,100) at _sleep+0x23c/frame 0xb3e5a94 vm_pageout_worker(0,17ede000,17e53000,17ede000,17e53000,...) at vm_pageout_worker+0x266/frame 0xb3e5c94 vm_pageout(0,b3e5ce8) at vm_pageout+0x10a/frame 0xb3e5cb4 fork_exit(12dd130,0,b3e5ce8,0,0,...) at fork_exit+0x6c/frame 0xb3e5cd4 fork_trampoline() at 0xffc033ca/frame 0xb3e5cd4 --- trap 0, eip = 0, esp = 0xb3e5d20, ebp = 0 --- (null)() at 0 Tracing command pagedaemon pid 21 tid 100099 td 0x17a14a80 sched_switch(17a14a80,0,104) at sched_switch+0x598/frame 0xb3efa6c mi_switch(104,0) at mi_switch+0x1de/frame 0xb3efa9c sleepq_switch(17a14a80,0,1f95a28,b3efb14,fdb4a7,...) at sleepq_switch+0xe1/frame 0xb3efac0 sleepq_wait(1f95a28,54) at sleepq_wait+0x3a/frame 0xb3efad4 _sleep(1f95a28,1f95680,54,1696319,0,...) at _sleep+0x307/frame 0xb3efb14 vm_pageout_laundry_worker(0,b3efce8) at vm_pageout_laundry_worker+0xd03/frame 0xb3efcb4 fork_exit(12de890,0,b3efce8,0,0,...) at fork_exit+0x6c/frame 0xb3efcd4 fork_trampoline() at 0xffc033ca/frame 0xb3efcd4 --- trap 0, eip = 0, esp = 0xb3efd20, ebp = 0 --- (null)() at 0 Tracing command pagedaemon pid 21 tid 100101 td 0x17a14700 sched_switch(17a14700,0,104) at sched_switch+0x598/frame 0xb3f9bbc mi_switch(104,0) at mi_switch+0x1de/frame 0xb3f9bec sleepq_switch(1eed884,17a14700,0,1f61090,b3f9c40,...) at sleepq_switch+0xe1/frame 0xb3f9c10 sleepq_timedwait(12bcae0,54,0,0,0,...) at sleepq_timedwait+0x47/frame 0xb3f9c3c _sleep(12bcae0,1f61090,54,16074b1,fffffed8,0,0,0,100) at _sleep+0x23c/frame 0xb3f9c7c uma_reclaim_worker(0,b3f9ce8) at uma_reclaim_worker+0x104/frame 0xb3f9cb4 fork_exit(12bd1b0,0,b3f9ce8,0,0,...) at fork_exit+0x6c/frame 0xb3f9cd4 fork_trampoline() at 0xffc033ca/frame 0xb3f9cd4 --- trap 0, eip = 0, esp = 0xb3f9d20, ebp = 0 --- (null)() at 0 Tracing command rand_harvestq pid 20 tid 100094 td 0x185cc000 sched_switch(185cc000,0,104) at sched_switch+0x598/frame 0xb3d6b94 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3d6bc4 sleepq_switch(1,185cc000,185cc000,0,1d36f04,...) at sleepq_switch+0xe1/frame 0xb3d6be8 sleepq_timedwait(1d36f04,0,1d3bffc,0,b3d6c50,...) at sleepq_timedwait+0x47/frame 0xb3d6c14 _sleep(1d36f04,0,0,15aafcf,19999999,0,0,0,4) at _sleep+0x23c/frame 0xb3d6c54 random_kthread(0,b3d6ce8) at random_kthread+0x23e/frame 0xb3d6cb4 fork_exit(d43390,0,b3d6ce8,0,0,...) at fork_exit+0x6c/frame 0xb3d6cd4 fork_trampoline() at 0xffc033ca/frame 0xb3d6cd4 --- trap 0, eip = 0, esp = 0xb3d6d20, ebp = 0 --- (null)() at 0 Tracing command sctp_iterator pid 19 tid 100090 td 0x185cd000 sched_switch(185cd000,0,104) at sched_switch+0x598/frame 0xb3bebdc mi_switch(104,0) at mi_switch+0x1de/frame 0xb3bec10 sleepq_switch(185cd000,0,1f94afc,b3bec88,fdb4a7,...) at sleepq_switch+0xe1/frame 0xb3bec34 sleepq_wait(1f94afc,0) at sleepq_wait+0x3a/frame 0xb3bec48 _sleep(1f94afc,1f94ac4,0,159fbe1,0,0,0,0,100) at _sleep+0x307/frame 0xb3bec88 sctp_iterator_thread(0,b3bece8) at sctp_iterator_thread+0x43/frame 0xb3becb4 fork_exit(114e3d0,0,b3bece8,0,0,...) at fork_exit+0x6c/frame 0xb3becd4 fork_trampoline() at 0xffc033ca/frame 0xb3becd4 --- trap 0, eip = 0, esp = 0xb3bed20, ebp = 0 --- (null)() at 0 Tracing command soaiod4 pid 18 tid 100089 td 0x185cd380 sched_switch(185cd380,0,104) at sched_switch+0x598/frame 0xb3b8bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3b8be4 sleepq_switch(3,185cd380,177,185cd380,0,...) at sleepq_switch+0xe1/frame 0xb3b8c08 sleepq_timedwait(1f4b628,0,0,15b13b4,1621f8e,...) at sleepq_timedwait+0x47/frame 0xb3b8c38 _sleep(1f4b628,1f4b608,0,15aafcf,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0xb3b8c78 soaio_kproc_loop(4,b3b8ce8) at soaio_kproc_loop+0x14b/frame 0xb3b8cb4 fork_exit(103ded0,4,b3b8ce8,0,0,...) at fork_exit+0x6c/frame 0xb3b8cd4 fork_trampoline() at 0xffc033ca/frame 0xb3b8cd4 --- trap 0, eip = 0, esp = 0xb3b8d20, ebp = 0 --- (null)() at 0 Tracing command soaiod3 pid 17 tid 100088 td 0x185cd700 sched_switch(185cd700,0,104) at sched_switch+0x598/frame 0xb3b3bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3b3be4 sleepq_switch(0,185cd700,177,185cd700,0,...) at sleepq_switch+0xe1/frame 0xb3b3c08 sleepq_timedwait(1f4b628,0,2217c950,5b13b4,1f851c0,...) at sleepq_timedwait+0x47/frame 0xb3b3c38 _sleep(1f4b628,1f4b608,0,15aafcf,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0xb3b3c78 soaio_kproc_loop(3,b3b3ce8) at soaio_kproc_loop+0x14b/frame 0xb3b3cb4 fork_exit(103ded0,3,b3b3ce8,0,0,...) at fork_exit+0x6c/frame 0xb3b3cd4 fork_trampoline() at 0xffc033ca/frame 0xb3b3cd4 --- trap 0, eip = 0, esp = 0xb3b3d20, ebp = 0 --- (null)() at 0 Tracing command soaiod2 pid 16 tid 100087 td 0x185cda80 sched_switch(185cda80,0,104) at sched_switch+0x598/frame 0xb3aebb4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3aebe4 sleepq_switch(0,185cda80,177,185cda80,0,...) at sleepq_switch+0xe1/frame 0xb3aec08 sleepq_timedwait(1f4b628,0,0,15b13b4,1621f8e,...) at sleepq_timedwait+0x47/frame 0xb3aec38 _sleep(1f4b628,1f4b608,0,15aafcf,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0xb3aec78 soaio_kproc_loop(2,b3aece8) at soaio_kproc_loop+0x14b/frame 0xb3aecb4 fork_exit(103ded0,2,b3aece8,0,0,...) at fork_exit+0x6c/frame 0xb3aecd4 fork_trampoline() at 0xffc033ca/frame 0xb3aecd4 --- trap 0, eip = 0, esp = 0xb3aed20, ebp = 0 --- (null)() at 0 Tracing command soaiod1 pid 9 tid 100086 td 0x185ce000 sched_switch(185ce000,0,104) at sched_switch+0x598/frame 0xb3a9bb4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3a9be4 sleepq_switch(3,185ce000,177,185ce000,0,...) at sleepq_switch+0xe1/frame 0xb3a9c08 sleepq_timedwait(1f4b628,0,0,15b13b4,1621f8e,...) at sleepq_timedwait+0x47/frame 0xb3a9c38 _sleep(1f4b628,1f4b608,0,15aafcf,ffffdd50,1d,0,0,100) at _sleep+0x23c/frame 0xb3a9c78 soaio_kproc_loop(1,b3a9ce8) at soaio_kproc_loop+0x14b/frame 0xb3a9cb4 fork_exit(103ded0,1,b3a9ce8,0,0,...) at fork_exit+0x6c/frame 0xb3a9cd4 fork_trampoline() at 0xffc033ca/frame 0xb3a9cd4 --- trap 0, eip = 0, esp = 0xb3a9d20, ebp = 0 --- (null)() at 0 Tracing command fdc0 pid 8 tid 100083 td 0x17edea80 sched_switch(17edea80,0,104) at sched_switch+0x598/frame 0xb39ab94 mi_switch(104,0) at mi_switch+0x1de/frame 0xb39abc4 sleepq_switch(17edea80,0,17b4a23c,b39ac3c,fdb4a7,...) at sleepq_switch+0xe1/frame 0xb39abe8 sleepq_wait(17b4a23c,5c) at sleepq_wait+0x3a/frame 0xb39abfc _sleep(17b4a23c,17b4a2f8,5c,15aafcf,0,0,0,0,100) at _sleep+0x307/frame 0xb39ac3c fdc_thread(17b4a200,b39ace8) at fdc_thread+0x10f1/frame 0xb39acb4 fork_exit(14abd90,17b4a200,b39ace8,0,0,...) at fork_exit+0x6c/frame 0xb39acd4 fork_trampoline() at 0xffc033ca/frame 0xb39acd4 --- trap 0, eip = 0, esp = 0xb39ad20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100048 td 0x17bae000 sched_switch(17bae000,0,104) at sched_switch+0x598/frame 0xb2e2bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb2e2c24 sleepq_switch(17bae000,17b8bcf8,17b8bacc,b2e2c94,f72555,...) at sleepq_switch+0xe1/frame 0xb2e2c48 sleepq_wait(17b8bacc,0) at sleepq_wait+0x3a/frame 0xb2e2c5c _cv_wait(17b8bacc,17b8bcf8) at _cv_wait+0x135/frame 0xb2e2c94 usb_process(17b8bac4,b2e2ce8) at usb_process+0x104/frame 0xb2e2cb4 fork_exit(e3d390,17b8bac4,b2e2ce8,0,0,...) at fork_exit+0x6c/frame 0xb2e2cd4 fork_trampoline() at 0xffc033ca/frame 0xb2e2cd4 --- trap 0, eip = 0, esp = 0xb2e2d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100049 td 0x17bada80 sched_switch(17bada80,0,104) at sched_switch+0x598/frame 0xb2e7bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb2e7c24 sleepq_switch(17bada80,17b8bcf8,17b8bafc,b2e7c94,f72555,...) at sleepq_switch+0xe1/frame 0xb2e7c48 sleepq_wait(17b8bafc,0) at sleepq_wait+0x3a/frame 0xb2e7c5c _cv_wait(17b8bafc,17b8bcf8) at _cv_wait+0x135/frame 0xb2e7c94 usb_process(17b8baf4,b2e7ce8) at usb_process+0x104/frame 0xb2e7cb4 fork_exit(e3d390,17b8baf4,b2e7ce8,0,0,...) at fork_exit+0x6c/frame 0xb2e7cd4 fork_trampoline() at 0xffc033ca/frame 0xb2e7cd4 --- trap 0, eip = 0, esp = 0xb2e7d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100050 td 0x17bad700 sched_switch(17bad700,0,104) at sched_switch+0x598/frame 0xb2ecbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb2ecc24 sleepq_switch(17bad700,17b8bcf8,17b8bb2c,b2ecc94,f72555,...) at sleepq_switch+0xe1/frame 0xb2ecc48 sleepq_wait(17b8bb2c,0) at sleepq_wait+0x3a/frame 0xb2ecc5c _cv_wait(17b8bb2c,17b8bcf8) at _cv_wait+0x135/frame 0xb2ecc94 usb_process(17b8bb24,b2ecce8) at usb_process+0x104/frame 0xb2eccb4 fork_exit(e3d390,17b8bb24,b2ecce8,0,0,...) at fork_exit+0x6c/frame 0xb2eccd4 fork_trampoline() at 0xffc033ca/frame 0xb2eccd4 --- trap 0, eip = 0, esp = 0xb2ecd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100051 td 0x17bad380 sched_switch(17bad380,0,104) at sched_switch+0x598/frame 0xb2f1bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb2f1c24 sleepq_switch(17bad380,17b8bcf8,17b8bb5c,b2f1c94,f72555,...) at sleepq_switch+0xe1/frame 0xb2f1c48 sleepq_wait(17b8bb5c,0) at sleepq_wait+0x3a/frame 0xb2f1c5c _cv_wait(17b8bb5c,17b8bcf8) at _cv_wait+0x135/frame 0xb2f1c94 usb_process(17b8bb54,b2f1ce8) at usb_process+0x104/frame 0xb2f1cb4 fork_exit(e3d390,17b8bb54,b2f1ce8,0,0,...) at fork_exit+0x6c/frame 0xb2f1cd4 fork_trampoline() at 0xffc033ca/frame 0xb2f1cd4 --- trap 0, eip = 0, esp = 0xb2f1d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100052 td 0x17bad000 sched_switch(17bad000,0,104) at sched_switch+0x598/frame 0xb2f6bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb2f6c24 sleepq_switch(17bad000,17b8bcf8,17b8bb8c,b2f6c94,f72555,...) at sleepq_switch+0xe1/frame 0xb2f6c48 sleepq_wait(17b8bb8c,0) at sleepq_wait+0x3a/frame 0xb2f6c5c _cv_wait(17b8bb8c,17b8bcf8) at _cv_wait+0x135/frame 0xb2f6c94 usb_process(17b8bb84,b2f6ce8) at usb_process+0x104/frame 0xb2f6cb4 fork_exit(e3d390,17b8bb84,b2f6ce8,0,0,...) at fork_exit+0x6c/frame 0xb2f6cd4 fork_trampoline() at 0xffc033ca/frame 0xb2f6cd4 --- trap 0, eip = 0, esp = 0xb2f6d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100054 td 0x17b9f700 sched_switch(17b9f700,0,104) at sched_switch+0x598/frame 0xb301bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb301c24 sleepq_switch(17b9f700,17e5fcf8,17e5facc,b301c94,f72555,...) at sleepq_switch+0xe1/frame 0xb301c48 sleepq_wait(17e5facc,0) at sleepq_wait+0x3a/frame 0xb301c5c _cv_wait(17e5facc,17e5fcf8) at _cv_wait+0x135/frame 0xb301c94 usb_process(17e5fac4,b301ce8) at usb_process+0x104/frame 0xb301cb4 fork_exit(e3d390,17e5fac4,b301ce8,0,0,...) at fork_exit+0x6c/frame 0xb301cd4 fork_trampoline() at 0xffc033ca/frame 0xb301cd4 --- trap 0, eip = 0, esp = 0xb301d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100055 td 0x17b9f380 sched_switch(17b9f380,0,104) at sched_switch+0x598/frame 0xb306bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb306c24 sleepq_switch(17b9f380,17e5fcf8,17e5fafc,b306c94,f72555,...) at sleepq_switch+0xe1/frame 0xb306c48 sleepq_wait(17e5fafc,0) at sleepq_wait+0x3a/frame 0xb306c5c _cv_wait(17e5fafc,17e5fcf8) at _cv_wait+0x135/frame 0xb306c94 usb_process(17e5faf4,b306ce8) at usb_process+0x104/frame 0xb306cb4 fork_exit(e3d390,17e5faf4,b306ce8,0,0,...) at fork_exit+0x6c/frame 0xb306cd4 fork_trampoline() at 0xffc033ca/frame 0xb306cd4 --- trap 0, eip = 0, esp = 0xb306d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100056 td 0x17b9f000 sched_switch(17b9f000,0,104) at sched_switch+0x598/frame 0xb30bbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb30bc24 sleepq_switch(17b9f000,17e5fcf8,17e5fb2c,b30bc94,f72555,...) at sleepq_switch+0xe1/frame 0xb30bc48 sleepq_wait(17e5fb2c,0) at sleepq_wait+0x3a/frame 0xb30bc5c _cv_wait(17e5fb2c,17e5fcf8) at _cv_wait+0x135/frame 0xb30bc94 usb_process(17e5fb24,b30bce8) at usb_process+0x104/frame 0xb30bcb4 fork_exit(e3d390,17e5fb24,b30bce8,0,0,...) at fork_exit+0x6c/frame 0xb30bcd4 fork_trampoline() at 0xffc033ca/frame 0xb30bcd4 --- trap 0, eip = 0, esp = 0xb30bd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100057 td 0x17e65380 sched_switch(17e65380,0,104) at sched_switch+0x598/frame 0xb310bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb310c24 sleepq_switch(17e65380,17e5fcf8,17e5fb5c,b310c94,f72555,...) at sleepq_switch+0xe1/frame 0xb310c48 sleepq_wait(17e5fb5c,0) at sleepq_wait+0x3a/frame 0xb310c5c _cv_wait(17e5fb5c,17e5fcf8) at _cv_wait+0x135/frame 0xb310c94 usb_process(17e5fb54,b310ce8) at usb_process+0x104/frame 0xb310cb4 fork_exit(e3d390,17e5fb54,b310ce8,0,0,...) at fork_exit+0x6c/frame 0xb310cd4 fork_trampoline() at 0xffc033ca/frame 0xb310cd4 --- trap 0, eip = 0, esp = 0xb310d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100058 td 0x17e65000 sched_switch(17e65000,0,104) at sched_switch+0x598/frame 0xb315bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb315c24 sleepq_switch(17e65000,17e5fcf8,17e5fb8c,b315c94,f72555,...) at sleepq_switch+0xe1/frame 0xb315c48 sleepq_wait(17e5fb8c,0) at sleepq_wait+0x3a/frame 0xb315c5c _cv_wait(17e5fb8c,17e5fcf8) at _cv_wait+0x135/frame 0xb315c94 usb_process(17e5fb84,b315ce8) at usb_process+0x104/frame 0xb315cb4 fork_exit(e3d390,17e5fb84,b315ce8,0,0,...) at fork_exit+0x6c/frame 0xb315cd4 fork_trampoline() at 0xffc033ca/frame 0xb315cd4 --- trap 0, eip = 0, esp = 0xb315d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100060 td 0x17e64700 sched_switch(17e64700,0,104) at sched_switch+0x598/frame 0xb320bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb320c24 sleepq_switch(17e64700,17e66cf8,17e66acc,b320c94,f72555,...) at sleepq_switch+0xe1/frame 0xb320c48 sleepq_wait(17e66acc,0) at sleepq_wait+0x3a/frame 0xb320c5c _cv_wait(17e66acc,17e66cf8) at _cv_wait+0x135/frame 0xb320c94 usb_process(17e66ac4,b320ce8) at usb_process+0x104/frame 0xb320cb4 fork_exit(e3d390,17e66ac4,b320ce8,0,0,...) at fork_exit+0x6c/frame 0xb320cd4 fork_trampoline() at 0xffc033ca/frame 0xb320cd4 --- trap 0, eip = 0, esp = 0xb320d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100061 td 0x17e64380 sched_switch(17e64380,0,104) at sched_switch+0x598/frame 0xb325bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb325c24 sleepq_switch(17e64380,17e66cf8,17e66afc,b325c94,f72555,...) at sleepq_switch+0xe1/frame 0xb325c48 sleepq_wait(17e66afc,0) at sleepq_wait+0x3a/frame 0xb325c5c _cv_wait(17e66afc,17e66cf8) at _cv_wait+0x135/frame 0xb325c94 usb_process(17e66af4,b325ce8) at usb_process+0x104/frame 0xb325cb4 fork_exit(e3d390,17e66af4,b325ce8,0,0,...) at fork_exit+0x6c/frame 0xb325cd4 fork_trampoline() at 0xffc033ca/frame 0xb325cd4 --- trap 0, eip = 0, esp = 0xb325d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100062 td 0x17e64000 sched_switch(17e64000,0,104) at sched_switch+0x598/frame 0xb32abf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb32ac24 sleepq_switch(17e64000,17e66cf8,17e66b2c,b32ac94,f72555,...) at sleepq_switch+0xe1/frame 0xb32ac48 sleepq_wait(17e66b2c,0) at sleepq_wait+0x3a/frame 0xb32ac5c _cv_wait(17e66b2c,17e66cf8) at _cv_wait+0x135/frame 0xb32ac94 usb_process(17e66b24,b32ace8) at usb_process+0x104/frame 0xb32acb4 fork_exit(e3d390,17e66b24,b32ace8,0,0,...) at fork_exit+0x6c/frame 0xb32acd4 fork_trampoline() at 0xffc033ca/frame 0xb32acd4 --- trap 0, eip = 0, esp = 0xb32ad20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100063 td 0x17e63a80 sched_switch(17e63a80,0,104) at sched_switch+0x598/frame 0xb32fbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb32fc24 sleepq_switch(17e63a80,17e66cf8,17e66b5c,b32fc94,f72555,...) at sleepq_switch+0xe1/frame 0xb32fc48 sleepq_wait(17e66b5c,0) at sleepq_wait+0x3a/frame 0xb32fc5c _cv_wait(17e66b5c,17e66cf8) at _cv_wait+0x135/frame 0xb32fc94 usb_process(17e66b54,b32fce8) at usb_process+0x104/frame 0xb32fcb4 fork_exit(e3d390,17e66b54,b32fce8,0,0,...) at fork_exit+0x6c/frame 0xb32fcd4 fork_trampoline() at 0xffc033ca/frame 0xb32fcd4 --- trap 0, eip = 0, esp = 0xb32fd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100064 td 0x17e63700 sched_switch(17e63700,0,104) at sched_switch+0x598/frame 0xb334bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb334c24 sleepq_switch(17e63700,17e66cf8,17e66b8c,b334c94,f72555,...) at sleepq_switch+0xe1/frame 0xb334c48 sleepq_wait(17e66b8c,0) at sleepq_wait+0x3a/frame 0xb334c5c _cv_wait(17e66b8c,17e66cf8) at _cv_wait+0x135/frame 0xb334c94 usb_process(17e66b84,b334ce8) at usb_process+0x104/frame 0xb334cb4 fork_exit(e3d390,17e66b84,b334ce8,0,0,...) at fork_exit+0x6c/frame 0xb334cd4 fork_trampoline() at 0xffc033ca/frame 0xb334cd4 --- trap 0, eip = 0, esp = 0xb334d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100065 td 0x17e63380 sched_switch(17e63380,0,104) at sched_switch+0x598/frame 0xb33abf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb33ac24 sleepq_switch(17e63380,17e6acf8,17e6aacc,b33ac94,f72555,...) at sleepq_switch+0xe1/frame 0xb33ac48 sleepq_wait(17e6aacc,0) at sleepq_wait+0x3a/frame 0xb33ac5c _cv_wait(17e6aacc,17e6acf8) at _cv_wait+0x135/frame 0xb33ac94 usb_process(17e6aac4,b33ace8) at usb_process+0x104/frame 0xb33acb4 fork_exit(e3d390,17e6aac4,b33ace8,0,0,...) at fork_exit+0x6c/frame 0xb33acd4 fork_trampoline() at 0xffc033ca/frame 0xb33acd4 --- trap 0, eip = 0, esp = 0xb33ad20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100066 td 0x17e63000 sched_switch(17e63000,0,104) at sched_switch+0x598/frame 0xb33fbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb33fc24 sleepq_switch(17e63000,17e6acf8,17e6aafc,b33fc94,f72555,...) at sleepq_switch+0xe1/frame 0xb33fc48 sleepq_wait(17e6aafc,0) at sleepq_wait+0x3a/frame 0xb33fc5c _cv_wait(17e6aafc,17e6acf8) at _cv_wait+0x135/frame 0xb33fc94 usb_process(17e6aaf4,b33fce8) at usb_process+0x104/frame 0xb33fcb4 fork_exit(e3d390,17e6aaf4,b33fce8,0,0,...) at fork_exit+0x6c/frame 0xb33fcd4 fork_trampoline() at 0xffc033ca/frame 0xb33fcd4 --- trap 0, eip = 0, esp = 0xb33fd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100067 td 0x17bafa80 sched_switch(17bafa80,0,104) at sched_switch+0x598/frame 0xb344bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb344c24 sleepq_switch(17bafa80,17e6acf8,17e6ab2c,b344c94,f72555,...) at sleepq_switch+0xe1/frame 0xb344c48 sleepq_wait(17e6ab2c,0) at sleepq_wait+0x3a/frame 0xb344c5c _cv_wait(17e6ab2c,17e6acf8) at _cv_wait+0x135/frame 0xb344c94 usb_process(17e6ab24,b344ce8) at usb_process+0x104/frame 0xb344cb4 fork_exit(e3d390,17e6ab24,b344ce8,0,0,...) at fork_exit+0x6c/frame 0xb344cd4 fork_trampoline() at 0xffc033ca/frame 0xb344cd4 --- trap 0, eip = 0, esp = 0xb344d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100068 td 0x17baf700 sched_switch(17baf700,0,104) at sched_switch+0x598/frame 0xb349bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb349c24 sleepq_switch(17baf700,17e6acf8,17e6ab5c,b349c94,f72555,...) at sleepq_switch+0xe1/frame 0xb349c48 sleepq_wait(17e6ab5c,0) at sleepq_wait+0x3a/frame 0xb349c5c _cv_wait(17e6ab5c,17e6acf8) at _cv_wait+0x135/frame 0xb349c94 usb_process(17e6ab54,b349ce8) at usb_process+0x104/frame 0xb349cb4 fork_exit(e3d390,17e6ab54,b349ce8,0,0,...) at fork_exit+0x6c/frame 0xb349cd4 fork_trampoline() at 0xffc033ca/frame 0xb349cd4 --- trap 0, eip = 0, esp = 0xb349d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100069 td 0x17baf380 sched_switch(17baf380,0,104) at sched_switch+0x598/frame 0xb34ebf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb34ec24 sleepq_switch(17baf380,17e6acf8,17e6ab8c,b34ec94,f72555,...) at sleepq_switch+0xe1/frame 0xb34ec48 sleepq_wait(17e6ab8c,0) at sleepq_wait+0x3a/frame 0xb34ec5c _cv_wait(17e6ab8c,17e6acf8) at _cv_wait+0x135/frame 0xb34ec94 usb_process(17e6ab84,b34ece8) at usb_process+0x104/frame 0xb34ecb4 fork_exit(e3d390,17e6ab84,b34ece8,0,0,...) at fork_exit+0x6c/frame 0xb34ecd4 fork_trampoline() at 0xffc033ca/frame 0xb34ecd4 --- trap 0, eip = 0, esp = 0xb34ed20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100070 td 0x17e77700 sched_switch(17e77700,0,104) at sched_switch+0x598/frame 0xb354bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb354c24 sleepq_switch(17e77700,17e71cf8,17e71acc,b354c94,f72555,...) at sleepq_switch+0xe1/frame 0xb354c48 sleepq_wait(17e71acc,0) at sleepq_wait+0x3a/frame 0xb354c5c _cv_wait(17e71acc,17e71cf8) at _cv_wait+0x135/frame 0xb354c94 usb_process(17e71ac4,b354ce8) at usb_process+0x104/frame 0xb354cb4 fork_exit(e3d390,17e71ac4,b354ce8,0,0,...) at fork_exit+0x6c/frame 0xb354cd4 fork_trampoline() at 0xffc033ca/frame 0xb354cd4 --- trap 0, eip = 0, esp = 0xb354d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100071 td 0x17e77380 sched_switch(17e77380,0,104) at sched_switch+0x598/frame 0xb359bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb359c24 sleepq_switch(17e77380,17e71cf8,17e71afc,b359c94,f72555,...) at sleepq_switch+0xe1/frame 0xb359c48 sleepq_wait(17e71afc,0) at sleepq_wait+0x3a/frame 0xb359c5c _cv_wait(17e71afc,17e71cf8) at _cv_wait+0x135/frame 0xb359c94 usb_process(17e71af4,b359ce8) at usb_process+0x104/frame 0xb359cb4 fork_exit(e3d390,17e71af4,b359ce8,0,0,...) at fork_exit+0x6c/frame 0xb359cd4 fork_trampoline() at 0xffc033ca/frame 0xb359cd4 --- trap 0, eip = 0, esp = 0xb359d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100072 td 0x17e77000 sched_switch(17e77000,0,104) at sched_switch+0x598/frame 0xb35ebf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb35ec24 sleepq_switch(17e77000,17e71cf8,17e71b2c,b35ec94,f72555,...) at sleepq_switch+0xe1/frame 0xb35ec48 sleepq_wait(17e71b2c,0) at sleepq_wait+0x3a/frame 0xb35ec5c _cv_wait(17e71b2c,17e71cf8) at _cv_wait+0x135/frame 0xb35ec94 usb_process(17e71b24,b35ece8) at usb_process+0x104/frame 0xb35ecb4 fork_exit(e3d390,17e71b24,b35ece8,0,0,...) at fork_exit+0x6c/frame 0xb35ecd4 fork_trampoline() at 0xffc033ca/frame 0xb35ecd4 --- trap 0, eip = 0, esp = 0xb35ed20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100073 td 0x17e76a80 sched_switch(17e76a80,0,104) at sched_switch+0x598/frame 0xb363bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb363c24 sleepq_switch(17e76a80,17e71cf8,17e71b5c,b363c94,f72555,...) at sleepq_switch+0xe1/frame 0xb363c48 sleepq_wait(17e71b5c,0) at sleepq_wait+0x3a/frame 0xb363c5c _cv_wait(17e71b5c,17e71cf8) at _cv_wait+0x135/frame 0xb363c94 usb_process(17e71b54,b363ce8) at usb_process+0x104/frame 0xb363cb4 fork_exit(e3d390,17e71b54,b363ce8,0,0,...) at fork_exit+0x6c/frame 0xb363cd4 fork_trampoline() at 0xffc033ca/frame 0xb363cd4 --- trap 0, eip = 0, esp = 0xb363d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100074 td 0x17e76700 sched_switch(17e76700,0,104) at sched_switch+0x598/frame 0xb368bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb368c24 sleepq_switch(17e76700,17e71cf8,17e71b8c,b368c94,f72555,...) at sleepq_switch+0xe1/frame 0xb368c48 sleepq_wait(17e71b8c,0) at sleepq_wait+0x3a/frame 0xb368c5c _cv_wait(17e71b8c,17e71cf8) at _cv_wait+0x135/frame 0xb368c94 usb_process(17e71b84,b368ce8) at usb_process+0x104/frame 0xb368cb4 fork_exit(e3d390,17e71b84,b368ce8,0,0,...) at fork_exit+0x6c/frame 0xb368cd4 fork_trampoline() at 0xffc033ca/frame 0xb368cd4 --- trap 0, eip = 0, esp = 0xb368d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100076 td 0x17e76000 sched_switch(17e76000,0,104) at sched_switch+0x598/frame 0xb373bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb373c24 sleepq_switch(17e76000,17b85ed0,17b85ca4,b373c94,f72555,...) at sleepq_switch+0xe1/frame 0xb373c48 sleepq_wait(17b85ca4,0) at sleepq_wait+0x3a/frame 0xb373c5c _cv_wait(17b85ca4,17b85ed0) at _cv_wait+0x135/frame 0xb373c94 usb_process(17b85c9c,b373ce8) at usb_process+0x104/frame 0xb373cb4 fork_exit(e3d390,17b85c9c,b373ce8,0,0,...) at fork_exit+0x6c/frame 0xb373cd4 fork_trampoline() at 0xffc033ca/frame 0xb373cd4 --- trap 0, eip = 0, esp = 0xb373d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100077 td 0x17e75a80 sched_switch(17e75a80,0,104) at sched_switch+0x598/frame 0xb378bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb378c24 sleepq_switch(17e75a80,17b85ed0,17b85cd4,b378c94,f72555,...) at sleepq_switch+0xe1/frame 0xb378c48 sleepq_wait(17b85cd4,0) at sleepq_wait+0x3a/frame 0xb378c5c _cv_wait(17b85cd4,17b85ed0) at _cv_wait+0x135/frame 0xb378c94 usb_process(17b85ccc,b378ce8) at usb_process+0x104/frame 0xb378cb4 fork_exit(e3d390,17b85ccc,b378ce8,0,0,...) at fork_exit+0x6c/frame 0xb378cd4 fork_trampoline() at 0xffc033ca/frame 0xb378cd4 --- trap 0, eip = 0, esp = 0xb378d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100078 td 0x17e75700 sched_switch(17e75700,0,104) at sched_switch+0x598/frame 0xb37dbf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb37dc24 sleepq_switch(17e75700,17b85ed0,17b85d04,b37dc94,f72555,...) at sleepq_switch+0xe1/frame 0xb37dc48 sleepq_wait(17b85d04,0) at sleepq_wait+0x3a/frame 0xb37dc5c _cv_wait(17b85d04,17b85ed0) at _cv_wait+0x135/frame 0xb37dc94 usb_process(17b85cfc,b37dce8) at usb_process+0x104/frame 0xb37dcb4 fork_exit(e3d390,17b85cfc,b37dce8,0,0,...) at fork_exit+0x6c/frame 0xb37dcd4 fork_trampoline() at 0xffc033ca/frame 0xb37dcd4 --- trap 0, eip = 0, esp = 0xb37dd20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100079 td 0x17e75380 sched_switch(17e75380,0,104) at sched_switch+0x598/frame 0xb382bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb382c24 sleepq_switch(17e75380,17b85ed0,17b85d34,b382c94,f72555,...) at sleepq_switch+0xe1/frame 0xb382c48 sleepq_wait(17b85d34,0) at sleepq_wait+0x3a/frame 0xb382c5c _cv_wait(17b85d34,17b85ed0) at _cv_wait+0x135/frame 0xb382c94 usb_process(17b85d2c,b382ce8) at usb_process+0x104/frame 0xb382cb4 fork_exit(e3d390,17b85d2c,b382ce8,0,0,...) at fork_exit+0x6c/frame 0xb382cd4 fork_trampoline() at 0xffc033ca/frame 0xb382cd4 --- trap 0, eip = 0, esp = 0xb382d20, ebp = 0 --- (null)() at 0 Tracing command usb pid 15 tid 100080 td 0x17e75000 sched_switch(17e75000,0,104) at sched_switch+0x598/frame 0xb387bf4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb387c24 sleepq_switch(17e75000,17b85ed0,17b85d64,b387c94,f72555,...) at sleepq_switch+0xe1/frame 0xb387c48 sleepq_wait(17b85d64,0) at sleepq_wait+0x3a/frame 0xb387c5c _cv_wait(17b85d64,17b85ed0) at _cv_wait+0x135/frame 0xb387c94 usb_process(17b85d5c,b387ce8) at usb_process+0x104/frame 0xb387cb4 fork_exit(e3d390,17b85d5c,b387ce8,0,0,...) at fork_exit+0x6c/frame 0xb387cd4 fork_trampoline() at 0xffc033ca/frame 0xb387cd4 --- trap 0, eip = 0, esp = 0xb387d20, ebp = 0 --- (null)() at 0 Tracing command cam pid 7 tid 100043 td 0x17a15000 sched_switch(17a15000,0,104) at sched_switch+0x598/frame 0xb297bc4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb297bf4 sleepq_switch(17a15000,0,1c703c0,b297c6c,fdb4a7,...) at sleepq_switch+0xe1/frame 0xb297c18 sleepq_wait(1c703c0,5c) at sleepq_wait+0x3a/frame 0xb297c2c _sleep(1c703c0,1c70380,5c,15aafcf,0,0,0,0,100) at _sleep+0x307/frame 0xb297c6c xpt_done_td(1c70380,b297ce8) at xpt_done_td+0x72/frame 0xb297cb4 fork_exit(90a1f0,1c70380,b297ce8,0,0,...) at fork_exit+0x6c/frame 0xb297cd4 fork_trampoline() at 0xffc033ca/frame 0xb297cd4 --- trap 0, eip = 0, esp = 0xb297d20, ebp = 0 --- (null)() at 0 Tracing command cam pid 7 tid 100096 td 0x185ae700 sched_switch(185ae700,0,104) at sched_switch+0x598/frame 0xb3e0bbc mi_switch(104,0) at mi_switch+0x1de/frame 0xb3e0bec sleepq_switch(185ae700,0,1c702ec,b3e0c64,fdb4a7,...) at sleepq_switch+0xe1/frame 0xb3e0c10 sleepq_wait(1c702ec,5c) at sleepq_wait+0x3a/frame 0xb3e0c24 _sleep(1c702ec,1c7034c,5c,15aafcf,0,0,0,0,100) at _sleep+0x307/frame 0xb3e0c64 xpt_scanner_thread(0,b3e0ce8) at xpt_scanner_thread+0x63/frame 0xb3e0cb4 fork_exit(90a490,0,b3e0ce8,0,0,...) at fork_exit+0x6c/frame 0xb3e0cd4 fork_trampoline() at 0xffc033ca/frame 0xb3e0cd4 --- trap 0, eip = 0, esp = 0xb3e0d20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 3 pid 6 tid 100042 td 0x17a15380 sched_switch(17a15380,0,104) at sched_switch+0x598/frame 0xb292bbc mi_switch(104,0) at mi_switch+0x1de/frame 0xb292bec sleepq_switch(17a15380,0,95180c4,b292c64,fdb4a7,...) at sleepq_switch+0xe1/frame 0xb292c10 sleepq_wait(95180c4,6c) at sleepq_wait+0x3a/frame 0xb292c24 _sleep(95180c4,95180a8,6c,168bc2d,0,0,0,0,100) at _sleep+0x307/frame 0xb292c64 crypto_ret_proc(95180a8,b292ce8) at crypto_ret_proc+0x1e9/frame 0xb292cb4 fork_exit(12369a0,95180a8,b292ce8,0,0,...) at fork_exit+0x6c/frame 0xb292cd4 fork_trampoline() at 0xffc033ca/frame 0xb292cd4 --- trap 0, eip = 0, esp = 0xb292d20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 2 pid 5 tid 100041 td 0x17a15700 sched_switch(17a15700,0,104) at sched_switch+0x598/frame 0xb28dbbc mi_switch(104,0) at mi_switch+0x1de/frame 0xb28dbec sleepq_switch(17a15700,0,951808c,b28dc64,fdb4a7,...) at sleepq_switch+0xe1/frame 0xb28dc10 sleepq_wait(951808c,6c) at sleepq_wait+0x3a/frame 0xb28dc24 _sleep(951808c,9518070,6c,168bc2d,0,0,0,0,100) at _sleep+0x307/frame 0xb28dc64 crypto_ret_proc(9518070,b28dce8) at crypto_ret_proc+0x1e9/frame 0xb28dcb4 fork_exit(12369a0,9518070,b28dce8,0,0,...) at fork_exit+0x6c/frame 0xb28dcd4 fork_trampoline() at 0xffc033ca/frame 0xb28dcd4 --- trap 0, eip = 0, esp = 0xb28dd20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 1 pid 4 tid 100040 td 0x17a15a80 sched_switch(17a15a80,0,104) at sched_switch+0x598/frame 0xb288bbc mi_switch(104,0) at mi_switch+0x1de/frame 0xb288bec sleepq_switch(17a15a80,0,9518054,b288c64,fdb4a7,...) at sleepq_switch+0xe1/frame 0xb288c10 sleepq_wait(9518054,6c) at sleepq_wait+0x3a/frame 0xb288c24 _sleep(9518054,9518038,6c,168bc2d,0,0,0,0,100) at _sleep+0x307/frame 0xb288c64 crypto_ret_proc(9518038,b288ce8) at crypto_ret_proc+0x1e9/frame 0xb288cb4 fork_exit(12369a0,9518038,b288ce8,0,0,...) at fork_exit+0x6c/frame 0xb288cd4 fork_trampoline() at 0xffc033ca/frame 0xb288cd4 --- trap 0, eip = 0, esp = 0xb288d20, ebp = 0 --- (null)() at 0 Tracing command crypto returns 0 pid 3 tid 100039 td 0x17a16000 sched_switch(17a16000,0,104) at sched_switch+0x598/frame 0xb283bbc mi_switch(104,0) at mi_switch+0x1de/frame 0xb283bec sleepq_switch(17a16000,0,951801c,b283c64,fdb4a7,...) at sleepq_switch+0xe1/frame 0xb283c10 sleepq_wait(951801c,6c) at sleepq_wait+0x3a/frame 0xb283c24 _sleep(951801c,9518000,6c,168bc2d,0,0,0,0,100) at _sleep+0x307/frame 0xb283c64 crypto_ret_proc(9518000,b283ce8) at crypto_ret_proc+0x1e9/frame 0xb283cb4 fork_exit(12369a0,9518000,b283ce8,0,0,...) at fork_exit+0x6c/frame 0xb283cd4 fork_trampoline() at 0xffc033ca/frame 0xb283cd4 --- trap 0, eip = 0, esp = 0xb283d20, ebp = 0 --- (null)() at 0 Tracing command crypto pid 2 tid 100038 td 0x17a16380 sched_switch(17a16380,0,104) at sched_switch+0x598/frame 0xb27ebcc mi_switch(104,0) at mi_switch+0x1de/frame 0xb27ebfc sleepq_switch(17a16380,0,1f60278,b27ec74,fdb4a7,...) at sleepq_switch+0xe1/frame 0xb27ec20 sleepq_wait(1f60278,6c) at sleepq_wait+0x3a/frame 0xb27ec34 _sleep(1f60278,1f60260,6c,16404fd,0,0,0,0,100) at _sleep+0x307/frame 0xb27ec74 crypto_proc(0,b27ece8) at crypto_proc+0x250/frame 0xb27ecb4 fork_exit(1236620,0,b27ece8,0,0,...) at fork_exit+0x6c/frame 0xb27ecd4 fork_trampoline() at 0xffc033ca/frame 0xb27ecd4 --- trap 0, eip = 0, esp = 0xb27ed20, ebp = 0 --- (null)() at 0 Tracing command sequencer 00 pid 14 tid 100033 td 0x94e3000 sched_switch(94e3000,0,104) at sched_switch+0x598/frame 0x125e8bcc mi_switch(104,0) at mi_switch+0x1de/frame 0x125e8bfc sleepq_switch(94e3000,9585404,958544c,125e8c6c,f72555,...) at sleepq_switch+0xe1/frame 0x125e8c20 sleepq_wait(958544c,0) at sleepq_wait+0x3a/frame 0x125e8c34 _cv_wait(958544c,9585404) at _cv_wait+0x135/frame 0x125e8c6c seq_eventthread(9585400,125e8ce8) at seq_eventthread+0xcb/frame 0x125e8cb4 fork_exit(dc5890,9585400,125e8ce8,0,0,...) at fork_exit+0x6c/frame 0x125e8cd4 fork_trampoline() at 0xffc033ca/frame 0x125e8cd4 --- trap 0, eip = 0, esp = 0x125e8d20, ebp = 0 --- (null)() at 0 Tracing command geom pid 13 tid 100030 td 0x94e3a80 sched_switch(94e3a80,0,104) at sched_switch+0x598/frame 0x125d5bd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x125d5c04 sleepq_switch(94e3a80,0,1f84aa4,125d5c7c,fdb4a7,...) at sleepq_switch+0xe1/frame 0x125d5c28 sleepq_wait(1f84aa4,5c) at sleepq_wait+0x3a/frame 0x125d5c3c _sleep(1f84aa4,1ecc274,25c,15aafcf,0,0,0,0,100) at _sleep+0x307/frame 0x125d5c7c g_run_events(0,125d5ce8) at g_run_events+0x47/frame 0x125d5cb4 fork_exit(f28650,0,125d5ce8,0,0,...) at fork_exit+0x6c/frame 0x125d5cd4 fork_trampoline() at 0xffc033ca/frame 0x125d5cd4 --- trap 0, eip = 0, esp = 0x125d5d20, ebp = 0 --- (null)() at 0 Tracing command geom pid 13 tid 100031 td 0x94e3700 sched_switch(94e3700,0,104) at sched_switch+0x598/frame 0x125dabcc mi_switch(104,0) at mi_switch+0x1de/frame 0x125dabfc sleepq_switch(94e3700,0,1f84aac,125dac74,fdb4a7,...) at sleepq_switch+0xe1/frame 0x125dac20 sleepq_wait(1f84aac,5c) at sleepq_wait+0x3a/frame 0x125dac34 _sleep(1f84aac,1ecc2bc,25c,15aafcf,0,0,0,0,100) at _sleep+0x307/frame 0x125dac74 g_io_schedule_up(94e3700) at g_io_schedule_up+0x8e/frame 0x125daca8 g_up_procbody(0,125dace8) at g_up_procbody+0x5b/frame 0x125dacb4 fork_exit(f286a0,0,125dace8,0,0,...) at fork_exit+0x6c/frame 0x125dacd4 fork_trampoline() at 0xffc033ca/frame 0x125dacd4 --- trap 0, eip = 0, esp = 0x125dad20, ebp = 0 --- (null)() at 0 Tracing command geom pid 13 tid 100032 td 0x94e3380 sched_switch(94e3380,0,104) at sched_switch+0x598/frame 0x125dfbc4 mi_switch(104,0) at mi_switch+0x1de/frame 0x125dfbf8 sleepq_switch(94e3380,0,1f84aa0,125dfc70,fdb4a7,...) at sleepq_switch+0xe1/frame 0x125dfc1c sleepq_wait(1f84aa0,5c) at sleepq_wait+0x3a/frame 0x125dfc30 _sleep(1f84aa0,1ecc29c,25c,15aafcf,0,0,0,0,100) at _sleep+0x307/frame 0x125dfc70 g_io_schedule_down(94e3380) at g_io_schedule_down+0xa6/frame 0x125dfca8 g_down_procbody(0,125dfce8) at g_down_procbody+0x5b/frame 0x125dfcb4 fork_exit(f28700,0,125dfce8,0,0,...) at fork_exit+0x6c/frame 0x125dfcd4 fork_trampoline() at 0xffc033ca/frame 0x125dfcd4 --- trap 0, eip = 0, esp = 0x125dfd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100008 td 0x99e0380 sched_switch(99e0380,0,109) at sched_switch+0x598/frame 0x1253fc4c mi_switch(109,0) at mi_switch+0x1de/frame 0x1253fc80 ithread_loop(99f4f70,1253fce8) at ithread_loop+0x2f5/frame 0x1253fcb4 fork_exit(f994c0,99f4f70,1253fce8,0,0,...) at fork_exit+0x6c/frame 0x1253fcd4 fork_trampoline() at 0xffc033ca/frame 0x1253fcd4 --- trap 0, eip = 0, esp = 0x1253fd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100009 td 0x99e0000 sched_switch(99e0000,0,109) at sched_switch+0x598/frame 0x12544c4c mi_switch(109,0) at mi_switch+0x1de/frame 0x12544c80 ithread_loop(99f4f60,12544ce8) at ithread_loop+0x2f5/frame 0x12544cb4 fork_exit(f994c0,99f4f60,12544ce8,0,0,...) at fork_exit+0x6c/frame 0x12544cd4 fork_trampoline() at 0xffc033ca/frame 0x12544cd4 --- trap 0, eip = 0, esp = 0x12544d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100011 td 0x99da700 exit_tag() at 0xffc033c0 Tracing command intr pid 12 tid 100023 td 0x9515700 sched_switch(9515700,0,109) at sched_switch+0x598/frame 0x12596c4c mi_switch(109,0) at mi_switch+0x1de/frame 0x12596c80 ithread_loop(94de050,12596ce8) at ithread_loop+0x2f5/frame 0x12596cb4 fork_exit(f994c0,94de050,12596ce8,0,0,...) at fork_exit+0x6c/frame 0x12596cd4 fork_trampoline() at 0xffc033ca/frame 0x12596cd4 --- trap 0, eip = 0, esp = 0x12596d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100024 td 0x9515380 sched_switch(9515380,0,109) at sched_switch+0x598/frame 0x1259bc4c mi_switch(109,0) at mi_switch+0x1de/frame 0x1259bc80 ithread_loop(94de040,1259bce8) at ithread_loop+0x2f5/frame 0x1259bcb4 fork_exit(f994c0,94de040,1259bce8,0,0,...) at fork_exit+0x6c/frame 0x1259bcd4 fork_trampoline() at 0xffc033ca/frame 0x1259bcd4 --- trap 0, eip = 0, esp = 0x1259bd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100025 td 0x9515000 sched_switch(9515000,0,109) at sched_switch+0x598/frame 0x125a0c4c mi_switch(109,0) at mi_switch+0x1de/frame 0x125a0c80 ithread_loop(94de030,125a0ce8) at ithread_loop+0x2f5/frame 0x125a0cb4 fork_exit(f994c0,94de030,125a0ce8,0,0,...) at fork_exit+0x6c/frame 0x125a0cd4 fork_trampoline() at 0xffc033ca/frame 0x125a0cd4 --- trap 0, eip = 0, esp = 0x125a0d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100026 td 0x9514a80 sched_switch(9514a80,0,109) at sched_switch+0x598/frame 0x125a5c4c mi_switch(109,0) at mi_switch+0x1de/frame 0x125a5c80 ithread_loop(94de020,125a5ce8) at ithread_loop+0x2f5/frame 0x125a5cb4 fork_exit(f994c0,94de020,125a5ce8,0,0,...) at fork_exit+0x6c/frame 0x125a5cd4 fork_trampoline() at 0xffc033ca/frame 0x125a5cd4 --- trap 0, eip = 0, esp = 0x125a5d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100027 td 0x9514700 sched_switch(9514700,0,109) at sched_switch+0x598/frame 0x125aac4c mi_switch(109,0) at mi_switch+0x1de/frame 0x125aac80 ithread_loop(94de010,125aace8) at ithread_loop+0x2f5/frame 0x125aacb4 fork_exit(f994c0,94de010,125aace8,0,0,...) at fork_exit+0x6c/frame 0x125aacd4 fork_trampoline() at 0xffc033ca/frame 0x125aacd4 --- trap 0, eip = 0, esp = 0x125aad20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100028 td 0x9514380 exit_tag() at 0xffc033c0 Tracing command intr pid 12 tid 100044 td 0x17baf000 sched_switch(17baf000,0,109) at sched_switch+0x598/frame 0xb2c7c4c mi_switch(109,0) at mi_switch+0x1de/frame 0xb2c7c80 ithread_loop(17b2a080,b2c7ce8) at ithread_loop+0x2f5/frame 0xb2c7cb4 fork_exit(f994c0,17b2a080,b2c7ce8,0,0,...) at fork_exit+0x6c/frame 0xb2c7cd4 fork_trampoline() at 0xffc033ca/frame 0xb2c7cd4 --- trap 0, eip = 0, esp = 0xb2c7d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100045 td 0x17baea80 sched_switch(17baea80,0,109) at sched_switch+0x598/frame 0xb2d1c4c mi_switch(109,0) at mi_switch+0x1de/frame 0xb2d1c80 ithread_loop(17b2a060,b2d1ce8) at ithread_loop+0x2f5/frame 0xb2d1cb4 fork_exit(f994c0,17b2a060,b2d1ce8,0,0,...) at fork_exit+0x6c/frame 0xb2d1cd4 fork_trampoline() at 0xffc033ca/frame 0xb2d1cd4 --- trap 0, eip = 0, esp = 0xb2d1d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100046 td 0x17bae700 sched_switch(17bae700,0,109) at sched_switch+0x598/frame 0xb2d7c4c mi_switch(109,0) at mi_switch+0x1de/frame 0xb2d7c80 ithread_loop(17b2a050,b2d7ce8) at ithread_loop+0x2f5/frame 0xb2d7cb4 fork_exit(f994c0,17b2a050,b2d7ce8,0,0,...) at fork_exit+0x6c/frame 0xb2d7cd4 fork_trampoline() at 0xffc033ca/frame 0xb2d7cd4 --- trap 0, eip = 0, esp = 0xb2d7d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100047 td 0x17bae380 sched_switch(17bae380,0,109) at sched_switch+0x598/frame 0xb2ddc4c mi_switch(109,0) at mi_switch+0x1de/frame 0xb2ddc80 ithread_loop(17b2a040,b2ddce8) at ithread_loop+0x2f5/frame 0xb2ddcb4 fork_exit(f994c0,17b2a040,b2ddce8,0,0,...) at fork_exit+0x6c/frame 0xb2ddcd4 fork_trampoline() at 0xffc033ca/frame 0xb2ddcd4 --- trap 0, eip = 0, esp = 0xb2ddd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100053 td 0x17b9fa80 sched_switch(17b9fa80,0,109) at sched_switch+0x598/frame 0xb2fcc4c mi_switch(109,0) at mi_switch+0x1de/frame 0xb2fcc80 ithread_loop(17b2a030,b2fcce8) at ithread_loop+0x2f5/frame 0xb2fccb4 fork_exit(f994c0,17b2a030,b2fcce8,0,0,...) at fork_exit+0x6c/frame 0xb2fccd4 fork_trampoline() at 0xffc033ca/frame 0xb2fccd4 --- trap 0, eip = 0, esp = 0xb2fcd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100059 td 0x17e64a80 sched_switch(17e64a80,0,109) at sched_switch+0x598/frame 0xb31bc4c mi_switch(109,0) at mi_switch+0x1de/frame 0xb31bc80 ithread_loop(17b2a020,b31bce8) at ithread_loop+0x2f5/frame 0xb31bcb4 fork_exit(f994c0,17b2a020,b31bce8,0,0,...) at fork_exit+0x6c/frame 0xb31bcd4 fork_trampoline() at 0xffc033ca/frame 0xb31bcd4 --- trap 0, eip = 0, esp = 0xb31bd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100075 td 0x17e76380 exit_tag() at 0xffc033c0 Tracing command intr pid 12 tid 100081 td 0x17e65a80 sched_switch(17e65a80,0,109) at sched_switch+0x598/frame 0xb38cc4c mi_switch(109,0) at mi_switch+0x1de/frame 0xb38cc80 ithread_loop(94def80,b38cce8) at ithread_loop+0x2f5/frame 0xb38ccb4 fork_exit(f994c0,94def80,b38cce8,0,0,...) at fork_exit+0x6c/frame 0xb38ccd4 fork_trampoline() at 0xffc033ca/frame 0xb38ccd4 --- trap 0, eip = 0, esp = 0xb38cd20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100082 td 0x17e65700 sched_switch(17e65700,0,109) at sched_switch+0x598/frame 0xb395c4c mi_switch(109,0) at mi_switch+0x1de/frame 0xb395c80 ithread_loop(94def60,b395ce8) at ithread_loop+0x2f5/frame 0xb395cb4 fork_exit(f994c0,94def60,b395ce8,0,0,...) at fork_exit+0x6c/frame 0xb395cd4 fork_trampoline() at 0xffc033ca/frame 0xb395cd4 --- trap 0, eip = 0, esp = 0xb395d20, ebp = 0 --- (null)() at 0 Tracing command intr pid 12 tid 100084 td 0x17ede700 exit_tag() at 0xffc033c0 Tracing command idle pid 11 tid 100003 td 0x99e1700 sched_switch(99e1700,0,608) at sched_switch+0x598/frame 0x12521c14 mi_switch(608,0) at mi_switch+0x1de/frame 0x12521c48 critical_exit_preempt(0) at critical_exit_preempt+0x5d/frame 0x12521c5c sched_idletd(0,12521ce8) at sched_idletd+0x3ee/frame 0x12521cb4 fork_exit(ffcf30,0,12521ce8,0,0,...) at fork_exit+0x6c/frame 0x12521cd4 fork_trampoline() at 0xffc033ca/frame 0x12521cd4 --- trap 0, eip = 0, esp = 0x12521d20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100004 td 0x99e1380 sched_switch(99e1380,0,608) at sched_switch+0x598/frame 0x12526c14 mi_switch(608,0) at mi_switch+0x1de/frame 0x12526c48 critical_exit_preempt(0) at critical_exit_preempt+0x5d/frame 0x12526c5c sched_idletd(0,12526ce8) at sched_idletd+0x3ee/frame 0x12526cb4 fork_exit(ffcf30,0,12526ce8,0,0,...) at fork_exit+0x6c/frame 0x12526cd4 fork_trampoline() at 0xffc033ca/frame 0x12526cd4 --- trap 0, eip = 0, esp = 0x12526d20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100005 td 0x99e1000 (CPU 2) cpustop_handler(2,1252bbbc,1252bbb0,1533bb2,986add0,...) at cpustop_handler+0x27/frame 0x1252bae8 ipi_nmi_handler(986add0,0,99e1000,e0,99d86a8,...) at ipi_nmi_handler+0x34/frame 0x1252baf8 trap(1252bbbc,8,28,28,17b0b400,...) at trap+0xc2/frame 0x1252bbb0 calltrap() at 0xffc0316d/frame 0x1252bbb0 --- trap 0x13, eip = 0x1549ba5, esp = 0x1252bbfc, ebp = 0x1252bbfc --- acpi_cpu_c1(0,2,1fa2,9b753356,986adc0,...) at acpi_cpu_c1+0x5/frame 0x1252bbfc acpi_cpu_idle(7964bf5,0) at acpi_cpu_idle+0x230/frame 0x1252bc2c cpu_idle_acpi(7964bf5,0) at cpu_idle_acpi+0x35/frame 0x1252bc40 cpu_idle(0) at cpu_idle+0xa3/frame 0x1252bc5c sched_idletd(0,1252bce8) at sched_idletd+0x3ee/frame 0x1252bcb4 fork_exit(ffcf30,0,1252bce8,0,0,...) at fork_exit+0x6c/frame 0x1252bcd4 fork_trampoline() at 0xffc033ca/frame 0x1252bcd4 --- trap 0, eip = 0, esp = 0x1252bd20, ebp = 0 --- (null)() at 0 Tracing command idle pid 11 tid 100006 td 0x99e0a80 (CPU 3) cpustop_handler(3,12530bbc,12530bb0,1533bb2,1f92600,...) at cpustop_handler+0x27/frame 0x12530ae8 ipi_nmi_handler(1f92600,30,99e0a80,1f92670,99d86a8,...) at ipi_nmi_handler+0x34/frame 0x12530af8 trap(12530bbc,8,28,28,17b0b200,...) at trap+0xc2/frame 0x12530bb0 calltrap() at 0xffc0316d/frame 0x12530bb0 --- trap 0x13, eip = 0x1549ba5, esp = 0x12530bfc, ebp = 0x12530bfc --- acpi_cpu_c1(0,3,1fa2,9bb276ce,986fdc0,...) at acpi_cpu_c1+0x5/frame 0x12530bfc acpi_cpu_idle(be15d73,0) at acpi_cpu_idle+0x230/frame 0x12530c2c cpu_idle_acpi(be15d73,0) at cpu_idle_acpi+0x35/frame 0x12530c40 cpu_idle(0) at cpu_idle+0xa3/frame 0x12530c5c sched_idletd(0,12530ce8) at sched_idletd+0x3ee/frame 0x12530cb4 fork_exit(ffcf30,0,12530ce8,0,0,...) at fork_exit+0x6c/frame 0x12530cd4 fork_trampoline() at 0xffc033ca/frame 0x12530cd4 --- trap 0, eip = 0, esp = 0x12530d20, ebp = 0 --- (null)() at 0 Tracing command init pid 1 tid 100002 td 0x99e1a80 sched_switch(99e1a80,0,104) at sched_switch+0x598/frame 0x125188c4 mi_switch(104,0) at mi_switch+0x1de/frame 0x125188f4 sleepq_switch(6c,1251894c,10216b7,99d89fc,1eeeb54,...) at sleepq_switch+0xe1/frame 0x12518918 sleepq_catch_signals(99e1a80,0,99d89fc,12518998,fdb42e,...) at sleepq_catch_signals+0x3b7/frame 0x12518944 sleepq_wait_sig(99d89fc,6c) at sleepq_wait_sig+0x11/frame 0x12518958 _sleep(99d89fc,99d8aa4,36c,167698b,0,...) at _sleep+0x28e/frame 0x12518998 kern_wait6(99e1a80,7,0,0,12518ba4,...) at kern_wait6+0xa2a/frame 0x12518a78 kern_wait(99e1a80,ffffffff,12518ba4,30,0,...) at kern_wait+0x119/frame 0x12518b80 sys_wait4(99e1a80,99e1d0c) at sys_wait4+0x68/frame 0x12518c08 syscall(12518ce8,3b,3b,3b,7100ff6e,...) at syscall+0x304/frame 0x12518cdc Xint0x80_syscall() at 0xffc033b7/frame 0x12518cdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x47f57f, esp = 0xffbfe920, ebp = 0xffbfe934 --- (null)() at 0x47f57f Tracing command audit pid 10 tid 100001 td 0x99e2000 sched_switch(99e2000,0,104) at sched_switch+0x598/frame 0x12513bcc mi_switch(104,0) at mi_switch+0x1de/frame 0x12513c00 sleepq_switch(99e2000,1f9528c,1f952e0,12513c70,f72555,...) at sleepq_switch+0xe1/frame 0x12513c24 sleepq_wait(1f952e0,0) at sleepq_wait+0x3a/frame 0x12513c38 _cv_wait(1f952e0,1f9528c) at _cv_wait+0x135/frame 0x12513c70 audit_worker(0,12513ce8) at audit_worker+0x7f/frame 0x12513cb4 fork_exit(1255570,0,12513ce8,0,0,...) at fork_exit+0x6c/frame 0x12513cd4 fork_trampoline() at 0xffc033ca/frame 0x12513cd4 --- trap 0, eip = 0, esp = 0x12513d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100000 td 0x1f84e20 sched_switch(1f84e20,0,104) at sched_switch+0x598/frame 0x24f9c04 mi_switch(104,0) at mi_switch+0x1de/frame 0x24f9c34 sleepq_switch(1,1f84e20,177,1f84e20,0,...) at sleepq_switch+0xe1/frame 0x24f9c58 sleepq_timedwait(1f84ac4,54,211dfa80,1eed484,2c9,...) at sleepq_timedwait+0x47/frame 0x24f9c88 _sleep(1f84ac4,0,54,167957e,fffff470,9,0,0,100) at _sleep+0x23c/frame 0x24f9cc8 swapper(0,0,0,1c44ac4) at swapper+0x6d/frame 0x24f9d14 mi_startup() at mi_startup+0x2b5/frame 0x24f9d38 btext() at btext+0x5f Tracing command kernel pid 0 tid 100007 td 0x99e0700 sched_switch(99e0700,0,104) at sched_switch+0x598/frame 0x1253abd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x1253ac04 sleepq_switch(99e0700,0,947f180,1253ac7c,fdb4a7,...) at sleepq_switch+0xe1/frame 0x1253ac28 sleepq_wait(947f180,0) at sleepq_wait+0x3a/frame 0x1253ac3c _sleep(947f180,947f19c,0,15aafcf,0,0,0,0,100) at _sleep+0x307/frame 0x1253ac7c taskqueue_thread_loop(1f94670,1253ace8) at taskqueue_thread_loop+0xcb/frame 0x1253acb4 fork_exit(1026640,1f94670,1253ace8,0,0,...) at fork_exit+0x6c/frame 0x1253acd4 fork_trampoline() at 0xffc033ca/frame 0x1253acd4 --- trap 0, eip = 0, esp = 0x1253ad20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100010 td 0x99daa80 sched_switch(99daa80,0,104) at sched_switch+0x598/frame 0x12549bd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x12549c04 sleepq_switch(99daa80,0,947f000,12549c7c,fdb4a7,...) at sleepq_switch+0xe1/frame 0x12549c28 sleepq_wait(947f000,0) at sleepq_wait+0x3a/frame 0x12549c3c _sleep(947f000,947f01c,0,15aafcf,0,0,0,0,100) at _sleep+0x307/frame 0x12549c7c taskqueue_thread_loop(1f94620,12549ce8) at taskqueue_thread_loop+0xcb/frame 0x12549cb4 fork_exit(1026640,1f94620,12549ce8,0,0,...) at fork_exit+0x6c/frame 0x12549cd4 fork_trampoline() at 0xffc033ca/frame 0x12549cd4 --- trap 0, eip = 0, esp = 0x12549d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100012 td 0x99da380 sched_switch(99da380,0,104) at sched_switch+0x598/frame 0x12553bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x12553c10 sleepq_switch(0,947ee80,99da380,12553c80,fdb6f2,...) at sleepq_switch+0xe1/frame 0x12553c34 sleepq_wait(947ee80,0) at sleepq_wait+0x3a/frame 0x12553c48 msleep_spin_sbt(947ee80,947ee9c,15aafcf,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x12553c80 gtaskqueue_thread_loop(94d4804,12553ce8) at gtaskqueue_thread_loop+0x9c/frame 0x12553cb4 fork_exit(10129a0,94d4804,12553ce8,0,0,...) at fork_exit+0x6c/frame 0x12553cd4 fork_trampoline() at 0xffc033ca/frame 0x12553cd4 --- trap 0, eip = 0, esp = 0x12553d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100013 td 0x99da000 sched_switch(99da000,0,104) at sched_switch+0x598/frame 0x12558bd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x12558c04 sleepq_switch(99da000,0,947ee00,12558c7c,fdb4a7,...) at sleepq_switch+0xe1/frame 0x12558c28 sleepq_wait(947ee00,0) at sleepq_wait+0x3a/frame 0x12558c3c _sleep(947ee00,947ee1c,0,15aafcf,0,0,0,0,100) at _sleep+0x307/frame 0x12558c7c taskqueue_thread_loop(1f85478,12558ce8) at taskqueue_thread_loop+0xcb/frame 0x12558cb4 fork_exit(1026640,1f85478,12558ce8,0,0,...) at fork_exit+0x6c/frame 0x12558cd4 fork_trampoline() at 0xffc033ca/frame 0x12558cd4 --- trap 0, eip = 0, esp = 0x12558d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100014 td 0x94da380 sched_switch(94da380,0,104) at sched_switch+0x598/frame 0x12569bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x12569c10 sleepq_switch(0,947ed80,94da380,12569c80,fdb6f2,...) at sleepq_switch+0xe1/frame 0x12569c34 sleepq_wait(947ed80,0) at sleepq_wait+0x3a/frame 0x12569c48 msleep_spin_sbt(947ed80,947ed9c,15aafcf,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x12569c80 gtaskqueue_thread_loop(94d4c04,12569ce8) at gtaskqueue_thread_loop+0x9c/frame 0x12569cb4 fork_exit(10129a0,94d4c04,12569ce8,0,0,...) at fork_exit+0x6c/frame 0x12569cd4 fork_trampoline() at 0xffc033ca/frame 0x12569cd4 --- trap 0, eip = 0, esp = 0x12569d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100015 td 0x94da000 sched_switch(94da000,0,104) at sched_switch+0x598/frame 0x1256ebdc mi_switch(104,0) at mi_switch+0x1de/frame 0x1256ec10 sleepq_switch(0,947ed00,94da000,1256ec80,fdb6f2,...) at sleepq_switch+0xe1/frame 0x1256ec34 sleepq_wait(947ed00,0) at sleepq_wait+0x3a/frame 0x1256ec48 msleep_spin_sbt(947ed00,947ed1c,15aafcf,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1256ec80 gtaskqueue_thread_loop(94d5004,1256ece8) at gtaskqueue_thread_loop+0x9c/frame 0x1256ecb4 fork_exit(10129a0,94d5004,1256ece8,0,0,...) at fork_exit+0x6c/frame 0x1256ecd4 fork_trampoline() at 0xffc033ca/frame 0x1256ecd4 --- trap 0, eip = 0, esp = 0x1256ed20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100016 td 0x94d8a80 sched_switch(94d8a80,0,104) at sched_switch+0x598/frame 0x12573bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x12573c10 sleepq_switch(0,947ec80,94d8a80,12573c80,fdb6f2,...) at sleepq_switch+0xe1/frame 0x12573c34 sleepq_wait(947ec80,0) at sleepq_wait+0x3a/frame 0x12573c48 msleep_spin_sbt(947ec80,947ec9c,15aafcf,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x12573c80 gtaskqueue_thread_loop(94d5014,12573ce8) at gtaskqueue_thread_loop+0x9c/frame 0x12573cb4 fork_exit(10129a0,94d5014,12573ce8,0,0,...) at fork_exit+0x6c/frame 0x12573cd4 fork_trampoline() at 0xffc033ca/frame 0x12573cd4 --- trap 0, eip = 0, esp = 0x12573d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100017 td 0x94d8700 sched_switch(94d8700,0,104) at sched_switch+0x598/frame 0x12578bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x12578c10 sleepq_switch(0,947ec00,94d8700,12578c80,fdb6f2,...) at sleepq_switch+0xe1/frame 0x12578c34 sleepq_wait(947ec00,0) at sleepq_wait+0x3a/frame 0x12578c48 msleep_spin_sbt(947ec00,947ec1c,15aafcf,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x12578c80 gtaskqueue_thread_loop(94d5024,12578ce8) at gtaskqueue_thread_loop+0x9c/frame 0x12578cb4 fork_exit(10129a0,94d5024,12578ce8,0,0,...) at fork_exit+0x6c/frame 0x12578cd4 fork_trampoline() at 0xffc033ca/frame 0x12578cd4 --- trap 0, eip = 0, esp = 0x12578d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100018 td 0x94d8380 sched_switch(94d8380,0,104) at sched_switch+0x598/frame 0x1257dbdc mi_switch(104,0) at mi_switch+0x1de/frame 0x1257dc10 sleepq_switch(0,947eb80,94d8380,1257dc80,fdb6f2,...) at sleepq_switch+0xe1/frame 0x1257dc34 sleepq_wait(947eb80,0) at sleepq_wait+0x3a/frame 0x1257dc48 msleep_spin_sbt(947eb80,947eb9c,15aafcf,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1257dc80 gtaskqueue_thread_loop(94d5034,1257dce8) at gtaskqueue_thread_loop+0x9c/frame 0x1257dcb4 fork_exit(10129a0,94d5034,1257dce8,0,0,...) at fork_exit+0x6c/frame 0x1257dcd4 fork_trampoline() at 0xffc033ca/frame 0x1257dcd4 --- trap 0, eip = 0, esp = 0x1257dd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100019 td 0x94d8000 sched_switch(94d8000,0,104) at sched_switch+0x598/frame 0x12582bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x12582c10 sleepq_switch(0,947eb00,94d8000,12582c80,fdb6f2,...) at sleepq_switch+0xe1/frame 0x12582c34 sleepq_wait(947eb00,0) at sleepq_wait+0x3a/frame 0x12582c48 msleep_spin_sbt(947eb00,947eb1c,15aafcf,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x12582c80 gtaskqueue_thread_loop(94d4404,12582ce8) at gtaskqueue_thread_loop+0x9c/frame 0x12582cb4 fork_exit(10129a0,94d4404,12582ce8,0,0,...) at fork_exit+0x6c/frame 0x12582cd4 fork_trampoline() at 0xffc033ca/frame 0x12582cd4 --- trap 0, eip = 0, esp = 0x12582d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100020 td 0x94d7a80 sched_switch(94d7a80,0,104) at sched_switch+0x598/frame 0x12587bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x12587c10 sleepq_switch(0,947ea80,94d7a80,12587c80,fdb6f2,...) at sleepq_switch+0xe1/frame 0x12587c34 sleepq_wait(947ea80,0) at sleepq_wait+0x3a/frame 0x12587c48 msleep_spin_sbt(947ea80,947ea9c,15aafcf,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x12587c80 gtaskqueue_thread_loop(94d4414,12587ce8) at gtaskqueue_thread_loop+0x9c/frame 0x12587cb4 fork_exit(10129a0,94d4414,12587ce8,0,0,...) at fork_exit+0x6c/frame 0x12587cd4 fork_trampoline() at 0xffc033ca/frame 0x12587cd4 --- trap 0, eip = 0, esp = 0x12587d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100021 td 0x94d7700 sched_switch(94d7700,0,104) at sched_switch+0x598/frame 0x1258cbdc mi_switch(104,0) at mi_switch+0x1de/frame 0x1258cc10 sleepq_switch(0,947ea00,94d7700,1258cc80,fdb6f2,...) at sleepq_switch+0xe1/frame 0x1258cc34 sleepq_wait(947ea00,0) at sleepq_wait+0x3a/frame 0x1258cc48 msleep_spin_sbt(947ea00,947ea1c,15aafcf,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x1258cc80 gtaskqueue_thread_loop(94d4424,1258cce8) at gtaskqueue_thread_loop+0x9c/frame 0x1258ccb4 fork_exit(10129a0,94d4424,1258cce8,0,0,...) at fork_exit+0x6c/frame 0x1258ccd4 fork_trampoline() at 0xffc033ca/frame 0x1258ccd4 --- trap 0, eip = 0, esp = 0x1258cd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100022 td 0x94d7380 sched_switch(94d7380,0,104) at sched_switch+0x598/frame 0x12591bdc mi_switch(104,0) at mi_switch+0x1de/frame 0x12591c10 sleepq_switch(0,947e980,94d7380,12591c80,fdb6f2,...) at sleepq_switch+0xe1/frame 0x12591c34 sleepq_wait(947e980,0) at sleepq_wait+0x3a/frame 0x12591c48 msleep_spin_sbt(947e980,947e99c,15aafcf,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0x12591c80 gtaskqueue_thread_loop(94d4434,12591ce8) at gtaskqueue_thread_loop+0x9c/frame 0x12591cb4 fork_exit(10129a0,94d4434,12591ce8,0,0,...) at fork_exit+0x6c/frame 0x12591cd4 fork_trampoline() at 0xffc033ca/frame 0x12591cd4 --- trap 0, eip = 0, esp = 0x12591d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100029 td 0x9514000 sched_switch(9514000,0,104) at sched_switch+0x598/frame 0x125d0bd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x125d0c04 sleepq_switch(9514000,0,9590080,125d0c7c,fdb4a7,...) at sleepq_switch+0xe1/frame 0x125d0c28 sleepq_wait(9590080,0) at sleepq_wait+0x3a/frame 0x125d0c3c _sleep(9590080,959009c,0,15aafcf,0,0,0,0,100) at _sleep+0x307/frame 0x125d0c7c taskqueue_thread_loop(1eec48c,125d0ce8) at taskqueue_thread_loop+0xcb/frame 0x125d0cb4 fork_exit(1026640,1eec48c,125d0ce8,0,0,...) at fork_exit+0x6c/frame 0x125d0cd4 fork_trampoline() at 0xffc033ca/frame 0x125d0cd4 --- trap 0, eip = 0, esp = 0x125d0d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100034 td 0x94daa80 sched_switch(94daa80,0,104) at sched_switch+0x598/frame 0x125edbd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x125edc04 sleepq_switch(94daa80,0,958fe00,125edc7c,fdb4a7,...) at sleepq_switch+0xe1/frame 0x125edc28 sleepq_wait(958fe00,0) at sleepq_wait+0x3a/frame 0x125edc3c _sleep(958fe00,958fe1c,0,15aafcf,0,0,0,0,100) at _sleep+0x307/frame 0x125edc7c taskqueue_thread_loop(1f6031c,125edce8) at taskqueue_thread_loop+0xcb/frame 0x125edcb4 fork_exit(1026640,1f6031c,125edce8,0,0,...) at fork_exit+0x6c/frame 0x125edcd4 fork_trampoline() at 0xffc033ca/frame 0x125edcd4 --- trap 0, eip = 0, esp = 0x125edd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100035 td 0x94da700 sched_switch(94da700,0,104) at sched_switch+0x598/frame 0x125f2bd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x125f2c04 sleepq_switch(94da700,0,958fe00,125f2c7c,fdb4a7,...) at sleepq_switch+0xe1/frame 0x125f2c28 sleepq_wait(958fe00,0) at sleepq_wait+0x3a/frame 0x125f2c3c _sleep(958fe00,958fe1c,0,15aafcf,0,0,0,0,100) at _sleep+0x307/frame 0x125f2c7c taskqueue_thread_loop(1f6031c,125f2ce8) at taskqueue_thread_loop+0xcb/frame 0x125f2cb4 fork_exit(1026640,1f6031c,125f2ce8,0,0,...) at fork_exit+0x6c/frame 0x125f2cd4 fork_trampoline() at 0xffc033ca/frame 0x125f2cd4 --- trap 0, eip = 0, esp = 0x125f2d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100036 td 0x17a16a80 sched_switch(17a16a80,0,104) at sched_switch+0x598/frame 0x125f7bd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x125f7c04 sleepq_switch(17a16a80,0,958fe00,125f7c7c,fdb4a7,...) at sleepq_switch+0xe1/frame 0x125f7c28 sleepq_wait(958fe00,0) at sleepq_wait+0x3a/frame 0x125f7c3c _sleep(958fe00,958fe1c,0,15aafcf,0,0,0,0,100) at _sleep+0x307/frame 0x125f7c7c taskqueue_thread_loop(1f6031c,125f7ce8) at taskqueue_thread_loop+0xcb/frame 0x125f7cb4 fork_exit(1026640,1f6031c,125f7ce8,0,0,...) at fork_exit+0x6c/frame 0x125f7cd4 fork_trampoline() at 0xffc033ca/frame 0x125f7cd4 --- trap 0, eip = 0, esp = 0x125f7d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100037 td 0x17a16700 sched_switch(17a16700,0,104) at sched_switch+0x598/frame 0x125fcbd4 mi_switch(104,0) at mi_switch+0x1de/frame 0x125fcc04 sleepq_switch(17a16700,0,958fe00,125fcc7c,fdb4a7,...) at sleepq_switch+0xe1/frame 0x125fcc28 sleepq_wait(958fe00,0) at sleepq_wait+0x3a/frame 0x125fcc3c _sleep(958fe00,958fe1c,0,15aafcf,0,0,0,0,100) at _sleep+0x307/frame 0x125fcc7c taskqueue_thread_loop(1f6031c,125fcce8) at taskqueue_thread_loop+0xcb/frame 0x125fccb4 fork_exit(1026640,1f6031c,125fcce8,0,0,...) at fork_exit+0x6c/frame 0x125fccd4 fork_trampoline() at 0xffc033ca/frame 0x125fccd4 --- trap 0, eip = 0, esp = 0x125fcd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100085 td 0x17ede380 sched_switch(17ede380,0,104) at sched_switch+0x598/frame 0xb3a4bdc mi_switch(104,0) at mi_switch+0x1de/frame 0xb3a4c10 sleepq_switch(0,17b99f00,17ede380,b3a4c80,fdb6f2,...) at sleepq_switch+0xe1/frame 0xb3a4c34 sleepq_wait(17b99f00,0) at sleepq_wait+0x3a/frame 0xb3a4c48 msleep_spin_sbt(17b99f00,17b99f1c,15aafcf,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0xb3a4c80 taskqueue_thread_loop(1f78f48,b3a4ce8) at taskqueue_thread_loop+0x9c/frame 0xb3a4cb4 fork_exit(1026640,1f78f48,b3a4ce8,0,0,...) at fork_exit+0x6c/frame 0xb3a4cd4 fork_trampoline() at 0xffc033ca/frame 0xb3a4cd4 --- trap 0, eip = 0, esp = 0xb3a4d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100091 td 0x185cca80 sched_switch(185cca80,0,104) at sched_switch+0x598/frame 0xb3c7bdc mi_switch(104,0) at mi_switch+0x1de/frame 0xb3c7c10 sleepq_switch(0,18100180,185cca80,b3c7c80,fdb6f2,...) at sleepq_switch+0xe1/frame 0xb3c7c34 sleepq_wait(18100180,0) at sleepq_wait+0x3a/frame 0xb3c7c48 msleep_spin_sbt(18100180,1810019c,15aafcf,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0xb3c7c80 taskqueue_thread_loop(1f7ab80,b3c7ce8) at taskqueue_thread_loop+0x9c/frame 0xb3c7cb4 fork_exit(1026640,1f7ab80,b3c7ce8,0,0,...) at fork_exit+0x6c/frame 0xb3c7cd4 fork_trampoline() at 0xffc033ca/frame 0xb3c7cd4 --- trap 0, eip = 0, esp = 0xb3c7d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100092 td 0x185cc700 sched_switch(185cc700,0,104) at sched_switch+0x598/frame 0xb3ccbdc mi_switch(104,0) at mi_switch+0x1de/frame 0xb3ccc10 sleepq_switch(0,18100180,185cc700,b3ccc80,fdb6f2,...) at sleepq_switch+0xe1/frame 0xb3ccc34 sleepq_wait(18100180,0) at sleepq_wait+0x3a/frame 0xb3ccc48 msleep_spin_sbt(18100180,1810019c,15aafcf,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0xb3ccc80 taskqueue_thread_loop(1f7ab80,b3ccce8) at taskqueue_thread_loop+0x9c/frame 0xb3cccb4 fork_exit(1026640,1f7ab80,b3ccce8,0,0,...) at fork_exit+0x6c/frame 0xb3cccd4 fork_trampoline() at 0xffc033ca/frame 0xb3cccd4 --- trap 0, eip = 0, esp = 0xb3ccd20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100093 td 0x185cc380 sched_switch(185cc380,0,104) at sched_switch+0x598/frame 0xb3d1bdc mi_switch(104,0) at mi_switch+0x1de/frame 0xb3d1c10 sleepq_switch(0,18100180,185cc380,b3d1c80,fdb6f2,...) at sleepq_switch+0xe1/frame 0xb3d1c34 sleepq_wait(18100180,0) at sleepq_wait+0x3a/frame 0xb3d1c48 msleep_spin_sbt(18100180,1810019c,15aafcf,0,0,0,0,100) at msleep_spin_sbt+0x132/frame 0xb3d1c80 taskqueue_thread_loop(1f7ab80,b3d1ce8) at taskqueue_thread_loop+0x9c/frame 0xb3d1cb4 fork_exit(1026640,1f7ab80,b3d1ce8,0,0,...) at fork_exit+0x6c/frame 0xb3d1cd4 fork_trampoline() at 0xffc033ca/frame 0xb3d1cd4 --- trap 0, eip = 0, esp = 0xb3d1d20, ebp = 0 --- (null)() at 0 Tracing command kernel pid 0 tid 100095 td 0x185aea80 sched_switch(185aea80,0,104) at sched_switch+0x598/frame 0xb3dbbd4 mi_switch(104,0) at mi_switch+0x1de/frame 0xb3dbc04 sleepq_switch(185aea80,0,958fc80,b3dbc7c,fdb4a7,...) at sleepq_switch+0xe1/frame 0xb3dbc28 sleepq_wait(958fc80,0) at sleepq_wait+0x3a/frame 0xb3dbc3c _sleep(958fc80,958fc9c,0,15aafcf,0,0,0,0,100) at _sleep+0x307/frame 0xb3dbc7c taskqueue_thread_loop(1c70374,b3dbce8) at taskqueue_thread_loop+0xcb/frame 0xb3dbcb4 fork_exit(1026640,1c70374,b3dbce8,0,0,...) at fork_exit+0x6c/frame 0xb3dbcd4 fork_trampoline() at 0xffc033ca/frame 0xb3dbcd4 --- trap 0, eip = 0, esp = 0xb3dbd20, ebp = 0 --- (null)() at 0 db:0:pho> dump Physical memory: 3426 MB Dumping 1158 MB: 1143 1127 1111 1095 1079 1063 1047 1031 1015 999 983 967 951 935 919 903 887 871 855 839 823 807 791 775 759 743 727 711 695 679 663 647 631 615 599 583 567 551 535 519 503 487 471 455 439 423 407 391 375 359 343 327 311 295 279 263 247 231 215 199 183 167 151 135 119 103 87 71 55 39 23 7 Dump complete db> reset (kgdb) bt #0 0x00fd11a9 in doadump (textdump=0x0) at ../../../kern/kern_shutdown.c:391 #1 0x00a01ac4 in db_dump (dummy=0x1013d65, dummy2=, dummy3=0xffffffff, dummy4=0x23a1722c "") at ../../../ddb/db_command.c:575 #2 0x00a0189f in db_command (last_cmdp=, cmd_table=0x1c71f88 , dopager=0x0) at ../../../ddb/db_command.c:482 #3 0x00a060b6 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #4 0x00a0189f in db_command (last_cmdp=, cmd_table=0x1c71f88 , dopager=0x1) at ../../../ddb/db_command.c:482 #5 0x00a01622 in db_command_loop () at ../../../ddb/db_command.c:535 #6 0x00a044aa in db_trap (type=0x3, code=0x0) at ../../../ddb/db_main.c:252 #7 0x010144da in kdb_trap (type=0x3, code=0x0, tf=0x23a1751c) at ../../../kern/subr_kdb.c:692 #8 0x01533e96 in trap (frame=0x23a1751c) at ../../../i386/i386/trap.c:713 #9 0xffc0316d in ?? () #10 0x23a1751c in ?? () #11 0x00fd1359 in vpanic (fmt=0x163709e "%s: fault on nofault entry, addr: %#lx", ap=0x23a175b0 "ÙÚX\001") at ../../../kern/kern_shutdown.c:894 #12 0x00fd1174 in panic (fmt=0x163709e "%s: fault on nofault entry, addr: %#lx") at ../../../kern/kern_shutdown.c:832 #13 0x012c2044 in vm_fault_hold (map=0x2db5000, vaddr=0x83326000, fault_type=, fault_flags=0x0, m_hold=0x0) at ../../../vm/vm_fault.c:602 #14 0x012bfb8a in vm_fault (map=0x2db5000, vaddr=0x83326000, fault_type=0x2, fault_flags=0x0) at ../../../vm/vm_fault.c:551 #15 0x01534893 in trap_pfault (frame=0x23a177bc, usermode=, eva=0x8332680c) at ../../../i386/i386/trap.c:881 #16 0x01533eb0 in trap (frame=0x23a177bc) at ../../../i386/i386/trap.c:520 #17 0xffc0316d in ?? () #18 0x23a177bc in ?? () #19 0x00fb8960 in pgdelete (pgrp=0x27e5ea6c) at ../../../kern/kern_proc.c:733 #20 0x00fb88d5 in leavepgrp (p=0x298d46a8) at ../../../kern/kern_proc.c:712 #21 0x00f927e4 in proc_reap (td=0x23c00a80, p=0x298d46a8, status=0x23a17ba4, options=0x36) at ../../../kern/kern_exit.c:919 #22 0x00f93438 in proc_to_reap (td=0x23c00a80, p=0x298d46a8, idtype=P_ALL, id=0x0, status=0x23a17ba4, options=0x36, wrusage=0x0, siginfo=0x0, check_only=0x0) at ../../../kern/kern_exit.c:1132 #23 0x00f919da in kern_wait6 (td=0x23c00a80, idtype=P_ALL, id=0x0, status=0x23a17ba4, options=0x36, wrusage=0x0, siginfo=0x0) at ../../../kern/kern_exit.c:1258 #24 0x00f91439 in kern_wait (td=0x23c00a80, pid=0xffffffff, status=0x23a17ba4, options=0x36, rusage=0x0) at ../../../kern/kern_exit.c:1173 #25 0x00f91278 in sys_wait4 (td=0x23c00a80, uap=0x23c00d0c) at ../../../kern/kern_exit.c:799 #26 0x01534ec4 in syscallenter (td=) at ../../../i386/i386/../../kern/subr_syscall.c:144 #27 syscall (frame=0x23a17ce8) at ../../../i386/i386/trap.c:1159 #28 0xffc033b7 in ?? () #29 0x23a17ce8 in ?? () Backtrace stopped: Cannot access memory at address 0xffbfe794 (kgdb) f 19 #19 0x00fb8960 in pgdelete (pgrp=0x27e5ea6c) at ../../../kern/kern_proc.c:733 733 funsetownlst(&pgrp->pg_sigiolst); (kgdb) l 728 729 /* 730 * Reset any sigio structures pointing to us as a result of 731 * F_SETOWN with our pgid. 732 */ 733 funsetownlst(&pgrp->pg_sigiolst); 734 735 PGRP_LOCK(pgrp); 736 tp = pgrp->pg_session->s_ttyp; 737 LIST_REMOVE(pgrp, pg_hash); (kgdb) info loc tp = savesess = (kgdb) p *pgrp $1 = {pg_hash = {le_next = 0x0, le_prev = 0xdeadc0de}, pg_members = {lh_first = 0xdeadc0de}, pg_session = 0xdeadc0de, pg_sigiolst = { slh_first = 0x1bed5fc }, pg_id = 0xdeadc0de, pg_jobc = 0xdeadc0de, pg_mtx = {lock_object = { lo_name = 0xdeadc0de , lo_flags = 0xdeadc0de, lo_data = 0xdeadc0de, lo_witness = 0xdeadc0de}, mtx_lock = 0xdeadc0de}} (kgdb) f 20 #20 0x00fb88d5 in leavepgrp (p=0x298d46a8) at ../../../kern/kern_proc.c:712 712 pgdelete(savepgrp); (kgdb) l 707 LIST_REMOVE(p, p_pglist); 708 p->p_pgrp = NULL; 709 PROC_UNLOCK(p); 710 PGRP_UNLOCK(savepgrp); 711 if (LIST_EMPTY(&savepgrp->pg_members)) 712 pgdelete(savepgrp); 713 return (0); 714 } 715 716 /* (kgdb) info loc savepgrp = 0x27e5ea40 (kgdb) p *p $2 = {p_list = {le_next = 0x0, le_prev = 0x99d7354}, p_threads = {tqh_first = 0x2b2bd000, tqh_last = 0x2b2bd008}, p_slock = {lock_object = { lo_name = 0x1651aca "process slock", lo_flags = 0x20030000, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x0}, p_ucred = 0x17ace900, p_fd = 0x0, p_fdtol = 0x0, p_stats = 0x295ade00, p_limit = 0x0, p_limco = {c_links = {le = {le_next = 0x0, le_prev = 0x0}, sle = { sle_next = 0x0}, tqe = {tqe_next = 0x0, tqe_prev = 0x0}}, c_time = 0x0, c_precision = 0x0, c_arg = 0x0, c_func = 0x0, c_lock = 0x298d4750, c_flags = 0x0, c_iflags = 0x0, c_cpu = 0x0}, p_sigacts = 0x2b2d5000, p_flag = 0x10006002, p_flag2 = 0x0, p_state = PRS_ZOMBIE, p_pid = 0xcdf9, p_hash = {le_next = 0x0, le_prev = 0x998b7e4}, p_pglist = {le_next = 0x0, le_prev = 0x27e5ea48}, p_pptr = 0x2242a000, p_sibling = { le_next = 0x0, le_prev = 0x2242a094}, p_children = {lh_first = 0x0}, p_reaper = 0x99d89fc, p_reaplist = {lh_first = 0x0}, p_reapsibling = { le_next = 0x99d66a8, le_prev = 0x299300a0}, p_mtx = {lock_object = {lo_name = 0x15e8b69 "process lock", lo_flags = 0x21430000, lo_data = 0x0, lo_witness = 0x2db83a8}, mtx_lock = 0x0}, p_statmtx = {lock_object = {lo_name = 0x15a6eae "pstatl", lo_flags = 0x20030000, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x0}, p_itimmtx = {lock_object = {lo_name = 0x15df954 "pitiml", lo_flags = 0x20030000, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x0}, p_profmtx = {lock_object = {lo_name = 0x1634d7b "pprofl", lo_flags = 0x20030000, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x0}, p_ksi = 0x2998f780, p_sigqueue = {sq_signals = {__bits = {0x0, 0x0, 0x0, 0x0}}, sq_kill = {__bits = { 0x0, 0x0, 0x0, 0x0}}, sq_ptrace = {__bits = {0x0, 0x0, 0x0, 0x0}}, sq_list = {tqh_first = 0x0, tqh_last = 0x298d47d4}, sq_proc = 0x298d46a8, sq_flags = 0x1}, p_oppid = 0x376, p_vmspace = 0x1f851c0 , p_swtick = 0x811c19eb, p_cowgen = 0x0, p_realtimer = {it_interval = {tv_sec = 0x0, tv_usec = 0x0}, it_value = {tv_sec = 0x0, tv_usec = 0x0}}, p_ru = {ru_utime = {tv_sec = 0x0, tv_usec = 0x0}, ru_stime = {tv_sec = 0x0, tv_usec = 0x0}, ru_maxrss = 0x25769c, ru_ixrss = 0x1180f8fc, ru_idrss = 0x3ddf008, ru_isrss = 0x46953ef8, ru_minflt = 0xa4a0745, ru_majflt = 0x1dc506, ru_nswap = 0x8b7, ru_inblock = 0x104213, ru_oublock = 0xcf6dc5, ru_msgsnd = 0x2ba745, ru_msgrcv = 0xf89565, ru_nsignals = 0xcab21e, ru_nvcsw = 0x144b0064, ru_nivcsw = 0x1b9f8e9}, p_rux = { rux_runtime = 0x2525e67045e9, rux_uticks = 0x87964, rux_sticks = 0x2325cd, rux_iticks = 0x0, rux_uu = 0x10728a153, rux_su = 0x44206b545, rux_tu = 0x548826370}, p_crux = {rux_runtime = 0x2524395b6b1f, rux_uticks = 0x87942, rux_sticks = 0x232409, rux_iticks = 0x0, rux_uu = 0x107245b85, rux_su = 0x441cdf607, rux_tu = 0x548455f70}, p_profthreads = 0x0, p_exitthreads = 0x0, p_traceflag = 0x0, p_tracevp = 0x0, p_tracecred = 0x0, p_textvp = 0x0, p_lock = 0x0, p_sigiolst = {slh_first = 0x0}, p_sigparent = 0x14, p_sig = 0x0, p_stops = 0x0, p_stype = 0x0, p_step = 0x0, p_pfsflags = 0x0, p_ptevents = 0x0, p_nlminfo = 0x0, p_aioinfo = 0x0, p_singlethread = 0x0, p_suspcount = 0x0, p_xthread = 0x2b2bd000, p_boundary_count = 0x0, p_pendingcnt = 0x0, p_itimers = 0x0, p_procdesc = 0x0, p_treeflag = 0x0, p_pendingexits = 0x0, p_filemon = 0x0, p_pdeathsig = 0x0, p_magic = 0xbeefface, p_osrel = 0x13d642, p_fctl0 = 0x0, p_comm = "sh", '\000' , p_sysent = 0x1c38980 , p_args = 0x0, p_cpulimit = 0x7fffffffffffffff, p_nice = 0x0, p_fibnum = 0x0, p_reapsubtree = 0x1, p_elf_machine = 0x3, p_elf_flags = 0x0, p_xexit = 0x0, p_xsig = 0xf, p_pgrp = 0x0, p_klist = 0x295c5120, p_numthreads = 0x1, p_md = {md_ldt = 0x0}, p_itcallout = {c_links = {le = {le_next = 0x0, le_prev = 0x0}, sle = { sle_next = 0x0}, tqe = {tqe_next = 0x0, tqe_prev = 0x0}}, c_time = 0x0, c_precision = 0x0, c_arg = 0x0, c_func = 0x0, c_lock = 0x298d4750, c_flags = 0x0, c_iflags = 0x0, c_cpu = 0x0}, p_acflag = 0x10, p_peers = 0x0, p_leader = 0x298d46a8, p_emuldata = 0x0, p_label = 0x0, p_ktr = { stqh_first = 0x0, stqh_last = 0x298d49c8}, p_mqnotifier = {lh_first = 0x0}, p_dtrace = 0x2465d000, p_pwait = { cv_description = 0x15ba50e "ppwait", cv_waiters = 0x0}, p_prev_runtime = 0x0, p_racct = 0x0, p_throttled = 0x0, p_orphan = {le_next = 0x0, le_prev = 0x0}, p_orphans = {lh_first = 0x0}} (kgdb) f 21 #21 0x00f927e4 in proc_reap (td=0x23c00a80, p=0x298d46a8, status=0x23a17ba4, options=0x36) at ../../../kern/kern_exit.c:919 919 leavepgrp(p); (kgdb) l 914 reaper_clear(p); 915 proc_id_clear(PROC_ID_PID, p->p_pid); 916 PROC_LOCK(p); 917 proc_clear_orphan(p); 918 PROC_UNLOCK(p); 919 leavepgrp(p); 920 if (p->p_procdesc != NULL) 921 procdesc_reap(p); 922 sx_xunlock(&proctree_lock); (kgdb) info loc q = 0x2242a000 t = 0x17ace900 (kgdb) p *td $3 = {td_lock = 0x1edeb40 , td_proc = 0x2242a000, td_plist = {tqe_next = 0x0, tqe_prev = 0x2242a008}, td_runq = {tqe_next = 0x0, tqe_prev = 0x1edec94 }, td_slpq = {tqe_next = 0x0, tqe_prev = 0x94e5c80}, td_lockq = {tqe_next = 0x0, tqe_prev = 0x0}, td_hash = { le_next = 0x0, le_prev = 0x9998db0}, td_cpuset = 0x99a00c0, td_domain = {dr_policy = 0x1ecc660 , dr_iter = 0x0}, td_sel = 0x95ba3c0, td_sleepqueue = 0x94e5c80, td_turnstile = 0x94ec580, td_rlqe = 0x210f7380, td_umtxq = 0x94f0000, td_tid = 0x1876c, td_sigqueue = {sq_signals = {__bits = {0x0, 0x0, 0x0, 0x0}}, sq_kill = {__bits = {0x0, 0x0, 0x0, 0x0}}, sq_ptrace = {__bits = {0x0, 0x0, 0x0, 0x0}}, sq_list = {tqh_first = 0x0, tqh_last = 0x23c00b04}, sq_proc = 0x2242a000, sq_flags = 0x1}, td_lend_user_pri = 0xff, td_epochnest = 0x0, td_flags = 0x4, td_inhibitors = 0x0, td_pflags = 0x0, td_dupfd = 0xffffffff, td_sqqueue = 0x0, td_wchan = 0x0, td_wmesg = 0x0, td_owepreempt = 0x0, td_tsqueue = 0x0, td_locks = 0x1, td_rw_rlocks = 0x0, td_sx_slocks = 0x0, td_lk_slocks = 0x0, td_stopsched = 0x1, td_blocked = 0x0, td_lockname = 0x0, td_contested = {lh_first = 0x0}, td_sleeplocks = 0x1f1b6b0 , td_intr_nesting_level = 0x0, td_pinned = 0x1, td_ucred = 0x17ace900, td_limit = 0x1892e700, td_slptick = 0x0, td_blktick = 0x0, td_swvoltick = 0x811cdcbc, td_swinvoltick = 0x0, td_cow = 0x83, td_ru = {ru_utime = {tv_sec = 0x0, tv_usec = 0x0}, ru_stime = {tv_sec = 0x0, tv_usec = 0x0}, ru_maxrss = 0xdf8, ru_ixrss = 0xa30, ru_idrss = 0xd0, ru_isrss = 0x200, ru_minflt = 0x243, ru_majflt = 0x2b, ru_nswap = 0x8, ru_inblock = 0x17, ru_oublock = 0x0, ru_msgsnd = 0x0, ru_msgrcv = 0x0, ru_nsignals = 0x2, ru_nvcsw = 0x8c, ru_nivcsw = 0x0}, td_rux = { rux_runtime = 0x4875a0a, rux_uticks = 0x1, rux_sticks = 0x3, rux_iticks = 0x0, rux_uu = 0x2938, rux_su = 0x7ba9, rux_tu = 0xa4e2}, td_incruntime = 0x6bfa5, td_runtime = 0x48e19af, td_pticks = 0x0, td_sticks = 0x0, td_iticks = 0x0, td_uticks = 0x0, td_intrval = 0xffffffff, td_oldsigmask = {__bits = {0x0, 0x0, 0x0, 0x0}}, td_generation = 0x8c, td_sigstk = {ss_sp = 0x0, ss_size = 0x0, ss_flags = 0x4}, td_xsig = 0x0, td_profil_addr = 0x0, td_profil_ticks = 0x0, td_name = "bash", '\000' , td_fpop = 0x0, td_dbgflags = 0x0, td_si = { si_signo = 0x0, si_errno = 0x0, si_code = 0x0, si_pid = 0x0, si_uid = 0x0, si_status = 0x0, si_addr = 0x0, si_value = {sival_int = 0x0, sival_ptr = 0x0, sigval_int = 0x0, sigval_ptr = 0x0}, _reason = {_fault = {_trapno = 0x0}, _timer = {_timerid = 0x0, _overrun = 0x0}, _mesgq = {_mqd = 0x0}, _poll = {_band = 0x0}, __spare__ = {__spare1__ = 0x0, __spare2__ = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}}, td_ng_outbound = 0x0, td_osd = {osd_nslots = 0x0, osd_slots = 0x0, osd_next = {le_next = 0x0, le_prev = 0x0}}, td_map_def_user = 0x0, td_dbg_forked = 0x0, td_vp_reserv = 0x0, td_no_sleeping = 0x0, td_su = 0x0, td_sleeptimo = 0x0, td_rtcgen = 0x0, td_errno = 0xfffffffe, td_vslock_sz = 0x0, td_kcov_info = 0x0, td_sigmask = {__bits = {0x80000, 0x0, 0x0, 0x0}}, td_rqindex = 0x1e, td_base_pri = 0x78, td_priority = 0x78, td_pri_class = 0x3, td_user_pri = 0x78, td_base_user_pri = 0x78, td_pre_epoch_prio = 0x7e, td_rb_list = 0x0, td_rbp_list = 0x0, td_rb_inact = 0x0, td_sa = {code = 0x7, callp = 0x1be7db0 , args = {0xffffffff, 0xffbfe7d4, 0x6, 0x0, 0xffffffff, 0x0, 0x0, 0x0}, narg = 0x4}, td_pcb = 0x23a17d40, td_state = TDS_RUNNING, td_uretoff = {tdu_retval = {0x0, 0x6}, tdu_off = 0x600000000}, td_cowgen = 0x0, td_slpcallout = {c_links = {le = {le_next = 0x0, le_prev = 0x95726ec}, sle = {sle_next = 0x0}, tqe = {tqe_next = 0x0, tqe_prev = 0x95726ec}}, c_time = 0x4b59bb476dae, c_precision = 0x13ffffe8e, c_arg = 0x23c00a80, c_func = 0x1021950 , c_lock = 0x0, c_flags = 0x0, c_iflags = 0x110, c_cpu = 0x3}, td_frame = 0x23a17ce8, td_kstack_obj = 0x24b54750, td_kstack = 0x23a14000, td_kstack_pages = 0x4, td_critnest = 0x1, td_md = {md_spinlock_count = 0x1, md_saved_flags = 0x200246, md_spurflt_addr = 0x0}, td_ar = 0x0, td_lprof = {{lh_first = 0x0}, {lh_first = 0x0}}, td_dtrace = 0x21eb1d00, td_vnet = 0x0, td_vnet_lpush = 0x0, td_intr_frame = 0x0, td_rfppwait_p = 0x0, td_ma = 0x0, td_ma_cnt = 0x0, td_emuldata = 0x0, td_lastcpu = 0x3, td_oncpu = 0x0, td_lkpi_task = 0x0, td_et = 0x94d9a10, td_pmcpend = 0x0} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/kern/kern_exit.c =================================================================== --- /usr/src/sys/kern/kern_exit.c (revision 350437) +++ /usr/src/sys/kern/kern_exit.c (working copy) @@ -355,7 +355,6 @@ exit1(struct thread *td, int rval, int signo) */ PROC_LOCK(p); stopprofclock(p); - p->p_flag &= ~(P_TRACED | P_PPWAIT | P_PPTRACE); p->p_ptevents = 0; /* @@ -458,6 +457,9 @@ exit1(struct thread *td, int rval, int signo) sx_xunlock(&allproc_lock); sx_xlock(&proctree_lock); + PROC_LOCK(p); + p->p_flag &= ~(P_TRACED | P_PPWAIT | P_PPTRACE); + PROC_UNLOCK(p); /* * Reparent all children processes: