obiwan.piupiu.local dumped core - see /var/crash/vmcore.9

Tue Jun 18 19:57:38 CEST 2013

FreeBSD obiwan.piupiu.local 10.0-CURRENT FreeBSD 10.0-CURRENT #7 r251519: Sun Jun  9 22:37:09 CEST 2013     root@obiwan.piupiu.local:/usr/obj/usr/src/sys/OBIWAN  amd64

panic: destroying non-empty racct: 1007616 allocated for resource 4

GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "amd64-marcel-freebsd"...

Unread portion of the kernel message buffer:
panic: destroying non-empty racct: 1007616 allocated for resource 4

cpuid = 1
KDB: enter: panic

Reading symbols from /boot/kernel/zfs.ko.symbols...done.
Loaded symbols for /boot/kernel/zfs.ko.symbols
Reading symbols from /boot/kernel/opensolaris.ko.symbols...done.
Loaded symbols for /boot/kernel/opensolaris.ko.symbols
#0  doadump (textdump=0) at pcpu.h:236
236	pcpu.h: No such file or directory.
	in pcpu.h
(kgdb) #0  doadump (textdump=0) at pcpu.h:236
#1  0xffffffff802f7352 in db_fncall (dummy1=<value optimized out>, 
    dummy2=<value optimized out>, dummy3=<value optimized out>, 
    dummy4=<value optimized out>) at /usr/src/sys/ddb/db_command.c:578
#2  0xffffffff802f704d in db_command (cmd_table=<value optimized out>)
    at /usr/src/sys/ddb/db_command.c:449
#3  0xffffffff802fb2af in db_script_exec (
    scriptname=0xffffff80e63b31f0 "kdb.enter.panic", 
    warnifnotfound=<value optimized out>) at /usr/src/sys/ddb/db_script.c:302
#4  0xffffffff802fb0d6 in db_script_kdbenter (eventname=0x0)
    at /usr/src/sys/ddb/db_script.c:324
#5  0xffffffff802f975b in db_trap (type=<value optimized out>, code=0)
    at /usr/src/sys/ddb/db_main.c:230
#6  0xffffffff80666393 in kdb_trap (type=3, code=0, tf=<value optimized out>)
    at /usr/src/sys/kern/subr_kdb.c:654
#7  0xffffffff8090c7d9 in trap (frame=0xffffff80e63b3540)
    at /usr/src/sys/amd64/amd64/trap.c:579
#8  0xffffffff808f5532 in calltrap ()
    at /usr/src/sys/amd64/amd64/exception.S:228
#9  0xffffffff80665b6e in kdb_enter (why=0xffffffff80a6b4e8 "panic", 
    msg=<value optimized out>) at cpufunc.h:63
#10 0xffffffff80630956 in vpanic (fmt=<value optimized out>, 
    ap=<value optimized out>) at /usr/src/sys/kern/kern_shutdown.c:747
#11 0xffffffff80630806 in kassert_panic (fmt=<value optimized out>)
    at /usr/src/sys/kern/kern_shutdown.c:642
#12 0xffffffff8062470e in racct_destroy (racct=0xfffffe0019e3d8d8)
    at /usr/src/sys/kern/kern_racct.c:461
#13 0xffffffff8062c11e in uifree (uip=0xfffffe0019e3d880)
    at /usr/src/sys/kern/kern_resource.c:1320
#14 0xffffffff80621e68 in crfree (cr=0xfffffe00b2b99a00)
    at /usr/src/sys/kern/kern_prot.c:1850
#15 0xffffffff8064048c in thread_wait (p=<value optimized out>)
    at /usr/src/sys/kern/kern_thread.c:523
#16 0xffffffff805f871f in proc_reap (td=<value optimized out>, 
    p=0xfffffe006dd42000, status=<value optimized out>, options=48)
    at /usr/src/sys/kern/kern_exit.c:857
#17 0xffffffff805f8b10 in proc_to_reap (td=0xfffffe0036675920, 
    p=0xfffffe006dd42000, idtype=<value optimized out>, 
    id=<value optimized out>, status=0xffffff80e63b3ad4, options=48, 
    wrusage=<value optimized out>, siginfo=<value optimized out>)
    at /usr/src/sys/kern/kern_exit.c:1014
#18 0xffffffff805f7dea in kern_wait6 (td=0xfffffe0036675920, idtype=Cannot access memory at address 0x2
)
    at /usr/src/sys/kern/kern_exit.c:1106
#19 0xffffffff805f7aca in kern_wait (td=0xffffff80e63b3500, 
    pid=<value optimized out>, status=0x80, options=<value optimized out>, 
    rusage=0x0) at /usr/src/sys/kern/kern_exit.c:1057
#20 0xffffffff802c709e in freebsd32_wait4 (td=0xffffff80e63b3500, 
    uap=0xffffff80e63b3b80)
    at /usr/src/sys/compat/freebsd32/freebsd32_misc.c:173
#21 0xffffffff80979aac in ia32_syscall (frame=0xffffff80e63b3c00)
    at subr_syscall.c:134
#22 0xffffffff808f5b15 in Xint0x80_syscall () at ia32_exception.S:73
#23 0x000000002810a7bb in ?? ()
Previous frame inner to this frame (corrupt stack?)
Current language:  auto; currently minimal
(kgdb) 

------------------------------------------------------------------------
ps -axl

UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT  TIME COMMAND

------------------------------------------------------------------------
vmstat -s

223660775 cpu context switches
 45919520 device interrupts
  7587755 software interrupts
 32822454 traps
174325463 system calls
       23 kernel threads created
   102119  fork() calls
    64277 vfork() calls
        0 rfork() calls
        5 swap pager pageins
       35 swap pager pages paged in
      384 swap pager pageouts
     2372 swap pager pages paged out
    34136 vnode pager pageins
   259164 vnode pager pages paged in
      266 vnode pager pageouts
      267 vnode pager pages paged out
       25 page daemon wakeups
        0 pages examined by the page daemon
     9478 pages reactivated
  4387865 copy-on-write faults
    12652 copy-on-write optimized faults
 14293318 zero fill pages zeroed
    17589 zero fill pages prezeroed
      746 intransit blocking page faults
 21757554 total VM faults taken
    32706 page faults requiring I/O
        0 pages affected by kernel thread creation
 25912163 pages affected by  fork()
 13394300 pages affected by vfork()
        0 pages affected by rfork()
        0 pages cached
 60438840 pages freed
        0 pages freed by daemon
        0 pages freed by exiting processes
     8158 pages active
    39573 pages inactive
     5358 pages in VM cache
   590299 pages wired down
   148592 pages free
     4096 bytes per page
129355850 total name lookups
          cache hits (62% pos + 0% neg) system 0% per-directory
          deletions 0%, falsehits 0%, toolong 0%

------------------------------------------------------------------------
vmstat -m

         Type InUse MemUse HighUse Requests  Size(s)
     filedesc   145   441K       -   166878  16,32,128,2048,4096
        sigio     1     1K       -        1  64
     filecaps     0     0K       -        5  64
      kdtrace   963   220K       -   167756  64,256
         kenv    86    12K       -      105  16,32,64,128
       kqueue     4    11K       -     1487  256,512,2048
    proc-args    90     6K       -   489800  16,32,64,128,256
        hhook     2     1K       -        2  128
      ithread    90    15K       -       91  32,128,256
       prison    16    33K       -       55  16,4096
 prison_racct     9     5K       -       24  512
       KTRACE   100    13K       -      100  128
       linker   118    10K       -      132  16,32,64,128,512
        lockf   153    17K       -  1071281  64,128
   loginclass     3     1K       -    11103  64
        cache     1     1K       -        1  32
       devbuf 10897 15891K       -    11164  16,32,64,128,256,512,1024,2048,4096
         temp    48    32K       - 17216675  16,32,64,128,256,512,1024,2048,4096
       ip6ndp    10     1K       -       11  64,128
       module   336    42K       -      336  128
     mtx_pool     3    18K       -        3  2048
          osd     8     1K       -     4445  16,32,64
     pmchooks     1     1K       -        1  128
  nullfs_hash     1  1024K       -        1  
         pgrp    81    11K       -    10428  128
      session    78    10K       -    10164  128
         proc     2    32K       -        2  
      subproc   344   571K       -   166650  512,4096
         cred   500    79K       -  2524566  64,256
       plimit    45    12K       -   176656  256
      uidinfo     9     5K       -     6068  128,4096
  nullfs_node   137     9K       -   169210  64
 nullfs_mount    26     1K       -       47  32
    pfs_nodes    21     6K       -       21  256
  pfs_vncache     0     0K       -        3  64
  tmpfs mount     0     0K       -        6  128
   tmpfs name     0     0K       -     2987  16,32,64
       sysctl     0     0K       -    79325  16,32,64
    sysctloid  4950   245K       -     5095  16,32,64,128
    sysctltmp     0     0K       -    29098  16,32,64,128,4096
       kbdmux     6    18K       -        6  16,512,1024,2048
      tidhash     1    32K       -        1  
      callout     3  1672K       -        3  
         umtx  1764   221K       -     1764  128
     p1003.1b     1     1K       -        1  16
         SWAP     2   549K       -        2  64
          bus   895    78K       -     4268  16,32,64,128,256,1024
       bus-sc    78   340K       -     1911  16,32,64,128,256,512,1024,2048,4096
          LED     4     1K       -        4  16,128
      devstat    16    33K       -       16  32,4096
 eventhandler   102     9K       -      102  64,128
         UART     3     3K       -        3  16,1024
         kobj   200   800K       -      536  4096
      Per-cpu     1     1K       -        1  32
      gg_data     1     2K       -        1  2048
         rman   239    28K       -      629  16,32,128
         sbuf     0     0K       -    24572  16,32,64,128,256,512,1024,2048,4096
         GEOM   192    34K       -     2226  16,32,64,128,256,512,1024,2048
    taskqueue   315    46K       -      479  16,32,64,256,1024
       Unitno    21     2K       -   135301  32,64
      Witness     1   128K       -        1  
       acpica  6031   631K       -    62457  16,32,64,128,256,512,1024,2048
     ioctlops     0     0K       -   956830  16,32,64,128,256,512,1024,2048,4096
       select   159    20K       -      159  128
          iov     0     0K       -    24065  16,32,64,128,256,512
          msg     4    30K       -        4  2048,4096
          sem     4   106K       -        4  2048,4096
          shm     1    20K       -        1  
          tty    25    25K       -       36  1024,2048
          pts     7     2K       -       16  256
     mbuf_tag     0     0K       -       35  32,128
        shmfd     1     8K       -        1  
       soname    24     1K       -    25974  16,32,64,128
          pcb    42   662K       -     3160  16,32,128,1024,2048
          acl     0     0K       -     4395  4096
     vfscache     1  2048K       -        1  
  export_host    16     4K       -      288  256
     vfs_hash     1  1024K       -        1  
       vnodes     3     1K       -       71  32,256
      CAM SIM     8     2K       -        8  256
        mount  2021   106K       -   138370  16,32,64,128,256,512,1024
  vnodemarker     0     0K       -  1499741  512
          BPF     7     1K       -        7  128
        ifnet     9    17K       -        9  128,2048
       ifaddr   329    33K       -      329  32,64,128,256,512,2048,4096
  ether_multi    47     3K       -       54  16,32,64
        clone     9     2K       -        9  128
       arpcom     4     1K       -        4  16
      lltable    30    12K       -       77  256,512
      ata_pci     2     1K       -        2  64
     acpitask     1     8K       -        1  
      acpisem    20     3K       -       20  128
          USB    45    45K       -       49  16,128,512,2048,4096
       USBdev    36     3K       -       36  32,64,128
     routetbl    68    15K       -     8783  32,64,128,256,512
     80211com     1     8K       -        1  
    80211scan     1     4K       -        1  4096
         igmp     8     2K       -        8  256
         ipid     2    24K       -        2  
     in_multi     2     1K       -        2  256
      CAM XPT    40     4K       -      162  16,32,64,128,1024
      acpidev    35     3K       -       35  64
      CAM DEV    12    24K       -       25  2048
    sctp_a_it     0     0K       -       11  16
     sctp_vrf     1     1K       -        1  64
     sctp_ifa    13     2K       -       13  128
     sctp_ifn     2     1K       -        2  128
    sctp_iter     0     0K       -       11  256
    hostcache     1    28K       -        1  
     syncache     1   100K       -        1  
  in6_mfilter     1     1K       -        1  1024
    in6_multi    27     4K       -       27  32,256
 ip6_moptions     2     1K       -        2  32,256
          pmc    90   468K       -       90  16,64,128,256,512,1024,4096
      CAM CCB     8    16K       -      124  2048
          mld     8     1K       -        8  128
    raid_data     0     0K       -      222  32,128,256
       pfsync     1     1K       -        1  1024
      pf_hash     3  2880K       -        3  
     pf_ifnet    13     5K       -       20  256,2048
      pf_rule     1     1K       -        1  1024
      pf_osfp  1130   115K       -     1130  64,128
      NFS FHA     1     2K       -    17917  64,2048
          NLM     0     0K       -        1  32
       crypto     1     1K       -        1  512
        xform     0     0K       -     3787  16,32
          rpc    64     8K       -   210523  16,32,64,128,256,512,1024,2048
audit_evclass   188     6K       -      229  32
      pagedep     1   128K       -        1  
     inodedep     1  1024K       -        1  
    bmsafemap     1     8K       -        1  
       newblk     1   128K       -        1  
     freework     1     1K       -        1  32
    ufs_quota     1  1024K       -        1  
    vm_pgdata     2   513K       -        2  128
      UMAHash     1     1K       -        1  512
     CAM path    16     1K       -       55  32
      entropy  1024    64K       -     1024  64
   CAM periph    10     3K       -       26  16,32,64,256
    CAM queue    25     1K       -       92  16,32,64
CAM dev queue     8     1K       -        8  32
  ddb_capture     1    48K       -        1  
      memdesc     1     4K       -        1  4096
     acpiintr     1     1K       -        1  64
     atkbddev     2     1K       -        2  64
md_nvidia_data     0     0K       -       37  512
     pci_link    16     2K       -       16  64,128
  md_sii_data     0     0K       -       37  512
       DEVFS2   134    17K       -     1440  16,32,64,128
       DEVFS3  1620   405K       -     2645  256
       DEVFS1   134    67K       -      159  512
   DEVFS_RULE    55    26K       -      107  64,512
        DEVFS   290     6K       -      459  16,128
  fdesc_mount     8     1K       -       11  16
NFSD srvcache     0     0K       -   179275  128
       apmdev     1     1K       -        1  128
   madt_table     0     0K       -        1  4096
       isadev     6     1K       -        6  128
      io_apic     1     2K       -        1  2048
          MCA     6     1K       -        6  128
          msi     4     1K       -        4  128
     nexusdev     4     1K       -        4  16
         cdev     8     2K       -        8  256
   kstat_data     5     1K       -        5  64
      solaris 381866 1397486K       - 1217444159  16,32,64,128,256,512,1024,2048,4096

------------------------------------------------------------------------
vmstat -z

ITEM                   SIZE  LIMIT     USED     FREE      REQ FAIL SLEEP

UMA Kegs:               208,      0,     177,      10,     189,   0,   0
UMA Zones:              640,      0,     177,       3,     189,   0,   0
UMA Slabs:              568,      0,   58327,    5450, 6580904,   0,   0
UMA RCntSlabs:          568,      0,    1034,     268,    1629,   0,   0
UMA Hash:               256,      0,       6,       9,       7,   0,   0
16 Bucket:              152,      0,     128,      72,     240,   0,   0
32 Bucket:              280,      0,     119,      35,     243,   5,   0
64 Bucket:              536,      0,      65,      12,     240,  91,   0
128 Bucket:            1048,      0,    9411,       0,   47650,93292,   0
VM OBJECT:              240,      0,   21892,   26476, 7842192,   0,   0
RADIX NODE:             144, 766194,   34319,  731927, 4869584,   0,   0
MAP:                    232,      0,       8,      24,       8,   0,   0
KMAP ENTRY:             120, 218023,    5557,    4797,16934627,   0,   0
MAP ENTRY:              120,      0,    2745,    1316, 7791476,   0,   0
fakepg:                 104,      0,       0,       0,       0,   0,   0
mt_zone:               4112,      0,     341,       2,     341,   0,   0
16:                      16,      0,      45,     291,   34957,   0,   0
16:                      16,      0,      10,     326,      34,   0,   0
16:                      16,      0,      25,     143,      25,   0,   0
16:                      16,      0,   43629,   24915,10241206,   0,   0
16:                      16,      0,    2851,     509,   74398,   0,   0
16:                      16,      0,     171,     501,   62659,   0,   0
16:                      16,      0,     107,     229,   22158,   0,   0
16:                      16,      0,      32,     304,     259,   0,   0
32:                      32,      0,     516,     191,   22590,   0,   0
32:                      32,      0,     327,     380,  135638,   0,   0
32:                      32,      0,      36,     267,    3154,   0,   0
32:                      32,      0,   19834,   13092,14559178,   0,   0
32:                      32,      0,    2194,     331,   10126,   0,   0
32:                      32,      0,      60,     344,  108424,   0,   0
32:                      32,      0,     141,     364,     584,   0,   0
32:                      32,      0,      11,     292,     138,   0,   0
64:                      64,      0,    1712,     528,    4134,   0,   0
64:                      64,      0,      81,     143,      87,   0,   0
64:                      64,      0,      17,      95,      17,   0,   0
64:                      64,      0,   57218,  123998,547106460,   0,   0
64:                      64,      0,     954,    9182,  219951,   0,   0
64:                      64,      0,    1390,     346, 1399076,   0,   0
64:                      64,      0,    3428,     324,  192306,   0,   0
64:                      64,      0,      32,     136,      65,   0,   0
128:                    128,      0,    4933,      84,   28498,   0,   0
128:                    128,      0,     298,     166,  180001,   0,   0
128:                    128,      0,     202,     146,   10549,   0,   0
128:                    128,      0,   31048,   21065,34468453,   0,   0
128:                    128,      0,    3492,     133,    3556,   0,   0
128:                    128,      0,      79,     153,    6878,   0,   0
128:                    128,      0,    3963,     300,  927810,   0,   0
128:                    128,      0,      41,      75,     394,   0,   0
256:                    256,      0,      32,      43,    1055,   0,   0
256:                    256,      0,     103,      92,  176862,   0,   0
256:                    256,      0,       0,      45,      11,   0,   0
256:                    256,      0,   23146,   24194,23323496,   0,   0
256:                    256,      0,     156,      54,    8392,   0,   0
256:                    256,      0,     427,      98, 1301253,   0,   0
256:                    256,      0,    2035,     365,   19459,   0,   0
256:                    256,      0,      86,      49,     490,   0,   0
512:                    512,      0,       3,      11,       4,   0,   0
512:                    512,      0,      39,      24,      54,   0,   0
512:                    512,      0,       6,       8,       6,   0,   0
512:                    512,      0,  159243,  129388,563017600,   0,   0
512:                    512,      0,      33,      30,     305,   0,   0
512:                    512,      0,      21,      42,  208164,   0,   0
512:                    512,      0,     193,      45,     240,   0,   0
512:                    512,      0,       0,      42, 1500383,   0,   0
1024:                  1024,      0,       4,      16,    1830,   0,   0
1024:                  1024,      0,      25,      11,      34,   0,   0
1024:                  1024,      0,       4,       4,       4,   0,   0
1024:                  1024,      0,     648,    2076,  646588,   0,   0
1024:                  1024,      0,       1,      11,    3294,   0,   0
1024:                  1024,      0,       3,      45,15790680,   0,   0
1024:                  1024,      0,      15,       5,      27,   0,   0
1024:                  1024,      0,       8,      36,     115,   0,   0
2048:                  2048,      0,       2,       6,       2,   0,   0
2048:                  2048,      0,       2,       6,       4,   0,   0
2048:                  2048,      0,       3,       1,       3,   0,   0
2048:                  2048,      0,     531,     959, 1118386,   0,   0
2048:                  2048,      0,     124,     116,  166430,   0,   0
2048:                  2048,      0,       3,      41,  743540,   0,   0
2048:                  2048,      0,      13,       5,      27,   0,   0
2048:                  2048,      0,       3,      31,      40,   0,   0
4096:                  4096,      0,       0,       2,       2,   0,   0
4096:                  4096,      0,       9,      11,      24,   0,   0
4096:                  4096,      0,     209,      60,     549,   0,   0
4096:                  4096,      0,   20091,    6131,18687882,   0,   0
4096:                  4096,      0,      12,       8,    4410,   0,   0
4096:                  4096,      0,       4,      40,   33900,   0,   0
4096:                  4096,      0,       9,      11,      26,   0,   0
4096:                  4096,      0,       1,       1,       2,   0,   0
Files:                   80,      0,     447,     273,11614849,   0,   0
TURNSTILE:              136,      0,     883,      57,     883,   0,   0
rl_entry:                40,      0,     190,     230,     190,   0,   0
umtx pi:                 96,      0,       0,       0,       0,   0,   0
uint64 pcpu:              8,      0,     127,       1,     127,   0,   0
rctl_rule_link:          32,      0,       0,       0,       0,   0,   0
rctl_rule:               80,      0,       0,       0,       0,   0,   0
racct:                  176,      0,     134,     181,  183614,   0,   0
MAC labels:              40,      0,       0,       0,       0,   0,   0
PROC:                  1208,      0,     114,     114,  166419,   0,   0
THREAD:                1168,      0,     847,      35,    1335,   0,   0
SLEEPQUEUE:              88,      0,     883,      45,     883,   0,   0
VMSPACE:                392,      0,      91,     139,  166401,   0,   0
cpuset:                  72,      0,     618,      82,    4351,   0,   0
audit_record:          1240,      0,       0,       0,       0,   0,   0
mbuf_packet:            256, 1268970,    1151,    1405, 4722139,   0,   0
mbuf:                   256, 1268970,       1,    1531,20772378,   0,   0
mbuf_cluster:          2048, 198276,    1408,     454, 5912641,   0,   0
mbuf_jumbo_page:       4096,  99138,       0,     103,   83887,   0,   0
mbuf_jumbo_9k:         9216,  88122,       0,       0,       0,   0,   0
mbuf_jumbo_16k:       16384,  66092,       0,       0,       0,   0,   0
mbuf_ext_refcnt:          4,      0,       0,       0,       0,   0,   0
g_bio:                  248,      0,       0,     270,39619618,   0,   0
ttyinq:                 160,      0,     420,     108,    1140,   0,   0
ttyoutq:                256,      0,     220,      50,     600,   0,   0
ata_request:            336,      0,       1,      67,12279870,   0,   0
cryptop:                 88,      0,       0,       0,       0,   0,   0
cryptodesc:              72,      0,       0,       0,       0,   0,   0
vtnet_tx_hdr:            24,      0,       0,       0,       0,   0,   0
FPU_save_area:          512,      0,       0,       0,       0,   0,   0
taskq_zone:              48,      0,       0,     360,   28667,   0,   0
VNODE:                  472,      0,   45984,   20216,46008995,   0,   0
VNODEPOLL:              112,      0,       0,       0,       0,   0,   0
BUF TRIE:               144,      0,       0,   21034,       0,   0,   0
S VFS Cache:            108,      0,   47727,   18471,37550109,   0,   0
STS VFS Cache:          148,      0,       0,       0,       0,   0,   0
L VFS Cache:            328,      0,    1054,   46394, 9161808,   0,   0
LTS VFS Cache:          368,      0,       0,       0,       0,   0,   0
NAMEI:                 1024,      0,       0,      80,70615242,   0,   0
DIRHASH:               1024,      0,       0,       0,       0,   0,   0
NCLNODE:                528,      0,       0,       0,       0,   0,   0
Mountpoints:            816,      0,     143,      47,     188,   0,   0
space_seg_cache:         64,      0,  112298,   15270, 2245887,   0,   0
zio_cache:              944,      0,       3,   31713,118530126,   0,   0
zio_link_cache:          48,      0,       0,   32544,63629031,   0,   0
sa_cache:                80,      0,   45530,   22420,45833645,   0,   0
dnode_t:                856,      0,  158608,  102104,45502649,   0,   0
dmu_buf_impl_t:         224,      0,  189015,  153824,56190627,   0,   0
arc_buf_hdr_t:          216,      0,  310651,   31925, 8252467,   0,   0
arc_buf_t:               72,      0,   34788,   14912,10849539,   0,   0
zil_lwb_cache:          192,      0,      34,     146,    4371,   0,   0
zfs_znode_cache:        368,      0,   45530,   21310,45833549,   0,   0
pipe:                   744,      0,      20,     105,   92182,   0,   0
ksiginfo:               112,      0,     217,     179,   77020,   0,   0
itimer:                 352,      0,       1,      21,       1,   0,   0
pf states:              296,  10010,       3,     153,    3777,   0,   0
pf state keys:           88,      0,       3,     207,    3777,   0,   0
pf source nodes:        136,  10024,       0,       0,       0,   0,   0
pf mtags:                40,      0,       0,       0,       0,   0,   0
pf table entries:       160, 200016,       0,       0,       0,   0,   0
pf table counters:       64,      0,       0,       0,       0,   0,   0
pf frags:                80,      0,       0,       0,       0,   0,   0
pf frag entries:         32,   5050,       0,       0,       0,   0,   0
pf state scrubs:         40,      0,       0,       0,       0,   0,   0
KNOTE:                  128,      0,       8,     166,    1542,   0,   0
socket:                 680, 101754,     141,      39,    8676,   0,   0
unpcb:                  240, 101760,      58,      70,    2878,   0,   0
ipq:                     56,   6237,       0,       0,       0,   0,   0
udp_inpcb:              392, 101760,      47,      73,    5453,   0,   0
udpcb:                   16, 101808,      47,     457,    5453,   0,   0
tcp_inpcb:              392, 101760,      35,      65,     331,   0,   0
tcpcb:                 1024, 101756,      35,      49,     331,   0,   0
tcptw:                   72,  20350,       0,     200,     131,   0,   0
syncache:               152,  15375,       0,      75,      50,   0,   0
hostcache:              136,  15372,       0,     112,      52,   0,   0
tcpreass:                40,  12432,       0,     252,      62,   0,   0
sackhole:                32,      0,       0,     303,     410,   0,   0
sctp_ep:               1408, 101754,       0,       0,       0,   0,   0
sctp_asoc:             2344,  40000,       0,       0,       0,   0,   0
sctp_laddr:              48,  80064,       0,     216,      12,   0,   0
sctp_raddr:             728,  80000,       0,       0,       0,   0,   0
sctp_chunk:             136, 400008,       0,       0,       0,   0,   0
sctp_readq:             104, 400032,       0,       0,       0,   0,   0
sctp_stream_msg_out:    104, 400032,       0,       0,       0,   0,   0
sctp_asconf:             40, 400008,       0,       0,       0,   0,   0
sctp_asconf_ack:         48, 400032,       0,       0,       0,   0,   0
ripcb:                  392, 101760,       0,      30,       2,   0,   0
rtentry:                200,      0,      33,      43,      33,   0,   0
g_stripe_zone:       131072,   3200,       0,       0,       0,   0,   0
selfd:                   56,      0,     310,     320, 8581316,   0,   0
SWAPMETA:               288, 396552,     174,      34,    9263,   0,   0


------------------------------------------------------------------------
vmstat -i

interrupt                          total       rate
irq1: atkbd0                          16          0
irq4: uart0                           11          0
irq6: fdc0                             1          0
irq20: hpet0 uhci0+             30750506     287387
irq23: atapci0+                 12267669     114651
irq256: em0                      2901317      27115
Total                           45919520     429154

------------------------------------------------------------------------
pstat -T

447/101754 files
7M/4095M swap space

------------------------------------------------------------------------
pstat -s

Device          512-blocks     Used    Avail Capacity
/dev/gpt/swap0     8388352    14944  8373408     0%

------------------------------------------------------------------------
iostat

iostat: kvm_read(_tk_nin): invalid address (0x0)
iostat: disabling TTY statistics
            ada0             ada1             ada2             cpu
  KB/t tps  MB/s   KB/t tps  MB/s   KB/t tps  MB/s  us ni sy in id
  8.70 16171 137.39   8.43 16153 132.91   5.63 26167 143.81   1  0  4  0 95

------------------------------------------------------------------------
ipcs -a

Message Queues:
T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP                 CBYTES                 QNUM               QBYTES        LSPID        LRPID STIME    RTIME    CTIME   

Shared Memory:
T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP         NATTCH        SEGSZ         CPID         LPID ATIME    DTIME    CTIME   

Semaphores:
T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP          NSEMS OTIME    CTIME   


------------------------------------------------------------------------
ipcs -T

msginfo:
	msgmax:        16384	(max characters in a message)
	msgmni:           40	(# of message queues)
	msgmnb:         2048	(max characters in a message queue)
	msgtql:           40	(max # of messages in system)
	msgssz:            8	(size of a message segment)
	msgseg:         2048	(# of message segments in system)

shminfo:
	shmmax:    536870912	(max shared memory segment size)
	shmmin:            1	(min shared memory segment size)
	shmmni:          192	(max number of shared memory identifiers)
	shmseg:          128	(max shared memory segments per process)
	shmall:       131072	(max amount of shared memory in pages)

seminfo:
	semmni:           50	(# of semaphore identifiers)
	semmns:          340	(# of semaphores in system)
	semmnu:          150	(# of undo structures in system)
	semmsl:          340	(max # of semaphores per id)
	semopm:          100	(max # of operations per semop call)
	semume:           50	(max # of undo entries per process)
	semusz:          632	(size in bytes of undo structure)
	semvmx:        32767	(semaphore maximum value)
	semaem:        16384	(adjust on exit max value)


------------------------------------------------------------------------
nfsstat

Client Info:
Rpc Counts:
  Getattr   Setattr    Lookup  Readlink      Read     Write    Create    Remove
        0         0         0         0         0         0         0         0
   Rename      Link   Symlink     Mkdir     Rmdir   Readdir  RdirPlus    Access
        0         0         0         0         0         0         0         0
    Mknod    Fsstat    Fsinfo  PathConf    Commit
        0         0         0         0         0
Rpc Info:
 TimedOut   Invalid X Replies   Retries  Requests
        0         0         0         0         0
Cache Info:
Attr Hits    Misses Lkup Hits    Misses BioR Hits    Misses BioW Hits    Misses
        0         0         0         0         0         0         0         0
BioRLHits    Misses BioD Hits    Misses DirE Hits    Misses Accs Hits    Misses
        0         0         0         0         0         0         0         0

Server Info:
  Getattr   Setattr    Lookup  Readlink      Read     Write    Create    Remove
        0         0         0         0         0         0         0         0
   Rename      Link   Symlink     Mkdir     Rmdir   Readdir  RdirPlus    Access
        0         0         0         0         0         0         0         0
    Mknod    Fsstat    Fsinfo  PathConf    Commit
        0         0         0         0         0
Server Ret-Failed
                0
Server Faults
            0
Server Cache Stats:
   Inprog      Idem  Non-idem    Misses
        0         0         0         0
Server Write Gathering:
 WriteOps  WriteRPC   Opsaved
        0         0         0

------------------------------------------------------------------------
netstat -s

tcp:
	4290482 packets sent
		4111119 data packets (12106941992 bytes)
		17821 data packets (25993396 bytes) retransmitted
		3 data packets unnecessarily retransmitted
		0 resends initiated by MTU discovery
		160928 ack-only packets (1324 delayed)
		0 URG only packets
		0 window probe packets
		195 window update packets
		419 control packets
	4594337 packets received
		4226148 acks (for 12106932724 bytes)
		24232 duplicate acks
		0 acks for unsent data
		361603 packets (269231908 bytes) received in-sequence
		93 completely duplicate packets (8832 bytes)
		0 old duplicate packets
		1 packet with some dup. data (1 byte duped)
		62 out-of-order packets (32208 bytes)
		0 packets (0 bytes) of data after window
		0 window probes
		54 window update packets
		3 packets received after close
		0 discarded for bad checksums
		0 discarded for bad header offset fields
		0 discarded because packet too short
		0 discarded due to memory problems
	222 connection requests
	46 connection accepts
	0 bad connection attempts
	0 listen queue overflows
	9 ignored RSTs in the windows
	203 connections established (including accepts)
	296 connections closed (including 4 drops)
		158 connections updated cached RTT on close
		161 connections updated cached RTT variance on close
		13 connections updated cached ssthresh on close
	65 embryonic connections dropped
	4226142 segments updated rtt (of 4078969 attempts)
	78 retransmit timeouts
		0 connections dropped by rexmit timeout
	0 persist timeouts
		0 connections dropped by persist timeout
	0 Connections (fin_wait_2) dropped because of timeout
	2 keepalive timeouts
		0 keepalive probes sent
		2 connections dropped by keepalive
	4186817 correct ACK header predictions
	342808 correct data packet header predictions
	50 syncache entries added
		0 retransmitted
		0 dupsyn
		0 dropped
		46 completed
		0 bucket overflow
		0 cache overflow
		4 reset
		0 stale
		0 aborted
		0 badack
		0 unreach
		0 zone failures
	50 cookies sent
	0 cookies received
	52 hostcache entries added
		0 bucket overflow
	142 SACK recovery episodes
	17590 segment rexmits in SACK recovery episodes
	25468388 byte rexmits in SACK recovery episodes
	42200 SACK options (SACK blocks) received
	883 SACK options (SACK blocks) sent
	0 SACK scoreboard overflow
	0 packets with ECN CE bit set
	0 packets with ECN ECT(0) bit set
	0 packets with ECN ECT(1) bit set
	0 successful ECN handshakes
	0 times ECN reduced the congestion window
udp:
	1911 datagrams received
	0 with incomplete header
	0 with bad data length field
	0 with bad checksum
	0 with no checksum
	14 dropped due to no socket
	74 broadcast/multicast datagrams undelivered
	0 dropped due to full socket buffers
	0 not for hashed pcb
	1823 delivered
	1837 datagrams output
	0 times multicast source filter matched
ip:
	4597898 total packets received
	0 bad header checksums
	0 with size smaller than minimum
	0 with data size < data length
	0 with ip length > max ip packet size
	0 with header length < data size
	0 with data length < header length
	0 with bad options
	0 with incorrect version number
	0 fragments received
	0 fragments dropped (dup or out of space)
	0 fragments dropped after timeout
	0 packets reassembled ok
	4596244 packets for this host
	14 packets for unknown/unsupported protocol
	0 packets forwarded (0 packets fast forwarded)
	0 packets not forwardable
	0 packets received for unknown multicast group
	0 redirects sent
	4292411 packets sent from this host
	0 packets sent with fabricated ip header
	0 output packets dropped due to no bufs, etc.
	0 output packets discarded due to no route
	0 output datagrams fragmented
	0 fragments created
	0 datagrams that can't be fragmented
	0 tunneling packets that can't find gif
	0 datagrams with bad address in header
icmp:
	14 calls to icmp_error
	0 errors not generated in response to an icmp message
	Output histogram:
		destination unreachable: 14
	0 messages with bad code fields
	0 messages less than the minimum length
	0 messages with bad checksum
	0 messages with bad length
	0 multicast echo requests ignored
	0 multicast timestamp requests ignored
	Input histogram:
		destination unreachable: 14
	0 message responses generated
	0 invalid return addresses
	0 no return routes
igmp:
	0 messages received
	0 messages received with too few bytes
	0 messages received with wrong TTL
	0 messages received with bad checksum
	0 V1/V2 membership queries received
	0 V3 membership queries received
	0 membership queries received with invalid field(s)
	0 general queries received
	0 group queries received
	0 group-source queries received
	0 group-source queries dropped
	0 membership reports received
	0 membership reports received with invalid field(s)
	0 membership reports received for groups to which we belong
	0 V3 reports received without Router Alert
	0 membership reports sent
pfsync:
	0 packets received (IPv4)
	0 packets received (IPv6)
	    0 clear all requests received
	    0 state inserts received
	    0 state inserted acks received
	    0 state updates received
	    0 compressed state updates received
	    0 uncompressed state requests received
	    0 state deletes received
	    0 compressed state deletes received
	    0 fragment inserts received
	    0 fragment deletes received
	    0 bulk update marks received
	    0 TDB replay counter updates received
	    0 end of frame marks received
		0 packets discarded for bad interface
		0 packets discarded for bad ttl
		0 packets shorter than header
		0 packets discarded for bad version
		0 packets discarded for bad HMAC
		0 packets discarded for bad action
		0 packets discarded for short packet
		0 states discarded for bad values
		0 stale states
		0 failed state lookup/inserts
	0 packets sent (IPv4)
	0 packets sent (IPv6)
	    1 clear all request sent
	    3777 state inserts sent
	    0 state inserted acks sent
	    0 state updates sent
	    83472 compressed state updates sent
	    0 uncompressed state requests sent
	    0 state deletes sent
	    3774 compressed state deletes sent
	    0 fragment inserts sent
	    0 fragment deletes sent
	    0 bulk update marks sent
	    0 TDB replay counter updates sent
	    82338 end of frame marks sent
		0 failures due to mbuf memory error
		0 send errors
arp:
	58 ARP requests sent
	6747 ARP replies sent
	8464 ARP requests received
	49 ARP replies received
	8513 ARP packets received
	0 total packets dropped due to no ARP entry
	47 ARP entrys timed out
	0 Duplicate IPs seen
ip6:
	4 total packets received
	0 with size smaller than minimum
	0 with data size < data length
	0 with bad options
	0 with incorrect version number
	0 fragments received
	0 fragments dropped (dup or out of space)
	0 fragments dropped after timeout
	0 fragments that exceeded limit
	0 packets reassembled ok
	4 packets for this host
	0 packets forwarded
	0 packets not forwardable
	0 redirects sent
	11 packets sent from this host
	0 packets sent with fabricated ip header
	0 output packets dropped due to no bufs, etc.
	13 output packets discarded due to no route
	0 output datagrams fragmented
	0 fragments created
	0 datagrams that can't be fragmented
	0 packets that violated scope rules
	0 multicast packets which we don't join
	Input histogram:
		UDP: 4
	Mbuf statistics:
		2 one mbuf
		two or more mbuf:
			lo0= 2
		45 one ext mbuf
		0 two or more ext mbuf
	0 packets whose headers are not contiguous
	0 tunneling packets that can't find gif
	0 packets discarded because of too many headers
	10 failures of source address selection
	source addresses on a non-outgoing I/F
		10 addresses scope=f
	Source addresses selection rule applied:
		10 same address
icmp6:
	0 calls to icmp6_error
	0 errors not generated in response to an icmp6 message
	0 errors not generated because of rate limitation
	Output histogram:
		neighbor solicitation: 1
	0 messages with bad code fields
	0 messages < minimum length
	0 bad checksums
	0 messages with bad length
	Histogram of error messages to be generated:
		0 no route
		0 administratively prohibited
		0 beyond scope
		0 address unreachable
		0 port unreachable
		0 packet too big
		0 time exceed transit
		0 time exceed reassembly
		0 erroneous header field
		0 unrecognized next header
		0 unrecognized option
		0 redirect
		0 unknown
	0 message responses generated
	0 messages with too many ND options
	0 messages with bad ND options
	0 bad neighbor solicitation messages
	0 bad neighbor advertisement messages
	0 bad router solicitation messages
	0 bad router advertisement messages
	0 bad redirect messages
	0 path MTU changes
rip6:
	0 messages received
	0 checksum calculations on inbound
	0 messages with bad checksum
	0 messages dropped due to no socket
	0 multicast messages dropped due to no socket
	0 messages dropped due to full socket buffers
	0 delivered
	0 datagrams output

------------------------------------------------------------------------
netstat -m

1152/2936/4088 mbufs in use (current/cache/total)
3/1859/1862/198276 mbuf clusters in use (current/cache/total/max)
1151/1405 mbuf+clusters out of packet secondary zone in use (current/cache)
0/103/103/99138 4k (page size) jumbo clusters in use (current/cache/total/max)
0/0/0/88122 9k jumbo clusters in use (current/cache/total/max)
0/0/0/66092 16k jumbo clusters in use (current/cache/total/max)
294K/4864K/5158K bytes allocated to network (current/cache/total)
0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters)
0/0/0 requests for jumbo clusters delayed (4k/9k/16k)
0/0/0 requests for jumbo clusters denied (4k/9k/16k)
0 requests for sfbufs denied
0 requests for sfbufs delayed
0 requests for I/O initiated by sendfile
0 calls to protocol drain routines

------------------------------------------------------------------------
netstat -id

Name    Mtu Network       Address              Ipkts Ierrs Idrop    Opkts Oerrs  Coll Drop
em0    1500 <Link#1>      00:15:17:24:74:9a  4606113     0     0  4298409     0     0    0 
em0    1500 192.168.1.0   obiwan             4407761     -     -  8565496     -     -    - 
em0    1500 fe80::215:17f fe80::215:17ff:fe        0     -     -        3     -     -    - 
em0    1500 192.168.1.20/ arrowslit              408     -     -        0     -     -    - 
em0    1500 192.168.1.21/ warehouse              312     -     -        0     -     -    - 
em0    1500 192.168.1.22/ donjon              187611     -     -        0     -     -    - 
em0    1500 192.168.1.30/ 192.168.1.30             7     -     -        0     -     -    - 
em0    1500 192.168.1.31/ 192.168.1.31             7     -     -        0     -     -    - 
em0    1500 192.168.1.32/ 192.168.1.32             7     -     -        0     -     -    - 
em0    1500 192.168.1.33/ 192.168.1.33             7     -     -        0     -     -    - 
em0    1500 192.168.1.34/ 192.168.1.34            42     -     -        0     -     -    - 
em1*   1500 <Link#2>      00:15:17:24:74:9b        0     0     0        0     0     0    0 
msk0*  1500 <Link#3>      00:18:f3:e0:54:7c        0     0     0        0     0     0    0 
msk1*  1500 <Link#4>      00:18:f3:e0:2d:2c        0     0     0        0     0     0    0 
ral0*  2290 <Link#5>      00:0e:8e:14:5a:d0        0     0     0        0     0     0    0 
pflog 33152 <Link#6>                               0     0     0     1640     0     0    0 
pfsyn  1500 <Link#7>                               0     0     0        0     0     0    0 
lo0   16384 <Link#8>                             426     0     0      426     0     0    0 
lo0   16384 localhost     ::1                      4     -     -        4     -     -    - 
lo0   16384 fe80::1%lo0   fe80::1                  0     -     -        0     -     -    - 
lo0   16384 your-net      localhost               22     -     -      422     -     -    - 

------------------------------------------------------------------------
netstat -anr

Routing tables

Internet:
Destination        Gateway            Flags    Refs      Use  Netif Expire
default            192.168.1.1        UGS         0   118728    em0
127.0.0.1          link#8             UH          0       22    lo0
192.168.1.0/24     link#1             U           0  4173261    em0
192.168.1.3        link#1             UHS         0        0    lo0
192.168.1.20       link#1             UHS         0      126    lo0 =>
192.168.1.20/32    link#1             U           0        0    em0
192.168.1.21       link#1             UHS         0      123    lo0 =>
192.168.1.21/32    link#1             U           0        0    em0
192.168.1.22       link#1             UHS         0      125    lo0 =>
192.168.1.22/32    link#1             U           0        0    em0
192.168.1.30       link#1             UHS         0        0    lo0 =>
192.168.1.30/32    link#1             U           0        0    em0
192.168.1.31       link#1             UHS         0        0    lo0 =>
192.168.1.31/32    link#1             U           0        0    em0
192.168.1.32       link#1             UHS         0        0    lo0 =>
192.168.1.32/32    link#1             U           0        0    em0
192.168.1.33       link#1             UHS         0        0    lo0 =>
192.168.1.33/32    link#1             U           0        0    em0
192.168.1.34       link#1             UHS         0       26    lo0 =>
192.168.1.34/32    link#1             U           0        0    em0

Internet6:
Destination                       Gateway                       Flags      Netif Expire
::/96                             ::1                           UGRS        lo0
::1                               link#8                        UH          lo0
::ffff:0.0.0.0/96                 ::1                           UGRS        lo0
fe80::/10                         ::1                           UGRS        lo0
fe80::%em0/64                     link#1                        U           em0
fe80::215:17ff:fe24:749a%em0      link#1                        UHS         lo0
fe80::%lo0/64                     link#8                        U           lo0
fe80::1%lo0                       link#8                        UHS         lo0
ff01::%em0/32                     fe80::215:17ff:fe24:749a%em0  U           em0
ff01::%lo0/32                     ::1                           U           lo0
ff02::/16                         ::1                           UGRS        lo0
ff02::%em0/32                     fe80::215:17ff:fe24:749a%em0  U           em0
ff02::%lo0/32                     ::1                           U           lo0

------------------------------------------------------------------------
netstat -anA

Active Internet connections (including servers)
Tcpcb            Proto Recv-Q Send-Q Local Address      Foreign Address    (state)
fffffe007ecdec00 tcp4       0      0 192.168.1.3.22     192.168.1.155.5944 ESTABLISHED
fffffe00b2a0d400 tcp4       0      0 192.168.1.22.22    74.125.57.33.8721  ESTABLISHED
fffffe00b29e2c00 tcp4       0      0 192.168.1.34.25    *.*                LISTEN
fffffe00b2a0d000 tcp4       0      0 192.168.1.34.22    *.*                LISTEN
fffffe00a3ca4c00 tcp4       0      0 192.168.1.33.25    *.*                LISTEN
fffffe00afd75800 tcp4       0      0 192.168.1.33.22    *.*                LISTEN
fffffe00afd1cc00 tcp4       0      0 192.168.1.32.25    *.*                LISTEN
fffffe00afd75c00 tcp4       0      0 192.168.1.32.22    *.*                LISTEN
fffffe00a3ca4000 tcp4       0      0 192.168.1.31.25    *.*                LISTEN
fffffe00a3ca4400 tcp4       0      0 192.168.1.31.22    *.*                LISTEN
fffffe00a3ca4800 tcp4       0      0 192.168.1.30.25    *.*                LISTEN
fffffe00a3be9400 tcp4       0      0 192.168.1.22.25    *.*                LISTEN
fffffe00a3be9800 tcp4       0      0 192.168.1.22.22    *.*                LISTEN
fffffe00afd04c00 tcp4       0      0 192.168.1.21.25    *.*                LISTEN
fffffe00afde6000 tcp4       0      0 192.168.1.21.139   *.*                LISTEN
fffffe00afde6400 tcp4       0      0 192.168.1.21.445   *.*                LISTEN
fffffe00afde7c00 tcp4       0      0 192.168.1.20.25    *.*                LISTEN
fffffe00afd75400 tcp4       0      0 192.168.1.20.80    *.*                LISTEN
fffffe00afde7800 tcp4       0      0 192.168.1.20.8080  *.*                LISTEN
fffffe00afde6800 tcp4       0      0 192.168.1.20.9090  *.*                LISTEN
fffffe00afd1c000 tcp4       0      0 127.0.0.1.22       *.*                LISTEN
fffffe00afd1c400 tcp4       0      0 192.168.1.3.22     *.*                LISTEN
fffffe00afde7000 tcp4       0      0 *.676              *.*                LISTEN
fffffe00afde7400 tcp6       0      0 *.972              *.*                LISTEN
fffffe00afb4e000 tcp4       0      0 *.813              *.*                LISTEN
fffffe00afb4e400 tcp6       0      0 *.813              *.*                LISTEN
fffffe00afb4dc00 tcp6       0      0 *.2049             *.*                LISTEN
fffffe00afb4e800 tcp4       0      0 *.2049             *.*                LISTEN
fffffe00afb4d800 tcp4       0      0 *.628              *.*                LISTEN
fffffe00afb4d000 tcp6       0      0 *.628              *.*                LISTEN
fffffe00afb4ec00 tcp4       0      0 *.111              *.*                LISTEN
fffffe00afd04000 tcp6       0      0 *.111              *.*                LISTEN
fffffe00afd04400 tcp6       0      0 ::1.953            *.*                LISTEN
fffffe00afd04800 tcp4       0      0 127.0.0.1.953      *.*                LISTEN
fffffe00afb4d400 tcp4       0      0 127.0.0.1.53       *.*                LISTEN
fffffe00b21f0dc8 udp4       0      0 192.168.1.34.514   *.*                
fffffe00a381c000 udp4       0      0 192.168.1.34.123   *.*                
fffffe00b21f0188 udp4       0      0 192.168.1.33.123   *.*                
fffffe00b21f0930 udp4       0      0 192.168.1.33.514   *.*                
fffffe00b21f07a8 udp4       0      0 192.168.1.32.123   *.*                
fffffe00b21f0498 udp4       0      0 192.168.1.32.514   *.*                
fffffe00a381c930 udp4       0      0 192.168.1.31.123   *.*                
fffffe00a381c7a8 udp4       0      0 192.168.1.31.514   *.*                
fffffe00afdffdc8 udp4       0      0 192.168.1.30.514   *.*                
fffffe00afdffab8 udp4       0      0 192.168.1.30.123   *.*                
fffffe00afdff930 udp4       0      0 192.168.1.22.514   *.*                
fffffe00a381c310 udp4       0      0 192.168.1.22.123   *.*                
fffffe0030536c40 udp4       0      0 192.168.1.21.138   *.*                
fffffe0030536dc8 udp4       0      0 192.168.1.21.138   *.*                
fffffe0030536498 udp4       0      0 192.168.1.21.137   *.*                
fffffe00afdff000 udp4       0      0 192.168.1.21.137   *.*                
fffffe00afdff188 udp4       0      0 192.168.1.21.138   *.*                
fffffe0030536930 udp4       0      0 192.168.1.21.137   *.*                
fffffe0030555930 udp4       0      0 192.168.1.21.123   *.*                
fffffe0030536620 udp4       0      0 192.168.1.21.514   *.*                
fffffe00afdff310 udp4       0      0 192.168.1.20.514   *.*                
fffffe00305367a8 udp4       0      0 192.168.1.20.123   *.*                
fffffe0030555c40 udp4       0      0 127.0.0.1.123      *.*                
fffffe0030536310 udp6       0      0 fe80:8::1.123      *.*                
fffffe0030536000 udp6       0      0 ::1.123            *.*                
fffffe00305557a8 udp6       0      0 fe80:1::215:17ff.1 *.*                
fffffe0030555620 udp4       0      0 192.168.1.3.123    *.*                
fffffe00305547a8 udp6       0      0 *.123              *.*                
fffffe0030555188 udp4       0      0 *.123              *.*                
fffffe00afdff498 udp4       0      0 *.690              *.*                
fffffe00afdff620 udp6       0      0 *.670              *.*                
fffffe00afdff7a8 udp6       0      0 *.955              *.*                
fffffe0030536188 udp4       0      0 *.*                *.*                
fffffe0030555310 udp4       0      0 *.813              *.*                
fffffe0030554ab8 udp6       0      0 *.813              *.*                
fffffe0030554000 udp6       0      0 *.2049             *.*                
fffffe0030554310 udp4       0      0 *.2049             *.*                
fffffe0030554c40 udp4       0      0 *.628              *.*                
fffffe0030555498 udp6       0      0 *.628              *.*                
fffffe0030554498 udp6       0      0 *.*                *.*                
fffffe0030554dc8 udp4       0      0 *.733              *.*                
fffffe0030554620 udp4       0      0 *.111              *.*                
fffffe0030555dc8 udp6       0      0 *.869              *.*                
fffffe0030554188 udp6       0      0 *.111              *.*                
fffffe0030555ab8 udp4       0      0 127.0.0.1.53       *.*                
fffffe0030555000 udp4       0      0 *.514              *.*                
fffffe0030554930 udp6       0      0 *.514              *.*                
Active UNIX domain sockets
Address  Type   Recv-Q Send-Q    Inode     Conn     Refs  Nextref Addr
fffffe00b2d7b690 stream      0      0        0 fffffe00b2a8f2d0        0        0
fffffe00b2a8f2d0 stream      0      0        0 fffffe00b2d7b690        0        0
fffffe00afd72870 stream      0      0 fffffe00b2c45b10        0        0        0 /tmp/tmux-1000/default
fffffe00afd72780 stream      0      0        0 fffffe00afd72690        0        0
fffffe00afd72690 stream      0      0        0 fffffe00afd72780        0        0
fffffe0030882d20 stream      0      0 fffffe00a3847760        0        0        0 /var/run/samba/nmbd/unexpected
fffffe00308851e0 stream      0      0 fffffe00afb501d8        0        0        0 /var/run/rpcbind.sock
fffffe0030884e10 stream      0      0 fffffe003052cce8        0        0        0 /var/run/devd.pipe
fffffe00b2a8f870 dgram       0      0        0 fffffe0030884a50        0 fffffe0030885b40
fffffe0030885780 dgram       0      0        0 fffffe00308824b0        0        0
fffffe0030885b40 dgram       0      0        0 fffffe0030884a50        0        0
fffffe0030884a50 dgram       0      0 fffffe00b2990760        0 fffffe00b2a8f870        0 /var/run/logpriv
fffffe00308824b0 dgram       0      0 fffffe00b2990938        0 fffffe0030885780        0 /var/run/log
fffffe0030882870 dgram       0      0        0 fffffe0030882e10        0 fffffe00308825a0
fffffe0030882a50 dgram       0      0        0 fffffe00afd720f0        0        0
fffffe00308825a0 dgram       0      0        0 fffffe0030882e10        0        0
fffffe0030882e10 dgram       0      0 fffffe00b2453588        0 fffffe0030882870        0 /var/run/logpriv
fffffe00afd720f0 dgram       0      0 fffffe00b2453760        0 fffffe0030882a50        0 /var/run/log
fffffe00afd724b0 dgram       0      0        0 fffffe0030885690        0        0
fffffe00308822d0 dgram       0      0        0 fffffe0030882780        0        0
fffffe0030882780 dgram       0      0 fffffe00b23aa000        0 fffffe00308822d0        0 /var/run/logpriv
fffffe0030885690 dgram       0      0 fffffe00b23aa1d8        0 fffffe00afd724b0        0 /var/run/log
fffffe00308821e0 dgram       0      0        0 fffffe00308820f0        0        0
fffffe00308852d0 dgram       0      0        0 fffffe00308842d0        0        0
fffffe00308842d0 dgram       0      0 fffffe00b2145000        0 fffffe00308852d0        0 /var/run/logpriv
fffffe00308820f0 dgram       0      0 fffffe00b21451d8        0 fffffe00308821e0        0 /var/run/log
fffffe0030885000 dgram       0      0        0 fffffe0030885c30        0 fffffe0030884000
fffffe0030882000 dgram       0      0        0 fffffe0030884b40        0        0
fffffe0030884000 dgram       0      0        0 fffffe0030885c30        0        0
fffffe0030885c30 dgram       0      0 fffffe00a3ddb1d8        0 fffffe0030885000        0 /var/run/logpriv
fffffe0030884b40 dgram       0      0 fffffe00a3ddb3b0        0 fffffe0030882000        0 /var/run/log
fffffe0030885a50 dgram       0      0        0 fffffe00308841e0        0 fffffe0030885870
fffffe00308854b0 dgram       0      0        0 fffffe00308855a0        0        0
fffffe0030885870 dgram       0      0        0 fffffe00308841e0        0        0
fffffe00308841e0 dgram       0      0 fffffe00a39e5938        0 fffffe0030885a50        0 /var/run/logpriv
fffffe00308855a0 dgram       0      0 fffffe00a39e5b10        0 fffffe00308854b0        0 /var/run/log
fffffe0030885960 dgram       0      0        0 fffffe0030884960        0 fffffe0030884d20
fffffe0030884780 dgram       0      0        0 fffffe0030884870        0        0
fffffe0030884d20 dgram       0      0        0 fffffe0030884960        0 fffffe0030882b40
fffffe0030882b40 dgram       0      0        0 fffffe0030884960        0        0
fffffe0030884960 dgram       0      0 fffffe00a33dd760        0 fffffe0030885960        0 /var/run/logpriv
fffffe0030884870 dgram       0      0 fffffe00a33dd938        0 fffffe0030884780        0 /var/run/log
fffffe00308840f0 dgram       0      0        0 fffffe00afd721e0        0 fffffe0030885d20
fffffe00308853c0 dgram       0      0        0 fffffe00afd72000        0        0
fffffe0030885d20 dgram       0      0        0 fffffe00afd721e0        0 fffffe00afd723c0
fffffe00afd723c0 dgram       0      0        0 fffffe00afd721e0        0        0
fffffe00afd721e0 dgram       0      0 fffffe00a327d000        0 fffffe00308840f0        0 /var/run/logpriv
fffffe00afd72000 dgram       0      0 fffffe00a327d1d8        0 fffffe00308853c0        0 /var/run/log
fffffe0030882960 dgram       0      0        0 fffffe00308845a0        0 fffffe00308823c0
fffffe00afd722d0 dgram       0      0        0 fffffe00308844b0        0        0
fffffe00308823c0 dgram       0      0        0 fffffe00308845a0        0 fffffe0030885e10
fffffe0030885e10 dgram       0      0        0 fffffe00308845a0        0 fffffe0030884c30
fffffe0030884c30 dgram       0      0        0 fffffe00308845a0        0 fffffe00308850f0
fffffe00308850f0 dgram       0      0        0 fffffe00308845a0        0        0
fffffe00308843c0 dgram       0      0 fffffe0030571b10        0        0        0 /var/named/var/run/log
fffffe00308844b0 dgram       0      0 fffffe0030572000        0 fffffe00afd722d0        0 /var/run/log
fffffe00308845a0 dgram       0      0 fffffe00305721d8        0 fffffe0030882960        0 /var/run/logpriv
fffffe0030884690 dgram       0      0 fffffe00305723b0        0        0        0 /var/run/log

------------------------------------------------------------------------
netstat -aL

Current listen queue sizes (qlen/incqlen/maxqlen)
Proto Listen         Local Address         
tcp4  0/0/10         192.168.1.34.smtp      
tcp4  0/0/128        192.168.1.34.ssh       
tcp4  0/0/10         192.168.1.33.smtp      
tcp4  0/0/128        192.168.1.33.ssh       
tcp4  0/0/10         192.168.1.32.smtp      
tcp4  0/0/128        192.168.1.32.ssh       
tcp4  0/0/10         192.168.1.31.smtp      
tcp4  0/0/128        192.168.1.31.ssh       
tcp4  0/0/10         192.168.1.30.smtp      
tcp4  0/0/10         donjon.smtp            
tcp4  0/0/128        donjon.ssh             
tcp4  0/0/10         warehouse.smtp         
tcp4  0/0/50         warehouse.netbios-ssn  
tcp4  0/0/50         warehouse.microsoft-ds 
tcp4  0/0/10         arrowslit.smtp         
tcp4  0/0/128        arrowslit.http         
tcp4  0/0/5          arrowslit.8080         
tcp4  0/0/5          arrowslit.9090         
tcp4  0/0/128        localhost.ssh          
tcp4  0/0/128        obiwan.ssh             
tcp4  0/0/128        *.676                  
tcp6  0/0/128        *.972                  
tcp4  0/0/128        *.813                  
tcp6  0/0/128        *.813                  
tcp6  0/0/5          *.nfsd                 
tcp4  0/0/5          *.nfsd                 
tcp4  0/0/128        *.qmqp                 
tcp6  0/0/128        *.qmqp                 
tcp4  0/0/128        *.sunrpc               
tcp6  0/0/128        *.sunrpc               
tcp6  0/0/128        localhost.rndc         
tcp4  0/0/128        localhost.rndc         
tcp4  0/0/3          localhost.domain       
unix  0/0/16         /tmp/tmux-1000/default
unix  0/0/5          /var/run/samba/nmbd/unexpected
unix  0/0/128        /var/run/rpcbind.sock
unix  0/0/4          /var/run/devd.pipe

------------------------------------------------------------------------
fstat

fstat: procstat_getprocs()

------------------------------------------------------------------------
dmesg

Copyright (c) 1992-2013 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 10.0-CURRENT #7 r251519: Sun Jun  9 22:37:09 CEST 2013
    root@obiwan.piupiu.local:/usr/obj/usr/src/sys/OBIWAN amd64
FreeBSD clang version 3.3 (trunk 178860) 20130405
WARNING: WITNESS option enabled, expect reduced performance.
CPU: Intel(R) Core(TM)2 CPU          6320  @ 1.86GHz (1869.91-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x6f6  Family = 0x6  Model = 0xf  Stepping = 6
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0xe3bd<SSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM>
  AMD Features=0x20100800<SYSCALL,NX,LM>
  AMD Features2=0x1<LAHF>
  TSC: P-state invariant, performance statistics
real memory  = 4294967296 (4096 MB)
avail memory = 3104186368 (2960 MB)
Event timer "LAPIC" quality 400
ACPI APIC Table: <A_M_I_ OEMAPIC >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
FreeBSD/SMP: 1 package(s) x 2 core(s)
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
ioapic0 <Version 2.0> irqs 0-23 on motherboard
kbd1 at kbdmux0
cryptosoft0: <software crypto> on motherboard
acpi0: <A_M_I_ OEMXSDT> on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, c7f00000 (3) failed
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 450
Event timer "HPET1" frequency 14318180 Hz quality 440
Event timer "HPET2" frequency 14318180 Hz quality 440
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci0
pci6: <ACPI PCI bus> on pcib1
vgapci0: <VGA-compatible display> mem 0xfd000000-0xfdffffff,0xd0000000-0xdfffffff,0xfc000000-0xfcffffff irq 16 at device 0.0 on pci6
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 3.0 on pci0
pci5: <ACPI PCI bus> on pcib2
em0: <Intel(R) PRO/1000 Network Connection 7.3.8> port 0xc880-0xc89f mem 0xfa9a0000-0xfa9bffff,0xfa980000-0xfa99ffff irq 16 at device 0.0 on pci5
em0: Using an MSI interrupt
em0: Ethernet address: 00:15:17:24:74:9a
em1: <Intel(R) PRO/1000 Network Connection 7.3.8> port 0xcc00-0xcc1f mem 0xfa9e0000-0xfa9fffff,0xfa9c0000-0xfa9dffff irq 17 at device 0.1 on pci5
em1: Using an MSI interrupt
em1: Ethernet address: 00:15:17:24:74:9b
pcib3: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
pci4: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> irq 19 at device 28.3 on pci0
pci3: <ACPI PCI bus> on pcib4
mskc0: <Marvell Yukon 88E8053 Gigabit Ethernet> port 0xb800-0xb8ff mem 0xfa8fc000-0xfa8fffff irq 19 at device 0.0 on pci3
msk0: <Marvell Technology Group Ltd. Yukon EC Id 0xb6 Rev 0x02> on mskc0
msk0: Ethernet address: 00:18:f3:e0:54:7c
miibus0: <MII bus> on msk0
e1000phy0: <Marvell 88E1111 Gigabit PHY> PHY 0 on miibus0
e1000phy0:  none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
pcib5: <ACPI PCI-PCI bridge> irq 16 at device 28.4 on pci0
pci2: <ACPI PCI bus> on pcib5
mskc1: <Marvell Yukon 88E8053 Gigabit Ethernet> port 0xa800-0xa8ff mem 0xfa7fc000-0xfa7fffff irq 16 at device 0.0 on pci2
msk1: <Marvell Technology Group Ltd. Yukon EC Id 0xb6 Rev 0x02> on mskc1
msk1: Ethernet address: 00:18:f3:e0:2d:2c
miibus1: <MII bus> on msk1
e1000phy1: <Marvell 88E1111 Gigabit PHY> PHY 0 on miibus1
e1000phy1:  none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
uhci0: <Intel 82801G (ICH7) USB controller USB-A> port 0xe480-0xe49f irq 20 at device 29.0 on pci0
uhci0: LegSup = 0x2f00
usbus0 on uhci0
uhci1: <Intel 82801G (ICH7) USB controller USB-B> port 0xe800-0xe81f irq 17 at device 29.1 on pci0
uhci1: LegSup = 0x2f00
usbus1 on uhci1
uhci2: <Intel 82801G (ICH7) USB controller USB-C> port 0xe880-0xe89f irq 18 at device 29.2 on pci0
uhci2: LegSup = 0x2f00
usbus2 on uhci2
uhci3: <Intel 82801G (ICH7) USB controller USB-D> port 0xec00-0xec1f irq 19 at device 29.3 on pci0
uhci3: LegSup = 0x2f00
usbus3 on uhci3
ehci0: <Intel 82801GB/R (ICH7) USB 2.0 controller> mem 0xfebffc00-0xfebfffff irq 20 at device 29.7 on pci0
usbus4: EHCI version 1.0
usbus4 on ehci0
pcib6: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci1: <ACPI PCI bus> on pcib6
ral0: <Ralink Technology RT2860> mem 0xfa6f0000-0xfa6fffff irq 22 at device 1.0 on pci1
atapci0: <Promise PDC40718 SATA300 controller> port 0x9c00-0x9c7f,0x9800-0x98ff mem 0xfa6ef000-0xfa6effff,0xfa6c0000-0xfa6dffff irq 23 at device 2.0 on pci1
ata2: <ATA channel> at channel 0 on atapci0
ata3: <ATA channel> at channel 1 on atapci0
ata4: <ATA channel> at channel 2 on atapci0
ata5: <ATA channel> at channel 3 on atapci0
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci1: <Intel ICH7 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf at device 31.1 on pci0
ata0: <ATA channel> at channel 0 on atapci1
atapci2: <Intel ICH7 SATA300 controller> port 0xe400-0xe407,0xe080-0xe083,0xe000-0xe007,0xdc00-0xdc03,0xd880-0xd88f mem 0xfebff800-0xfebffbff irq 23 at device 31.2 on pci0
ata6: <ATA channel> at channel 0 on atapci2
ata7: <ATA channel> at channel 1 on atapci2
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
acpi_button0: <Power Button> on acpi0
fdc0: <floppy drive controller (FDE)> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart0: console (9600,n,8,1)
orm0: <ISA Option ROM> at iomem 0xcf000-0xd3fff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
ppc0: cannot reserve I/O port range
est0: <Enhanced SpeedStep Frequency Control> on cpu0
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 729072906000729
device_attach: est0 attach returned 6
p4tcc0: <CPU Frequency Thermal Control> on cpu0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 729072906000729
device_attach: est1 attach returned 6
p4tcc1: <CPU Frequency Thermal Control> on cpu1
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
ugen0.1: <Intel> at usbus0
uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen1.1: <Intel> at usbus1
uhub1: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
usbus2: 12Mbps Full Speed USB v1.0
usbus3: 12Mbps Full Speed USB v1.0
ugen2.1: <Intel> at usbus2
uhub2: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
ugen3.1: <Intel> at usbus3
uhub3: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3
usbus4: 480Mbps High Speed USB v2.0
ugen4.1: <Intel> at usbus4
uhub4: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus4
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
uhub2: 2 ports with 2 removable, self powered
uhub3: 2 ports with 2 removable, self powered
ata3: SIGNATURE: 00000101
ata5: SIGNATURE: 00000101
ada0 at ata3 bus 0 scbus1 target 0 lun 0
ada0: <WDC WD2002FAEX-007BA0 05.01D05> ATA-8 SATA 3.x device
ada0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada0: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad6
ada1 at ata5 bus 0 scbus3 target 0 lun 0
ada1: <Hitachi HDS723020BLA642 MN6OA180> ATA-8 SATA 3.x device
ada1: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada1: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
ada1: Previously was known as ad10
ada2 at ata6 bus 0 scbus5 target 0 lun 0
ada2: <HDT722516DLA380 V43OA9BA> ATA-7 SATA 1.x device
ada2: 150.000MB/s transfers (SATA 1.x, UDMA5, PIO 8192bytes)
ada2: 157066MB (321672960 512 byte sectors: 16H 63S/T 16383C)
ada2: Previously was known as ad12
ada3 at ata6 bus 0 scbus5 target 1 lun 0
ada3: <WDC WD5000AAKX-001CA0 15.01H15> ATA-8 SATA 3.x device
ada3: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada3: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C)
ada3: Previously was known as ad13
SMP: AP CPU #1 Launched!
Timecounter "TSC" frequency 1869905149 Hz quality 1000
hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> TSC/1/64/0x20<REA> IAP/2/40/0x3ff<INT,USR,SYS,EDG,THR,REA,WRI,INV,QUA,PRC> IAF/0/0/0x67<INT,USR,SYS,REA,WRI>
WARNING: WITNESS option enabled, expect reduced performance.
uhub4: 8 ports with 8 removable, self powered
Root mount waiting for: usbus4
ugen4.2: <vendor 0x05e3> at usbus4
uhub5: <vendor 0x05e3 USB2.0 Hub, class 9/0, rev 2.00/7.02, addr 2> on usbus4
Root mount waiting for: usbus4
uhub5: 4 ports with 4 removable, self powered
ugen4.3: <vendor 0x0bda> at usbus4
Root mount waiting for: usbus4
Trying to mount root from zfs:zroot/root []...
sysctl: oid 'vfs.zfs.write_limit_override' is a read only tunable at line 16
sysctl: Tunable values are set in /boot/loader.conf
Setting hostuuid: 6061d69a-8dfe-d511-b73c-001bfc016fd7.
Setting hostid: 0x6b55bdce.
Starting ddb.
Entropy harvesting: interrupts ethernet point_to_point kickstart.
Starting file system checks:
Mounting local file systems:.
Writing entropy file:.
Setting hostname: obiwan.piupiu.local.
Starting Network: lo0 em0 em1 msk0 msk1 ral0 pflog0 pfsync0.
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
	options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
	inet6 ::1 prefixlen 128 
	inet6 fe80::1%lo0 prefixlen 64 scopeid 0x8 
	inet 127.0.0.1 netmask 0xff000000 
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
	ether 00:15:17:24:74:9a
	inet 192.168.1.3 netmask 0xffffff00 broadcast 192.168.1.255 
	inet6 fe80::215:17ff:fe24:749a%em0 prefixlen 64 scopeid 0x1 
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect (100baseTX <full-duplex>)
	status: active
em1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
	ether 00:15:17:24:74:9b
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
	status: no carrier
msk0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=c011a<TXCSUM,VLAN_MTU,VLAN_HWTAGGING,TSO4,VLAN_HWTSO,LINKSTATE>
	ether 00:18:f3:e0:54:7c
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
msk1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=c011a<TXCSUM,VLAN_MTU,VLAN_HWTAGGING,TSO4,VLAN_HWTSO,LINKSTATE>
	ether 00:18:f3:e0:2d:2c
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
ral0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 2290
	ether 00:0e:8e:14:5a:d0
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: IEEE 802.11 Wireless Ethernet autoselect (autoselect)
	status: no carrier
pflog0: flags=0<> metric 0 mtu 33152
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
pfsync0: flags=0<> metric 0 mtu 1500
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	syncpeer: 0.0.0.0 maxupd: 128 defer: off
Starting devd.
Starting Network: em1.
em1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
	ether 00:15:17:24:74:9b
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
	status: no carrier
Starting Network: msk0.
msk0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=c011a<TXCSUM,VLAN_MTU,VLAN_HWTAGGING,TSO4,VLAN_HWTSO,LINKSTATE>
	ether 00:18:f3:e0:54:7c
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
Starting Network: msk1.
msk1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=c011a<TXCSUM,VLAN_MTU,VLAN_HWTAGGING,TSO4,VLAN_HWTSO,LINKSTATE>
	ether 00:18:f3:e0:2d:2c
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
Starting Network: ral0.
ral0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 2290
	ether 00:0e:8e:14:5a:d0
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: IEEE 802.11 Wireless Ethernet autoselect (autoselect)
	status: no carrier
Starting Network: ral0.
ral0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 2290
	ether 00:0e:8e:14:5a:d0
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: IEEE 802.11 Wireless Ethernet autoselect (autoselect)
	status: no carrier
Starting Network: pflog0.
pflog0: flags=0<> metric 0 mtu 33152
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
Starting Network: pfsync0.
pfsync0: flags=0<> metric 0 mtu 1500
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	syncpeer: 0.0.0.0 maxupd: 128 defer: off
kldload: can't load if_urtw: No such file or directory
Enabling pfNo ALTQ support in kernel
ALTQ related functions disabled
No ALTQ support in kernel
ALTQ related functions disabled
.
add net default: gateway 192.168.1.1
add net ::ffff:0.0.0.0: gateway ::1
add net ::0.0.0.0: gateway ::1
add net fe80::: gateway ::1
add net ff02::: gateway ::1
ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg
32-bit compatibility ldconfig path: /usr/lib32
Creating and/or trimming log files.
Starting syslogd.
No core dumps found.
lock order reversal:
 1st 0xfffffe0043480b78 zfs (zfs) @ /usr/src/sys/kern/vfs_mount.c:851
 2nd 0xfffffe0043513d50 devfs (devfs) @ /usr/src/sys/kern/vfs_subr.c:2099
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff80e580c3f0
kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff80e580c4a0
witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff80e580c530
__lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff80e580c660
vop_stdlock() at vop_stdlock+0x3c/frame 0xffffff80e580c680
VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf9/frame 0xffffff80e580c6b0
_vn_lock() at _vn_lock+0xab/frame 0xffffff80e580c720
vget() at vget+0x70/frame 0xffffff80e580c770
devfs_allocv() at devfs_allocv+0xfd/frame 0xffffff80e580c7c0
devfs_root() at devfs_root+0x43/frame 0xffffff80e580c7f0
vfs_donmount() at vfs_donmount+0x11bc/frame 0xffffff80e580caa0
sys_nmount() at sys_nmount+0x72/frame 0xffffff80e580cae0
amd64_syscall() at amd64_syscall+0x265/frame 0xffffff80e580cbf0
Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff80e580cbf0
--- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x800a98cba, rsp = 0x7fffffffccc8, rbp = 0x7fffffffd230 ---
Starting named.
NFS access cache time=60
Clearing /tmp.
Starting rpcbind.
Starting mountd.
NFS on reserved port only=YES
NFSv4 is disabled
Starting nfsd.
Starting statd.
Starting lockd.
Recovering vi editor sessions:.
Updating motd:.
Mounting late file systems:.
Starting ntpd.
Starting powerd.
Starting smartd.
Starting nullmailer.
Configuring syscons: keymap blanktime allscreens.
Performing sanity check on sshd configuration.
Starting sshd.
Starting cron.
Configuring jails:.
Starting jails: arrowslit.piupiu.local warehouse.piupiu.local donjon.piupiu.localmount: /jails/test9/mnt/repos: No such file or directory
 test9.piupiu.local test8.piupiu.local test8i386.piupiu.local test9i386.piupiu.local test10i386.piupiu.local.
sysctl: oid 'vfs.zfs.write_limit_override' is a read only tunable at line 16
sysctl: Tunable values are set in /boot/loader.conf
Starting background file system checks in 60 seconds.

Sun Jun  9 22:48:04 CEST 2013
KLD dtraceall.ko: depends on cyclic - not available or version mismatch
linker_load_file: Unsupported file type
KLD dtraceall.ko: depends on cyclic - not available or version mismatch
linker_load_file: Unsupported file type
KLD dtrace.ko: depends on cyclic - not available or version mismatch
linker_load_file: Unsupported file type
panic: destroying non-empty racct: 1028096 allocated for resource 4

cpuid = 0
KDB: enter: panic
Copyright (c) 1992-2013 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 10.0-CURRENT #7 r251519: Sun Jun  9 22:37:09 CEST 2013
    root@obiwan.piupiu.local:/usr/obj/usr/src/sys/OBIWAN amd64
FreeBSD clang version 3.3 (trunk 178860) 20130405
WARNING: WITNESS option enabled, expect reduced performance.
CPU: Intel(R) Core(TM)2 CPU          6320  @ 1.86GHz (1869.90-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x6f6  Family = 0x6  Model = 0xf  Stepping = 6
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0xe3bd<SSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM>
  AMD Features=0x20100800<SYSCALL,NX,LM>
  AMD Features2=0x1<LAHF>
  TSC: P-state invariant, performance statistics
real memory  = 4294967296 (4096 MB)
avail memory = 3104186368 (2960 MB)
Event timer "LAPIC" quality 400
ACPI APIC Table: <A_M_I_ OEMAPIC >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
FreeBSD/SMP: 1 package(s) x 2 core(s)
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
ioapic0 <Version 2.0> irqs 0-23 on motherboard
kbd1 at kbdmux0
cryptosoft0: <software crypto> on motherboard
acpi0: <A_M_I_ OEMXSDT> on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, c7f00000 (3) failed
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 450
Event timer "HPET1" frequency 14318180 Hz quality 440
Event timer "HPET2" frequency 14318180 Hz quality 440
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci0
pci6: <ACPI PCI bus> on pcib1
vgapci0: <VGA-compatible display> mem 0xfd000000-0xfdffffff,0xd0000000-0xdfffffff,0xfc000000-0xfcffffff irq 16 at device 0.0 on pci6
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 3.0 on pci0
pci5: <ACPI PCI bus> on pcib2
em0: <Intel(R) PRO/1000 Network Connection 7.3.8> port 0xc880-0xc89f mem 0xfa9a0000-0xfa9bffff,0xfa980000-0xfa99ffff irq 16 at device 0.0 on pci5
em0: Using an MSI interrupt
em0: Ethernet address: 00:15:17:24:74:9a
em1: <Intel(R) PRO/1000 Network Connection 7.3.8> port 0xcc00-0xcc1f mem 0xfa9e0000-0xfa9fffff,0xfa9c0000-0xfa9dffff irq 17 at device 0.1 on pci5
em1: Using an MSI interrupt
em1: Ethernet address: 00:15:17:24:74:9b
pcib3: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
pci4: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> irq 19 at device 28.3 on pci0
pci3: <ACPI PCI bus> on pcib4
mskc0: <Marvell Yukon 88E8053 Gigabit Ethernet> port 0xb800-0xb8ff mem 0xfa8fc000-0xfa8fffff irq 19 at device 0.0 on pci3
msk0: <Marvell Technology Group Ltd. Yukon EC Id 0xb6 Rev 0x02> on mskc0
msk0: Ethernet address: 00:18:f3:e0:54:7c
miibus0: <MII bus> on msk0
e1000phy0: <Marvell 88E1111 Gigabit PHY> PHY 0 on miibus0
e1000phy0:  none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
pcib5: <ACPI PCI-PCI bridge> irq 16 at device 28.4 on pci0
pci2: <ACPI PCI bus> on pcib5
mskc1: <Marvell Yukon 88E8053 Gigabit Ethernet> port 0xa800-0xa8ff mem 0xfa7fc000-0xfa7fffff irq 16 at device 0.0 on pci2
msk1: <Marvell Technology Group Ltd. Yukon EC Id 0xb6 Rev 0x02> on mskc1
msk1: Ethernet address: 00:18:f3:e0:2d:2c
miibus1: <MII bus> on msk1
e1000phy1: <Marvell 88E1111 Gigabit PHY> PHY 0 on miibus1
e1000phy1:  none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
uhci0: <Intel 82801G (ICH7) USB controller USB-A> port 0xe480-0xe49f irq 20 at device 29.0 on pci0
uhci0: LegSup = 0x2f00
usbus0 on uhci0
uhci1: <Intel 82801G (ICH7) USB controller USB-B> port 0xe800-0xe81f irq 17 at device 29.1 on pci0
uhci1: LegSup = 0x2f00
usbus1 on uhci1
uhci2: <Intel 82801G (ICH7) USB controller USB-C> port 0xe880-0xe89f irq 18 at device 29.2 on pci0
uhci2: LegSup = 0x2f00
usbus2 on uhci2
uhci3: <Intel 82801G (ICH7) USB controller USB-D> port 0xec00-0xec1f irq 19 at device 29.3 on pci0
uhci3: LegSup = 0x2f00
usbus3 on uhci3
ehci0: <Intel 82801GB/R (ICH7) USB 2.0 controller> mem 0xfebffc00-0xfebfffff irq 20 at device 29.7 on pci0
usbus4: EHCI version 1.0
usbus4 on ehci0
pcib6: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci1: <ACPI PCI bus> on pcib6
ral0: <Ralink Technology RT2860> mem 0xfa6f0000-0xfa6fffff irq 22 at device 1.0 on pci1
atapci0: <Promise PDC40718 SATA300 controller> port 0x9c00-0x9c7f,0x9800-0x98ff mem 0xfa6ef000-0xfa6effff,0xfa6c0000-0xfa6dffff irq 23 at device 2.0 on pci1
ata2: <ATA channel> at channel 0 on atapci0
ata3: <ATA channel> at channel 1 on atapci0
ata4: <ATA channel> at channel 2 on atapci0
ata5: <ATA channel> at channel 3 on atapci0
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci1: <Intel ICH7 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf at device 31.1 on pci0
ata0: <ATA channel> at channel 0 on atapci1
atapci2: <Intel ICH7 SATA300 controller> port 0xe400-0xe407,0xe080-0xe083,0xe000-0xe007,0xdc00-0xdc03,0xd880-0xd88f mem 0xfebff800-0xfebffbff irq 23 at device 31.2 on pci0
ata6: <ATA channel> at channel 0 on atapci2
ata7: <ATA channel> at channel 1 on atapci2
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
acpi_button0: <Power Button> on acpi0
fdc0: <floppy drive controller (FDE)> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart0: console (9600,n,8,1)
orm0: <ISA Option ROM> at iomem 0xcf000-0xd3fff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
ppc0: cannot reserve I/O port range
est0: <Enhanced SpeedStep Frequency Control> on cpu0
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 729072906000729
device_attach: est0 attach returned 6
p4tcc0: <CPU Frequency Thermal Control> on cpu0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 729072906000729
device_attach: est1 attach returned 6
p4tcc1: <CPU Frequency Thermal Control> on cpu1
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
ugen0.1: <Intel> at usbus0
uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen1.1: <Intel> at usbus1
uhub1: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
usbus2: 12Mbps Full Speed USB v1.0
usbus3: 12Mbps Full Speed USB v1.0
ugen2.1: <Intel> at usbus2
uhub2: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
ugen3.1: <Intel> at usbus3
uhub3: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3
usbus4: 480Mbps High Speed USB v2.0
ugen4.1: <Intel> at usbus4
uhub4: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus4
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
uhub2: 2 ports with 2 removable, self powered
uhub3: 2 ports with 2 removable, self powered
ata3: SIGNATURE: 00000101
ata5: SIGNATURE: 00000101
ada0 at ata3 bus 0 scbus1 target 0 lun 0
ada0: <WDC WD2002FAEX-007BA0 05.01D05> ATA-8 SATA 3.x device
ada0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada0: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad6
ada1 at ata5 bus 0 scbus3 target 0 lun 0
ada1: <Hitachi HDS723020BLA642 MN6OA180> ATA-8 SATA 3.x device
ada1: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada1: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
ada1: Previously was known as ad10
ada2 at ata6 bus 0 scbus5 target 0 lun 0
ada2: <HDT722516DLA380 V43OA9BA> ATA-7 SATA 1.x device
ada2: 150.000MB/s transfers (SATA 1.x, UDMA5, PIO 8192bytes)
ada2: 157066MB (321672960 512 byte sectors: 16H 63S/T 16383C)
ada2: Previously was known as ad12
ada3 at ata6 bus 0 scbus5 target 1 lun 0
ada3: <WDC WD5000AAKX-001CA0 15.01H15> ATA-8 SATA 3.x device
ada3: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada3: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C)
ada3: Previously was known as ad13
SMP: AP CPU #1 Launched!
Timecounter "TSC" frequency 1869904799 Hz quality 1000
hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> TSC/1/64/0x20<REA> IAP/2/40/0x3ff<INT,USR,SYS,EDG,THR,REA,WRI,INV,QUA,PRC> IAF/0/0/0x67<INT,USR,SYS,REA,WRI>
WARNING: WITNESS option enabled, expect reduced performance.
uhub4: 8 ports with 8 removable, self powered
Root mount waiting for: usbus4
ugen4.2: <vendor 0x05e3> at usbus4
uhub5: <vendor 0x05e3 USB2.0 Hub, class 9/0, rev 2.00/7.02, addr 2> on usbus4
Root mount waiting for: usbus4
uhub5: 4 ports with 4 removable, self powered
ugen4.3: <vendor 0x0bda> at usbus4
Root mount waiting for: usbus4
Trying to mount root from zfs:zroot/root []...
sysctl: oid 'vfs.zfs.write_limit_override' is a read only tunable at line 16
sysctl: Tunable values are set in /boot/loader.conf
Setting hostuuid: 6061d69a-8dfe-d511-b73c-001bfc016fd7.
Setting hostid: 0x6b55bdce.
Starting ddb.
Entropy harvesting: interrupts ethernet point_to_point kickstart.
Starting file system checks:
Mounting local file systems:.
Writing entropy file:.
Setting hostname: obiwan.piupiu.local.
Starting Network: lo0 em0 em1 msk0 msk1 ral0 pflog0 pfsync0.
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
	options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
	inet6 ::1 prefixlen 128 
	inet6 fe80::1%lo0 prefixlen 64 scopeid 0x8 
	inet 127.0.0.1 netmask 0xff000000 
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
	ether 00:15:17:24:74:9a
	inet 192.168.1.3 netmask 0xffffff00 broadcast 192.168.1.255 
	inet6 fe80::215:17ff:fe24:749a%em0 prefixlen 64 scopeid 0x1 
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect (100baseTX <full-duplex>)
	status: active
em1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
	ether 00:15:17:24:74:9b
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
	status: no carrier
msk0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=c011a<TXCSUM,VLAN_MTU,VLAN_HWTAGGING,TSO4,VLAN_HWTSO,LINKSTATE>
	ether 00:18:f3:e0:54:7c
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
msk1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=c011a<TXCSUM,VLAN_MTU,VLAN_HWTAGGING,TSO4,VLAN_HWTSO,LINKSTATE>
	ether 00:18:f3:e0:2d:2c
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
ral0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 2290
	ether 00:0e:8e:14:5a:d0
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: IEEE 802.11 Wireless Ethernet autoselect (autoselect)
	status: no carrier
pflog0: flags=0<> metric 0 mtu 33152
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
pfsync0: flags=0<> metric 0 mtu 1500
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	syncpeer: 0.0.0.0 maxupd: 128 defer: off
Starting devd.
Starting Network: em1.
em1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
	ether 00:15:17:24:74:9b
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
	status: no carrier
Starting Network: msk0.
msk0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=c011a<TXCSUM,VLAN_MTU,VLAN_HWTAGGING,TSO4,VLAN_HWTSO,LINKSTATE>
	ether 00:18:f3:e0:54:7c
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
Starting Network: msk1.
msk1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=c011a<TXCSUM,VLAN_MTU,VLAN_HWTAGGING,TSO4,VLAN_HWTSO,LINKSTATE>
	ether 00:18:f3:e0:2d:2c
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
Starting Network: ral0.
ral0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 2290
	ether 00:0e:8e:14:5a:d0
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: IEEE 802.11 Wireless Ethernet autoselect (autoselect)
	status: no carrier
Starting Network: ral0.
ral0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 2290
	ether 00:0e:8e:14:5a:d0
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: IEEE 802.11 Wireless Ethernet autoselect (autoselect)
	status: no carrier
Starting Network: pflog0.
pflog0: flags=0<> metric 0 mtu 33152
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
Starting Network: pfsync0.
pfsync0: flags=0<> metric 0 mtu 1500
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	syncpeer: 0.0.0.0 maxupd: 128 defer: off
kldload: can't load if_urtw: No such file or directory
Enabling pfNo ALTQ support in kernel
ALTQ related functions disabled
No ALTQ support in kernel
ALTQ related functions disabled
.
add net default: gateway 192.168.1.1
add net ::ffff:0.0.0.0: gateway ::1
add net ::0.0.0.0: gateway ::1
add net fe80::: gateway ::1
add net ff02::: gateway ::1
ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg
32-bit compatibility ldconfig path: /usr/lib32
Creating and/or trimming log files.
Starting syslogd.
savecore: reboot after panic: destroying non-empty racct: 1028096 allocated for resource 4
Jun 11 23:07:57 obiwan savecore: reboot after panic: destroying non-empty racct: 1028096 allocated for resource 4
savecore: writing core to /var/crash/vmcore.7
Writing crash summary to /var/crash/core.txt.7.
lock order reversal:
 1st 0xfffffe002ee00418 zfs (zfs) @ /usr/src/sys/kern/vfs_mount.c:851
 2nd 0xfffffe002eea35f0 devfs (devfs) @ /usr/src/sys/kern/vfs_subr.c:2099
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff80e58023f0
kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff80e58024a0
witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff80e5802530
__lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff80e5802660
vop_stdlock() at vop_stdlock+0x3c/frame 0xffffff80e5802680
VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf9/frame 0xffffff80e58026b0
_vn_lock() at _vn_lock+0xab/frame 0xffffff80e5802720
vget() at vget+0x70/frame 0xffffff80e5802770
devfs_allocv() at devfs_allocv+0xfd/frame 0xffffff80e58027c0
devfs_root() at devfs_root+0x43/frame 0xffffff80e58027f0
vfs_donmount() at vfs_donmount+0x11bc/frame 0xffffff80e5802aa0
sys_nmount() at sys_nmount+0x72/frame 0xffffff80e5802ae0
amd64_syscall() at amd64_syscall+0x265/frame 0xffffff80e5802bf0
Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff80e5802bf0
--- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x800a98cba, rsp = 0x7fffffffccc8, rbp = 0x7fffffffd230 ---
Starting named.
NFS access cache time=60
Clearing /tmp.
Starting rpcbind.
Starting mountd.
NFS on reserved port only=YES
NFSv4 is disabled
Starting nfsd.
Starting statd.
Starting lockd.
Recovering vi editor sessions:.
Updating motd:.
Mounting late file systems:.
Starting ntpd.
Starting powerd.
Starting smartd.
Starting nullmailer.
Configuring syscons: keymap blanktime allscreens.
Performing sanity check on sshd configuration.
Starting sshd.
Starting cron.
Configuring jails:.
Starting jails: arrowslit.piupiu.local warehouse.piupiu.local donjon.piupiu.localmount: /jails/test9/mnt/repos: No such file or directory
 test9.piupiu.local test8.piupiu.local test8i386.piupiu.local test9i386.piupiu.local test10i386.piupiu.local.
sysctl: oid 'vfs.zfs.write_limit_override' is a read only tunable at line 16
sysctl: Tunable values are set in /boot/loader.conf
Starting background file system checks in 60 seconds.

Tue Jun 11 23:09:13 CEST 2013
lock order reversal:
 1st 0xfffffe008e593418 zfs (zfs) @ /usr/src/sys/kern/vfs_mount.c:1236
 2nd 0xfffffe00a3443068 syncer (syncer) @ /usr/src/sys/kern/vfs_subr.c:2210
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff80e61b55d0
kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff80e61b5680
witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff80e61b5710
__lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff80e61b5840
vop_stdlock() at vop_stdlock+0x3c/frame 0xffffff80e61b5860
VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf9/frame 0xffffff80e61b5890
_vn_lock() at _vn_lock+0xab/frame 0xffffff80e61b5900
vputx() at vputx+0x206/frame 0xffffff80e61b5960
dounmount() at dounmount+0x2a4/frame 0xffffff80e61b59d0
sys_unmount() at sys_unmount+0x37b/frame 0xffffff80e61b5ae0
amd64_syscall() at amd64_syscall+0x265/frame 0xffffff80e61b5bf0
Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff80e61b5bf0
--- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8008860ba, rsp = 0x7fffffffd258, rbp = 0x7fffffffd370 ---
lock order reversal:
 1st 0xfffffe00163a2068 zfs (zfs) @ /usr/src/sys/fs/nullfs/null_vnops.c:615
 2nd 0xffffffff810051f0 allproc (allproc) @ /usr/src/sys/kern/kern_descrip.c:2757
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff80e61b57a0
kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff80e61b5850
witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff80e61b58e0
_sx_slock() at _sx_slock+0x76/frame 0xffffff80e61b5920
mountcheckdirs() at mountcheckdirs+0x43/frame 0xffffff80e61b5960
dounmount() at dounmount+0x2fe/frame 0xffffff80e61b59d0
sys_unmount() at sys_unmount+0x37b/frame 0xffffff80e61b5ae0
amd64_syscall() at amd64_syscall+0x265/frame 0xffffff80e61b5bf0
Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff80e61b5bf0
--- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8008860ba, rsp = 0x7fffffffd258, rbp = 0x7fffffffd370 ---
lock order reversal:
 1st 0xfffffe009e0cc5f0 pseudofs (pseudofs) @ /usr/src/sys/kern/vfs_lookup.c:517
 2nd 0xffffffff810051f0 allproc (allproc) @ /usr/src/sys/kern/kern_proc.c:319
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff80e61b5520
kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff80e61b55d0
witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff80e61b5660
_sx_slock() at _sx_slock+0x76/frame 0xffffff80e61b56a0
pfind() at pfind+0x22/frame 0xffffff80e61b56c0
pfs_lookup() at pfs_lookup+0x45a/frame 0xffffff80e61b5760
VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xea/frame 0xffffff80e61b5790
vfs_cache_lookup() at vfs_cache_lookup+0xcf/frame 0xffffff80e61b57e0
VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xea/frame 0xffffff80e61b5810
lookup() at lookup+0x590/frame 0xffffff80e61b58a0
namei() at namei+0x464/frame 0xffffff80e61b5950
kern_readlinkat() at kern_readlinkat+0xb7/frame 0xffffff80e61b5ac0
sys_readlink() at sys_readlink+0x26/frame 0xffffff80e61b5ae0
amd64_syscall() at amd64_syscall+0x265/frame 0xffffff80e61b5bf0
Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff80e61b5bf0
--- syscall (58, FreeBSD ELF64, sys_readlink), rip = 0x8014762ec, rsp = 0x7fffffffa628, rbp = 0x800b7b698 ---
GEOM_ELI: Device zvol/data/encrypted.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: software
Limiting closed port RST response from 655 to 200 packets/sec
pid 59823 (try), uid 0: exited on signal 10 (core dumped)
lock order reversal:
 1st 0xffffff80c1e3b388 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:3065
 2nd 0xfffffe007696c000 dirhash (dirhash) @ /usr/src/sys/ufs/ufs/ufs_dirhash.c:284
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff80e605bd80
kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff80e605be30
witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff80e605bec0
_sx_xlock() at _sx_xlock+0x75/frame 0xffffff80e605bf00
ufsdirhash_add() at ufsdirhash_add+0x3b/frame 0xffffff80e605bf40
ufs_direnter() at ufs_direnter+0x688/frame 0xffffff80e605c000
ufs_mkdir() at ufs_mkdir+0x863/frame 0xffffff80e605c200
VOP_MKDIR_APV() at VOP_MKDIR_APV+0xf0/frame 0xffffff80e605c230
nfsvno_mkdir() at nfsvno_mkdir+0x57/frame 0xffffff80e605c280
nfsrvd_mkdirsub() at nfsrvd_mkdirsub+0x53/frame 0xffffff80e605c2f0
nfsrvd_mkdir() at nfsrvd_mkdir+0x2d8/frame 0xffffff80e605c6b0
nfsrvd_dorpc() at nfsrvd_dorpc+0x6b6/frame 0xffffff80e605c8a0
nfssvc_program() at nfssvc_program+0x482/frame 0xffffff80e605ca00
svc_run_internal() at svc_run_internal+0x1e9/frame 0xffffff80e605cba0
svc_thread_start() at svc_thread_start+0xb/frame 0xffffff80e605cbb0
fork_exit() at fork_exit+0x84/frame 0xffffff80e605cbf0
fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80e605cbf0
--- trap 0xc, rip = 0x800886bba, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 ---
pid 23415 (try), uid 0: exited on signal 10 (core dumped)
pid 45475 (try), uid 0: exited on signal 10 (core dumped)
pid 60816 (try), uid 0: exited on signal 10 (core dumped)
pid 85083 (try), uid 0: exited on signal 10 (core dumped)
Jun 15 14:03:22 obiwan mountd[20517]: can't delete exports for /jails/donjon/mnt/tataz/pictures: Invalid argument 
Jun 15 14:04:02 obiwan mountd[20517]: can't delete exports for /jails/donjon/mnt/tataz/pictures: Invalid argument 
pid 52754 (try), uid 0: exited on signal 10 (core dumped)
Jun 15 14:04:14 obiwan mountd[20517]: can't delete exports for /jails/donjon/mnt/tataz/pictures: Invalid argument 
Jun 15 14:10:23 obiwan last message repeated 5 times
Jun 15 14:22:53 obiwan mountd[20517]: can't delete exports for /jails/donjon/mnt/tataz/pictures: Invalid argument 
Jun 15 14:53:43 obiwan mountd[20517]: can't delete exports for /jails/donjon/mnt/tataz/pictures: Invalid argument 
Jun 15 15:01:35 obiwan last message repeated 13 times
Jun 15 15:13:44 obiwan last message repeated 2 times
lock order reversal:
 1st 0xfffffe005f7b3d50 zfs (zfs) @ /usr/src/sys/fs/nullfs/null_vnops.c:615
 2nd 0xfffffe00544ad040 filedesc structure (filedesc structure) @ /usr/src/sys/kern/kern_descrip.c:2762
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff80e667e7a0
kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff80e667e850
witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff80e667e8e0
_sx_xlock() at _sx_xlock+0x75/frame 0xffffff80e667e920
mountcheckdirs() at mountcheckdirs+0xd1/frame 0xffffff80e667e960
dounmount() at dounmount+0x2fe/frame 0xffffff80e667e9d0
sys_unmount() at sys_unmount+0x37b/frame 0xffffff80e667eae0
amd64_syscall() at amd64_syscall+0x265/frame 0xffffff80e667ebf0
Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff80e667ebf0
--- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8008860ba, rsp = 0x7fffffffd258, rbp = 0x7fffffffd370 ---
Jun 15 15:23:22 obiwan last message repeated 16 times
Jun 15 15:33:02 obiwan last message repeated 8 times
Jun 15 15:40:23 obiwan last message repeated 3 times
Jun 15 16:18:40 obiwan mountd[20517]: can't delete exports for /jails/donjon/mnt/tataz/pictures: Invalid argument 
Jun 16 00:00:00 obiwan root: snapshot: making snapshot on /data/adm failed
shared lock of (lockmgr) zfs @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:1521
while exclusively locked from /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1810
panic: excl->share
cpuid = 1
KDB: enter: panic
Copyright (c) 1992-2013 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 10.0-CURRENT #7 r251519: Sun Jun  9 22:37:09 CEST 2013
    root@obiwan.piupiu.local:/usr/obj/usr/src/sys/OBIWAN amd64
FreeBSD clang version 3.3 (trunk 178860) 20130405
WARNING: WITNESS option enabled, expect reduced performance.
CPU: Intel(R) Core(TM)2 CPU          6320  @ 1.86GHz (1869.90-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x6f6  Family = 0x6  Model = 0xf  Stepping = 6
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0xe3bd<SSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM>
  AMD Features=0x20100800<SYSCALL,NX,LM>
  AMD Features2=0x1<LAHF>
  TSC: P-state invariant, performance statistics
real memory  = 4294967296 (4096 MB)
avail memory = 3104186368 (2960 MB)
Event timer "LAPIC" quality 400
ACPI APIC Table: <A_M_I_ OEMAPIC >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
FreeBSD/SMP: 1 package(s) x 2 core(s)
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
ioapic0 <Version 2.0> irqs 0-23 on motherboard
kbd1 at kbdmux0
cryptosoft0: <software crypto> on motherboard
acpi0: <A_M_I_ OEMXSDT> on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, c7f00000 (3) failed
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 450
Event timer "HPET1" frequency 14318180 Hz quality 440
Event timer "HPET2" frequency 14318180 Hz quality 440
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci0
pci6: <ACPI PCI bus> on pcib1
vgapci0: <VGA-compatible display> mem 0xfd000000-0xfdffffff,0xd0000000-0xdfffffff,0xfc000000-0xfcffffff irq 16 at device 0.0 on pci6
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 3.0 on pci0
pci5: <ACPI PCI bus> on pcib2
em0: <Intel(R) PRO/1000 Network Connection 7.3.8> port 0xc880-0xc89f mem 0xfa9a0000-0xfa9bffff,0xfa980000-0xfa99ffff irq 16 at device 0.0 on pci5
em0: Using an MSI interrupt
em0: Ethernet address: 00:15:17:24:74:9a
em1: <Intel(R) PRO/1000 Network Connection 7.3.8> port 0xcc00-0xcc1f mem 0xfa9e0000-0xfa9fffff,0xfa9c0000-0xfa9dffff irq 17 at device 0.1 on pci5
em1: Using an MSI interrupt
em1: Ethernet address: 00:15:17:24:74:9b
pcib3: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
pci4: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> irq 19 at device 28.3 on pci0
pci3: <ACPI PCI bus> on pcib4
mskc0: <Marvell Yukon 88E8053 Gigabit Ethernet> port 0xb800-0xb8ff mem 0xfa8fc000-0xfa8fffff irq 19 at device 0.0 on pci3
msk0: <Marvell Technology Group Ltd. Yukon EC Id 0xb6 Rev 0x02> on mskc0
msk0: Ethernet address: 00:18:f3:e0:54:7c
miibus0: <MII bus> on msk0
e1000phy0: <Marvell 88E1111 Gigabit PHY> PHY 0 on miibus0
e1000phy0:  none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
pcib5: <ACPI PCI-PCI bridge> irq 16 at device 28.4 on pci0
pci2: <ACPI PCI bus> on pcib5
mskc1: <Marvell Yukon 88E8053 Gigabit Ethernet> port 0xa800-0xa8ff mem 0xfa7fc000-0xfa7fffff irq 16 at device 0.0 on pci2
msk1: <Marvell Technology Group Ltd. Yukon EC Id 0xb6 Rev 0x02> on mskc1
msk1: Ethernet address: 00:18:f3:e0:2d:2c
miibus1: <MII bus> on msk1
e1000phy1: <Marvell 88E1111 Gigabit PHY> PHY 0 on miibus1
e1000phy1:  none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
uhci0: <Intel 82801G (ICH7) USB controller USB-A> port 0xe480-0xe49f irq 20 at device 29.0 on pci0
uhci0: LegSup = 0x2f00
usbus0 on uhci0
uhci1: <Intel 82801G (ICH7) USB controller USB-B> port 0xe800-0xe81f irq 17 at device 29.1 on pci0
uhci1: LegSup = 0x2f00
usbus1 on uhci1
uhci2: <Intel 82801G (ICH7) USB controller USB-C> port 0xe880-0xe89f irq 18 at device 29.2 on pci0
uhci2: LegSup = 0x2f00
usbus2 on uhci2
uhci3: <Intel 82801G (ICH7) USB controller USB-D> port 0xec00-0xec1f irq 19 at device 29.3 on pci0
uhci3: LegSup = 0x2f00
usbus3 on uhci3
ehci0: <Intel 82801GB/R (ICH7) USB 2.0 controller> mem 0xfebffc00-0xfebfffff irq 20 at device 29.7 on pci0
usbus4: EHCI version 1.0
usbus4 on ehci0
pcib6: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci1: <ACPI PCI bus> on pcib6
ral0: <Ralink Technology RT2860> mem 0xfa6f0000-0xfa6fffff irq 22 at device 1.0 on pci1
atapci0: <Promise PDC40718 SATA300 controller> port 0x9c00-0x9c7f,0x9800-0x98ff mem 0xfa6ef000-0xfa6effff,0xfa6c0000-0xfa6dffff irq 23 at device 2.0 on pci1
ata2: <ATA channel> at channel 0 on atapci0
ata3: <ATA channel> at channel 1 on atapci0
ata4: <ATA channel> at channel 2 on atapci0
ata5: <ATA channel> at channel 3 on atapci0
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci1: <Intel ICH7 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf at device 31.1 on pci0
ata0: <ATA channel> at channel 0 on atapci1
atapci2: <Intel ICH7 SATA300 controller> port 0xe400-0xe407,0xe080-0xe083,0xe000-0xe007,0xdc00-0xdc03,0xd880-0xd88f mem 0xfebff800-0xfebffbff irq 23 at device 31.2 on pci0
ata6: <ATA channel> at channel 0 on atapci2
ata7: <ATA channel> at channel 1 on atapci2
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
acpi_button0: <Power Button> on acpi0
fdc0: <floppy drive controller (FDE)> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart0: console (9600,n,8,1)
orm0: <ISA Option ROM> at iomem 0xcf000-0xd3fff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
ppc0: cannot reserve I/O port range
est0: <Enhanced SpeedStep Frequency Control> on cpu0
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 729072906000729
device_attach: est0 attach returned 6
p4tcc0: <CPU Frequency Thermal Control> on cpu0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 729072906000729
device_attach: est1 attach returned 6
p4tcc1: <CPU Frequency Thermal Control> on cpu1
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
ugen0.1: <Intel> at usbus0
uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen1.1: <Intel> at usbus1
uhub1: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
usbus2: 12Mbps Full Speed USB v1.0
usbus3: 12Mbps Full Speed USB v1.0
ugen2.1: <Intel> at usbus2
uhub2: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
ugen3.1: <Intel> at usbus3
uhub3: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3
usbus4: 480Mbps High Speed USB v2.0
ugen4.1: <Intel> at usbus4
uhub4: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus4
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
uhub2: 2 ports with 2 removable, self powered
uhub3: 2 ports with 2 removable, self powered
ata3: SIGNATURE: 00000101
ata5: SIGNATURE: 00000101
ada0 at ata3 bus 0 scbus1 target 0 lun 0
ada0: <WDC WD2002FAEX-007BA0 05.01D05> ATA-8 SATA 3.x device
ada0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada0: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad6
ada1 at ata5 bus 0 scbus3 target 0 lun 0
ada1: <Hitachi HDS723020BLA642 MN6OA180> ATA-8 SATA 3.x device
ada1: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada1: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
ada1: Previously was known as ad10
ada2 at ata6 bus 0 scbus5 target 0 lun 0
ada2: <HDT722516DLA380 V43OA9BA> ATA-7 SATA 1.x device
ada2: 150.000MB/s transfers (SATA 1.x, UDMA5, PIO 8192bytes)
ada2: 157066MB (321672960 512 byte sectors: 16H 63S/T 16383C)
ada2: Previously was known as ad12
ada3 at ata6 bus 0 scbus5 target 1 lun 0
ada3: <WDC WD5000AAKX-001CA0 15.01H15> ATA-8 SATA 3.x device
ada3: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada3: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C)
ada3: Previously was known as ad13
SMP: AP CPU #1 Launched!
Timecounter "TSC" frequency 1869901068 Hz quality 1000
hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> TSC/1/64/0x20<REA> IAP/2/40/0x3ff<INT,USR,SYS,EDG,THR,REA,WRI,INV,QUA,PRC> IAF/0/0/0x67<INT,USR,SYS,REA,WRI>
WARNING: WITNESS option enabled, expect reduced performance.
uhub4: 8 ports with 8 removable, self powered
Root mount waiting for: usbus4
ugen4.2: <vendor 0x05e3> at usbus4
uhub5: <vendor 0x05e3 USB2.0 Hub, class 9/0, rev 2.00/7.02, addr 2> on usbus4
Root mount waiting for: usbus4
uhub5: 4 ports with 4 removable, self powered
ugen4.3: <vendor 0x0bda> at usbus4
Trying to mount root from zfs:zroot/root []...
sysctl: oid 'vfs.zfs.write_limit_override' is a read only tunable at line 16
sysctl: Tunable values are set in /boot/loader.conf
Setting hostuuid: 6061d69a-8dfe-d511-b73c-001bfc016fd7.
Setting hostid: 0x6b55bdce.
Starting ddb.
Entropy harvesting: interrupts ethernet point_to_point kickstart.
Starting file system checks:
Mounting local file systems:.
Writing entropy file:.
Setting hostname: obiwan.piupiu.local.
Starting Network: lo0 em0 em1 msk0 msk1 ral0 pflog0 pfsync0.
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
	options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
	inet6 ::1 prefixlen 128 
	inet6 fe80::1%lo0 prefixlen 64 scopeid 0x8 
	inet 127.0.0.1 netmask 0xff000000 
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
	ether 00:15:17:24:74:9a
	inet 192.168.1.3 netmask 0xffffff00 broadcast 192.168.1.255 
	inet6 fe80::215:17ff:fe24:749a%em0 prefixlen 64 scopeid 0x1 
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect (100baseTX <full-duplex>)
	status: active
em1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
	ether 00:15:17:24:74:9b
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
	status: no carrier
msk0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=c011a<TXCSUM,VLAN_MTU,VLAN_HWTAGGING,TSO4,VLAN_HWTSO,LINKSTATE>
	ether 00:18:f3:e0:54:7c
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
msk1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=c011a<TXCSUM,VLAN_MTU,VLAN_HWTAGGING,TSO4,VLAN_HWTSO,LINKSTATE>
	ether 00:18:f3:e0:2d:2c
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
ral0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 2290
	ether 00:0e:8e:14:5a:d0
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: IEEE 802.11 Wireless Ethernet autoselect (autoselect)
	status: no carrier
pflog0: flags=0<> metric 0 mtu 33152
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
pfsync0: flags=0<> metric 0 mtu 1500
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	syncpeer: 0.0.0.0 maxupd: 128 defer: off
Starting devd.
Starting Network: em1.
em1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
	ether 00:15:17:24:74:9b
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
	status: no carrier
Starting Network: msk0.
msk0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=c011a<TXCSUM,VLAN_MTU,VLAN_HWTAGGING,TSO4,VLAN_HWTSO,LINKSTATE>
	ether 00:18:f3:e0:54:7c
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
Starting Network: msk1.
msk1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=c011a<TXCSUM,VLAN_MTU,VLAN_HWTAGGING,TSO4,VLAN_HWTSO,LINKSTATE>
	ether 00:18:f3:e0:2d:2c
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: Ethernet autoselect
Starting Network: ral0.
ral0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 2290
	ether 00:0e:8e:14:5a:d0
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: IEEE 802.11 Wireless Ethernet autoselect (autoselect)
	status: no carrier
Starting Network: ral0.
ral0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 2290
	ether 00:0e:8e:14:5a:d0
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	media: IEEE 802.11 Wireless Ethernet autoselect (autoselect)
	status: no carrier
Starting Network: pflog0.
pflog0: flags=0<> metric 0 mtu 33152
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
Starting Network: pfsync0.
pfsync0: flags=0<> metric 0 mtu 1500
	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
	syncpeer: 0.0.0.0 maxupd: 128 defer: off
kldload: can't load if_urtw: No such file or directory
Enabling pfNo ALTQ support in kernel
ALTQ related functions disabled
No ALTQ support in kernel
ALTQ related functions disabled
.
add net default: gateway 192.168.1.1
add net ::ffff:0.0.0.0: gateway ::1
add net ::0.0.0.0: gateway ::1
add net fe80::: gateway ::1
add net ff02::: gateway ::1
ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg
32-bit compatibility ldconfig path: /usr/lib32
Creating and/or trimming log files.
Starting syslogd.
savecore: reboot after panic: excl->share
Jun 16 10:51:53 obiwan savecore: reboot after panic: excl->share
savecore: writing core to /var/crash/vmcore.8
Writing crash summary to /var/crash/core.txt.8.
lock order reversal:
 1st 0xfffffe00afb98b78 zfs (zfs) @ /usr/src/sys/kern/vfs_mount.c:851
 2nd 0xfffffe00308809a0 devfs (devfs) @ /usr/src/sys/kern/vfs_subr.c:2099
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff80e604d3f0
kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff80e604d4a0
witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff80e604d530
__lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff80e604d660
vop_stdlock() at vop_stdlock+0x3c/frame 0xffffff80e604d680
VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf9/frame 0xffffff80e604d6b0
_vn_lock() at _vn_lock+0xab/frame 0xffffff80e604d720
vget() at vget+0x70/frame 0xffffff80e604d770
devfs_allocv() at devfs_allocv+0xfd/frame 0xffffff80e604d7c0
devfs_root() at devfs_root+0x43/frame 0xffffff80e604d7f0
vfs_donmount() at vfs_donmount+0x11bc/frame 0xffffff80e604daa0
sys_nmount() at sys_nmount+0x72/frame 0xffffff80e604dae0
amd64_syscall() at amd64_syscall+0x265/frame 0xffffff80e604dbf0
Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff80e604dbf0
--- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x800a98cba, rsp = 0x7fffffffccc8, rbp = 0x7fffffffd230 ---
Starting named.
NFS access cache time=60
Clearing /tmp.
Starting rpcbind.
Starting mountd.
NFS on reserved port only=YES
NFSv4 is disabled
Starting nfsd.
Starting statd.
Starting lockd.
Recovering vi editor sessions:.
Updating motd:.
Mounting late file systems:.
Starting ntpd.
Starting powerd.
Starting smartd.
Starting nullmailer.
Configuring syscons: keymap blanktime allscreens.
Performing sanity check on sshd configuration.
Starting sshd.
Starting cron.
Configuring jails:.
Starting jails: arrowslit.piupiu.local warehouse.piupiu.local donjon.piupiu.localmount: /jails/test9/mnt/repos/freebsd.git: No such file or directory
 test9.piupiu.local test8.piupiu.local test8i386.piupiu.local test9i386.piupiu.local test10i386.piupiu.local.
sysctl: oid 'vfs.zfs.write_limit_override' is a read only tunable at line 16
sysctl: Tunable values are set in /boot/loader.conf
Starting background file system checks in 60 seconds.

Sun Jun 16 10:53:05 CEST 2013
lock order reversal:
 1st 0xfffffe0019fb85f0 zfs (zfs) @ /usr/src/sys/kern/vfs_mount.c:1236
 2nd 0xfffffe0019e85b78 syncer (syncer) @ /usr/src/sys/kern/vfs_subr.c:2210
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff80e5fda5d0
kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff80e5fda680
witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff80e5fda710
__lockmgr_args() at __lockmgr_args+0x6f2/frame 0xffffff80e5fda840
vop_stdlock() at vop_stdlock+0x3c/frame 0xffffff80e5fda860
VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf9/frame 0xffffff80e5fda890
_vn_lock() at _vn_lock+0xab/frame 0xffffff80e5fda900
vputx() at vputx+0x206/frame 0xffffff80e5fda960
dounmount() at dounmount+0x2a4/frame 0xffffff80e5fda9d0
sys_unmount() at sys_unmount+0x37b/frame 0xffffff80e5fdaae0
amd64_syscall() at amd64_syscall+0x265/frame 0xffffff80e5fdabf0
Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff80e5fdabf0
--- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8008860ba, rsp = 0x7fffffffd258, rbp = 0x7fffffffd370 ---
lock order reversal:
 1st 0xfffffe0019e855f0 zfs (zfs) @ /usr/src/sys/fs/nullfs/null_vnops.c:615
 2nd 0xffffffff810051f0 allproc (allproc) @ /usr/src/sys/kern/kern_descrip.c:2757
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff80e5fda7a0
kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff80e5fda850
witness_checkorder() at witness_checkorder+0xd4f/frame 0xffffff80e5fda8e0
_sx_slock() at _sx_slock+0x76/frame 0xffffff80e5fda920
mountcheckdirs() at mountcheckdirs+0x43/frame 0xffffff80e5fda960
dounmount() at dounmount+0x2fe/frame 0xffffff80e5fda9d0
sys_unmount() at sys_unmount+0x37b/frame 0xffffff80e5fdaae0
amd64_syscall() at amd64_syscall+0x265/frame 0xffffff80e5fdabf0
Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff80e5fdabf0
--- syscall (22, FreeBSD ELF64, sys_unmount), rip = 0x8008860ba, rsp = 0x7fffffffd258, rbp = 0x7fffffffd370 ---
Jun 16 21:55:52 obiwan sshd[9962]: error: PAM: authentication error for root from 192.168.1.155
panic: destroying non-empty racct: 1007616 allocated for resource 4

cpuid = 1
KDB: enter: panic

------------------------------------------------------------------------
kernel config

options	CONFIG_AUTOGENERATED
ident	GENERIC
machine	amd64
cpu	HAMMER
makeoptions	MODULES_OVERRIDE=dtrace opensolaris zfs zlib wlan wlan_acl wlan_amrr wlan_ccmp wlan_tkip wlan_wep wlan_xauth ath
makeoptions	WITH_CTF=1
makeoptions	DEBUG=-g
options	GEOM_NOP
options	GEOM_MIRROR
options	GEOM_JOURNAL
options	GEOM_GATE
options	GEOM_ELI
options	GEOM_STRIPE
options	GEOM_BDE
options	TMPFS
options	FDESCFS
options	UNIONFS
options	NULLFS
options	RCTL
options	RACCT
options	USB_DEBUG
options	RDRAND_RNG
options	PADLOCK_RNG
options	ATH_ENABLE_11N
options	AH_AR5416_INTERRUPT_MITIGATION
options	AH_SUPPORT_AR5416
options	IEEE80211_SUPPORT_MESH
options	IEEE80211_AMPDU_AGE
options	IEEE80211_DEBUG
options	SC_PIXEL_MODE
options	VESA
options	AHD_REG_PRETTY_PRINT
options	AHC_REG_PRETTY_PRINT
options	ATA_STATIC_ID
options	SMP
options	MALLOC_DEBUG_MAXZONES=8
options	WITNESS_SKIPSPIN
options	WITNESS
options	INVARIANT_SUPPORT
options	INVARIANTS
options	DEADLKRES
options	GDB
options	DDB
options	KDB
options	INCLUDE_CONFIG_FILE
options	DDB_CTF
options	KDTRACE_HOOKS
options	KDTRACE_FRAME
options	MAC
options	CAPABILITIES
options	CAPABILITY_MODE
options	AUDIT
options	HWPMC_HOOKS
options	KBD_INSTALL_CDEV
options	PRINTF_BUFR_SIZE=128
options	_KPOSIX_PRIORITY_SCHEDULING
options	SYSVSEM
options	SYSVMSG
options	SYSVSHM
options	STACK
options	KTRACE
options	SCSI_DELAY=5000
options	COMPAT_FREEBSD7
options	COMPAT_FREEBSD6
options	COMPAT_FREEBSD5
options	COMPAT_FREEBSD4
options	COMPAT_FREEBSD32
options	GEOM_LABEL
options	GEOM_RAID
options	GEOM_PART_GPT
options	PSEUDOFS
options	PROCFS
options	CD9660
options	MSDOSFS
options	NFS_ROOT
options	NFSLOCKD
options	NFSD
options	NFSCL
options	MD_ROOT
options	QUOTA
options	UFS_GJOURNAL
options	UFS_DIRHASH
options	UFS_ACL
options	SOFTUPDATES
options	FFS
options	SCTP
options	TCP_OFFLOAD
options	INET6
options	INET
options	PREEMPTION
options	SCHED_ULE
options	NEW_PCIB
options	GEOM_PART_MBR
options	GEOM_PART_EBR_COMPAT
options	GEOM_PART_EBR
options	GEOM_PART_BSD
device	isa
device	mem
device	io
device	uart_ns8250
device	cpufreq
device	acpi
device	pci
device	fdc
device	ahci
device	ata
device	mvs
device	siis
device	esp
device	mps
device	isci
device	scbus
device	da
device	pass
device	ciss
device	tws
device	atkbdc
device	atkbd
device	psm
device	kbdmux
device	vga
device	splash
device	sc
device	agp
device	cbb
device	uart
device	ppc
device	ppbus
device	lpt
device	ppi
device	puc
device	em
device	igb
device	ixgbe
device	vx
device	miibus
device	bce
device	bfe
device	bge
device	cas
device	fxp
device	gem
device	hme
device	msk
device	nfe
device	re
device	rl
device	sge
device	sis
device	sk
device	vr
device	wlan
device	wlan_wep
device	wlan_ccmp
device	wlan_tkip
device	wlan_amrr
device	ral
device	wi
device	wpi
device	loop
device	random
device	ether
device	vlan
device	tun
device	md
device	gif
device	faith
device	firmware
device	bpf
device	uhci
device	ohci
device	ehci
device	xhci
device	usb
device	ukbd
device	umass
device	mmc
device	mmcsd
device	sdhci
device	virtio
device	virtio_pci
device	vtnet
device	virtio_blk
device	virtio_scsi
device	virtio_balloon
device	hwpmc
device	crypto
device	cryptodev
device	pf
device	pflog
device	pfsync

------------------------------------------------------------------------
ddb capture buffer

db:0:kdb.enter.panic>  run lockinfo
db:1:lockinfo> show locks
exclusive sleep mutex racct lock (racct lock) r = 0 (0xffffffff80dc8340) locked @ /usr/src/sys/kern/kern_racct.c:474
exclusive rw uidinfo hash (uidinfo hash) r = 0 (0xffffffff80dc83c8) locked @ /usr/src/sys/kern/kern_resource.c:1318
db:1:locks>  show alllocks
Process 66555 (cron) thread 0xfffffe0036675920 (101280)
exclusive sleep mutex racct lock (racct lock) r = 0 (0xffffffff80dc8340) locked @ /usr/src/sys/kern/kern_racct.c:474
exclusive rw uidinfo hash (uidinfo hash) r = 0 (0xffffffff80dc83c8) locked @ /usr/src/sys/kern/kern_resource.c:1318
Process 34299 (sshd) thread 0xfffffe00b21d9000 (101194)
exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffffe0064e7e0f8) locked @ /usr/src/sys/kern/uipc_sockbuf.c:148
db:1:alllocks>  show lockedvnods
Locked vnodes
db:0:kdb.enter.panic>  show pcpu
cpuid        = 1
dynamic pcpu = 0xffffff807f489980
curthread    = 0xfffffe0036675920: pid 66555 "cron"
curpcb       = 0xffffff80e63b3cc0
fpcurthread  = none
idlethread   = 0xfffffe0009abb000: tid 100004 "idle: cpu1"
curpmap      = 0xfffffe00a3edfa60
tssp         = 0xffffffff81019e78
commontssp   = 0xffffffff81019e78
rsp0         = 0xffffff80e63b3cc0
gs32p        = 0xffffffff8101b8f0
ldt          = 0xffffffff8101b930
tss          = 0xffffffff8101b920
spin locks held:
db:0:kdb.enter.panic>  bt
Tracing pid 66555 tid 101280 td 0xfffffe0036675920
kdb_enter() at kdb_enter+0x3e/frame 0xffffff80e63b3610
vpanic() at vpanic+0x146/frame 0xffffff80e63b3650
kassert_panic() at kassert_panic+0x136/frame 0xffffff80e63b36c0
racct_destroy() at racct_destroy+0x8e/frame 0xffffff80e63b36f0
uifree() at uifree+0x5e/frame 0xffffff80e63b3710
crfree() at crfree+0x48/frame 0xffffff80e63b3730
thread_wait() at thread_wait+0xac/frame 0xffffff80e63b3750
proc_reap() at proc_reap+0x43f/frame 0xffffff80e63b37a0
proc_to_reap() at proc_to_reap+0x340/frame 0xffffff80e63b37f0
kern_wait6() at kern_wait6+0x1fa/frame 0xffffff80e63b3890
kern_wait() at kern_wait+0x5a/frame 0xffffff80e63b39e0
freebsd32_wait4() at freebsd32_wait4+0x2e/frame 0xffffff80e63b3ae0
ia32_syscall() at ia32_syscall+0x26c/frame 0xffffff80e63b3bf0
Xint0x80_syscall() at Xint0x80_syscall+0x95/frame 0xffffff80e63b3bf0
--- syscall (7, FreeBSD ELF32, freebsd32_wait4), rip = 0x2810a7bb, rsp = 0xffffc5cc, rbp = 0xffffc5e8 ---
db:0:kdb.enter.panic>  ps
  pid  ppid  pgrp   uid   state   wmesg         wchan        cmd
66555  4174  4174     0  RJ      CPU 1                       cron
44502 44498 44427     0  S       nanslp   0xffffffff80dc9a91 csup
44498 44473 44427     0  S       wait     0xfffffe006dd40000 sh
44473     1 44427     0  S       wait     0xfffffe00b2aa0970 lockf
40175 40173 40175     0  Ss+     pause    0xfffffe006dd44560 screen
40173  2289 40173     0  Ss      select   0xfffffe00b264d4c0 sshd
34303 34302 34303  1000  Ss+J    ttyin    0xfffffe00b2ebfca8 bash
34302 34299 34299  1000  SJ      select   0xfffffe00b264d340 sshd
34299  3219 34299     0  SsJ     sbwait   0xfffffe0064e7e144 sshd
15109 15107 15004     0  S       nanslp   0xffffffff80dc9a90 csup
15107 15049 15004     0  S       wait     0xfffffe00a3195970 sh
15049     1 15004     0  S       wait     0xfffffe00b2b68970 lockf
  880  5468   880  1000  T+J                                 vim
  878  5483   878  1000  S+J     select   0xfffffe000f454d40 vim
  701   698   700     0  S+      ttyin    0xfffffe000f088ca8 less
  698  5496   698     0  Ss+     wait     0xfffffe0072ff34b8 bash
99948  5467 99948  1000  Ss+J    ttyin    0xfffffe00b2cb10a8 bash
 5497  5496  5497     0  Ss+     ttyin    0xfffffe00b2cb18a8 bash
 5496     1  5496     0  Ss      select   0xfffffe00b27c1d40 screen
 5483  5467  5483  1000  Ss+J    wait     0xfffffe00b2ba24b8 bash
 5468  5467  5468  1000  Ss+J    ttyin    0xfffffe00b2cb20a8 bash
 5467     1  5467  1000  SsJ     select   0xfffffe00b2b60040 tmux
 4717     1  4717     0  Ss+     ttyin    0xfffffe0009bfaca8 getty
 4716     1  4716     0  Ss+     ttyin    0xfffffe0009bfb8a8 getty
 4715     1  4715     0  Ss+     ttyin    0xfffffe0009bfbca8 getty
 4714     1  4714     0  Ss+     ttyin    0xfffffe000f0860a8 getty
 4713     1  4713     0  Ss+     ttyin    0xfffffe000f0864a8 getty
 4712     1  4712     0  Ss+     ttyin    0xfffffe000f0868a8 getty
 4711     1  4711     0  Ss+     ttyin    0xfffffe0009bfa0a8 getty
 4710     1  4710     0  Ss+     ttyin    0xfffffe0009bfa4a8 getty
 4709     1  4709     0  Ss+     ttyin    0xfffffe0009bfa8a8 getty
 4648     1  4648     0  SsJ     nanslp   0xffffffff80dc9a91 cron
 4643     1  4643    25  SsJ     pause    0xfffffe00b2200a18 sendmail
 4640     1  4640     0  SsJ     select   0xfffffe00b2657140 sendmail
 4637     1  4637     0  SsJ     select   0xfffffe00b26571c0 sshd
 4578     1  4578     0  SsJ     select   0xfffffe00b2657240 syslogd
 4412     1  4412     0  SsJ     nanslp   0xffffffff80dc9a90 cron
 4408     1  4408    25  SsJ     pause    0xfffffe000f513a18 sendmail
 4405     1  4405     0  SsJ     select   0xfffffe00b2657340 sendmail
 4402     1  4402     0  SsJ     select   0xfffffe000f454cc0 sshd
 4351     1  4351     0  SsJ     select   0xfffffe00a3979340 syslogd
 4174     1  4174     0  SsJ     nanslp   0xffffffff80dc9a91 cron
 4168     1  4168    25  SsJ     pause    0xfffffe00b2202a18 sendmail
 4162     1  4162     0  SsJ     select   0xfffffe00a39793c0 sendmail
 4155     1  4155     0  SsJ     select   0xfffffe003059c2c0 sshd
 4048     1  4048     0  SsJ     select   0xfffffe00a39794c0 syslogd
 3823     1  3823     0  SsJ     nanslp   0xffffffff80dc9a91 cron
 3817     1  3817    25  SsJ     pause    0xfffffe00a31950a8 sendmail
 3811     1  3811     0  SsJ     select   0xfffffe003059c3c0 sendmail
 3804     1  3804     0  SsJ     select   0xfffffe003059c440 sshd
 3696     1  3696     0  SsJ     select   0xfffffe00a397b940 syslogd
 3471     1  3471     0  SsJ     nanslp   0xffffffff80dc9a90 cron
 3467     1  3467    25  SsJ     pause    0xfffffe00262a4560 sendmail
 3464     1  3464     0  SsJ     select   0xfffffe003059c5c0 sendmail
 3414     1  3414     0  SsJ     select   0xfffffe00305a3340 syslogd
 3230     1  3230     0  SsJ     nanslp   0xffffffff80dc9a91 cron
 3225     1  3225    25  SsJ     pause    0xfffffe00a393c560 sendmail
 3222     1  3222     0  SsJ     select   0xfffffe003059c6c0 sendmail
 3219     1  3219     0  SsJ     select   0xfffffe003059c740 sshd
 3166     1  3166     0  SsJ     select   0xfffffe00a397bb40 syslogd
 2899     1  2899     0  SsJ     nanslp   0xffffffff80dc9a91 cron
 2895     1  2895    25  SsJ     pause    0xfffffe00a393ca18 sendmail
 2892     1  2892     0  SsJ     select   0xfffffe003059c840 sendmail
 2891  2864  2864     0  SJ      select   0xfffffe003059c8c0 smbd
 2864     1  2864     0  SsJ     select   0xfffffe00a397bbc0 smbd
 2861     1  2861     0  SsJ     select   0xfffffe003045dbc0 nmbd
 2824     1  2824     0  SsJ     select   0xfffffe003045dc40 syslogd
 2607     1  2607     0  SsJ     nanslp   0xffffffff80dc9a90 cron
 2603     1  2603    25  SsJ     pause    0xfffffe00a34d5560 sendmail
 2600     1  2600     0  SsJ     select   0xfffffe003059cbc0 sendmail
 2575     1  2575    80  SsJ     kqread   0xfffffe00afd3eb00 mohawk
 2550     1  2550     0  SsJ     select   0xfffffe00305a3140 syslogd
 2531     1  2530   350  SJ      (threaded)                  python2.7
101153                   S       usem     0xfffffe00afc87900 python2.7
101152                   S       usem     0xfffffe00305a6700 python2.7
101151                   S       select   0xfffffe003045dcc0 python2.7
101150                   S       select   0xfffffe003059ca40 python2.7
101149                   S       usem     0xfffffe00305a6500 python2.7
101148                   S       usem     0xfffffe00afc87700 python2.7
101147                   S       usem     0xfffffe00afc87600 python2.7
101146                   S       select   0xfffffe003045ddc0 python2.7
101131                   S       usem     0xfffffe00afc87300 python2.7
101130                   S       usem     0xfffffe00afc87200 python2.7
101129                   S       usem     0xfffffe00afc87100 python2.7
101128                   S       usem     0xfffffe00305a3580 python2.7
101127                   S       usem     0xfffffe000f454b80 python2.7
101126                   S       usem     0xfffffe00afc89600 python2.7
101125                   S       usem     0xfffffe00afc89500 python2.7
101124                   S       usem     0xfffffe00afc89400 python2.7
101123                   S       usem     0xfffffe00afc89300 python2.7
101122                   S       usem     0xfffffe00afc89200 python2.7
101121                   S       select   0xfffffe003059ccc0 python2.7
101120                   S       usem     0xfffffe003045b680 python2.7
101119                   S       usem     0xfffffe003045b580 python2.7
101118                   S       usem     0xfffffe003045b480 python2.7
101117                   S       usem     0xfffffe003045b380 python2.7
101116                   S       usem     0xfffffe003045b280 python2.7
101115                   S       usem     0xfffffe003045b180 python2.7
101113                   S       usem     0xfffffe00300efe00 python2.7
101112                   S       usem     0xfffffe00300efd00 python2.7
101111                   S       usem     0xfffffe00afc89000 python2.7
101110                   S       select   0xfffffe00305a31c0 python2.7
101109                   S       select   0xfffffe00afc882c0 python2.7
100964                   S       select   0xfffffe00afc88240 python2.7
 2293     1  2293     0  Ss      nanslp   0xffffffff80dc9a90 cron
 2289     1  2289     0  Ss      select   0xfffffe00afc88440 sshd
 2261  2257  2257   522  S       piperd   0xfffffe00261fa8b8 logger
 2260  2257  2257   522  S       select   0xfffffe000f454c40 nullmailer-send
 2257     1  2257   522  Ss      wait     0xfffffe00afb3c4b8 sh
 2245     1  2244     0  S       nanslp   0xffffffff80dc9a90 smartd
 2229     1  2229     0  Ss      select   0xfffffe00afc883c0 powerd
 2226     1  2226     0  Ss      select   0xfffffe00305a33c0 ntpd
 2188     1  2188     0  Ss      rpcsvc   0xfffffe00afc1d820 NLM: master
 2180     1  2180     0  Ss      select   0xfffffe00afc884c0 rpc.statd
 2172  2171  2171     0  S       (threaded)                  nfsd
101108                   S       rpcsvc   0xfffffe00afc26420 nfsd: service
101107                   S       rpcsvc   0xfffffe00afc27420 nfsd: service
101106                   S       rpcsvc   0xfffffe00afc26220 nfsd: service
101095                   S       rpcsvc   0xfffffe00afc23220 nfsd: master
 2171     1  2171     0  Ss      select   0xfffffe00305a3240 nfsd
 2160     1  2160     0  Ss      select   0xfffffe00afc885c0 mountd
 2156     1  2156     0  Ss      select   0xfffffe00afc88640 rpcbind
 2110     1  2110    53  Ss      (threaded)                  named
101105                   S       kqread   0xfffffe0030487a00 named
101104                   S       uwait    0xfffffe00afc88980 named
101103                   S       uwait    0xfffffe00afc88880 named
101102                   S       uwait    0xfffffe00afc88780 named
101093                   S       sigwait  0xfffffe00afcb5000 named
 1968     1  1968     0  Ss      select   0xfffffe00305a3440 syslogd
 1800     1  1800     0  Ss      select   0xfffffe00305a34c0 devd
   23     0     0     0  DL      -        0xffffffff80dc88f0 [racctd]
   22     0     0     0  DL      sdflush  0xffffffff80fbd3ec [softdepflush]
   21     0     0     0  DL      vlruwt   0xfffffe000f4764b8 [vnlru]
   20     0     0     0  DL      syncer   0xffffffff80fb62a0 [syncer]
   19     0     0     0  DL      psleep   0xffffffff80fb5c84 [bufdaemon]
   18     0     0     0  DL      pgzero   0xffffffff80fbeb0c [pagezero]
   17     0     0     0  DL      psleep   0xffffffff80fbdd50 [vmdaemon]
   16     0     0     0  DL      psleep   0xffffffff81019d04 [pagedaemon]
    9     0     0     0  DL      jsw:wait 0xffffffff80dc5d40 [g_journal switcher]
    8     0     0     0  DL      ccb_scan 0xffffffff80da84b0 [xpt_thrd]
    7     0     0     0  DL      waiting_ 0xffffffff8100c860 [sctp_iterator]
    6     0     0     0  DL      pftm     0xffffffff80810d60 [pf purge]
    5     0     0     0  DL      (threaded)                  [zfskern]
100962                   D       tx->tx_s 0xfffffe000fda2218 [txg_thread_enter]
100961                   D       tx->tx_q 0xfffffe000fda2238 [txg_thread_enter]
100957                   D       spa->spa 0xfffffe000f3d89f0 [trim trifling]
100657                   D       zvol:io  0xfffffe000fcb55d8 [zvol data/encrypted]
100653                   D       zvol:io  0xfffffe000fd62dd8 [zvol data/test]
100652                   D       tx->tx_s 0xfffffe000fefca18 [txg_thread_enter]
100651                   D       tx->tx_q 0xfffffe000fefca38 [txg_thread_enter]
100649                   D       spa->spa 0xfffffe000f3d99f0 [trim data]
100362                   D       tx->tx_s 0xfffffe000f5caa18 [txg_thread_enter]
100361                   D       tx->tx_q 0xfffffe000f5caa38 [txg_thread_enter]
100359                   D       spa->spa 0xfffffe000f5109f0 [trim zroot]
100067                   D       l2arc_fe 0xffffffff81406d58 [l2arc_feed_thread]
100066                   D       arc_recl 0xffffffff813ff010 [arc_reclaim_thread]
    4     0     0     0  DL      -        0xfffffe0009ec5448 [fdc0]
   15     0     0     0  DL      (threaded)                  [usb]
100055                   D       -        0xffffff8000929e18 [usbus4]
100054                   D       -        0xffffff8000929dc0 [usbus4]
100053                   D       -        0xffffff8000929d68 [usbus4]
100052                   D       -        0xffffff8000929d10 [usbus4]
100051                   D       -        0xffffff8000920ef0 [usbus3]
100050                   D       -        0xffffff8000920e98 [usbus3]
100049                   D       -        0xffffff8000920e40 [usbus3]
100048                   D       -        0xffffff8000920de8 [usbus3]
100046                   D       -        0xffffff8000917ef0 [usbus2]
100045                   D       -        0xffffff8000917e98 [usbus2]
100044                   D       -        0xffffff8000917e40 [usbus2]
100043                   D       -        0xffffff8000917de8 [usbus2]
100041                   D       -        0xffffff800090eef0 [usbus1]
100040                   D       -        0xffffff800090ee98 [usbus1]
100039                   D       -        0xffffff800090ee40 [usbus1]
100038                   D       -        0xffffff800090ede8 [usbus1]
100036                   D       -        0xffffff8000905ef0 [usbus0]
100035                   D       -        0xffffff8000905e98 [usbus0]
100034                   D       -        0xffffff8000905e40 [usbus0]
100033                   D       -        0xffffff8000905de8 [usbus0]
   14     0     0     0  DL      -        0xffffffff80dacd88 [yarrow]
    3     0     0     0  DL      crypto_r 0xffffffff80fbc590 [crypto returns]
    2     0     0     0  DL      crypto_w 0xffffffff80fbc438 [crypto]
   13     0     0     0  DL      (threaded)                  [geom]
100011                   D       -        0xffffffff810010f0 [g_down]
100010                   D       -        0xffffffff810010e8 [g_up]
100009                   D       -        0xffffffff810010e0 [g_event]
   12     0     0     0  WL      (threaded)                  [intr]
100072                   I                                   [swi1: pfsync]
100070                   I                                   [swi1: pf send]
100062                   I                                   [swi0: uart]
100061                   I                                   [irq1: atkbd0]
100059                   I                                   [irq14: ata0]
100058                   I                                   [irq23: atapci0+]
100057                   I                                   [irq22: ral0]
100047                   I                                   [irq19: uhci3]
100042                   I                                   [irq18: uhci2]
100037                   I                                   [irq17: uhci1]
100032                   I                                   [irq20: hpet0 uhci0+]
100031                   I                                   [irq259: mskc1]
100030                   I                                   [irq258: mskc0]
100025                   I                                   [swi2: cambio]
100024                   I                                   [swi5: fast taskq]
100022                   I                                   [swi6: Giant taskq]
100020                   I                                   [swi6: task queue]
100008                   I                                   [swi4: clock]
100007                   I                                   [swi4: clock]
100006                   I                                   [swi1: netisr 0]
100005                   I                                   [swi3: vm]
   11     0     0     0  RL      (threaded)                  [idle]
100004                   CanRun                              [idle: cpu1]
100003                   Run     CPU 0                       [idle: cpu0]
    1     0     1     0  SLs     wait     0xfffffe0009ab9970 [init]
   10     0     0     0  DL      audit_wo 0xffffffff81011538 [audit]
    0     0     0     0  DLs     (threaded)                  [kernel]
101068                   D       -        0xfffffe0030487e00 [zil_clean]
101067                   D       -        0xfffffe0030488100 [zil_clean]
101066                   D       -        0xfffffe0030488300 [zil_clean]
101065                   D       -        0xfffffe0030488500 [zil_clean]
101064                   D       -        0xfffffe0030488700 [zil_clean]
101063                   D       -        0xfffffe0030488900 [zil_clean]
101062                   D       -        0xfffffe0030488b00 [zil_clean]
101061                   D       -        0xfffffe00302bd100 [zil_clean]
101060                   D       -        0xfffffe00302bd300 [zil_clean]
101059                   D       -        0xfffffe00302bd500 [zil_clean]
101058                   D       -        0xfffffe00302bd700 [zil_clean]
101057                   D       -        0xfffffe00302bd900 [zil_clean]
101056                   D       -        0xfffffe00302bdb00 [zil_clean]
101054                   D       -        0xfffffe00302bdc00 [zil_clean]
101053                   D       -        0xfffffe00302bde00 [zil_clean]
101052                   D       -        0xfffffe00303b1100 [zil_clean]
101051                   D       -        0xfffffe00303b1300 [zil_clean]
101050                   D       -        0xfffffe00303b1400 [zil_clean]
101049                   D       -        0xfffffe00303b1600 [zil_clean]
101048                   D       -        0xfffffe00303b1800 [zil_clean]
101047                   D       -        0xfffffe00303b1900 [zil_clean]
101046                   D       -        0xfffffe00303b1a00 [zil_clean]
101045                   D       -        0xfffffe00303b1c00 [zil_clean]
101044                   D       -        0xfffffe0030228400 [zil_clean]
101043                   D       -        0xfffffe0030228600 [zil_clean]
101042                   D       -        0xfffffe0030228800 [zil_clean]
101041                   D       -        0xfffffe0030228a00 [zil_clean]
101040                   D       -        0xfffffe0030228c00 [zil_clean]
101039                   D       -        0xfffffe0030228e00 [zil_clean]
101038                   D       -        0xfffffe00302bc100 [zil_clean]
101037                   D       -        0xfffffe0030169800 [zil_clean]
101036                   D       -        0xfffffe00302bc300 [zil_clean]
101035                   D       -        0xfffffe00302bc500 [zil_clean]
101034                   D       -        0xfffffe00302bc700 [zil_clean]
101033                   D       -        0xfffffe00302bc900 [zil_clean]
101032                   D       -        0xfffffe00302bcb00 [zil_clean]
101031                   D       -        0xfffffe00302bcd00 [zil_clean]
101030                   D       -        0xfffffe00302bd000 [zil_clean]
101029                   D       -        0xfffffe003017a900 [zil_clean]
101028                   D       -        0xfffffe003017ab00 [zil_clean]
101027                   D       -        0xfffffe003017ac00 [zil_clean]
101026                   D       -        0xfffffe003017ae00 [zil_clean]
101025                   D       -        0xfffffe0030227100 [zil_clean]
101024                   D       -        0xfffffe0030227300 [zil_clean]
101023                   D       -        0xfffffe0030227500 [zil_clean]
101022                   D       -        0xfffffe0030227700 [zil_clean]
101021                   D       -        0xfffffe0030227900 [zil_clean]
101020                   D       -        0xfffffe0030227b00 [zil_clean]
101019                   D       -        0xfffffe0030227d00 [zil_clean]
101018                   D       -        0xfffffe0030228000 [zil_clean]
101017                   D       -        0xfffffe0030228200 [zil_clean]
101016                   D       -        0xfffffe0030169d00 [zil_clean]
101015                   D       -        0xfffffe0030179000 [zil_clean]
101014                   D       -        0xfffffe0030179200 [zil_clean]
101013                   D       -        0xfffffe0030179400 [zil_clean]
101012                   D       -        0xfffffe0030179600 [zil_clean]
101011                   D       -        0xfffffe0030179800 [zil_clean]
101010                   D       -        0xfffffe0030169a00 [zil_clean]
101009                   D       -        0xfffffe0030179b00 [zil_clean]
101008                   D       -        0xfffffe0030179d00 [zil_clean]
101007                   D       -        0xfffffe003017a000 [zil_clean]
101006                   D       -        0xfffffe003017a100 [zil_clean]
101005                   D       -        0xfffffe003017a300 [zil_clean]
101004                   D       -        0xfffffe003017a500 [zil_clean]
101003                   D       -        0xfffffe003017a700 [zil_clean]
101002                   D       -        0xfffffe003004c500 [zil_clean]
101001                   D       -        0xfffffe003004c700 [zil_clean]
101000                   D       -        0xfffffe003004c800 [zil_clean]
100999                   D       -        0xfffffe003004ca00 [zil_clean]
100998                   D       -        0xfffffe003004cc00 [zil_clean]
100997                   D       -        0xfffffe003004ce00 [zil_clean]
100996                   D       -        0xfffffe0030114100 [zil_clean]
100995                   D       -        0xfffffe0026ff3300 [zil_clean]
100994                   D       -        0xfffffe0026ff3400 [zil_clean]
100993                   D       -        0xfffffe0030114500 [zil_clean]
100992                   D       -        0xfffffe0030114700 [zil_clean]
100991                   D       -        0xfffffe0030114900 [zil_clean]
100990                   D       -        0xfffffe0030114b00 [zil_clean]
100989                   D       -        0xfffffe0026ff3500 [zil_clean]
100988                   D       -        0xfffffe0026ff3700 [zil_clean]
100987                   D       -        0xfffffe0026ad4e00 [zil_clean]
100986                   D       -        0xfffffe0026ff2100 [zil_clean]
100985                   D       -        0xfffffe0026ff2300 [zil_clean]
100984                   D       -        0xfffffe0026ff3800 [zil_clean]
100983                   D       -        0xfffffe0026ff2600 [zil_clean]
100982                   D       -        0xfffffe0026ff2800 [zil_clean]
100981                   D       -        0xfffffe0026ff2a00 [zil_clean]
100980                   D       -        0xfffffe0026ff2c00 [zil_clean]
100979                   D       -        0xfffffe0026ff3900 [zil_clean]
100978                   D       -        0xfffffe0026ff3b00 [zil_clean]
100977                   D       -        0xfffffe0026ff3d00 [zil_clean]
100976                   D       -        0xfffffe0026ff3e00 [zil_clean]
100975                   D       -        0xfffffe003004c100 [zil_clean]
100974                   D       -        0xfffffe003004c200 [zil_clean]
100973                   D       -        0xfffffe0026ad4800 [zil_clean]
100972                   D       -        0xfffffe000f5aeb00 [zil_clean]
100971                   D       -        0xfffffe0026ff3200 [zil_clean]
100970                   D       -        0xfffffe0026ad4200 [zil_clean]
100960                   D       -        0xfffffe0026ad4500 [zfs_vn_rele_taskq]
100956                   D       -        0xfffffe0026ad4600 [zio_ioctl_intr]
100955                   D       -        0xfffffe0026ad4700 [zio_ioctl_issue]
100954                   D       -        0xfffffe0026ad4900 [zio_claim_intr]
100953                   D       -        0xfffffe0026ad4a00 [zio_claim_issue]
100952                   D       -        0xfffffe0026ad4b00 [zio_free_intr]
100951                   D       -        0xfffffe000f44ca00 [zio_free_issue_99]
100950                   D       -        0xfffffe000f44ca00 [zio_free_issue_98]
100949                   D       -        0xfffffe000f44ca00 [zio_free_issue_97]
100948                   D       -        0xfffffe000f44ca00 [zio_free_issue_96]
100947                   D       -        0xfffffe000f44ca00 [zio_free_issue_95]
100946                   D       -        0xfffffe000f44ca00 [zio_free_issue_94]
100945                   D       -        0xfffffe000f44ca00 [zio_free_issue_93]
100944                   D       -        0xfffffe000f44ca00 [zio_free_issue_92]
100943                   D       -        0xfffffe000f44ca00 [zio_free_issue_91]
100942                   D       -        0xfffffe000f44ca00 [zio_free_issue_90]
100941                   D       -        0xfffffe000f44ca00 [zio_free_issue_89]
100940                   D       -        0xfffffe000f44ca00 [zio_free_issue_88]
100939                   D       -        0xfffffe000f44ca00 [zio_free_issue_87]
100938                   D       -        0xfffffe000f44ca00 [zio_free_issue_86]
100937                   D       -        0xfffffe000f44ca00 [zio_free_issue_85]
100936                   D       -        0xfffffe000f44ca00 [zio_free_issue_84]
100935                   D       -        0xfffffe000f44ca00 [zio_free_issue_83]
100934                   D       -        0xfffffe000f44ca00 [zio_free_issue_82]
100933                   D       -        0xfffffe000f44ca00 [zio_free_issue_81]
100932                   D       -        0xfffffe000f44ca00 [zio_free_issue_80]
100931                   D       -        0xfffffe000f44ca00 [zio_free_issue_79]
100930                   D       -        0xfffffe000f44ca00 [zio_free_issue_78]
100929                   D       -        0xfffffe000f44ca00 [zio_free_issue_77]
100928                   D       -        0xfffffe000f44ca00 [zio_free_issue_76]
100927                   D       -        0xfffffe000f44ca00 [zio_free_issue_75]
100926                   D       -        0xfffffe000f44ca00 [zio_free_issue_74]
100925                   D       -        0xfffffe000f44ca00 [zio_free_issue_73]
100924                   D       -        0xfffffe000f44ca00 [zio_free_issue_72]
100923                   D       -        0xfffffe000f44ca00 [zio_free_issue_71]
100922                   D       -        0xfffffe000f44ca00 [zio_free_issue_70]
100921                   D       -        0xfffffe000f44ca00 [zio_free_issue_69]
100920                   D       -        0xfffffe000f44ca00 [zio_free_issue_68]
100919                   D       -        0xfffffe000f44ca00 [zio_free_issue_67]
100918                   D       -        0xfffffe000f44ca00 [zio_free_issue_66]
100917                   D       -        0xfffffe000f44ca00 [zio_free_issue_65]
100916                   D       -        0xfffffe000f44ca00 [zio_free_issue_64]
100915                   D       -        0xfffffe000f44ca00 [zio_free_issue_63]
100914                   D       -        0xfffffe000f44ca00 [zio_free_issue_62]
100913                   D       -        0xfffffe000f44ca00 [zio_free_issue_61]
100912                   D       -        0xfffffe000f44ca00 [zio_free_issue_60]
100911                   D       -        0xfffffe000f44ca00 [zio_free_issue_59]
100910                   D       -        0xfffffe000f44ca00 [zio_free_issue_58]
100909                   D       -        0xfffffe000f44ca00 [zio_free_issue_57]
100908                   D       -        0xfffffe000f44ca00 [zio_free_issue_56]
100907                   D       -        0xfffffe000f44ca00 [zio_free_issue_55]
100906                   D       -        0xfffffe000f44ca00 [zio_free_issue_54]
100905                   D       -        0xfffffe000f44ca00 [zio_free_issue_53]
100904                   D       -        0xfffffe000f44ca00 [zio_free_issue_52]
100903                   D       -        0xfffffe000f44ca00 [zio_free_issue_51]
100902                   D       -        0xfffffe000f44ca00 [zio_free_issue_50]
100901                   D       -        0xfffffe000f44ca00 [zio_free_issue_49]
100900                   D       -        0xfffffe000f44ca00 [zio_free_issue_48]
100899                   D       -        0xfffffe000f44ca00 [zio_free_issue_47]
100898                   D       -        0xfffffe000f44ca00 [zio_free_issue_46]
100897                   D       -        0xfffffe000f44ca00 [zio_free_issue_45]
100896                   D       -        0xfffffe000f44ca00 [zio_free_issue_44]
100895                   D       -        0xfffffe000f44ca00 [zio_free_issue_43]
100894                   D       -        0xfffffe000f44ca00 [zio_free_issue_42]
100893                   D       -        0xfffffe000f44ca00 [zio_free_issue_41]
100892                   D       -        0xfffffe000f44ca00 [zio_free_issue_40]
100891                   D       -        0xfffffe000f44ca00 [zio_free_issue_39]
100890                   D       -        0xfffffe000f44ca00 [zio_free_issue_38]
100889                   D       -        0xfffffe000f44ca00 [zio_free_issue_37]
100888                   D       -        0xfffffe000f44ca00 [zio_free_issue_36]
100887                   D       -        0xfffffe000f44ca00 [zio_free_issue_35]
100886                   D       -        0xfffffe000f44ca00 [zio_free_issue_34]
100885                   D       -        0xfffffe000f44ca00 [zio_free_issue_33]
100884                   D       -        0xfffffe000f44ca00 [zio_free_issue_32]
100883                   D       -        0xfffffe000f44ca00 [zio_free_issue_31]
100882                   D       -        0xfffffe000f44ca00 [zio_free_issue_30]
100881                   D       -        0xfffffe000f44ca00 [zio_free_issue_29]
100880                   D       -        0xfffffe000f44ca00 [zio_free_issue_28]
100879                   D       -        0xfffffe000f44ca00 [zio_free_issue_27]
100878                   D       -        0xfffffe000f44ca00 [zio_free_issue_26]
100877                   D       -        0xfffffe000f44ca00 [zio_free_issue_25]
100876                   D       -        0xfffffe000f44ca00 [zio_free_issue_24]
100875                   D       -        0xfffffe000f44ca00 [zio_free_issue_23]
100874                   D       -        0xfffffe000f44ca00 [zio_free_issue_22]
100873                   D       -        0xfffffe000f44ca00 [zio_free_issue_21]
100872                   D       -        0xfffffe000f44ca00 [zio_free_issue_20]
100871                   D       -        0xfffffe000f44ca00 [zio_free_issue_19]
100870                   D       -        0xfffffe000f44ca00 [zio_free_issue_18]
100869                   D       -        0xfffffe000f44ca00 [zio_free_issue_17]
100868                   D       -        0xfffffe000f44ca00 [zio_free_issue_16]
100867                   D       -        0xfffffe000f44ca00 [zio_free_issue_15]
100866                   D       -        0xfffffe000f44ca00 [zio_free_issue_14]
100865                   D       -        0xfffffe000f44ca00 [zio_free_issue_13]
100864                   D       -        0xfffffe000f44ca00 [zio_free_issue_12]
100863                   D       -        0xfffffe000f44ca00 [zio_free_issue_11]
100862                   D       -        0xfffffe000f44ca00 [zio_free_issue_10]
100861                   D       -        0xfffffe000f44ca00 [zio_free_issue_9]
100860                   D       -        0xfffffe000f44ca00 [zio_free_issue_8]
100859                   D       -        0xfffffe000f44ca00 [zio_free_issue_7]
100858                   D       -        0xfffffe000f44ca00 [zio_free_issue_6]
100857                   D       -        0xfffffe000f44ca00 [zio_free_issue_5]
100856                   D       -        0xfffffe000f44ca00 [zio_free_issue_4]
100855                   D       -        0xfffffe000f44ca00 [zio_free_issue_3]
100854                   D       -        0xfffffe000f44ca00 [zio_free_issue_2]
100853                   D       -        0xfffffe000f44ca00 [zio_free_issue_1]
100852                   D       -        0xfffffe000f44ca00 [zio_free_issue_0]
100851                   D       -        0xfffffe000f5ae700 [zio_write_intr_high]
100850                   D       -        0xfffffe000f5ae700 [zio_write_intr_high]
100849                   D       -        0xfffffe000f5ae700 [zio_write_intr_high]
100848                   D       -        0xfffffe000f5ae700 [zio_write_intr_high]
100847                   D       -        0xfffffe000f5ae700 [zio_write_intr_high]
100846                   D       -        0xfffffe000f5ae800 [zio_write_intr_7]
100845                   D       -        0xfffffe000f5ae800 [zio_write_intr_6]
100844                   D       -        0xfffffe000f5ae800 [zio_write_intr_5]
100843                   D       -        0xfffffe000f5ae800 [zio_write_intr_4]
100842                   D       -        0xfffffe000f5ae800 [zio_write_intr_3]
100841                   D       -        0xfffffe000f5ae800 [zio_write_intr_2]
100840                   D       -        0xfffffe000f5ae800 [zio_write_intr_1]
100839                   D       -        0xfffffe000f5ae800 [zio_write_intr_0]
100838                   D       -        0xfffffe000f5ae900 [zio_write_issue_hig]
100837                   D       -        0xfffffe000f5ae900 [zio_write_issue_hig]
100836                   D       -        0xfffffe000f5ae900 [zio_write_issue_hig]
100835                   D       -        0xfffffe000f5ae900 [zio_write_issue_hig]
100834                   D       -        0xfffffe000f5ae900 [zio_write_issue_hig]
100833                   D       -        0xfffffe000f5aea00 [zio_write_issue_1]
100832                   D       -        0xfffffe000f5aea00 [zio_write_issue_0]
100831                   D       -        0xfffffe000f5aed00 [zio_read_intr_1]
100830                   D       -        0xfffffe000f5aed00 [zio_read_intr_0]
100829                   D       -        0xfffffe000f5aee00 [zio_read_issue_7]
100828                   D       -        0xfffffe000f5aee00 [zio_read_issue_6]
100827                   D       -        0xfffffe000f5aee00 [zio_read_issue_5]
100826                   D       -        0xfffffe000f5aee00 [zio_read_issue_4]
100825                   D       -        0xfffffe000f5aee00 [zio_read_issue_3]
100824                   D       -        0xfffffe000f5aee00 [zio_read_issue_2]
100823                   D       -        0xfffffe000f5aee00 [zio_read_issue_1]
100822                   D       -        0xfffffe000f5aee00 [zio_read_issue_0]
100821                   D       -        0xfffffe0026ad4100 [zio_null_intr]
100820                   D       -        0xfffffe0026ad4000 [zio_null_issue]
100650                   D       -        0xfffffe000f44c900 [zfs_vn_rele_taskq]
100648                   D       -        0xfffffe000f5ae400 [zio_ioctl_intr]
100647                   D       -        0xfffffe000f5ae500 [zio_ioctl_issue]
100646                   D       -        0xfffffe000f44c000 [zio_claim_intr]
100645                   D       -        0xfffffe000f5ae300 [zio_claim_issue]
100644                   D       -        0xfffffe000f5ae200 [zio_free_intr]
100643                   D       -        0xfffffe000f5ae100 [zio_free_issue_99]
100642                   D       -        0xfffffe000f5ae100 [zio_free_issue_98]
100641                   D       -        0xfffffe000f5ae100 [zio_free_issue_97]
100640                   D       -        0xfffffe000f5ae100 [zio_free_issue_96]
100639                   D       -        0xfffffe000f5ae100 [zio_free_issue_95]
100638                   D       -        0xfffffe000f5ae100 [zio_free_issue_94]
100637                   D       -        0xfffffe000f5ae100 [zio_free_issue_93]
100636                   D       -        0xfffffe000f5ae100 [zio_free_issue_92]
100635                   D       -        0xfffffe000f5ae100 [zio_free_issue_91]
100634                   D       -        0xfffffe000f5ae100 [zio_free_issue_90]
100633                   D       -        0xfffffe000f5ae100 [zio_free_issue_89]
100632                   D       -        0xfffffe000f5ae100 [zio_free_issue_88]
100631                   D       -        0xfffffe000f5ae100 [zio_free_issue_87]
100630                   D       -        0xfffffe000f5ae100 [zio_free_issue_86]
100629                   D       -        0xfffffe000f5ae100 [zio_free_issue_85]
100628                   D       -        0xfffffe000f5ae100 [zio_free_issue_84]
100627                   D       -        0xfffffe000f5ae100 [zio_free_issue_83]
100626                   D       -        0xfffffe000f5ae100 [zio_free_issue_82]
100625                   D       -        0xfffffe000f5ae100 [zio_free_issue_81]
100624                   D       -        0xfffffe000f5ae100 [zio_free_issue_80]
100623                   D       -        0xfffffe000f5ae100 [zio_free_issue_79]
100622                   D       -        0xfffffe000f5ae100 [zio_free_issue_78]
100621                   D       -        0xfffffe000f5ae100 [zio_free_issue_77]
100620                   D       -        0xfffffe000f5ae100 [zio_free_issue_76]
100619                   D       -        0xfffffe000f5ae100 [zio_free_issue_75]
100618                   D       -        0xfffffe000f5ae100 [zio_free_issue_74]
100617                   D       -        0xfffffe000f5ae100 [zio_free_issue_73]
100616                   D       -        0xfffffe000f5ae100 [zio_free_issue_72]
100615                   D       -        0xfffffe000f5ae100 [zio_free_issue_71]
100614                   D       -        0xfffffe000f5ae100 [zio_free_issue_70]
100613                   D       -        0xfffffe000f5ae100 [zio_free_issue_69]
100612                   D       -        0xfffffe000f5ae100 [zio_free_issue_68]
100611                   D       -        0xfffffe000f5ae100 [zio_free_issue_67]
100610                   D       -        0xfffffe000f5ae100 [zio_free_issue_66]
100609                   D       -        0xfffffe000f5ae100 [zio_free_issue_65]
100608                   D       -        0xfffffe000f5ae100 [zio_free_issue_64]
100607                   D       -        0xfffffe000f5ae100 [zio_free_issue_63]
100606                   D       -        0xfffffe000f5ae100 [zio_free_issue_62]
100605                   D       -        0xfffffe000f5ae100 [zio_free_issue_61]
100604                   D       -        0xfffffe000f5ae100 [zio_free_issue_60]
100603                   D       -        0xfffffe000f5ae100 [zio_free_issue_59]
100602                   D       -        0xfffffe000f5ae100 [zio_free_issue_58]
100601                   D       -        0xfffffe000f5ae100 [zio_free_issue_57]
100600                   D       -        0xfffffe000f5ae100 [zio_free_issue_56]
100599                   D       -        0xfffffe000f5ae100 [zio_free_issue_55]
100598                   D       -        0xfffffe000f5ae100 [zio_free_issue_54]
100597                   D       -        0xfffffe000f5ae100 [zio_free_issue_53]
100596                   D       -        0xfffffe000f5ae100 [zio_free_issue_52]
100595                   D       -        0xfffffe000f5ae100 [zio_free_issue_51]
100594                   D       -        0xfffffe000f5ae100 [zio_free_issue_50]
100593                   D       -        0xfffffe000f5ae100 [zio_free_issue_49]
100592                   D       -        0xfffffe000f5ae100 [zio_free_issue_48]
100591                   D       -        0xfffffe000f5ae100 [zio_free_issue_47]
100590                   D       -        0xfffffe000f5ae100 [zio_free_issue_46]
100589                   D       -        0xfffffe000f5ae100 [zio_free_issue_45]
100588                   D       -        0xfffffe000f5ae100 [zio_free_issue_44]
100587                   D       -        0xfffffe000f5ae100 [zio_free_issue_43]
100586                   D       -        0xfffffe000f5ae100 [zio_free_issue_42]
100585                   D       -        0xfffffe000f5ae100 [zio_free_issue_41]
100584                   D       -        0xfffffe000f5ae100 [zio_free_issue_40]
100583                   D       -        0xfffffe000f5ae100 [zio_free_issue_39]
100582                   D       -        0xfffffe000f5ae100 [zio_free_issue_38]
100581                   D       -        0xfffffe000f5ae100 [zio_free_issue_37]
100580                   D       -        0xfffffe000f5ae100 [zio_free_issue_36]
100579                   D       -        0xfffffe000f5ae100 [zio_free_issue_35]
100578                   D       -        0xfffffe000f5ae100 [zio_free_issue_34]
100577                   D       -        0xfffffe000f5ae100 [zio_free_issue_33]
100576                   D       -        0xfffffe000f5ae100 [zio_free_issue_32]
100575                   D       -        0xfffffe000f5ae100 [zio_free_issue_31]
100574                   D       -        0xfffffe000f5ae100 [zio_free_issue_30]
100573                   D       -        0xfffffe000f5ae100 [zio_free_issue_29]
100572                   D       -        0xfffffe000f5ae100 [zio_free_issue_28]
100571                   D       -        0xfffffe000f5ae100 [zio_free_issue_27]
100570                   D       -        0xfffffe000f5ae100 [zio_free_issue_26]
100569                   D       -        0xfffffe000f5ae100 [zio_free_issue_25]
100568                   D       -        0xfffffe000f5ae100 [zio_free_issue_24]
100567                   D       -        0xfffffe000f5ae100 [zio_free_issue_23]
100566                   D       -        0xfffffe000f5ae100 [zio_free_issue_22]
100565                   D       -        0xfffffe000f5ae100 [zio_free_issue_21]
100564                   D       -        0xfffffe000f5ae100 [zio_free_issue_20]
100563                   D       -        0xfffffe000f5ae100 [zio_free_issue_19]
100562                   D       -        0xfffffe000f5ae100 [zio_free_issue_18]
100561                   D       -        0xfffffe000f5ae100 [zio_free_issue_17]
100560                   D       -        0xfffffe000f5ae100 [zio_free_issue_16]
100559                   D       -        0xfffffe000f5ae100 [zio_free_issue_15]
100558                   D       -        0xfffffe000f5ae100 [zio_free_issue_14]
100557                   D       -        0xfffffe000f5ae100 [zio_free_issue_13]
100556                   D       -        0xfffffe000f5ae100 [zio_free_issue_12]
100555                   D       -        0xfffffe000f5ae100 [zio_free_issue_11]
100554                   D       -        0xfffffe000f5ae100 [zio_free_issue_10]
100553                   D       -        0xfffffe000f5ae100 [zio_free_issue_9]
100552                   D       -        0xfffffe000f5ae100 [zio_free_issue_8]
100551                   D       -        0xfffffe000f5ae100 [zio_free_issue_7]
100550                   D       -        0xfffffe000f5ae100 [zio_free_issue_6]
100549                   D       -        0xfffffe000f5ae100 [zio_free_issue_5]
100548                   D       -        0xfffffe000f5ae100 [zio_free_issue_4]
100547                   D       -        0xfffffe000f5ae100 [zio_free_issue_3]
100546                   D       -        0xfffffe000f5ae100 [zio_free_issue_2]
100545                   D       -        0xfffffe000f5ae100 [zio_free_issue_1]
100544                   D       -        0xfffffe000f5ae100 [zio_free_issue_0]
100543                   D       -        0xfffffe000f5ae000 [zio_write_intr_high]
100542                   D       -        0xfffffe000f5ae000 [zio_write_intr_high]
100541                   D       -        0xfffffe000f5ae000 [zio_write_intr_high]
100540                   D       -        0xfffffe000f5ae000 [zio_write_intr_high]
100539                   D       -        0xfffffe000f5ae000 [zio_write_intr_high]
100538                   D       -        0xfffffe000f44ce00 [zio_write_intr_7]
100537                   D       -        0xfffffe000f44ce00 [zio_write_intr_6]
100536                   D       -        0xfffffe000f44ce00 [zio_write_intr_5]
100535                   D       -        0xfffffe000f44ce00 [zio_write_intr_4]
100534                   D       -        0xfffffe000f44ce00 [zio_write_intr_3]
100533                   D       -        0xfffffe000f44ce00 [zio_write_intr_2]
100532                   D       -        0xfffffe000f44ce00 [zio_write_intr_1]
100531                   D       -        0xfffffe000f44ce00 [zio_write_intr_0]
100530                   D       -        0xfffffe000f44cd00 [zio_write_issue_hig]
100529                   D       -        0xfffffe000f44cd00 [zio_write_issue_hig]
100528                   D       -        0xfffffe000f44cd00 [zio_write_issue_hig]
100527                   D       -        0xfffffe000f44cd00 [zio_write_issue_hig]
100526                   D       -        0xfffffe000f44cd00 [zio_write_issue_hig]
100525                   D       -        0xfffffe000f44cc00 [zio_write_issue_1]
100524                   D       -        0xfffffe000f44cc00 [zio_write_issue_0]
100523                   D       -        0xfffffe000f44c100 [zio_read_intr_1]
100522                   D       -        0xfffffe000f44c100 [zio_read_intr_0]
100521                   D       -        0xfffffe000f44c400 [zio_read_issue_7]
100520                   D       -        0xfffffe000f44c400 [zio_read_issue_6]
100519                   D       -        0xfffffe000f44c400 [zio_read_issue_5]
100518                   D       -        0xfffffe000f44c400 [zio_read_issue_4]
100517                   D       -        0xfffffe000f44c400 [zio_read_issue_3]
100516                   D       -        0xfffffe000f44c400 [zio_read_issue_2]
100515                   D       -        0xfffffe000f44c400 [zio_read_issue_1]
100514                   D       -        0xfffffe000f44c400 [zio_read_issue_0]
100513                   D       -        0xfffffe000f44cb00 [zio_null_intr]
100512                   D       -        0xfffffe000f44c300 [zio_null_issue]
100363                   D       -        0xfffffe000f44c500 [zil_clean]
100360                   D       -        0xfffffe000f44c600 [zfs_vn_rele_taskq]
100358                   D       -        0xfffffe000f44c800 [zio_ioctl_intr]
100357                   D       -        0xfffffe000f44c700 [zio_ioctl_issue]
100356                   D       -        0xfffffe0009d12200 [zio_claim_intr]
100355                   D       -        0xfffffe0009d12300 [zio_claim_issue]
100354                   D       -        0xfffffe0009d12400 [zio_free_intr]
100353                   D       -        0xfffffe0009d12500 [zio_free_issue_99]
100352                   D       -        0xfffffe0009d12500 [zio_free_issue_98]
100351                   D       -        0xfffffe0009d12500 [zio_free_issue_97]
100350                   D       -        0xfffffe0009d12500 [zio_free_issue_96]
100349                   D       -        0xfffffe0009d12500 [zio_free_issue_95]
100348                   D       -        0xfffffe0009d12500 [zio_free_issue_94]
100347                   D       -        0xfffffe0009d12500 [zio_free_issue_93]
100346                   D       -        0xfffffe0009d12500 [zio_free_issue_92]
100345                   D       -        0xfffffe0009d12500 [zio_free_issue_91]
100344                   D       -        0xfffffe0009d12500 [zio_free_issue_90]
100343                   D       -        0xfffffe0009d12500 [zio_free_issue_89]
100342                   D       -        0xfffffe0009d12500 [zio_free_issue_88]
100341                   D       -        0xfffffe0009d12500 [zio_free_issue_87]
100340                   D       -        0xfffffe0009d12500 [zio_free_issue_86]
100339                   D       -        0xfffffe0009d12500 [zio_free_issue_85]
100338                   D       -        0xfffffe0009d12500 [zio_free_issue_84]
100337                   D       -        0xfffffe0009d12500 [zio_free_issue_83]
100336                   D       -        0xfffffe0009d12500 [zio_free_issue_82]
100335                   D       -        0xfffffe0009d12500 [zio_free_issue_81]
100334                   D       -        0xfffffe0009d12500 [zio_free_issue_80]
100333                   D       -        0xfffffe0009d12500 [zio_free_issue_79]
100332