Summary of test results

Overall result: 57 TESTS FAILING

Execution context

Timing data:

• Start time: 2018-12-25T16:29:51.343822Z
• End time: 2018-12-26T00:25:14.362885Z
• Duration: 1506.025s

Broken test cases

• lib/atf/libatf-c++/detail/text_test:to_type
• lib/csu/dynamic/init_test:__test_cases_list__
• lib/msun/cexp_test:main
• lib/msun/csqrt_test:main
• lib/msun/exponential_test:main
• lib/msun/fenv_test:main
• lib/msun/fma_test:main
• lib/msun/ilogb2_test:main
• lib/msun/invtrig_test:main
• lib/msun/logarithm_test:main
• lib/msun/lrint_test:main
• lib/msun/nan_test:main
• lib/msun/nearbyint_test:main
• lib/msun/next_test:main
• lib/msun/rem_test:main
• local/kyua/utils/units_test:bytes__parse__error
• sys/kqueue/libkqueue/kqueue_test:main

Failed test cases

• lib/atf/libatf-c++/check_test:build_cpp
• lib/atf/libatf-c++/macros_test:detect_unused_tests
• lib/atf/libatf-c/check_test:build_cpp
• lib/atf/libatf-c/macros_test:detect_unused_tests
• lib/csu/dynamic/fini_test:dtors_test
• lib/csu/dynamiclib/fini_test:dtors_test
• lib/csu/dynamiclib/init_test:ctors_test
• lib/csu/dynamiclib/init_test:jcr_test
• lib/csu/static/fini_test:dtors_test
• lib/csu/static/init_test:ctors_test
• lib/libc/ssp/ssp_test:fgets
• lib/libc/ssp/ssp_test:gets
• lib/libc/ssp/ssp_test:memcpy
• lib/libc/ssp/ssp_test:memmove
• lib/libc/ssp/ssp_test:memset
• lib/libc/ssp/ssp_test:snprintf
• lib/libc/ssp/ssp_test:sprintf
• lib/libc/ssp/ssp_test:stpcpy
• lib/libc/ssp/ssp_test:stpncpy
• lib/libc/ssp/ssp_test:strcpy
• lib/libc/ssp/ssp_test:strncat
• lib/libc/ssp/ssp_test:strncpy
• lib/libc/ssp/ssp_test:vsnprintf
• lib/libc/ssp/ssp_test:vsprintf
• lib/libc/stdio/printfloat_test:decimal_rounding
• lib/libc/stdio/printfloat_test:float_within_limits
• lib/libc/stdio/printfloat_test:hexadecimal_floating_point
• lib/libc/stdio/scanfloat_test:infinities_and_nans
• lib/libc/stdio/scanfloat_test:rounding_tests
• lib/libc/stdio/scanfloat_test:strtod
• lib/libc/sys/mkdir_test:mkdir_mode
• lib/libc/tls/tls_dynamic_test:t_tls_dynamic
• lib/msun/ctrig_test:test_nan_inputs
• lib/msun/fmod_test:fmod
• lib/msun/trig_test:accuracy
• lib/msun/trig_test:special
• sys/acl/00:main
• sys/acl/02:main
• sys/kern/ptrace_test:ptrace__PT_STEP_with_signal
• sys/kern/ptrace_test:ptrace__step_siginfo

Expected failures

• bin/expr/expr_test:arithmetic_ops
• lib/libc/c063/faccessat_test:faccessat_fdlink
• lib/libc/gen/sleep_test:nanosleep
• lib/libc/regex/regex_att_test:leftassoc
• lib/libc/stdio/fflush_test:fflush_err
• lib/libc/stdio/scanf_test:sscanf_whitespace
• lib/libc/stdlib/getenv_test:setenv_basic
• lib/libc/stdlib/hsearch_test:hsearch_r_nonexistent
• lib/libc/sys/getgroups_test:getgroups_err
• lib/libc/sys/mknod_test:mknod_stat
• lib/libc/sys/mmap_test:mmap_truncate_signal
• lib/libc/time/mktime_test:mktime_negyear
• lib/libcrypt/crypt_test:crypt_salts
• lib/libregex/libregex_test:gnuext
• lib/libregex/regex_att_test:leftassoc
• lib/libthr/mutex_test:mutexattr2
• lib/libthr/timedmutex_test:mutexattr2
• sys/aio/lio_test:lio_listio_empty_nowait_kevent
• sys/aio/lio_test:lio_listio_empty_nowait_signal
• sys/aio/lio_test:lio_listio_empty_nowait_thread
• sys/fs/tmpfs/link_test:kqueue
• sys/fs/tmpfs/mount_test:large
• sys/fs/tmpfs/remove_test:uchg
• sys/kern/acct/acct_test:encode_tv_random_million
• sys/vfs/lookup_cap_dotdot:capmode__negative
• sys/vfs/lookup_cap_dotdot:lookup_cap_dotdot__advanced
• sys/vfs/lookup_cap_dotdot:lookup_cap_dotdot__basic
• sys/vfs/lookup_cap_dotdot:lookup_cap_dotdot__negative
• usr.bin/diff/diff_test:side_by_side
• usr.bin/grep/grep_test:color
• usr.bin/grep/grep_test:excessive_matches
• usr.bin/grep/grep_test:ocolor_metadata
• usr.bin/grep/grep_test:oflag_zerolen
• usr.sbin/extattr/extattr_test:long_name
• usr.sbin/makefs/makefs_cd9660_tests:o_flag_allow_max_name
• usr.sbin/makefs/makefs_cd9660_tests:o_flag_isolevel_1
• usr.sbin/makefs/makefs_ffs_tests:autocalculate_image_size

Skipped test cases

• bin/date/format_string_test:iso8601_date_parity
• bin/date/format_string_test:iso8601_default_parity
• bin/date/format_string_test:iso8601_hours_parity
• bin/date/format_string_test:iso8601_minutes_parity
• bin/date/format_string_test:iso8601_seconds_parity
• bin/dd/dd2_test:max_seek
• bin/dd/dd_test:length
• bin/pax/legacy_test:main
• lib/libc/gen/floatunditf_test:floatunditf
• lib/libc/gen/fpclassify_test:no_test
• lib/libc/gen/fpsetmask_test:no_test
• lib/libc/gen/fpsetround_test:fpsetround_basic
• lib/libc/gen/sethostname_test:sethostname_basic
• lib/libc/net/servent_test:servent
• lib/libc/rpc/rpc_test:get_svc_addr_tcp
• lib/libc/rpc/rpc_test:get_svc_addr_udp
• lib/libc/rpc/rpc_test:tcp
• lib/libc/rpc/rpc_test:tcp_poll
• lib/libc/rpc/rpc_test:udp
• lib/libc/rpc/rpc_test:udp_poll
• lib/libc/ssp/ssp_test:raw
• lib/libc/stdlib/strtod_test:strtod_round
• lib/libc/stdlib/strtod_test:strtold_inf
• lib/libc/stdlib/strtod_test:strtold_nan
• lib/libc/sys/getrusage_test:getrusage_utime_zero
• lib/libc/sys/kevent_test:kqueue_desc_passing
• lib/libc/sys/kevent_test:kqueue_unsupported_fd
• lib/libc/sys/mlock_test:mlock_err
• lib/libc/sys/mlock_test:mlock_mmap
• lib/libc/sys/mlock_test:mlock_nested
• lib/libc/sys/mlock_test:mlock_unaligned
• lib/libc/sys/revoke_test:revoke_basic
• lib/libc/sys/revoke_test:revoke_err
• lib/libc/sys/revoke_test:revoke_perm
• lib/libc/sys/setrlimit_test:setrlimit_memlock
• lib/libcam/libcam_test:cam_getccb_positive_test
• lib/libcam/libcam_test:cam_open_device_negative_test_O_RDONLY
• lib/libcam/libcam_test:cam_open_device_negative_test_unprivileged
• lib/libcam/libcam_test:cam_open_device_positive_test
• lib/msun/fe_round_test:t_nofe_round
• lib/msun/scalbn_test:scalbnl_inf_neg
• lib/msun/scalbn_test:scalbnl_inf_pos
• lib/msun/scalbn_test:scalbnl_nan
• lib/msun/scalbn_test:scalbnl_val
• lib/msun/scalbn_test:scalbnl_zero_neg
• lib/msun/scalbn_test:scalbnl_zero_pos
• local/atf/atf-c/detail/sanity_test:inv
• local/atf/atf-c/detail/sanity_test:post
• local/atf/atf-c/detail/sanity_test:pre
• local/atf/atf-c/detail/sanity_test:unreachable
• local/kyua/examples/syntax_test:kyua_conf
• local/kyua/examples/syntax_test:kyuafile_top__no_matches
• local/kyua/examples/syntax_test:kyuafile_top__some_matches
• local/kyua/integration/cmd_about_test:all_topics__installed
• local/kyua/integration/cmd_about_test:topic__authors__installed
• local/kyua/integration/cmd_about_test:topic__license__installed
• local/kyua/utils/cmdline/ui_test:ui__screen_width__columns_empty__tty
• local/kyua/utils/cmdline/ui_test:ui__screen_width__columns_invalid__tty
• local/kyua/utils/cmdline/ui_test:ui__screen_width__columns_set__tty
• local/kyua/utils/stacktrace_test:dump_stacktrace__integration
• local/lutok/examples_test:bindings
• local/lutok/examples_test:hello
• local/lutok/examples_test:interpreter
• local/lutok/examples_test:raii
• sbin/growfs/legacy_test:main
• sbin/pfctl/pfctl_test:pf0001
• sbin/pfctl/pfctl_test:pf0002
• sbin/pfctl/pfctl_test:pf0003
• sbin/pfctl/pfctl_test:pf0004
• sbin/pfctl/pfctl_test:pf0005
• sbin/pfctl/pfctl_test:pf0006
• sbin/pfctl/pfctl_test:pf0007
• sbin/pfctl/pfctl_test:pf0008
• sbin/pfctl/pfctl_test:pf0009
• sbin/pfctl/pfctl_test:pf0010
• sbin/pfctl/pfctl_test:pf0011
• sbin/pfctl/pfctl_test:pf0012
• sbin/pfctl/pfctl_test:pf0013
• sbin/pfctl/pfctl_test:pf0014
• sbin/pfctl/pfctl_test:pf0016
• sbin/pfctl/pfctl_test:pf0018
• sbin/pfctl/pfctl_test:pf0019
• sbin/pfctl/pfctl_test:pf0020
• sbin/pfctl/pfctl_test:pf0022
• sbin/pfctl/pfctl_test:pf0023
• sbin/pfctl/pfctl_test:pf0024
• sbin/pfctl/pfctl_test:pf0025
• sbin/pfctl/pfctl_test:pf0026
• sbin/pfctl/pfctl_test:pf0028
• sbin/pfctl/pfctl_test:pf0030
• sbin/pfctl/pfctl_test:pf0031
• sbin/pfctl/pfctl_test:pf0032
• sbin/pfctl/pfctl_test:pf0034
• sbin/pfctl/pfctl_test:pf0035
• sbin/pfctl/pfctl_test:pf0038
• sbin/pfctl/pfctl_test:pf0039
• sbin/pfctl/pfctl_test:pf0040
• sbin/pfctl/pfctl_test:pf0041
• sbin/pfctl/pfctl_test:pf0047
• sbin/pfctl/pfctl_test:pf0048
• sbin/pfctl/pfctl_test:pf0049
• sbin/pfctl/pfctl_test:pf0050
• sbin/pfctl/pfctl_test:pf0052
• sbin/pfctl/pfctl_test:pf0053
• sbin/pfctl/pfctl_test:pf0055
• sbin/pfctl/pfctl_test:pf0056
• sbin/pfctl/pfctl_test:pf0057
• sbin/pfctl/pfctl_test:pf0060
• sbin/pfctl/pfctl_test:pf0061
• sbin/pfctl/pfctl_test:pf0065
• sbin/pfctl/pfctl_test:pf0067
• sbin/pfctl/pfctl_test:pf0069
• sbin/pfctl/pfctl_test:pf0070
• sbin/pfctl/pfctl_test:pf0071
• sbin/pfctl/pfctl_test:pf0072
• sbin/pfctl/pfctl_test:pf0074
• sbin/pfctl/pfctl_test:pf0075
• sbin/pfctl/pfctl_test:pf0077
• sbin/pfctl/pfctl_test:pf0078
• sbin/pfctl/pfctl_test:pf0079
• sbin/pfctl/pfctl_test:pf0081
• sbin/pfctl/pfctl_test:pf0082
• sbin/pfctl/pfctl_test:pf0084
• sbin/pfctl/pfctl_test:pf0085
• sbin/pfctl/pfctl_test:pf0087
• sbin/pfctl/pfctl_test:pf0088
• sbin/pfctl/pfctl_test:pf0089
• sbin/pfctl/pfctl_test:pf0090
• sbin/pfctl/pfctl_test:pf0091
• sbin/pfctl/pfctl_test:pf0092
• sbin/pfctl/pfctl_test:pf0094
• sbin/pfctl/pfctl_test:pf0095
• sbin/pfctl/pfctl_test:pf0096
• sbin/pfctl/pfctl_test:pf0097
• sbin/pfctl/pfctl_test:pf0098
• sbin/pfctl/pfctl_test:pf0100
• sbin/pfctl/pfctl_test:pf0101
• sbin/pfctl/pfctl_test:pf0102
• sbin/pfctl/pfctl_test:pf0104
• sbin/pfctl/pfctl_test:pf1001
• sbin/pfctl/pfctl_test:pf1002
• sbin/pfctl/pfctl_test:pf1003
• sbin/pfctl/pfctl_test:pf1004
• sbin/pfctl/pfctl_test:pf1005
• sys/acl/01:main
• sys/acl/03:main
• sys/acl/04:main
• sys/aio/aio_test:aio_fsync_errors
• sys/aio/aio_test:aio_fsync_test
• sys/aio/aio_test:aio_large_read_test
• sys/aio/aio_test:fifo_poll
• sys/aio/aio_test:fifo_signal
• sys/aio/aio_test:fifo_suspend
• sys/aio/aio_test:fifo_thread
• sys/aio/aio_test:fifo_waitcomplete
• sys/aio/aio_test:file_poll
• sys/aio/aio_test:file_signal
• sys/aio/aio_test:file_suspend
• sys/aio/aio_test:file_thread
• sys/aio/aio_test:file_waitcomplete
• sys/aio/aio_test:pipe_poll
• sys/aio/aio_test:pipe_signal
• sys/aio/aio_test:pipe_suspend
• sys/aio/aio_test:pipe_thread
• sys/aio/aio_test:pipe_waitcomplete
• sys/aio/aio_test:pty_poll
• sys/aio/aio_test:pty_signal
• sys/aio/aio_test:pty_suspend
• sys/aio/aio_test:pty_thread
• sys/aio/aio_test:pty_waitcomplete
• sys/aio/lio_test:lio_listio_eagain_kevent
• sys/audit/miscellaneous:sysarch_success
• sys/geom/class/eli/misc_test:preserve_disk_props
• sys/geom/class/nop/nop_test:physpath_blank
• sys/geom/class/nop/nop_test:preserve_disk_props
• sys/kern/coredump_phnum_test:coredump_phnum
• sys/kern/kern_descrip_test:kern_maxfiles__increase
• sys/kern/mqueue_test:mqueue
• sys/mac/bsdextended/matches_test:main
• sys/mac/bsdextended/ugidfw_test:main
• sys/mac/portacl/nobody_test:main
• sys/mac/portacl/root_test:main
• sys/netinet/fibs_test:arpresolve_checks_interface_fib
• sys/netinet/fibs_test:default_route_with_multiple_fibs_on_same_subnet
• sys/netinet/fibs_test:default_route_with_multiple_fibs_on_same_subnet_inet6
• sys/netinet/fibs_test:loopback_and_network_routes_on_nondefault_fib
• sys/netinet/fibs_test:loopback_and_network_routes_on_nondefault_fib_inet6
• sys/netinet/fibs_test:same_ip_multiple_ifaces
• sys/netinet/fibs_test:same_ip_multiple_ifaces_fib0
• sys/netinet/fibs_test:same_ip_multiple_ifaces_inet6
• sys/netinet/fibs_test:slaac_on_nondefault_fib6
• sys/netinet/fibs_test:subnet_route_with_multiple_fibs_on_same_subnet
• sys/netinet/fibs_test:subnet_route_with_multiple_fibs_on_same_subnet_inet6
• sys/netinet/fibs_test:udp_dontroute
• sys/netinet/fibs_test:udp_dontroute6
• sys/netpfil/pf/anchor:pr183198
• sys/netpfil/pf/forward:v4
• sys/netpfil/pf/forward:v6
• sys/netpfil/pf/fragmentation:too_many_fragments
• sys/netpfil/pf/fragmentation:v6
• sys/netpfil/pf/ioctl/validation:addaddrs
• sys/netpfil/pf/ioctl/validation:addtables
• sys/netpfil/pf/ioctl/validation:clrastats
• sys/netpfil/pf/ioctl/validation:clrtstats
• sys/netpfil/pf/ioctl/validation:commit
• sys/netpfil/pf/ioctl/validation:cxbegin
• sys/netpfil/pf/ioctl/validation:cxrollback
• sys/netpfil/pf/ioctl/validation:deladdrs
• sys/netpfil/pf/ioctl/validation:deltables
• sys/netpfil/pf/ioctl/validation:getaddrs
• sys/netpfil/pf/ioctl/validation:gettables
• sys/netpfil/pf/ioctl/validation:gettstats
• sys/netpfil/pf/ioctl/validation:igetifaces
• sys/netpfil/pf/ioctl/validation:inadefine
• sys/netpfil/pf/ioctl/validation:setaddrs
• sys/netpfil/pf/ioctl/validation:settflags
• sys/netpfil/pf/ioctl/validation:tstaddrs
• sys/netpfil/pf/names:names
• sys/netpfil/pf/pass_block:noalias
• sys/netpfil/pf/pass_block:v4
• sys/netpfil/pf/pass_block:v6
• sys/netpfil/pf/pfsync:basic
• sys/netpfil/pf/pfsync:defer
• sys/netpfil/pf/route_to:v4
• sys/netpfil/pf/route_to:v6
• sys/netpfil/pf/set_skip:set_skip_group
• sys/netpfil/pf/set_tos:v4
• sys/netpfil/pf/synproxy:synproxy
• sys/opencrypto/blake2_test:blake2b_vectors
• sys/opencrypto/blake2_test:blake2s_vectors
• sys/opencrypto/poly1305_test:poly1305_vectors
• sys/opencrypto/runtests:main
• usr.bin/grep/grep_freebsd_test:grep_r_implied
• usr.bin/grep/grep_freebsd_test:rgrep
• usr.bin/lastcomm/legacy_test:main
• usr.bin/procstat/procstat_test:command_line_arguments
• usr.bin/procstat/procstat_test:environment
• usr.sbin/makefs/makefs_cd9660_tests:D_flag
• usr.sbin/makefs/makefs_ffs_tests:D_flag
• usr.sbin/sa/legacy_test:main