FreeBSD r363251 + fast path lookup root on ufs, /tmp on tmpfs DragonFlyBSD cfe603905713d4e92a7956678970d5dff8e913f2 root on hammer2, /tmp on tmpfs NetBSD as of Jul 18, top kernel commit: jmcneill at Fri Jul 17 21:59:30 2020 +0000 Remove 2 CPU limit in OCTEON interrupt controller driver. root on ufs, /tmp on tmpfs Hardware: 24 threads vms (2 threads per core) on Intel(R) Xeon(R) Platinum 8275CL CPU @ 3.00GHz 24GB RAM Running on top of Ubuntu 20.04. All systems had to get modified to stop issuing rdtscp on timestamp updates. Per-os notes: FreeBSD: patched with fast path lookup; sysctl vfs.timestamp_precision=1 DragonflyBSD: CPU is immune to meltdown but the system fails to recognize it protection disabled by hand; patched to compile without retpoline; disabled invariants sysctl vfs.timestamp_precision=1 NetBSD: does not support vfs.timestamp_precision=1, thus vfs_timestamp got patched to use getnanotime. The last 3 columns represent relative performance (%). FvD - FreeBSD versus DragonFlyBSD FvN - FreeBSD versus NetBSD DvN - DragonFlyBSD versus NetBSD t - processes or threads c - number of workers spawned Some tests failed to complete due to bugs/other issues and are represented as 0. To be fixed later. test t c FreeBSD DragonFlyBSD NetBSD FvD FvN DvN access1 p 01 3531657 1182389 1645703 298 214 71 access1 t 01 3559277 1218596 1677470 292 212 72 access1 p 24 49856247 9748619 3156731 511 1579 308 access1 t 24 48458247 9726003 2825702 498 1714 344 context_switch1 p 01 451153 1686291 166750 26 270 1011 context_switch1 t 01 460271 1620280 148198 28 310 1093 context_switch1 p 24 9388555 7234392 1150904 129 815 628 context_switch1 t 24 9377522 7335393 1160670 127 807 631 dup1 p 01 5628256 4801701 4865260 117 115 98 dup1 t 01 5294292 4412247 4317581 119 122 102 dup1 p 24 86047560 74557211 85831748 115 100 86 dup1 t 24 2374467 493931 1377578 480 172 35 fstat1 p 01 6776923 6167336 4296093 109 157 143 fstat1 t 01 6822132 6202663 4108816 109 166 150 fstat1 p 24 92209325 110845445 72971581 83 126 151 fstat1 t 24 96995751 110807251 69676926 87 139 159 getppid1 p 01 17794001 14638248 15624112 121 113 93 getppid1 t 01 17717990 14705005 15660465 120 113 93 getppid1 p 24 273833506 233795253 288569497 117 94 81 getppid1 t 24 278644601 232300358 281455002 119 99 82 lock1 p 01 4194708 5346356 4592282 78 91 116 lock1 t 01 4293975 4852050 4314068 88 99 112 lock1 p 24 50741150 62526633 3075353 81 1649 2033 lock1 t 24 54437392 63289309 3017026 86 1804 2097 lseek1 p 01 10740478 9251037 6654024 116 161 139 lseek1 t 01 10702480 9193003 6804887 116 157 135 lseek1 p 24 149718140 161928602 109306284 92 136 148 lseek1 t 24 187618319 162388465 101636011 115 184 159 lseek2 p 01 10394965 9225068 6845159 112 151 134 lseek2 t 01 10406084 9162207 6390806 113 162 143 lseek2 p 24 166385047 161139604 10460486 103 1590 1540 lseek2 t 24 184755368 162430863 8524044 113 2167 1905 mmap1 p 01 3354557 2403655 2567575 139 130 93 mmap1 t 01 1560407 2281812 2502097 68 62 91 mmap1 p 24 8699340 35436056 37263118 24 23 95 mmap1 t 24 990640 978478 532381 101 186 183 mmap2 p 01 1469031 352787 1158580 416 126 30 mmap2 t 01 1462375 345625 1101579 423 132 31 mmap2 p 24 2911820 5581495 14609898 52 19 38 mmap2 t 24 872839 333295 491532 261 177 67 open1 p 01 1896831 840185 1234276 225 153 68 open1 t 01 1829230 808676 1188972 226 153 68 open1 p 24 11066272 6107699 3218512 181 343 189 open1 t 24 1705162 354278 1069401 481 159 33 open2 p 01 1759783 701709 1131105 250 155 62 open2 t 01 1676961 684240 1092520 245 153 62 open2 p 24 10375960 5613703 3386692 184 306 165 open2 t 24 1581018 350478 1161322 451 136 30 open3 p 01 1909124 830863 1234504 229 154 67 open3 t 01 1837667 815458 1192514 225 154 68 open3 p 24 372351 1619985 1162676 22 32 139 open3 t 24 378385 341440 1188143 110 31 28 page_fault1 p 01 694562 400545 561169 173 123 71 page_fault1 t 01 708651 402460 562383 176 126 71 page_fault1 p 24 7009376 6539226 8183372 107 85 79 page_fault1 t 24 1159210 479833 114347 241 1013 419 page_fault2 p 01 576460 313367 492933 183 116 63 page_fault2 t 01 578624 316493 504573 182 114 62 page_fault2 p 24 1660855 4782210 6911752 34 24 69 page_fault2 t 24 1420878 385682 113215 368 1255 340 page_fault3 p 01 11339040 1040354 1884246 1089 601 55 page_fault3 t 01 9600818 1104165 1877850 869 511 58 page_fault3 p 24 132232302 17207622 27124620 768 487 63 page_fault3 t 24 7162733 434692 1596241 1647 448 27 pipe1 p 01 3531459 2646270 3147312 133 112 84 pipe1 t 01 3360592 2389077 2814457 140 119 84 pipe1 p 24 44464168 48953465 44621117 90 99 109 pipe1 t 24 46028534 45537037 39752539 101 115 114 poll1 p 01 8397076 3480291 5123667 241 163 67 poll1 t 01 7903895 3260993 4746143 242 166 68 poll1 p 24 134062749 57139741 89600740 234 149 63 poll1 t 24 10438443 54234165 84234697 19 12 64 poll2 p 01 310111 104393 258463 297 119 40 poll2 t 01 306938 103526 193453 296 158 53 poll2 p 24 4626003 1360230 1814736 340 254 74 poll2 t 24 4647695 652217 1523408 712 305 42 posix_semaphore1 p 01 50206317 5219092 5800401 961 865 89 posix_semaphore1 t 01 50494448 5282732 5262190 955 959 100 posix_semaphore1 p 24 658233899 104675398 107830168 628 610 97 posix_semaphore1 t 24 768078510 105795848 98696389 726 778 107 pread1 p 01 4430902 3134196 3219860 141 137 97 pread1 t 01 4440416 3345579 3103620 132 143 107 pread1 p 24 56574371 58345271 1452395 96 3895 4017 pread1 t 24 59601713 57312768 1514133 103 3936 3785 pread2 p 01 4007502 3345582 3049510 119 131 109 pread2 t 01 4091131 3323597 3042482 123 134 109 pread2 p 24 4637685 4996002 1419549 92 326 351 pread2 t 24 5069442 4941946 1348257 102 375 366 pread3 p 01 4008744 3473485 3230811 115 124 107 pread3 t 01 4054477 3566061 2910475 113 139 122 pread3 p 24 6760137 7529177 1380882 89 489 545 pread3 t 24 7323607 8121965 1576660 90 464 515 pthread_mutex1 p 01 220957222 261517497 242779285 84 91 107 pthread_mutex1 t 01 35312400 50846909 72181585 69 48 70 pthread_mutex1 p 24 3785119997 6089042880 5770631132 62 65 105 pthread_mutex1 t 24 10669720 1256733 6889711 849 154 18 pthread_mutex2 p 01 250119524 296482317 327413315 84 76 90 pthread_mutex2 t 01 35248732 50891382 72029419 69 48 70 pthread_mutex2 p 24 3786923198 5363475413 5920313263 70 63 90 pthread_mutex2 t 24 533035590 909083323 885254859 58 60 102 pwrite1 p 01 3991443 2723423 3001747 146 132 90 pwrite1 t 01 3938925 2281409 2851003 172 138 80 pwrite1 p 24 50414422 42582226 1338910 118 3765 3180 pwrite1 t 24 52053242 35988673 1302130 144 3997 2763 pwrite2 p 01 4004976 2751132 2970923 145 134 92 pwrite2 t 01 3011086 2180584 2842497 138 105 76 pwrite2 p 24 472045 460442 1338419 102 35 34 pwrite2 t 24 467334 471748 1205235 99 38 39 pwrite3 p 01 3914954 2763849 2996601 141 130 92 pwrite3 t 01 3094763 2731826 2372039 113 130 115 pwrite3 p 24 753675 524480 1753352 143 42 29 pwrite3 t 24 681683 507689 1601411 134 42 31 read1 p 01 3638425 2603372 2956693 139 123 88 read1 t 01 3594879 2580709 3055528 139 117 84 read1 p 24 32912513 36674246 1407076 89 2339 2606 read1 t 24 35804172 35765877 1553858 100 2304 2301 read2 p 01 3375129 2701368 3321191 124 101 81 read2 t 01 3307936 2593798 3148122 127 105 82 read2 p 24 6512502 6621155 1451036 98 448 456 read2 t 24 6895929 6299355 1349408 109 511 466 readseek1 p 01 2906652 2495066 2178880 116 133 114 readseek1 t 01 2871135 2305566 2177509 124 131 105 readseek1 p 24 39942055 39253586 1304666 101 3061 3008 readseek1 t 24 41405630 39991209 1320562 103 3135 3028 readseek2 p 01 2719724 2194029 2186399 123 124 100 readseek2 t 01 2785658 2285680 2141360 121 130 106 readseek2 p 24 4949481 4744821 1524319 104 324 311 readseek2 t 24 4782388 4835296 1525323 98 313 317 readseek3 p 01 2783532 2423874 2194571 114 126 110 readseek3 t 01 2765947 2382783 2077084 116 133 114 readseek3 p 24 6874719 6682177 1553090 102 442 430 readseek3 t 24 6740957 6522043 1490882 103 452 437 sched_yield p 01 8777043 7259902 599207937 120 1 1 sched_yield t 01 8847834 7203115 337791 122 2619 2132 sched_yield p 24 126424390 135695396 9967352472 93 1 1 sched_yield t 24 127211693 134831248 1524049 94 8346 8846 signal1 p 01 725028 1382091 922400 52 78 149 signal1 t 01 640401 1364394 916684 46 69 148 signal1 p 24 6719125 23273050 2419625 28 277 961 signal1 t 24 638994 2832956 619081 22 103 457 stat1 p 01 2739330 1103069 1563610 248 175 70 stat1 t 01 2736260 1123499 1574707 243 173 71 stat1 p 24 39809411 9355706 3042718 425 1308 307 stat1 t 24 40019314 9507481 2828438 420 1414 336 stat2 p 01 3021744 1162652 1646643 259 183 70 stat2 t 01 3038577 1146249 1665975 265 182 68 stat2 p 24 44015191 9379238 3205267 469 1373 292 stat2 t 24 44379178 9416729 3031397 471 1463 310 unix1 p 01 2253222 1695603 2201576 132 102 77 unix1 t 01 2163314 1564701 2025716 138 106 77 unix1 p 24 34033935 28066900 20637203 121 164 136 unix1 t 24 33721046 26751640 20321833 126 165 131 unlink1 p 01 467596 219403 250821 213 186 87 unlink1 t 01 446762 214884 250159 207 178 85 unlink1 p 24 179332 24996 128477 717 139 19 unlink1 t 24 186078 26364 129778 705 143 20 unlink2 p 01 425359 209327 248036 203 171 84 unlink2 t 01 417419 204993 244046 203 171 83 unlink2 p 24 761506 481452 502040 158 151 95 unlink2 t 24 753489 468157 499183 160 150 93 vfsmix p 01 118175 52867 73477 223 160 71 vfsmix t 01 117991 52269 72292 225 163 72 vfsmix p 24 76070 19054 44865 399 169 42 vfsmix t 24 29802 16938 22092 175 134 76 write1 p 01 2973979 2158239 2768032 137 107 77 write1 t 01 2660256 2089001 2470755 127 107 84 write1 p 24 37999734 33659531 1345854 112 2823 2500 write1 t 24 38995988 32702055 1353825 119 2880 2415 writeseek1 p 01 2766688 1740897 2175934 158 127 80 writeseek1 t 01 2592894 1732512 2089400 149 124 82 writeseek1 p 24 37689624 32002683 1306083 117 2885 2450 writeseek1 t 24 37369357 29014985 1341973 128 2784 2162 writeseek2 p 01 2704442 2092510 2172515 129 124 96 writeseek2 t 01 2134145 1736259 2051071 122 104 84 writeseek2 p 24 385942 482110 23634 80 1632 2039 writeseek2 t 24 371079 451809 24971 82 1486 1809 writeseek3 p 01 2779025 2018082 2186732 137 127 92 writeseek3 t 01 2238584 1982814 1806415 112 123 109 writeseek3 p 24 656150 512360 24150 128 2716 2121 writeseek3 t 24 633140 516554 23226 122 2725 2224