The machine is overloaded.
Previously, was also used to debug -current itself. This is incompatible with most of the needs above.
CPU: 40.7% user, 0.0% nice, 34.2% system, 0.6% interrupt, 24.5% idle; 1297 processes. That's a _light_ load.
The disk can be 100% busy for 10s of minutes at a time
The work directories are NFS mounted
Nothing has been scaled up since there were ~16000 ports on 3 branches; some things, not since there were half that (example: naive logfile compression)
4G RAM probably holds down ZFS performance