===> Testing for py312-bitsandbytes-0.50.2 ===> py312-bitsandbytes-0.50.2 depends on package: py312-einops>=0.8.0 - found ===> py312-bitsandbytes-0.50.2 depends on package: py312-lion-pytorch>=0.2.3 - found ===> py312-bitsandbytes-0.50.2 depends on package: py312-scipy>=1.11.4 - found ===> py312-bitsandbytes-0.50.2 depends on package: py312-transformers>=4.30.1 - found ===> py312-bitsandbytes-0.50.2 depends on package: py312-pytest>=7,1 - found ===> py312-bitsandbytes-0.50.2 depends on file: /usr/local/bin/python3.12 - found cd /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2 && /usr/bin/env -i HOME=/usr/ports/misc/py-bitsandbytes/work-py312 LANG=C.UTF-8 MACHINE_ARCH=amd64 PWD="${PWD}" GIT_CEILING_DIRECTORIES=/usr/ports/misc/py-bitsandbytes/work-py312 __MAKE_CONF=/nonexistent OSVERSION=1501501 PATH=/usr/local/libexec/ccache:/usr/ports/misc/py-bitsandbytes/work-py312/.bin:/home/yuri/.grok/bin:/home/yuri/.local/bin:/home/yuri/.bun/bin:/home/yuri/.bun/bin:/home/yuri/bin:/sbin:/bin:/usr/sbin:/usr/bin:/usr/local/sbin:/usr/local/bin TERM=xterm-256color XDG_DATA_HOME=/usr/ports/misc/py-bitsandbytes/work-py312 XDG_CONFIG_HOME=/usr/ports/misc/py-bitsandbytes/work-py312 XDG_CACHE_HOME=/usr/ports/misc/py-bitsandbytes/work-py312/.cache HOME=/usr/ports/misc/py-bitsandbytes/work-py312 PATH=/usr/local/libexec/ccache:/usr/ports/misc/py-bitsandbytes/work-py312/.bin:/home/yuri/.grok/bin:/home/yuri/.local/bin:/home/yuri/.bun/bin:/home/yuri/.bun/bin:/home/yuri/bin:/sbin:/bin:/usr/sbin:/usr/bin:/usr/local/sbin:/usr/local/bin PKG_CONFIG_LIBDIR=/usr/ports/misc/py-bitsandbytes/work-py312/.pkgconfig:/usr/local/libdata/pkgconfig:/usr/local/share/pkgconfig:/usr/libdata/pkgconfig MK_DEBUG_FILES=no MK_KERNEL_SYMBOLS=no SHELL=/bin/sh NO_LINT=YES PREFIX=/usr/local LOCALBASE=/usr/local CC="cc" CFLAGS="-O2 -pipe -fstack-protector-strong -fno-strict-aliasing " CPP="cpp" CPPFLAGS="" LDFLAGS=" " LIBS="" CXX="c++" CXXFLAGS="-O2 -pipe -fstack-protector-strong -fno-strict-aliasing " CCACHE_DIR="/var/ccache" BSD_INSTALL_PROGRAM="install -s -m 555" BSD_INSTALL_LIB="install -s -m 0644" BSD_INSTALL_SCRIPT="install -m 555" BSD_INSTALL_DATA="install -m 0644" BSD_INSTALL_MAN="install -m 444" PYTHONPATH=/usr/ports/misc/py-bitsandbytes/work-py312/stage/usr/local/lib/python3.12/site-packages /usr/local/bin/python3.12 -m pytest -k '' -rs -v -o addopts= ============================= test session starts ============================== platform freebsd15 -- Python 3.12.14, pytest-9.1.1, pluggy-1.6.0 -- /usr/local/bin/python3.12 codspeed: 5.0.3 (disabled, mode: walltime, callgraph: not supported, timer_resolution: 1.0ns) cachedir: .pytest_cache Matplotlib: 3.11.1 Freetype: 2.14.3 hypothesis profile 'default' benchmark: 5.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000) Using --randomly-seed=3637218289 rootdir: /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2 configfile: pyproject.toml testpaths: tests plugins: aspectlib-2.0.0, forked-1.6.0, pytest_httpserver-1.1.5, mpl-0.19.0, asyncio-1.4.0, cov-6.3.0, timeout-2.4.0, env-1.1.4, codspeed-5.0.3, langsmith-0.10.14, xdist-3.8.0, boost-histogram-1.8.1, filter-subpackage-0.2.0, doctestplus-1.7.1, xdoctest-1.3.2, remotedata-0.4.2, inline-snapshot-0.35.4, hypothesis-6.165.10, respx-0.23.1, services-2.2.2, rerunfailures-16.0.1, jaxtyping-0.3.11, dotenv-0.5.2, flask-1.3.0, cwltest-2.7.20260814150058, subprocess-1.5.4, pyfakefs-5.10.2, benchmark-5.2.3, recording-0.13.4, sugar-1.1.1, napari-plugin-engine-0.2.1, anyio-4.14.1, dash-4.4.1, flaky-3.8.1, examples-0.0.18, retry-1.7.0, flake8-1.3.0, socket-0.8.0, aiomisc-pytest-2.0.0, time-machine-2.13.0, arraydiff-0.7.0, httpx-0.29.0, randomly-4.1.0, mock-3.15.1, check-2.9.1, astropy-0.12.0, repeat-0.9.4, Faker-15.1.1, run-parallel-0.10.0, astropy-header-0.2.2, syrupy-2026.4.6.124150327040, skip-slow-1.1.0, requests-mock-1.12.1 asyncio: mode=Mode.STRICT, debug=False, asyncio_default_fixture_loop_scope=None, asyncio_default_test_loop_scope=function collecting ... ----------------------------- live log collection ------------------------------ WARNING bitsandbytes.backends.cpu.ops:ops.py:252 Failed to load CPU gemm_4bit_forward from kernels-community: No module named 'kernels'. Please make sure you already `pip install kernels` and the kernels >= 0.11.1 collected 3534 items Collected 0 items to run in parallel tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=T-bias=F-original_dtype1-bfloat16-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=F-bias=F-compress_statistics=T-fp32-nf4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=F-bias=F-compress_statistics=F-fp32-nf4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=T-bias=F-compress_statistics=F-bf16-fp4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=F-bias=F-compress_statistics=F-bf16-nf4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=T-bias=F-compress_statistics=T-bf16-nf4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=T-bias=F-compress_statistics=F-bf16-nf4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=T-bias=F-original_dtype1-uint8-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=T-bias=F-compress_statistics=T-fp32-nf4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_quant_storage_shard_roundtrip[fp32-fp4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=F-bias=F-compress_statistics=T-fp32-fp4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=F-bias=T-original_dtype1-bfloat16-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_params4bit_torch_chunk_split[nf4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=F-bias=F-original_dtype1-uint8-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile_activation_checkpointing[compress_statistics=T-fp4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_params4bit_real_serialization[compress_statistics=T-64-fp4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=T-bias=T-original_dtype0-bfloat16-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_params4bit_real_serialization[compress_statistics=F-64-nf4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=F-bias=T-original_dtype1-uint8-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_fsdp_state_dict_save_4bit SKIPPED (FS...) [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=T-bias=T-compress_statistics=T-fp32-fp4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=T-bias=T-compress_statistics=F-fp32-fp4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=F-bias=F-original_dtype0-bfloat16-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=F-bias=T-compress_statistics=T-bf16-nf4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=T-bias=T-compress_statistics=T-bf16-fp4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=F-bias=T-compress_statistics=T-bf16-fp4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_copy_param[compress_statistics=T-64-fp4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=F-bias=T-compress_statistics=F-bf16-fp4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_copy_param[compress_statistics=F-64-nf4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=T-bias=T-original_dtype1-uint8-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=F-bias=T-compress_statistics=F-fp32-fp4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=T-bias=T-compress_statistics=F-fp32-nf4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=T-bias=T-compress_statistics=F-bf16-nf4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=T-bias=T-original_dtype0-uint8-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=F-bias=T-compress_statistics=F-bf16-fp4-cpu] PASSED [ 0%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=T-bias=T-compress_statistics=F-fp32-nf4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=T-bias=T-compress_statistics=T-fp32-nf4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=T-bias=T-compress_statistics=T-fp32-fp4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=F-bias=T-compress_statistics=T-fp32-nf4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=T-bias=T-original_dtype1-bfloat16-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=F-bias=T-compress_statistics=F-bf16-nf4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=F-bias=T-compress_statistics=T-bf16-nf4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_deepcopy_param[compress_statistics=T-32-nf4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_deepcopy_param[compress_statistics=F-32-fp4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=F-bias=T-original_dtype0-uint8-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=F-bias=F-original_dtype1-bfloat16-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_copy_param[compress_statistics=F-128-nf4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=F-bias=F-original_dtype0-uint8-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear4bit_torch_compile_activation_checkpointing[compress_statistics=F-fp4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=T-bias=F-original_dtype0-bfloat16-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=F-bias=F-compress_statistics=T-bf16-fp4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=T-bias=F-compress_statistics=T-bf16-nf4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=T-bias=F-original_dtype0-uint8-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=F-bias=F-compress_statistics=F-fp32-fp4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=F-bias=F-compress_statistics=T-fp32-fp4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=F-bias=F-compress_statistics=F-fp32-nf4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_params4bit_real_serialization[compress_statistics=F-128-fp4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_deepcopy_param[compress_statistics=F-128-nf4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=T-bias=F-compress_statistics=F-fp32-fp4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=T-bias=F-compress_statistics=F-bf16-fp4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=T-bias=F-compress_statistics=T-bf16-fp4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=F-bias=T-original_dtype0-bfloat16-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=F-bias=F-original_dtype0-bfloat16-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=T-bias=T-original_dtype0-float16-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=T-bias=T-original_dtype1-float32-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=T-bias=F-original_dtype0-float32-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=T-bias=F-original_dtype1-float16-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=F-bias=F-original_dtype1-uint8-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=F-bias=F-compress_statistics=F-bf16-fp4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=F-bias=F-compress_statistics=T-bf16-fp4-cpu] PASSED [ 1%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=T-bias=T-original_dtype0-bfloat16-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=T-bias=F-original_dtype0-float16-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=F-bias=F-compress_statistics=T-fp32-fp4-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=T-bias=F-compress_statistics=T-fp32-nf4-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=T-bias=F-original_dtype1-float32-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=T-bias=F-compress_statistics=F-fp32-fp4-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=T-bias=F-compress_statistics=T-fp32-fp4-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=T-bias=F-original_dtype1-uint8-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=T-bias=T-original_dtype0-float32-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=F-bias=F-compress_statistics=F-bf16-nf4-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=T-bias=T-original_dtype1-float16-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=T-bias=F-compress_statistics=F-bf16-fp4-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=F-bias=T-original_dtype0-float16-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=F-bias=T-original_dtype1-bfloat16-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=T-bias=T-compress_statistics=F-bf16-nf4-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=T-bias=T-compress_statistics=T-bf16-nf4-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=F-bias=T-original_dtype1-float32-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=T-bias=T-compress_statistics=F-fp32-nf4-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=F-bias=T-compress_statistics=F-fp32-fp4-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=F-bias=T-compress_statistics=F-fp32-nf4-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=F-bias=F-original_dtype0-float32-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=T-bias=T-original_dtype1-uint8-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=F-bias=T-compress_statistics=T-fp32-nf4-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_deepcopy_param[compress_statistics=T-64-nf4-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=F-bias=F-original_dtype1-float16-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_deepcopy_param[compress_statistics=F-64-fp4-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=T-bias=T-compress_statistics=T-bf16-fp4-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_quant_storage_shard_roundtrip[fp16-fp4-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=F-bias=T-compress_statistics=T-bf16-nf4-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=F-bias=F-original_dtype0-float16-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=F-bias=F-original_dtype1-float32-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=T-bias=F-original_dtype1-bfloat16-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_params4bit_quant_state_attr_access[compress_statistics=F-fp4-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=F-bias=T-original_dtype0-float32-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=F-bias=T-original_dtype1-float16-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=F-bias=T-original_dtype1-uint8-cpu] PASSED [ 2%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=F-bias=T-original_dtype0-uint8-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_copy_param[compress_statistics=T-128-fp4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_copy_param[compress_statistics=T-32-fp4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_copy_param[compress_statistics=F-32-nf4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=F-bias=F-original_dtype0-float16-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_quant_storage_shard_roundtrip[uint8-nf4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=F-bias=F-original_dtype1-float32-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=F-bias=T-original_dtype0-bfloat16-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=F-bias=T-original_dtype0-float32-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=F-bias=T-original_dtype1-float16-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=F-bias=T-compress_statistics=T-fp32-nf4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=T-bias=T-compress_statistics=T-fp32-fp4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=T-bias=T-compress_statistics=T-bf16-fp4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=T-bias=T-compress_statistics=F-bf16-fp4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=F-bias=T-original_dtype0-float16-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=F-bias=T-original_dtype1-float32-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=T-bias=T-original_dtype0-uint8-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_params4bit_real_serialization[compress_statistics=T-128-nf4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=F-bias=T-compress_statistics=F-bf16-fp4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_params4bit_real_serialization[compress_statistics=T-32-fp4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_deepcopy_param[compress_statistics=T-128-fp4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=T-bias=T-compress_statistics=F-bf16-nf4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=F-bias=F-original_dtype0-float32-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_params4bit_real_serialization[compress_statistics=F-32-nf4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=F-bias=T-compress_statistics=T-fp32-fp4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=F-bias=F-original_dtype1-float16-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=T-bias=F-original_dtype0-bfloat16-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=F-bias=T-compress_statistics=F-fp32-fp4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=T-bias=F-compress_statistics=F-fp32-fp4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=T-bias=F-original_dtype0-float16-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=T-bias=F-original_dtype1-float32-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=F-bias=F-compress_statistics=F-fp32-nf4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=F-bias=F-compress_statistics=T-bf16-nf4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=F-bias=F-compress_statistics=F-bf16-nf4-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=T-bias=F-original_dtype0-uint8-cpu] PASSED [ 3%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=T-bias=T-original_dtype0-float32-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=T-bias=F-compress_statistics=T-bf16-nf4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_quant_storage_shard_roundtrip[bf16-fp4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=F-bias=F-compress_statistics=T-bf16-fp4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=T-bias=T-original_dtype1-float16-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=F-bias=F-original_dtype1-bfloat16-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=T-bias=F-compress_statistics=T-fp32-nf4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=T-bias=F-compress_statistics=F-fp32-nf4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=T-bias=T-original_dtype0-float16-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=F-bias=F-original_dtype0-uint8-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=T-bias=T-original_dtype1-float32-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=T-bias=F-original_dtype0-float32-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=T-bias=F-original_dtype1-float16-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=T-bias=T-original_dtype1-bfloat16-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_params4bit_quant_state_attr_access[compress_statistics=T-fp4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=F-bias=T-compress_statistics=T-bf16-fp4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_quant_storage_shard_roundtrip[fp16-nf4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=T-bias=T-compress_statistics=T-bf16-nf4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_deepcopy_param[compress_statistics=F-64-nf4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_deepcopy_param[compress_statistics=T-64-fp4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=F-bias=T-compress_statistics=T-fp32-fp4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=F-bias=T-compress_statistics=F-fp32-fp4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=F-bias=T-compress_statistics=F-fp32-nf4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=T-bias=T-compress_statistics=F-fp32-fp4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=T-bias=T-original_dtype0-uint8-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=T-bias=T-compress_statistics=T-bf16-fp4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=F-bias=T-original_dtype1-bfloat16-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=T-bias=T-compress_statistics=F-bf16-fp4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_params4bit_quant_state_attr_access[compress_statistics=F-nf4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=T-bias=F-original_dtype1-bfloat16-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=F-bias=T-original_dtype0-uint8-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=F-bias=F-original_dtype0-uint8-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=F-bias=F-original_dtype0-bfloat16-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=T-bias=F-compress_statistics=F-bf16-nf4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=F-bias=F-compress_statistics=F-bf16-fp4-cpu] PASSED [ 4%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=T-bias=F-compress_statistics=T-fp32-nf4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=T-bias=F-compress_statistics=F-fp32-nf4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=T-bias=T-original_dtype0-bfloat16-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=T-bias=F-compress_statistics=T-fp32-fp4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=F-bias=F-compress_statistics=T-fp32-nf4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=T-bias=F-original_dtype0-uint8-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=F-bias=F-compress_statistics=T-bf16-nf4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=F-bias=F-compress_statistics=F-bf16-nf4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=T-bias=F-compress_statistics=F-fp32-fp4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=T-bias=F-compress_statistics=T-fp32-fp4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=F-bias=F-compress_statistics=T-bf16-nf4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_quant_storage_shard_roundtrip[bf16-nf4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=T-bias=F-original_dtype1-uint8-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=F-bias=F-original_dtype1-bfloat16-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=T-bias=F-compress_statistics=T-bf16-fp4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=F-bias=F-compress_statistics=F-bf16-fp4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=F-bias=F-compress_statistics=T-bf16-fp4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=F-bias=F-compress_statistics=F-fp32-fp4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=T-bias=F-compress_statistics=F-fp32-nf4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_params4bit_quant_state_attr_access[compress_statistics=T-nf4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=T-bias=T-original_dtype1-bfloat16-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=F-bias=F-original_dtype1-uint8-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=F-bias=T-original_dtype1-uint8-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=F-bias=T-original_dtype0-bfloat16-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_quant_storage_shard_roundtrip[uint8-fp4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_copy_param[compress_statistics=F-32-fp4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_copy_param[compress_statistics=T-32-nf4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_copy_param[compress_statistics=T-128-nf4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=F-bias=T-compress_statistics=F-fp32-nf4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=F-bias=T-compress_statistics=T-fp32-nf4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_params4bit_real_serialization[compress_statistics=F-32-fp4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=T-bias=F-original_dtype0-bfloat16-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=T-bias=T-compress_statistics=F-bf16-fp4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=T-bias=T-original_dtype1-uint8-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_deepcopy_param[compress_statistics=T-128-nf4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_params4bit_real_serialization[compress_statistics=T-32-nf4-cpu] PASSED [ 5%] tests/test_linear4bit.py::test_params4bit_real_serialization[compress_statistics=T-128-fp4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=F-bias=T-compress_statistics=F-bf16-nf4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=T-bias=T-compress_statistics=F-bf16-nf4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=T-bias=T-compress_statistics=T-bf16-nf4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=T-bias=T-compress_statistics=T-fp32-nf4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=F-bias=T-compress_statistics=T-fp32-fp4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=F-bias=T-original_dtype0-float16-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=F-bias=T-original_dtype1-float32-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_params4bit_real_serialization[compress_statistics=F-64-fp4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=F-bias=F-original_dtype0-float32-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=F-bias=T-original_dtype0-uint8-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=F-bias=F-original_dtype1-float16-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_params4bit_real_serialization[compress_statistics=T-64-nf4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=T-bias=T-original_dtype0-bfloat16-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear4bit_torch_compile_activation_checkpointing[compress_statistics=T-nf4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=T-bias=T-compress_statistics=F-fp32-fp4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=F-bias=F-original_dtype0-float16-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=F-bias=F-original_dtype1-float32-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=F-bias=T-compress_statistics=F-fp32-nf4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_copy_param[compress_statistics=F-64-fp4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=F-bias=T-compress_statistics=F-bf16-nf4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_copy_param[compress_statistics=T-64-nf4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=F-bias=T-compress_statistics=T-bf16-nf4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=F-bias=F-original_dtype0-bfloat16-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=F-bias=T-original_dtype0-float32-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=T-bias=T-compress_statistics=T-bf16-nf4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=F-bias=T-original_dtype1-float16-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=F-bias=T-compress_statistics=T-bf16-fp4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=T-bias=T-original_dtype0-uint8-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=T-bias=T-compress_statistics=F-fp32-nf4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=T-bias=T-compress_statistics=T-fp32-nf4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=F-bias=F-compress_statistics=T-fp32-nf4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_quant_storage_shard_roundtrip[fp32-nf4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=T-bias=F-compress_statistics=T-fp32-fp4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=T-bias=F-compress_statistics=F-bf16-fp4-cpu] PASSED [ 6%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=T-bias=T-original_dtype0-float16-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=T-bias=F-compress_statistics=T-bf16-fp4-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=T-bias=T-original_dtype1-float32-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=F-bias=F-compress_statistics=F-bf16-fp4-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=T-bias=F-compress_statistics=F-bf16-nf4-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=T-bias=F-original_dtype0-float32-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=T-bias=F-original_dtype1-bfloat16-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=F-bias=F-compress_statistics=F-fp32-fp4-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=T-bias=F-original_dtype0-uint8-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=F-bias=F-compress_statistics=T-fp32-fp4-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=T-bias=F-original_dtype1-float16-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=T-bias=F-original_dtype0-float16-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_params4bit_torch_chunk_split[fp4-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=T-bias=F-original_dtype1-float32-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=F-bias=F-original_dtype0-uint8-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=F-bias=T-original_dtype1-bfloat16-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=T-bias=T-original_dtype0-float32-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=T-bias=T-original_dtype1-float16-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=T-bias=F-original_dtype0-float16-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=T-bias=F-original_dtype1-float32-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=T-bias=F-original_dtype0-bfloat16-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=F-bias=F-original_dtype1-uint8-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=T-bias=T-original_dtype0-float32-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear4bit_torch_compile_activation_checkpointing[compress_statistics=F-nf4-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=T-bias=T-original_dtype1-float16-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_copy_param[compress_statistics=F-128-fp4-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=T-bias=F-original_dtype1-uint8-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=T-bias=T-original_dtype0-float16-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=T-bias=F-compress_statistics=T-bf16-nf4-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=T-bias=T-original_dtype1-float32-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=F-bias=T-original_dtype0-bfloat16-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=T-bias=F-compress_statistics=F-bf16-nf4-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=T-bias=F-compress_statistics=F-fp32-nf4-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_deepcopy_param[compress_statistics=F-128-fp4-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_params4bit_real_serialization[compress_statistics=F-128-nf4-cpu] PASSED [ 7%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=F-bias=F-compress_statistics=F-fp32-fp4-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=F-bias=F-compress_statistics=T-fp32-nf4-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=F-bias=F-compress_statistics=F-fp32-nf4-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-fp4-compress_statistics=T-bias=F-original_dtype0-float32-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=T-bias=F-original_dtype1-float16-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=T-bias=F-compress_statistics=T-bf16-fp4-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=F-bias=F-compress_statistics=T-bf16-nf4-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=T-bias=T-original_dtype1-uint8-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=F-bias=T-compress_statistics=T-bf16-fp4-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=F-bias=T-compress_statistics=F-bf16-fp4-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=F-bias=F-original_dtype0-float16-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=F-bias=T-compress_statistics=T-fp32-fp4-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=T-bias=T-compress_statistics=T-fp32-nf4-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=T-bias=T-original_dtype1-bfloat16-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=F-bias=F-original_dtype1-float32-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=reduce-overhead-fullgraph=T-bias=T-compress_statistics=T-fp32-fp4-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=reduce-overhead-fullgraph=T-bias=T-compress_statistics=F-fp32-fp4-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=1-mode=default-fullgraph=F-bias=T-compress_statistics=F-bf16-nf4-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=F-bias=T-original_dtype0-float32-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=F-bias=T-original_dtype1-float16-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear4bit_torch_compile[batch_size=16-mode=default-fullgraph=T-bias=T-compress_statistics=F-bf16-fp4-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=F-nf4-compress_statistics=F-bias=F-original_dtype1-bfloat16-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=F-bias=T-original_dtype0-float16-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=F-bias=T-original_dtype1-float32-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=F-bias=T-original_dtype1-uint8-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_deepcopy_param[compress_statistics=F-32-nf4-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_deepcopy_param[compress_statistics=T-32-fp4-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-fp4-compress_statistics=F-bias=F-original_dtype0-float32-cpu] PASSED [ 8%] tests/test_linear4bit.py::test_linear_serialization[save_before_forward=T-nf4-compress_statistics=F-bias=F-original_dtype1-float16-cpu] PASSED [ 8%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-bf16-opt=lars] SKIPPED [ 8%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp16-opt=momentum] PASSED [ 8%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp16-opt=paged_ademamix] SKIPPED [ 8%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-bf16-opt=adam] PASSED [ 8%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp16-opt=adam] PASSED [ 8%] tests/test_optim.py::test_benchmark_blockwise[opt=paged_ademamix8bit_blockwise0-bf16-dim2=4096-dim1=4096] ERROR [ 8%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=1024-fp32-opt=ademamix8bit_blockwise] PASSED [ 8%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp16-opt=lars] PASSED [ 9%] tests/test_optim.py::test_lion32bit_weight_decay[device=cpu-dim2=1024-dim1=1024-fp32] PASSED [ 9%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp32-opt=momentum] PASSED [ 9%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp16-opt=ademamix_scheduled] PASSED [ 9%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-bf16-opt=paged_lion] SKIPPED [ 9%] tests/test_optim.py::test_benchmark_blockwise[opt=ademamix8bit_blockwise-fp32-dim2=4096-dim1=4096] ERROR [ 9%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp32-opt=momentum] PASSED [ 9%] tests/test_optim.py::test_benchmark_blockwise[opt=paged_lion8bit_blockwise-bf16-dim2=4096-dim1=4096] ERROR [ 9%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-bf16-opt=momentum] SKIPPED [ 9%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp16-opt=rmsprop] PASSED [ 9%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=1024-fp32-opt=adam8bit_blockwise] PASSED [ 9%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp32-opt=paged_lion] SKIPPED [ 9%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=4097-fp32-opt=ademamix8bit_blockwise_scheduled] PASSED [ 9%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=1024-bf16-opt=adam8bit_blockwise] PASSED [ 9%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp32-opt=paged_lion] SKIPPED [ 9%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp32-opt=lion] PASSED [ 9%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp16-opt=momentum] PASSED [ 9%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=1024-fp16-opt=ademamix8bit_blockwise] PASSED [ 9%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp16-opt=lion] PASSED [ 9%] tests/test_optim.py::test_benchmark_blockwise[opt=paged_lion8bit_blockwise-fp16-dim2=4096-dim1=4096] ERROR [ 9%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=32-bf16-opt=ademamix8bit_blockwise_scheduled] PASSED [ 9%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=1024-bf16-opt=momentum8bit_blockwise] PASSED [ 9%] tests/test_optim.py::test_lamb_max_unorm_threaded_to_config[max_unorm=2.0-opt=] PASSED [ 9%] tests/test_optim.py::test_benchmark_blockwise[opt=paged_ademamix8bit_blockwise_scheduled-fp32-dim2=4096-dim1=4096] ERROR [ 9%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-bf16-opt=lion] PASSED [ 9%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-bf16-opt=ademamix] PASSED [ 9%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp32-opt=paged_adam] SKIPPED [ 9%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=32-fp32-opt=lion8bit_blockwise] PASSED [ 9%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp32-opt=lars] PASSED [ 9%] tests/test_optim.py::test_lion32bit_weight_decay[device=cpu-dim2=32-dim1=1024-bf16] PASSED [ 9%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp32-opt=adam] PASSED [ 9%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp32-opt=paged_adam] SKIPPED [ 9%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=4097-fp16-opt=adam8bit_blockwise] PASSED [ 9%] tests/test_optim.py::test_ademamix_state_dict_no_nan[cpu-AdEMAMix8bit] PASSED [ 9%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=1024-fp16-opt=ademamix8bit_blockwise_scheduled] PASSED [ 9%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-bf16-opt=rmsprop] SKIPPED [ 10%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=4097-fp32-opt=rmsprop8bit_blockwise] PASSED [ 10%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=4097-bf16-opt=rmsprop8bit_blockwise] PASSED [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-bf16-opt=paged_adam] SKIPPED [ 10%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=32-bf16-opt=lion8bit_blockwise] PASSED [ 10%] tests/test_optim.py::test_lamb_max_unorm_changes_update PASSED [ 10%] tests/test_optim.py::test_benchmark_blockwise[opt=paged_ademamix8bit_blockwise0-fp16-dim2=4096-dim1=4096] ERROR [ 10%] tests/test_optim.py::test_benchmark_blockwise[opt=lion8bit_blockwise-fp32-dim2=4096-dim1=4096] ERROR [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp32-opt=paged_ademamix] SKIPPED [ 10%] tests/test_optim.py::test_ademamix_state_dict_no_nan[cpu-AdEMAMix32bit] PASSED [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp16-opt=paged_adam] SKIPPED [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp32-opt=rmsprop] PASSED [ 10%] tests/test_optim.py::test_global_config[cpu-fp16-dim2=1024-dim1=1024] PASSED [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp16-opt=lion] PASSED [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp16-opt=rmsprop] PASSED [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp16-opt=ademamix] PASSED [ 10%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=32-bf16-opt=momentum8bit_blockwise] PASSED [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp16-opt=paged_adam] SKIPPED [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp32-opt=paged_ademamix_scheduled] SKIPPED [ 10%] tests/test_optim.py::test_benchmark_blockwise[opt=ademamix8bit_blockwise_scheduled-fp16-dim2=4096-dim1=4096] ERROR [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp16-opt=paged_ademamix_scheduled] SKIPPED [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp32-opt=ademamix] PASSED [ 10%] tests/test_optim.py::test_ademamix_state_dict_no_nan[cpu-AdEMAMix32bit_scheduled] PASSED [ 10%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=32-fp16-opt=ademamix8bit_blockwise] PASSED [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-bf16-opt=ademamix] PASSED [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp16-opt=paged_ademamix] SKIPPED [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-bf16-opt=lion] PASSED [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp16-opt=rmsprop] PASSED [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-bf16-opt=ademamix] PASSED [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp32-opt=paged_ademamix_scheduled] SKIPPED [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp32-opt=lars] PASSED [ 10%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=1024-fp32-opt=rmsprop8bit_blockwise] PASSED [ 10%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=1024-fp32-opt=ademamix8bit_blockwise_scheduled] PASSED [ 10%] tests/test_optim.py::test_global_config[cpu-fp32-dim2=4097-dim1=1024] PASSED [ 10%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=4097-fp16-opt=momentum8bit_blockwise] PASSED [ 10%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp16-opt=paged_ademamix_scheduled] SKIPPED [ 11%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=1024-bf16-opt=rmsprop8bit_blockwise] PASSED [ 11%] tests/test_optim.py::test_benchmark_blockwise[opt=paged_ademamix8bit_blockwise1-fp16-dim2=4096-dim1=4096] ERROR [ 11%] tests/test_optim.py::test_benchmark_blockwise[opt=paged_adam8bit_blockwise-bf16-dim2=4096-dim1=4096] ERROR [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp32-opt=adam] PASSED [ 11%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=1024-fp16-opt=lion8bit_blockwise] PASSED [ 11%] tests/test_optim.py::test_lamb_max_unorm_threaded_to_config[max_unorm=2.0-opt=] PASSED [ 11%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=4097-bf16-opt=ademamix8bit_blockwise] PASSED [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-bf16-opt=paged_lion] SKIPPED [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp16-opt=ademamix_scheduled] PASSED [ 11%] tests/test_optim.py::test_override_config_after_register[cpu] PASSED [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-bf16-opt=paged_ademamix] SKIPPED [ 11%] tests/test_optim.py::test_benchmark_blockwise[opt=paged_adam8bit_blockwise-fp16-dim2=4096-dim1=4096] ERROR [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-bf16-opt=lars] SKIPPED [ 11%] tests/test_optim.py::test_global_config[cpu-fp32-dim2=32-dim1=1024] PASSED [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp16-opt=momentum] PASSED [ 11%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=32-fp32-opt=ademamix8bit_blockwise] PASSED [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-bf16-opt=adam] PASSED [ 11%] tests/test_optim.py::test_benchmark_blockwise[opt=paged_ademamix8bit_blockwise1-bf16-dim2=4096-dim1=4096] ERROR [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp16-opt=adam] PASSED [ 11%] tests/test_optim.py::test_lion32bit_weight_decay[device=cpu-dim2=1024-dim1=1024-fp16] PASSED [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp16-opt=paged_lion] SKIPPED [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp16-opt=ademamix_scheduled] PASSED [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp32-opt=paged_ademamix_scheduled] SKIPPED [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp16-opt=paged_lion] SKIPPED [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-bf16-opt=paged_ademamix] SKIPPED [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp16-opt=lars] PASSED [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp32-opt=momentum] PASSED [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp16-opt=paged_ademamix_scheduled] SKIPPED [ 11%] tests/test_optim.py::test_ademamix_state_dict_no_nan[cpu-AdEMAMix8bit_scheduled] PASSED [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp32-opt=paged_ademamix] SKIPPED [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-bf16-opt=paged_adam] SKIPPED [ 11%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=32-fp16-opt=adam8bit_blockwise] PASSED [ 11%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=4097-fp32-opt=lion8bit_blockwise] PASSED [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp32-opt=ademamix_scheduled] PASSED [ 11%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp32-opt=paged_ademamix_scheduled] SKIPPED [ 11%] tests/test_optim.py::test_benchmark_blockwise[opt=adam8bit_blockwise-fp32-dim2=4096-dim1=4096] ERROR [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp16-opt=paged_ademamix_scheduled] SKIPPED [ 12%] tests/test_optim.py::test_lamb_max_unorm_threaded_to_config[max_unorm=0.5-opt=] PASSED [ 12%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=32-fp32-opt=rmsprop8bit_blockwise] PASSED [ 12%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=4097-bf16-opt=lion8bit_blockwise] PASSED [ 12%] tests/test_optim.py::test_benchmark_blockwise[opt=ademamix8bit_blockwise_scheduled-bf16-dim2=4096-dim1=4096] ERROR [ 12%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=4097-fp32-opt=momentum8bit_blockwise] PASSED [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-bf16-opt=ademamix_scheduled] PASSED [ 12%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=32-bf16-opt=rmsprop8bit_blockwise] PASSED [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp32-opt=lion] PASSED [ 12%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=4097-fp16-opt=ademamix8bit_blockwise_scheduled] PASSED [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-bf16-opt=rmsprop] SKIPPED [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp32-opt=paged_adamw] SKIPPED [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-bf16-opt=paged_adam] SKIPPED [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp32-opt=adam] PASSED [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-bf16-opt=lion] PASSED [ 12%] tests/test_optim.py::test_lamb_max_unorm_threaded_to_config[max_unorm=0.0-opt=] PASSED [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp32-opt=ademamix_scheduled] PASSED [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-bf16-opt=paged_ademamix] SKIPPED [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp32-opt=lars] PASSED [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp32-opt=ademamix] PASSED [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-bf16-opt=paged_ademamix_scheduled] SKIPPED [ 12%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=32-fp16-opt=ademamix8bit_blockwise_scheduled] PASSED [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-bf16-opt=paged_adam] SKIPPED [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp16-opt=lion] PASSED [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-bf16-opt=paged_adamw] SKIPPED [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-bf16-opt=rmsprop] SKIPPED [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp16-opt=ademamix] PASSED [ 12%] tests/test_optim.py::test_benchmark_blockwise[opt=paged_ademamix8bit_blockwise0-fp32-dim2=4096-dim1=4096] ERROR [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp32-opt=paged_adam] SKIPPED [ 12%] tests/test_optim.py::test_benchmark_blockwise[opt=lion8bit_blockwise-fp16-dim2=4096-dim1=4096] ERROR [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-bf16-opt=ademamix_scheduled] PASSED [ 12%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=1024-fp16-opt=momentum8bit_blockwise] PASSED [ 12%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=1024-fp16-opt=rmsprop8bit_blockwise] PASSED [ 12%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-bf16-opt=paged_ademamix_scheduled] SKIPPED [ 12%] tests/test_optim.py::test_benchmark_blockwise[opt=ademamix8bit_blockwise-bf16-dim2=4096-dim1=4096] ERROR [ 13%] tests/test_optim.py::test_benchmark_blockwise[opt=paged_lion8bit_blockwise-fp32-dim2=4096-dim1=4096] ERROR [ 13%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=32-bf16-opt=adam8bit_blockwise] PASSED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp16-opt=paged_lion] SKIPPED [ 13%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=4097-fp16-opt=lion8bit_blockwise] PASSED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp16-opt=ademamix_scheduled] PASSED [ 13%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=1024-bf16-opt=ademamix8bit_blockwise] PASSED [ 13%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=1024-bf16-opt=ademamix8bit_blockwise_scheduled] PASSED [ 13%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=32-fp32-opt=adam8bit_blockwise] PASSED [ 13%] tests/test_optim.py::test_lamb8bit_rejects_amsgrad PASSED [ 13%] tests/test_optim.py::test_benchmark_blockwise[opt=paged_ademamix8bit_blockwise_scheduled-fp16-dim2=4096-dim1=4096] ERROR [ 13%] tests/test_optim.py::test_benchmark_blockwise[opt=ademamix8bit_blockwise-fp16-dim2=4096-dim1=4096] ERROR [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp32-opt=momentum] PASSED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp16-opt=adam] PASSED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-bf16-opt=momentum] SKIPPED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp16-opt=lars] PASSED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp32-opt=paged_lion] SKIPPED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp32-opt=paged_adamw] SKIPPED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp32-opt=rmsprop] PASSED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp32-opt=lion] PASSED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-bf16-opt=paged_lion] SKIPPED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-bf16-opt=lars] SKIPPED [ 13%] tests/test_optim.py::test_benchmark_blockwise[opt=paged_ademamix8bit_blockwise_scheduled-bf16-dim2=4096-dim1=4096] ERROR [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-bf16-opt=paged_lion] SKIPPED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-bf16-opt=paged_adamw] SKIPPED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-bf16-opt=adam] PASSED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-bf16-opt=paged_ademamix_scheduled] SKIPPED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp16-opt=momentum] PASSED [ 13%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=1024-bf16-opt=lion8bit_blockwise] PASSED [ 13%] tests/test_optim.py::test_lion32bit_weight_decay[device=cpu-dim2=32-dim1=1024-fp16] PASSED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp16-opt=paged_adam] SKIPPED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp32-opt=ademamix_scheduled] PASSED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp16-opt=paged_adamw] SKIPPED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-bf16-opt=paged_ademamix_scheduled] SKIPPED [ 13%] tests/test_optim.py::test_lamb_max_unorm_threaded_to_config[max_unorm=0.5-opt=] PASSED [ 13%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-bf16-opt=momentum] SKIPPED [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-bf16-opt=ademamix_scheduled] PASSED [ 14%] tests/test_optim.py::test_adagrad8bit_rejects_non_8_optim_bits PASSED [ 14%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=1024-fp32-opt=lion8bit_blockwise] PASSED [ 14%] tests/test_optim.py::test_benchmark_blockwise[opt=lion8bit_blockwise-bf16-dim2=4096-dim1=4096] ERROR [ 14%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=32-fp16-opt=rmsprop8bit_blockwise] PASSED [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp16-opt=paged_adamw] SKIPPED [ 14%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=1024-fp32-opt=momentum8bit_blockwise] PASSED [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-bf16-opt=paged_adamw] SKIPPED [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp32-opt=paged_adamw] SKIPPED [ 14%] tests/test_optim.py::test_lamb8bit_rejects_non_default_max_unorm PASSED [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp32-opt=paged_adam] SKIPPED [ 14%] tests/test_optim.py::test_benchmark_blockwise[opt=adam8bit_blockwise-fp16-dim2=4096-dim1=4096] ERROR [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp32-opt=paged_adamw] SKIPPED [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-bf16-opt=paged_adamw] SKIPPED [ 14%] tests/test_optim.py::test_global_config[cpu-fp16-dim2=32-dim1=1024] PASSED [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-bf16-opt=paged_ademamix] SKIPPED [ 14%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=4097-fp32-opt=ademamix8bit_blockwise] PASSED [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp16-opt=paged_lion] SKIPPED [ 14%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=4097-bf16-opt=adam8bit_blockwise] PASSED [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-bf16-opt=rmsprop] SKIPPED [ 14%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=32-fp32-opt=momentum8bit_blockwise] PASSED [ 14%] tests/test_optim.py::test_benchmark_blockwise[opt=paged_adam8bit_blockwise-fp32-dim2=4096-dim1=4096] ERROR [ 14%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=4097-bf16-opt=ademamix8bit_blockwise_scheduled] PASSED [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-bf16-opt=adam] PASSED [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp32-opt=paged_ademamix] SKIPPED [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp32-opt=lion] PASSED [ 14%] tests/test_optim.py::test_lion32bit_weight_decay[device=cpu-dim2=32-dim1=1024-fp32] PASSED [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-bf16-opt=lars] SKIPPED [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp16-opt=paged_adamw] SKIPPED [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-bf16-opt=momentum] SKIPPED [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp16-opt=paged_ademamix] SKIPPED [ 14%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=4097-fp32-opt=adam8bit_blockwise] PASSED [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp16-opt=lars] PASSED [ 14%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=32-fp16-opt=lion8bit_blockwise] PASSED [ 14%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp16-opt=adam] PASSED [ 14%] tests/test_optim.py::test_global_config[cpu-fp16-dim2=4097-dim1=1024] PASSED [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp32-opt=ademamix_scheduled] PASSED [ 15%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=4097-fp16-opt=ademamix8bit_blockwise] PASSED [ 15%] tests/test_optim.py::test_benchmark_blockwise[opt=paged_ademamix8bit_blockwise1-fp32-dim2=4096-dim1=4096] ERROR [ 15%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=32-fp32-opt=ademamix8bit_blockwise_scheduled] PASSED [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp32-opt=ademamix] PASSED [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp32-opt=paged_ademamix] SKIPPED [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp16-opt=paged_ademamix] SKIPPED [ 15%] tests/test_optim.py::test_lion32bit_weight_decay[device=cpu-dim2=1024-dim1=1024-bf16] PASSED [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-bf16-opt=ademamix_scheduled] PASSED [ 15%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=4097-bf16-opt=momentum8bit_blockwise] PASSED [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp16-opt=ademamix] PASSED [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp32-opt=paged_lion] SKIPPED [ 15%] tests/test_optim.py::test_global_config[cpu-fp32-dim2=1024-dim1=1024] PASSED [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp16-opt=rmsprop] PASSED [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-fp16-opt=lion] PASSED [ 15%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=32-bf16-opt=ademamix8bit_blockwise] PASSED [ 15%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=4097-fp16-opt=rmsprop8bit_blockwise] PASSED [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp16-opt=ademamix] PASSED [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp32-opt=rmsprop] PASSED [ 15%] tests/test_optim.py::test_lamb_max_unorm_threaded_to_config[max_unorm=0.0-opt=] PASSED [ 15%] tests/test_optim.py::test_benchmark_blockwise[opt=ademamix8bit_blockwise_scheduled-fp32-dim2=4096-dim1=4096] ERROR [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-bf16-opt=lion] PASSED [ 15%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=1024-fp16-opt=adam8bit_blockwise] PASSED [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp32-opt=lars] PASSED [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=32-dim1=1024-fp32-opt=ademamix] PASSED [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp16-opt=paged_adam] SKIPPED [ 15%] tests/test_optim.py::test_benchmark_blockwise[opt=adam8bit_blockwise-bf16-dim2=4096-dim1=4096] ERROR [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=4097-dim1=1024-bf16-opt=ademamix] PASSED [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp16-opt=paged_adamw] SKIPPED [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1024-dim1=1024-fp32-opt=rmsprop] PASSED [ 15%] tests/test_optim.py::test_optimizer8bit[cpu-dim1=1024-dim2=32-fp16-opt=momentum8bit_blockwise] PASSED [ 15%] tests/test_optim.py::test_optimizer32bit[device=cpu-dim2=1-dim1=1024-fp32-opt=adam] PASSED [ 15%] tests/test_parametrize.py::TestParametrizationCacheCounterUnderCheckpointing::test_counter_balanced_under_checkpoint_early_stop PASSED [ 15%] tests/test_parametrize.py::TestParametrizationCacheCounterUnderCheckpointing::test_counter_never_goes_negative PASSED [ 15%] tests/test_parametrize.py::test_replace_parameter_4bit[256-compress_statistics=T-nf4-fp16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_replace_parameter_4bit[256-compress_statistics=T-nf4-fp32-cpu] PASSED [ 16%] tests/test_parametrize.py::test_replace_parameter_4bit[256-compress_statistics=F-nf4-bf16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_replace_parameter_4bit[128-compress_statistics=T-fp4-fp16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_replace_parameter_4bit[128-compress_statistics=F-fp4-bf16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_replace_parameter_4bit[128-compress_statistics=T-fp4-fp32-cpu] PASSED [ 16%] tests/test_parametrize.py::test_prequantized_replacement[fp4-fp16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_state_dict_functionality[compress_statistics=T-fp4-fp16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_moe_parameter_shape[fp32-cpu] PASSED [ 16%] tests/test_parametrize.py::test_different_blocksizes[64-fp16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_state_dict_functionality[compress_statistics=T-fp4-fp32-cpu] PASSED [ 16%] tests/test_parametrize.py::test_moe_parameter_shape[fp16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_different_blocksizes[64-fp32-cpu] PASSED [ 16%] tests/test_parametrize.py::test_prequantized_replacement[fp4-fp32-cpu] PASSED [ 16%] tests/test_parametrize.py::test_state_dict_functionality[compress_statistics=F-fp4-bf16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_replace_parameter_4bit[64-compress_statistics=T-fp4-fp32-cpu] PASSED [ 16%] tests/test_parametrize.py::test_replace_parameter_4bit[64-compress_statistics=F-fp4-bf16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_replace_parameter_4bit[64-compress_statistics=T-fp4-fp16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_different_blocksizes[128-bf16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_different_blocksizes[256-fp16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_multiple_parameters[fp16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_replace_parameter_4bit[128-compress_statistics=F-nf4-fp16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_multiple_parameters[fp32-cpu] PASSED [ 16%] tests/test_parametrize.py::test_replace_parameter_4bit[128-compress_statistics=F-nf4-fp32-cpu] PASSED [ 16%] tests/test_parametrize.py::test_replace_parameter_4bit[128-compress_statistics=T-nf4-bf16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_different_blocksizes[256-fp32-cpu] PASSED [ 16%] tests/test_parametrize.py::test_replace_parameter_4bit[256-compress_statistics=F-fp4-fp16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_quant_state_preservation[fp32-cpu] PASSED [ 16%] tests/test_parametrize.py::test_moe_realistic_forward[bf16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_replace_parameter_4bit[256-compress_statistics=T-fp4-bf16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_replace_parameter_4bit[256-compress_statistics=F-fp4-fp32-cpu] PASSED [ 16%] tests/test_parametrize.py::test_quant_state_preservation[fp16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_replace_parameter_4bit[64-compress_statistics=T-nf4-bf16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_gradient_behavior[bf16-cpu] PASSED [ 16%] tests/test_parametrize.py::test_replace_parameter_4bit[64-compress_statistics=F-nf4-fp32-cpu] PASSED [ 16%] tests/test_parametrize.py::test_replace_parameter_4bit[64-compress_statistics=F-nf4-fp16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_state_dict_functionality[compress_statistics=F-nf4-fp16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_state_dict_functionality[compress_statistics=T-nf4-bf16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_state_dict_functionality[compress_statistics=F-nf4-fp32-cpu] PASSED [ 17%] tests/test_parametrize.py::test_prequantized_replacement[nf4-bf16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_error_conditions PASSED [ 17%] tests/test_parametrize.py::test_gradient_behavior[fp16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_replace_parameter_4bit[64-compress_statistics=T-nf4-fp16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_gradient_behavior[fp32-cpu] PASSED [ 17%] tests/test_parametrize.py::test_replace_parameter_4bit[64-compress_statistics=T-nf4-fp32-cpu] PASSED [ 17%] tests/test_parametrize.py::test_replace_parameter_4bit[64-compress_statistics=F-nf4-bf16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_state_dict_functionality[compress_statistics=T-nf4-fp32-cpu] PASSED [ 17%] tests/test_parametrize.py::test_prequantized_replacement[nf4-fp32-cpu] PASSED [ 17%] tests/test_parametrize.py::test_state_dict_functionality[compress_statistics=F-nf4-bf16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_prequantized_replacement[nf4-fp16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_state_dict_functionality[compress_statistics=T-nf4-fp16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_replace_parameter_4bit[128-compress_statistics=F-nf4-bf16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_multiple_parameters[bf16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_different_blocksizes[256-bf16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_replace_parameter_4bit[128-compress_statistics=T-nf4-fp32-cpu] PASSED [ 17%] tests/test_parametrize.py::test_replace_parameter_4bit[128-compress_statistics=T-nf4-fp16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_replace_parameter_4bit[256-compress_statistics=T-fp4-fp32-cpu] PASSED [ 17%] tests/test_parametrize.py::test_moe_realistic_forward[fp32-cpu] PASSED [ 17%] tests/test_parametrize.py::test_replace_parameter_4bit[256-compress_statistics=F-fp4-bf16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_quant_state_preservation[bf16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_replace_parameter_4bit[256-compress_statistics=T-fp4-fp16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_moe_realistic_forward[fp16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_different_blocksizes[64-bf16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_state_dict_functionality[compress_statistics=T-fp4-bf16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_state_dict_functionality[compress_statistics=F-fp4-fp32-cpu] PASSED [ 17%] tests/test_parametrize.py::test_prequantized_replacement[fp4-bf16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_state_dict_functionality[compress_statistics=F-fp4-fp16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_moe_parameter_shape[bf16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_parametrization_forward_method PASSED [ 17%] tests/test_parametrize.py::test_replace_parameter_4bit[64-compress_statistics=F-fp4-fp16-cpu] PASSED [ 17%] tests/test_parametrize.py::test_different_blocksizes[128-fp32-cpu] PASSED [ 17%] tests/test_parametrize.py::test_different_blocksizes[128-fp16-cpu] PASSED [ 18%] tests/test_parametrize.py::test_replace_parameter_4bit[64-compress_statistics=T-fp4-bf16-cpu] PASSED [ 18%] tests/test_parametrize.py::test_replace_parameter_4bit[64-compress_statistics=F-fp4-fp32-cpu] PASSED [ 18%] tests/test_parametrize.py::test_replace_parameter_4bit[256-compress_statistics=T-nf4-bf16-cpu] PASSED [ 18%] tests/test_parametrize.py::test_replace_parameter_4bit[256-compress_statistics=F-nf4-fp32-cpu] PASSED [ 18%] tests/test_parametrize.py::test_replace_parameter_4bit[256-compress_statistics=F-nf4-fp16-cpu] PASSED [ 18%] tests/test_parametrize.py::test_replace_parameter_4bit[128-compress_statistics=F-fp4-fp32-cpu] PASSED [ 18%] tests/test_parametrize.py::test_replace_parameter_4bit[128-compress_statistics=T-fp4-bf16-cpu] PASSED [ 18%] tests/test_parametrize.py::test_replace_parameter_4bit[128-compress_statistics=F-fp4-fp16-cpu] PASSED [ 18%] tests/test_cuda_setup_evaluator.py::test_version_selection[spec1-fake_libs1-None-libbitsandbytes_cuda121.so-True] PASSED [ 18%] tests/test_cuda_setup_evaluator.py::test_rocm_override PASSED [ 18%] tests/test_cuda_setup_evaluator.py::test_version_selection[spec5-fake_libs5-None-libbitsandbytes_cuda129.so-False] PASSED [ 18%] tests/test_cuda_setup_evaluator.py::test_version_selection[spec3-fake_libs3-7.13.0-libbitsandbytes_rocm72.so-True] PASSED [ 18%] tests/test_cuda_setup_evaluator.py::test_version_selection[spec2-fake_libs2-None-libbitsandbytes_cuda128.so-True] PASSED [ 18%] tests/test_cuda_setup_evaluator.py::test_override PASSED [ 18%] tests/test_cuda_setup_evaluator.py::test_version_selection[spec0-fake_libs0-None-libbitsandbytes_cuda124.so-False] PASSED [ 18%] tests/test_cuda_setup_evaluator.py::test_version_selection[spec4-fake_libs4-None-libbitsandbytes_cuda118.so-False] PASSED [ 18%] tests/test_cuda_setup_evaluator.py::test_override_invalid_format PASSED [ 18%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_blockwise_non_contiguous[128-dtype=bf16-cpu] PASSED [ 18%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_blockwise_non_contiguous[256-dtype=bf16-cpu] PASSED [ 18%] tests/test_ops.py::TestNonContiguousInputs::test_dequantize_blockwise_non_contiguous[64-dtype=fp32-cpu] PASSED [ 18%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_blockwise_non_contiguous[64-dtype=bf16-cpu] PASSED [ 18%] tests/test_ops.py::TestNonContiguousInputs::test_dequantize_blockwise_non_contiguous[64-dtype=fp16-cpu] PASSED [ 18%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_roundtrip_non_contiguous[256-fp4-dtype=fp16-cpu] SKIPPED [ 18%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_non_contiguous[128-nf4-dtype=bf16-cpu] SKIPPED [ 18%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_non_contiguous[256-fp4-dtype=fp32-cpu] SKIPPED [ 18%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_roundtrip_non_contiguous[256-fp4-dtype=fp32-cpu] SKIPPED [ 18%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_roundtrip_non_contiguous[128-nf4-dtype=bf16-cpu] SKIPPED [ 18%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_non_contiguous[256-fp4-dtype=fp16-cpu] SKIPPED [ 18%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_non_contiguous[64-fp4-dtype=fp16-cpu] SKIPPED [ 18%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_non_contiguous[64-fp4-dtype=fp32-cpu] SKIPPED [ 18%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_roundtrip_non_contiguous[64-nf4-dtype=bf16-cpu] SKIPPED [ 18%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_roundtrip_non_contiguous[256-nf4-dtype=fp32-cpu] SKIPPED [ 18%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_non_contiguous[256-nf4-dtype=fp16-cpu] SKIPPED [ 18%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_roundtrip_non_contiguous[128-fp4-dtype=bf16-cpu] SKIPPED [ 18%] tests/test_ops.py::TestNonContiguousInputs::test_dequantize_blockwise_non_contiguous[128-dtype=bf16-cpu] PASSED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_dequantize_blockwise_non_contiguous[256-dtype=bf16-cpu] PASSED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_non_contiguous[128-fp4-dtype=bf16-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_roundtrip_non_contiguous[256-nf4-dtype=fp16-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_non_contiguous[256-nf4-dtype=fp32-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_non_contiguous[64-nf4-dtype=fp32-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_roundtrip_non_contiguous[64-fp4-dtype=bf16-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_non_contiguous[64-nf4-dtype=fp16-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_dequantize_blockwise_non_contiguous[256-dtype=fp32-cpu] PASSED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_dequantize_blockwise_non_contiguous[128-dtype=fp32-cpu] PASSED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_roundtrip_non_contiguous[128-fp4-dtype=fp16-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_non_contiguous[256-nf4-dtype=bf16-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_non_contiguous[128-fp4-dtype=fp32-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_roundtrip_non_contiguous[128-fp4-dtype=fp32-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_roundtrip_non_contiguous[256-nf4-dtype=bf16-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_non_contiguous[128-fp4-dtype=fp16-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_dequantize_blockwise_non_contiguous[256-dtype=fp16-cpu] PASSED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_dequantize_blockwise_non_contiguous[128-dtype=fp16-cpu] PASSED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_roundtrip_non_contiguous[64-fp4-dtype=fp16-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_roundtrip_non_contiguous[64-fp4-dtype=fp32-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_non_contiguous[64-nf4-dtype=bf16-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_roundtrip_non_contiguous[128-nf4-dtype=fp32-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_non_contiguous[128-nf4-dtype=fp16-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_roundtrip_non_contiguous[256-fp4-dtype=bf16-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_non_contiguous[256-fp4-dtype=bf16-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_roundtrip_non_contiguous[128-nf4-dtype=fp16-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_non_contiguous[128-nf4-dtype=fp32-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_roundtrip_non_contiguous[64-nf4-dtype=fp32-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_non_contiguous[64-fp4-dtype=bf16-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_4bit_roundtrip_non_contiguous[64-nf4-dtype=fp16-cpu] SKIPPED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_blockwise_non_contiguous[64-dtype=fp16-cpu] PASSED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_blockwise_non_contiguous[64-dtype=fp32-cpu] PASSED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_dequantize_blockwise_non_contiguous[64-dtype=bf16-cpu] PASSED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_blockwise_non_contiguous[256-dtype=fp16-cpu] PASSED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_blockwise_non_contiguous[128-dtype=fp16-cpu] PASSED [ 19%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_blockwise_non_contiguous[256-dtype=fp32-cpu] PASSED [ 20%] tests/test_ops.py::TestNonContiguousInputs::test_quantize_blockwise_non_contiguous[128-dtype=fp32-cpu] PASSED [ 20%] tests/test_ops.py::TestLLMInt8Ops::test_int8_scaled_mm[True-dtype=bf16-cpu] PASSED [ 20%] tests/test_ops.py::TestLLMInt8Ops::test_int8_scaled_mm[False-dtype=fp32-cpu] PASSED [ 20%] tests/test_ops.py::TestLLMInt8Ops::test_int8_linear_matmul[cpu] PASSED [ 20%] tests/test_ops.py::TestLLMInt8Ops::test_int8_scaled_mm[False-dtype=fp16-cpu] PASSED [ 20%] tests/test_ops.py::TestLLMInt8Ops::test_int8_vectorwise_quant[cpu-0.0] PASSED [ 20%] tests/test_ops.py::TestLLMInt8Ops::test_int8_mm_dequant[cpu] PASSED [ 20%] tests/test_ops.py::TestLLMInt8Ops::test_int8_vectorwise_quant[cpu-6.0] PASSED [ 20%] tests/test_ops.py::TestLLMInt8Ops::test_int8_scaled_mm[False-dtype=bf16-cpu] PASSED [ 20%] tests/test_ops.py::TestLLMInt8Ops::test_int8_linear_matmul_out[cpu] PASSED [ 20%] tests/test_ops.py::TestLLMInt8Ops::test_int8_scaled_mm[True-dtype=fp32-cpu] PASSED [ 20%] tests/test_ops.py::TestLLMInt8Ops::test_int8_scaled_mm[True-dtype=fp16-cpu] PASSED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_quantize_blockwise[512-dtype=fp32-cpu] SKIPPED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_dequantize_blockwise[128-dtype=fp16-cpu] PASSED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_dequantize_blockwise[256-dtype=fp16-cpu] PASSED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_dequantize_blockwise[128-dtype=fp32-cpu] PASSED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_dequantize_blockwise[256-dtype=fp32-cpu] PASSED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_quantize_blockwise[512-dtype=fp16-cpu] SKIPPED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_quantize_blockwise[128-dtype=fp32-cpu] SKIPPED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_quantize_blockwise[256-dtype=fp32-cpu] PASSED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_dequantize_blockwise[512-dtype=fp16-cpu] PASSED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_dequantize_blockwise[64-dtype=fp32-cpu] PASSED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_dequantize_blockwise[512-dtype=fp32-cpu] PASSED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_dequantize_blockwise[64-dtype=fp16-cpu] PASSED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_quantize_blockwise[128-dtype=fp16-cpu] SKIPPED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_quantize_blockwise[256-dtype=fp16-cpu] PASSED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_quantize_blockwise[64-dtype=fp32-cpu] SKIPPED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_quantize_blockwise[64-dtype=fp16-cpu] SKIPPED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_dequantize_blockwise[512-dtype=bf16-cpu] PASSED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_quantize_blockwise[256-dtype=bf16-cpu] PASSED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_quantize_blockwise[128-dtype=bf16-cpu] SKIPPED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_dequantize_blockwise[64-dtype=bf16-cpu] PASSED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_quantize_blockwise[64-dtype=bf16-cpu] SKIPPED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_dequantize_blockwise[256-dtype=bf16-cpu] PASSED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_dequantize_blockwise[128-dtype=bf16-cpu] PASSED [ 20%] tests/test_ops.py::TestInt8BlockwiseQuantOps::test_quantize_blockwise[512-dtype=bf16-cpu] SKIPPED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[128-nf4-storage_dtype=bf16-dtype=fp16-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit_not_divisible_by_blocksize[64-nf4-dtype=fp16-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-nf4-compress_statistics=T-has_bias=T-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[64-nf4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[512-nf4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[256-nf4-storage_dtype=bf16-dtype=bf16-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-fp4-compress_statistics=F-has_bias=F-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[512-nf4-storage_dtype=bf16-dtype=fp16-cpu] XFAIL [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[512-nf4-storage_dtype=bf16-dtype=fp32-cpu] XFAIL [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[128-fp4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-nf4-compress_statistics=T-has_bias=F-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-nf4-compress_statistics=T-has_bias=F-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[128-nf4-storage_dtype=bf16-dtype=fp32-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-nf4-compress_statistics=F-has_bias=F-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit_not_divisible_by_blocksize[64-nf4-dtype=fp32-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[64-nf4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[512-nf4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[256-nf4-storage_dtype=bf16-dtype=fp16-cpu] XFAIL [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-fp4-compress_statistics=F-has_bias=T-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-fp4-compress_statistics=F-has_bias=T-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-nf4-compress_statistics=F-has_bias=T-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[32-nf4-storage_dtype=bf16-dtype=fp16-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[512-nf4-storage_dtype=bf16-dtype=bf16-cpu] SKIPPED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[128-nf4-storage_dtype=bf16-dtype=bf16-cpu] XFAIL [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[32-nf4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[256-nf4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[32-fp4-storage_dtype=bf16-dtype=fp16-cpu] XFAIL [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[32-nf4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-fp4-compress_statistics=F-has_bias=F-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-fp4-compress_statistics=F-has_bias=T-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[32-fp4-storage_dtype=bf16-dtype=fp32-cpu] XFAIL [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[64-fp4-storage_dtype=bf16-dtype=bf16-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[64-nf4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[256-nf4-storage_dtype=bf16-dtype=fp32-cpu] XFAIL [ 21%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[32-nf4-storage_dtype=bf16-dtype=fp32-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-nf4-compress_statistics=T-has_bias=F-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[256-fp4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-fp4-compress_statistics=T-has_bias=T-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-fp4-compress_statistics=T-has_bias=T-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[32-fp4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[512-fp4-storage_dtype=bf16-dtype=fp32-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-fp4-compress_statistics=F-has_bias=T-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit_not_divisible_by_blocksize[64-fp4-dtype=fp32-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[512-fp4-storage_dtype=bf16-dtype=fp16-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-fp4-compress_statistics=T-has_bias=F-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-fp4-compress_statistics=T-has_bias=F-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit_not_divisible_by_blocksize[64-fp4-dtype=fp16-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[64-fp4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-nf4-compress_statistics=F-has_bias=T-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[32-fp4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-nf4-compress_statistics=F-has_bias=T-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[256-fp4-storage_dtype=bf16-dtype=fp32-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-nf4-compress_statistics=F-has_bias=F-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[64-fp4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[512-fp4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[32-nf4-storage_dtype=bf16-dtype=fp16-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-fp4-compress_statistics=T-has_bias=T-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-nf4-compress_statistics=F-has_bias=F-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-nf4-compress_statistics=F-has_bias=F-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[64-fp4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[512-fp4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[128-fp4-storage_dtype=bf16-dtype=bf16-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[32-nf4-storage_dtype=bf16-dtype=fp32-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[64-nf4-storage_dtype=bf16-dtype=bf16-cpu] XFAIL [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-fp4-compress_statistics=F-has_bias=F-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[64-fp4-storage_dtype=bf16-dtype=bf16-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[128-nf4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[256-fp4-storage_dtype=bf16-dtype=fp16-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-nf4-compress_statistics=T-has_bias=T-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 22%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-nf4-compress_statistics=F-has_bias=F-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[64-nf4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[512-nf4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[128-nf4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[512-nf4-storage_dtype=bf16-dtype=fp32-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-nf4-compress_statistics=T-has_bias=F-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-nf4-compress_statistics=T-has_bias=F-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[128-fp4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-fp4-compress_statistics=F-has_bias=F-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[128-nf4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[512-nf4-storage_dtype=bf16-dtype=fp16-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[128-fp4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[64-nf4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-nf4-compress_statistics=T-has_bias=T-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[512-fp4-storage_dtype=uint8-dtype=bf16-cpu] SKIPPED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[32-nf4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[256-nf4-storage_dtype=bf16-dtype=fp32-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit_not_divisible_by_blocksize[128-fp4-dtype=bf16-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[256-nf4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit_not_divisible_by_blocksize[256-nf4-dtype=fp32-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[32-nf4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[32-fp4-storage_dtype=bf16-dtype=fp16-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-fp4-compress_statistics=F-has_bias=F-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-fp4-compress_statistics=F-has_bias=T-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[256-fp4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[256-nf4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[64-fp4-storage_dtype=bf16-dtype=bf16-cpu] XFAIL [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[32-nf4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit_not_divisible_by_blocksize[256-nf4-dtype=fp16-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[128-nf4-storage_dtype=bf16-dtype=bf16-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[32-fp4-storage_dtype=bf16-dtype=fp32-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[256-fp4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[64-nf4-storage_dtype=bf16-dtype=bf16-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[256-nf4-storage_dtype=bf16-dtype=fp16-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-fp4-compress_statistics=F-has_bias=T-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-fp4-compress_statistics=F-has_bias=T-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 23%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-nf4-compress_statistics=F-has_bias=T-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[256-nf4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[32-fp4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[128-fp4-storage_dtype=bf16-dtype=fp16-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[256-fp4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-nf4-compress_statistics=F-has_bias=T-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[256-fp4-storage_dtype=bf16-dtype=bf16-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-fp4-compress_statistics=T-has_bias=F-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-fp4-compress_statistics=T-has_bias=F-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[512-fp4-storage_dtype=bf16-dtype=fp16-cpu] XFAIL [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-fp4-compress_statistics=F-has_bias=T-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[512-fp4-storage_dtype=bf16-dtype=fp32-cpu] XFAIL [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[256-nf4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-fp4-compress_statistics=T-has_bias=T-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-fp4-compress_statistics=T-has_bias=T-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[32-fp4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[128-fp4-storage_dtype=bf16-dtype=fp32-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[256-fp4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-nf4-compress_statistics=T-has_bias=F-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit_non_float32_offset[bf16-bf16-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[32-fp4-storage_dtype=bf16-dtype=fp16-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[256-fp4-storage_dtype=bf16-dtype=fp16-cpu] XFAIL [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[128-nf4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-nf4-compress_statistics=T-has_bias=T-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[512-fp4-storage_dtype=bf16-dtype=bf16-cpu] SKIPPED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[128-fp4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit_not_divisible_by_blocksize[256-fp4-dtype=fp16-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[512-fp4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[128-fp4-storage_dtype=bf16-dtype=bf16-cpu] XFAIL [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-fp4-compress_statistics=F-has_bias=F-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-nf4-compress_statistics=F-has_bias=F-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-nf4-compress_statistics=F-has_bias=F-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[64-fp4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[32-nf4-storage_dtype=bf16-dtype=fp16-cpu] XFAIL [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[32-fp4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 24%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-fp4-compress_statistics=T-has_bias=T-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[64-nf4-storage_dtype=bf16-dtype=bf16-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[512-nf4-storage_dtype=uint8-dtype=bf16-cpu] SKIPPED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[64-fp4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[32-nf4-storage_dtype=bf16-dtype=fp32-cpu] XFAIL [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[32-fp4-storage_dtype=bf16-dtype=fp32-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[256-fp4-storage_dtype=bf16-dtype=fp32-cpu] XFAIL [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit_non_float32_offset[fp16-bf16-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit_not_divisible_by_blocksize[128-nf4-dtype=bf16-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[128-nf4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-nf4-compress_statistics=F-has_bias=F-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-nf4-compress_statistics=F-has_bias=T-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[128-fp4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit_not_divisible_by_blocksize[256-fp4-dtype=fp32-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-fp4-compress_statistics=F-has_bias=T-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[512-fp4-storage_dtype=bf16-dtype=bf16-cpu] XFAIL [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-nf4-compress_statistics=T-has_bias=T-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-nf4-compress_statistics=T-has_bias=T-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[256-fp4-storage_dtype=bf16-dtype=fp16-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-nf4-compress_statistics=T-has_bias=F-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[256-fp4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[128-fp4-storage_dtype=bf16-dtype=bf16-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-nf4-compress_statistics=F-has_bias=T-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-nf4-compress_statistics=T-has_bias=F-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[32-fp4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[256-nf4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-fp4-compress_statistics=T-has_bias=F-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[256-fp4-storage_dtype=bf16-dtype=fp32-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[64-fp4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[32-nf4-storage_dtype=bf16-dtype=bf16-cpu] XFAIL [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[64-nf4-storage_dtype=bf16-dtype=fp32-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[512-nf4-storage_dtype=uint8-dtype=fp32-cpu] SKIPPED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[128-fp4-storage_dtype=bf16-dtype=fp16-cpu] XFAIL [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[32-fp4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-fp4-compress_statistics=F-has_bias=T-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 25%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-fp4-compress_statistics=T-has_bias=T-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[512-fp4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[128-fp4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[512-fp4-storage_dtype=bf16-dtype=fp16-cpu] SKIPPED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit_not_divisible_by_blocksize[256-fp4-dtype=bf16-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit_not_divisible_by_blocksize[128-nf4-dtype=fp32-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit_non_float32_offset[bf16-fp16-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[32-fp4-storage_dtype=bf16-dtype=bf16-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-nf4-compress_statistics=F-has_bias=F-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[256-fp4-storage_dtype=bf16-dtype=bf16-cpu] XFAIL [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[512-fp4-storage_dtype=bf16-dtype=fp32-cpu] SKIPPED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[128-nf4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit_not_divisible_by_blocksize[128-nf4-dtype=fp16-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit_non_float32_offset[fp16-fp16-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-fp4-compress_statistics=F-has_bias=F-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-fp4-compress_statistics=F-has_bias=F-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-nf4-compress_statistics=T-has_bias=T-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[64-nf4-storage_dtype=bf16-dtype=fp16-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[512-nf4-storage_dtype=uint8-dtype=fp16-cpu] SKIPPED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[128-fp4-storage_dtype=bf16-dtype=fp32-cpu] XFAIL [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[32-fp4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-fp4-compress_statistics=F-has_bias=F-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[512-fp4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-fp4-compress_statistics=T-has_bias=T-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[128-nf4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[512-nf4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[32-nf4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-nf4-compress_statistics=T-has_bias=T-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[512-fp4-storage_dtype=uint8-dtype=fp32-cpu] SKIPPED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[64-nf4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-fp4-compress_statistics=T-has_bias=F-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[512-nf4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-fp4-compress_statistics=T-has_bias=F-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[32-nf4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[512-fp4-storage_dtype=uint8-dtype=fp16-cpu] SKIPPED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[128-fp4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 26%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-fp4-compress_statistics=T-has_bias=T-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[512-nf4-storage_dtype=bf16-dtype=bf16-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[128-nf4-storage_dtype=bf16-dtype=fp32-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[32-fp4-storage_dtype=bf16-dtype=bf16-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[64-fp4-storage_dtype=bf16-dtype=fp32-cpu] XFAIL [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-fp4-compress_statistics=T-has_bias=F-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-nf4-compress_statistics=F-has_bias=T-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-nf4-compress_statistics=F-has_bias=T-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[256-nf4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit_not_divisible_by_blocksize[128-fp4-dtype=fp16-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[64-nf4-storage_dtype=bf16-dtype=fp32-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-nf4-compress_statistics=T-has_bias=F-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[256-nf4-storage_dtype=bf16-dtype=bf16-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[64-nf4-storage_dtype=bf16-dtype=fp16-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-nf4-compress_statistics=F-has_bias=F-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[128-nf4-storage_dtype=bf16-dtype=fp16-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[256-fp4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit_not_divisible_by_blocksize[256-nf4-dtype=bf16-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[32-nf4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[64-fp4-storage_dtype=bf16-dtype=fp16-cpu] XFAIL [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit_not_divisible_by_blocksize[128-fp4-dtype=fp32-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-fp4-compress_statistics=T-has_bias=F-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[256-fp4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[32-fp4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-nf4-compress_statistics=F-has_bias=T-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-nf4-compress_statistics=T-has_bias=F-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[64-fp4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[256-fp4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-nf4-compress_statistics=T-has_bias=F-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[64-fp4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit_not_divisible_by_blocksize[64-fp4-dtype=bf16-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-fp4-compress_statistics=F-has_bias=T-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[512-fp4-storage_dtype=bf16-dtype=bf16-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-nf4-compress_statistics=T-has_bias=T-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-nf4-compress_statistics=T-has_bias=T-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 27%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[64-nf4-storage_dtype=bf16-dtype=fp32-cpu] XFAIL [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[128-fp4-storage_dtype=bf16-dtype=fp32-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-fp4-compress_statistics=F-has_bias=F-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[32-nf4-storage_dtype=bf16-dtype=bf16-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[512-fp4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-fp4-compress_statistics=F-has_bias=F-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-nf4-compress_statistics=T-has_bias=T-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-fp4-compress_statistics=F-has_bias=F-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[128-nf4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[64-fp4-storage_dtype=bf16-dtype=fp32-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[256-fp4-storage_dtype=bf16-dtype=bf16-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-nf4-compress_statistics=F-has_bias=F-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[128-nf4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[64-fp4-storage_dtype=bf16-dtype=fp16-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[64-nf4-storage_dtype=bf16-dtype=fp16-cpu] XFAIL [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-fp4-compress_statistics=F-has_bias=T-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[128-fp4-storage_dtype=bf16-dtype=fp16-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-fp4-compress_statistics=T-has_bias=T-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[64-fp4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-fp4-compress_statistics=T-has_bias=T-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[512-nf4-storage_dtype=bf16-dtype=bf16-cpu] XFAIL [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[128-fp4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[256-nf4-storage_dtype=bf16-dtype=fp16-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[512-nf4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit_not_divisible_by_blocksize[64-nf4-dtype=bf16-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-fp4-compress_statistics=T-has_bias=F-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-fp4-compress_statistics=T-has_bias=F-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[128-nf4-storage_dtype=bf16-dtype=bf16-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-nf4-compress_statistics=T-has_bias=T-storage_dtype=bf16-requires_grad=T-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[64-nf4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[128-fp4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[256-nf4-storage_dtype=bf16-dtype=fp32-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-fp4-compress_statistics=T-has_bias=T-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[64-fp4-storage_dtype=bf16-dtype=fp32-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[64-nf4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 28%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[32-fp4-storage_dtype=bf16-dtype=bf16-cpu] XFAIL [ 29%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[32-nf4-storage_dtype=uint8-dtype=bf16-cpu] PASSED [ 29%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[256-nf4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 29%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[128-nf4-storage_dtype=bf16-dtype=fp16-cpu] XFAIL [ 29%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp32-nf4-compress_statistics=F-has_bias=F-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 29%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[512-nf4-storage_dtype=bf16-dtype=fp16-cpu] SKIPPED [ 29%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[256-nf4-storage_dtype=bf16-dtype=bf16-cpu] XFAIL [ 29%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[32-nf4-storage_dtype=bf16-dtype=bf16-cpu] PASSED [ 29%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-nf4-compress_statistics=T-has_bias=F-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 29%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[512-nf4-storage_dtype=bf16-dtype=fp32-cpu] SKIPPED [ 29%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[bf16-nf4-compress_statistics=F-has_bias=T-storage_dtype=uint8-requires_grad=F-cpu] PASSED [ 29%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-nf4-compress_statistics=F-has_bias=T-storage_dtype=uint8-requires_grad=T-cpu] PASSED [ 29%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_dequantize_4bit[64-fp4-storage_dtype=bf16-dtype=fp16-cpu] PASSED [ 29%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemv_4bit[64-nf4-storage_dtype=uint8-dtype=fp16-cpu] PASSED [ 29%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[256-nf4-storage_dtype=uint8-dtype=fp32-cpu] PASSED [ 29%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_quantize_4bit[128-nf4-storage_dtype=bf16-dtype=fp32-cpu] XFAIL [ 29%] tests/test_ops.py::Test4bitBlockwiseQuantOps::test_gemm_4bit[fp16-fp4-compress_statistics=T-has_bias=F-storage_dtype=bf16-requires_grad=F-cpu] PASSED [ 29%] tests/test_linear8bitlt.py::test_linear8bitlt_torch_compile[mode=reduce-overhead-fullgraph=F-bias=T-threshold=0.0-cpu] PASSED [ 29%] tests/test_linear8bitlt.py::test_linear8bitlt_torch_compile[mode=default-fullgraph=T-bias=F-threshold=6.0-cpu] PASSED [ 29%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=T-save_before_forward=F-deserialize_before_cuda=F-serialize_before_forward=T-threshold=6.0-has_fp16_weights=F-cpu] PASSED [ 29%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=F-save_before_forward=F-deserialize_before_cuda=T-serialize_before_forward=F-threshold=6.0-has_fp16_weights=F-cpu] PASSED [ 29%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=T-save_before_forward=F-deserialize_before_cuda=F-serialize_before_forward=F-threshold=0.0-has_fp16_weights=F-cpu] PASSED [ 29%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=F-save_before_forward=F-deserialize_before_cuda=T-serialize_before_forward=T-threshold=0.0-has_fp16_weights=F-cpu] PASSED [ 29%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=F-save_before_forward=T-deserialize_before_cuda=F-serialize_before_forward=F-threshold=6.0-has_fp16_weights=F-cpu] PASSED [ 29%] tests/test_linear8bitlt.py::test_linear8bitlt_torch_compile[mode=reduce-overhead-fullgraph=F-bias=F-threshold=0.0-cpu] PASSED [ 29%] tests/test_linear8bitlt.py::test_linear8bitlt_torch_compile[mode=default-fullgraph=T-bias=T-threshold=6.0-cpu] PASSED [ 29%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=T-save_before_forward=T-deserialize_before_cuda=T-serialize_before_forward=T-threshold=6.0-has_fp16_weights=F-cpu] PASSED [ 29%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=F-save_before_forward=T-deserialize_before_cuda=F-serialize_before_forward=T-threshold=0.0-has_fp16_weights=F-cpu] PASSED [ 29%] tests/test_linear8bitlt.py::test_linear8bit_serialization[NOTSET] SKIPPED [ 29%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=T-save_before_forward=T-deserialize_before_cuda=T-serialize_before_forward=F-threshold=0.0-has_fp16_weights=F-cpu] PASSED [ 29%] tests/test_linear8bitlt.py::test_linear8bit_state_dict_skips_scb_for_tied_weight PASSED [ 29%] tests/test_linear8bitlt.py::test_linear8bit_deepcopy_param[NOTSET] SKIPPED [ 29%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=T-save_before_forward=T-deserialize_before_cuda=F-serialize_before_forward=T-threshold=0.0-has_fp16_weights=F-cpu] PASSED [ 29%] tests/test_linear8bitlt.py::test_linear8bitlt_torch_compile[mode=reduce-overhead-fullgraph=T-bias=T-threshold=6.0-cpu] PASSED [ 29%] tests/test_linear8bitlt.py::test_linear8bitlt_torch_compile[mode=default-fullgraph=F-bias=F-threshold=0.0-cpu] PASSED [ 29%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=F-save_before_forward=T-deserialize_before_cuda=T-serialize_before_forward=F-threshold=0.0-has_fp16_weights=F-cpu] PASSED [ 29%] tests/test_linear8bitlt.py::test_linear8bit_load_state_dict_raises_runtime_for_tied_weight PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=T-save_before_forward=T-deserialize_before_cuda=F-serialize_before_forward=F-threshold=6.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=F-save_before_forward=T-deserialize_before_cuda=T-serialize_before_forward=T-threshold=6.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=F-save_before_forward=F-deserialize_before_cuda=F-serialize_before_forward=F-threshold=0.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear8bitlt_torch_compile[mode=reduce-overhead-fullgraph=T-bias=F-threshold=6.0-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear8bitlt_torch_compile[mode=default-fullgraph=F-bias=T-threshold=0.0-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=T-save_before_forward=F-deserialize_before_cuda=T-serialize_before_forward=T-threshold=0.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=F-save_before_forward=F-deserialize_before_cuda=F-serialize_before_forward=T-threshold=6.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=T-save_before_forward=F-deserialize_before_cuda=T-serialize_before_forward=F-threshold=6.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear8bitlt_torch_compile[mode=default-fullgraph=F-bias=F-threshold=6.0-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear8bitlt_torch_compile[mode=reduce-overhead-fullgraph=T-bias=T-threshold=0.0-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=T-save_before_forward=T-deserialize_before_cuda=T-serialize_before_forward=F-threshold=6.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=F-save_before_forward=T-deserialize_before_cuda=F-serialize_before_forward=T-threshold=6.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear8bitlt_device_movement[NOTSET] SKIPPED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=T-save_before_forward=T-deserialize_before_cuda=T-serialize_before_forward=T-threshold=0.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=F-save_before_forward=T-deserialize_before_cuda=F-serialize_before_forward=F-threshold=0.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=F-save_before_forward=F-deserialize_before_cuda=T-serialize_before_forward=T-threshold=6.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear8bitlt_torch_compile[mode=default-fullgraph=F-bias=T-threshold=6.0-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear8bitlt_torch_compile[mode=reduce-overhead-fullgraph=T-bias=F-threshold=0.0-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=T-save_before_forward=F-deserialize_before_cuda=F-serialize_before_forward=F-threshold=6.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=F-save_before_forward=F-deserialize_before_cuda=T-serialize_before_forward=F-threshold=0.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=T-save_before_forward=F-deserialize_before_cuda=F-serialize_before_forward=T-threshold=0.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_no_igemmlt[cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=T-save_before_forward=F-deserialize_before_cuda=T-serialize_before_forward=F-threshold=0.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear8bitlt_torch_compile[mode=default-fullgraph=T-bias=F-threshold=0.0-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear8bitlt_torch_compile[mode=reduce-overhead-fullgraph=F-bias=T-threshold=6.0-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=F-save_before_forward=F-deserialize_before_cuda=F-serialize_before_forward=T-threshold=0.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear8bit_copy_param[NOTSET] SKIPPED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=T-save_before_forward=F-deserialize_before_cuda=T-serialize_before_forward=T-threshold=6.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=F-save_before_forward=F-deserialize_before_cuda=F-serialize_before_forward=F-threshold=6.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=F-save_before_forward=T-deserialize_before_cuda=T-serialize_before_forward=T-threshold=0.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=T-save_before_forward=T-deserialize_before_cuda=F-serialize_before_forward=F-threshold=0.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear8bitlt_torch_compile[mode=default-fullgraph=T-bias=T-threshold=0.0-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear8bitlt_torch_compile[mode=reduce-overhead-fullgraph=F-bias=F-threshold=6.0-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=F-save_before_forward=T-deserialize_before_cuda=T-serialize_before_forward=F-threshold=6.0-has_fp16_weights=F-cpu] PASSED [ 30%] tests/test_linear8bitlt.py::test_linear_serialization[load_before_cuda=T-save_before_forward=T-deserialize_before_cuda=F-serialize_before_forward=T-threshold=6.0-has_fp16_weights=F-cpu] PASSED [ 31%] tests/test_generation.py::test_pi[model_and_tokenizer1-fp16-inference_kernel=F-dq=F] SKIPPED [ 31%] tests/test_generation.py::test_pi[model_and_tokenizer1-fp16-inference_kernel=F-dq=T] SKIPPED [ 31%] tests/test_generation.py::test_pi[model_and_tokenizer1-fp16-inference_kernel=T-dq=T] SKIPPED [ 31%] tests/test_generation.py::test_pi[model_and_tokenizer1-fp16-inference_kernel=T-dq=F] SKIPPED [ 31%] tests/test_generation.py::test_pi[model_and_tokenizer0-fp16-inference_kernel=F-dq=F] SKIPPED [ 31%] tests/test_generation.py::test_pi[model_and_tokenizer0-fp16-inference_kernel=F-dq=T] SKIPPED [ 31%] tests/test_generation.py::test_pi[model_and_tokenizer0-fp16-inference_kernel=T-dq=T] SKIPPED [ 31%] tests/test_generation.py::test_pi[model_and_tokenizer0-fp16-inference_kernel=T-dq=F] SKIPPED [ 31%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 31%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 32%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 33%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 34%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 35%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 36%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 37%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 38%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 39%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 40%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 41%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 42%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 43%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=64-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 44%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 45%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 46%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 47%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 48%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=F-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 49%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=T-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=T-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=F-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=F-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=T-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFF-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFT-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFT-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=T-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=F-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 50%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp32-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp16-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-bf16-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp16-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-bf16-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp32-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFT-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=FFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FF-req_grad=TFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=T-transpose_B=T-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-fp32-has_bias=F-transpose_B=F-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 51%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=FFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FF-req_grad=TFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-bf16-has_bias=T-transpose_B=T-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=T-fp16-has_bias=F-transpose_B=F-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmul_4bit[quant_type=fp4-compress_statistics=F-bf16-has_bias=F-transpose_B=T-req_grad=TFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=F-fp16-has_bias=T-transpose_B=F-req_grad=FFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=TFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=FFT-bf16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=TFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=TFF-fp16-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=T-transpose=FT-req_grad=FFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=TFT-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FT-req_grad=TFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=F-has_fp16_weights=F-transpose=FF-req_grad=FFF-fp32-func=matmul-decomp=6.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FT-req_grad=FFF-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=F-transpose_B=T-req_grad=FFF-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=TFT-bf16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmul_4bit[quant_type=nf4-compress_statistics=T-fp32-has_bias=T-transpose_B=F-req_grad=TFT-dim4=96-dim3=64-dim2=0-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=T-transpose=FT-req_grad=FFF-fp32-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=64-dim1=40-cpu] PASSED [ 52%] tests/test_autograd.py::test_matmullt[has_bias=T-has_fp16_weights=F-transpose=FF-req_grad=FFF-fp16-func=matmul-decomp=0.0-dim4=48-dim3=32-dim2=0-dim1=40-cpu] PASSED [ 52%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-2048-nested=F-bf16-cpu] SKIPPED [ 52%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[linear-bits=2-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-256-nested=F-fp16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[dynamic-bits=2-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-256-nested=F-fp32-cpu] PASSED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-128-nested=F-bf16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-2048-nested=T-fp16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-128-nested=T-fp32-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-256-nested=T-bf16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[dynamic-bits=5-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-2048-nested=T-fp32-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-128-nested=T-fp16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[linear-bits=5-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-2048-nested=F-fp32-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-512-nested=T-bf16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-2048-nested=F-fp16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-512-nested=F-fp32-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[fp8-bits=7-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-512-nested=F-fp16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-2048-nested=T-bf16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-128-nested=F-fp32-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-4096-nested=T-fp32-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-64-nested=T-bf16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-1024-nested=T-fp16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-256-nested=F-bf16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-64-nested=T-fp32-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-64-nested=T-fp16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-128-nested=F-fp16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-4096-nested=T-fp16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-1024-nested=T-fp32-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-1024-nested=F-bf16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-64-nested=F-fp16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[linear-bits=7-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[dynamic-bits=7-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-256-nested=T-fp16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-64-nested=F-bf16-cpu] SKIPPED [ 53%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-256-nested=T-fp32-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_blockwise_cpu_large[4096-128] PASSED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-4096-nested=F-bf16-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-128-nested=T-bf16-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-64-nested=F-fp32-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-512-nested=T-fp32-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-4096-nested=T-bf16-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[fp8-bits=2-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-512-nested=T-fp16-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-1024-nested=T-bf16-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-1024-nested=F-fp32-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-4096-nested=F-fp16-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[fp8-bits=5-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-1024-nested=F-fp16-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-512-nested=F-bf16-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-4096-nested=F-fp32-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-4096-nested=T-fp16-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-1024-nested=T-fp32-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-4096-nested=T-fp32-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization_large[blocksize=256-fp16-NOTSET] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-512-nested=T-bf16-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-1024-nested=T-fp16-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-4096-nested=F-bf16-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-512-nested=F-fp32-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_blockwise_cpu_large[16384-128] PASSED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[linear-bits=6-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-1024-nested=F-bf16-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-512-nested=F-fp16-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[dynamic-bits=6-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[linear-bits=8-cpu] PASSED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-256-nested=F-fp16-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-64-nested=T-fp16-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[dynamic-bits=8-cpu] PASSED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-1024-nested=T-bf16-cpu] SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_bench_dequantization SKIPPED [ 54%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-64-nested=T-fp32-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-128-nested=F-bf16-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-4096-nested=T-bf16-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-256-nested=F-fp32-cpu] PASSED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-64-nested=T-bf16-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[fp8-bits=3-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-64-nested=F-fp32-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[fp8-bits=4-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-256-nested=T-bf16-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-1024-nested=F-fp16-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-64-nested=F-bf16-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-4096-nested=F-fp32-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-128-nested=T-fp32-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-1024-nested=F-fp32-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-4096-nested=F-fp16-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-128-nested=T-fp16-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-64-nested=F-fp16-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[fp8-bits=8-cpu] PASSED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-512-nested=T-fp32-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[linear-bits=3-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-2048-nested=F-bf16-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-512-nested=T-fp16-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization_large[blocksize=256-bf16-NOTSET] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[dynamic-bits=3-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization_large[blocksize=256-fp32-NOTSET] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[dynamic-bits=4-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-2048-nested=T-fp32-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[linear-bits=4-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-2048-nested=T-fp16-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-512-nested=F-bf16-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-256-nested=F-bf16-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-128-nested=F-fp32-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-2048-nested=F-fp16-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_fp8_quant[cpu] PASSED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-128-nested=F-fp16-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-2048-nested=F-fp32-cpu] SKIPPED [ 55%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-256-nested=T-fp16-cpu] SKIPPED [ 56%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-2048-nested=T-bf16-cpu] SKIPPED [ 56%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=T-128-nested=T-bf16-cpu] SKIPPED [ 56%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_few_bit_quant[fp8-bits=6-cpu] SKIPPED [ 56%] tests/test_functional.py::Test8BitBlockwiseQuantizeFunctional::test_dynamic_blockwise_quantization[signed=F-256-nested=T-fp32-cpu] SKIPPED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_compressed_stats[fp32-blocksize=128-nf4-cpu] PASSED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp16-fc1-fp4-DQ_True-cpu] PASSED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-bf16-attn-fp4-DQ_True-cpu] PASSED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp32-attn_packed-nf4-DQ_True-cpu] PASSED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp32-fc2-fp4-DQ_False-cpu] PASSED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp32-attn_packed-nf4-DQ_True-cpu] PASSED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 56%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-bf16-attn_packed-nf4-DQ_False-cpu] PASSED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant_large[blocksize=32-nf4-fp16-NOTSET] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-bf16-fc1-nf4-DQ_True-cpu] PASSED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[256-fp4-bf16-cpu] PASSED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 57%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp32-fc2-nf4-DQ_False-cpu] PASSED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp32-fc1-fp4-DQ_True-cpu] PASSED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp16-fc1-fp4-DQ_False-cpu] PASSED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp16-attn-nf4-DQ_True-cpu] PASSED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp32-attn_packed-fp4-DQ_True-cpu] PASSED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp32-attn_packed-fp4-DQ_True-cpu] PASSED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp32-fc1-nf4-DQ_False-cpu] PASSED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp32-attn_packed-nf4-DQ_False-cpu] PASSED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp16-attn-fp4-DQ_False-cpu] PASSED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp16-attn_packed-nf4-DQ_False-cpu] PASSED [ 58%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-bf16-fc1-fp4-DQ_False-cpu] PASSED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp16-fc1-nf4-DQ_True-cpu] PASSED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-bf16-attn_packed-fp4-DQ_False-cpu] PASSED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit_weight_orientation[cpu] PASSED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-bf16-attn-nf4-DQ_True-cpu] PASSED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[128-nf4-fp16-cpu] PASSED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 59%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp32-fc1-nf4-DQ_True-cpu] PASSED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[128-nf4-fp32-cpu] PASSED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp16-attn-fp4-DQ_True-cpu] PASSED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-bf16-fc1-fp4-DQ_True-cpu] PASSED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant_large[blocksize=32-fp4-fp16-NOTSET] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 60%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-bf16-fc1-nf4-DQ_True-cpu] PASSED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-bf16-fc2-fp4-DQ_False-cpu] PASSED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp32-attn-nf4-DQ_False-cpu] PASSED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[64-fp4-fp16-cpu] PASSED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[4096-fp4-fp32-cpu] PASSED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp32-fc2-nf4-DQ_False-cpu] PASSED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp16-fc1-fp4-DQ_False-cpu] PASSED [ 61%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[2048-fp4-bf16-cpu] PASSED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_compressed_stats[fp16-blocksize=64-fp4-cpu] PASSED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[32-nf4-bf16-cpu] PASSED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[512-nf4-fp32-cpu] PASSED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp32-attn-fp4-DQ_True-cpu] PASSED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-bf16-attn_packed-fp4-DQ_True-cpu] PASSED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp16-fc1-fp4-DQ_True-cpu] PASSED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[4096-fp4-fp16-cpu] PASSED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[512-nf4-fp16-cpu] PASSED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 62%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_compressed_stats[fp32-blocksize=64-nf4-cpu] PASSED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp32-fc2-nf4-DQ_True-cpu] PASSED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp16-fc1-nf4-DQ_False-cpu] PASSED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant_large[blocksize=64-fp4-fp16-NOTSET] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp16-attn-nf4-DQ_False-cpu] PASSED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_compressed_stats[fp16-blocksize=128-fp4-cpu] PASSED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[64-fp4-fp32-cpu] PASSED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-bf16-attn-nf4-DQ_False-cpu] PASSED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 63%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_eye_4bit[fp32-fp4-cpu] PASSED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[1024-fp4-fp32-cpu] PASSED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-bf16-attn_packed-nf4-DQ_True-cpu] PASSED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp32-attn-nf4-DQ_True-cpu] PASSED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp32-attn-nf4-DQ_False-cpu] PASSED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-bf16-fc1-nf4-DQ_False-cpu] PASSED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-bf16-fc1-fp4-DQ_True-cpu] PASSED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 64%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp16-fc2-fp4-DQ_False-cpu] PASSED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant_large[blocksize=64-nf4-fp16-NOTSET] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-bf16-attn-nf4-DQ_False-cpu] PASSED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp32-attn_packed-nf4-DQ_False-cpu] PASSED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp32-fc2-fp4-DQ_True-cpu] PASSED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp16-attn_packed-nf4-DQ_False-cpu] PASSED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-bf16-fc1-fp4-DQ_False-cpu] PASSED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 65%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp16-fc1-nf4-DQ_True-cpu] PASSED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[1024-fp4-fp16-cpu] PASSED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_eye_4bit[bf16-fp4-cpu] PASSED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp16-attn_packed-fp4-DQ_False-cpu] PASSED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp16-attn-fp4-DQ_True-cpu] PASSED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp16-attn-nf4-DQ_False-cpu] PASSED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp32-fc1-fp4-DQ_False-cpu] PASSED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp32-attn_packed-fp4-DQ_False-cpu] PASSED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp16-fc2-nf4-DQ_True-cpu] PASSED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-bf16-fc1-nf4-DQ_True-cpu] PASSED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 66%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant_large[blocksize=32-fp4-fp32-NOTSET] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp32-attn_packed-fp4-DQ_True-cpu] PASSED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-bf16-attn_packed-nf4-DQ_False-cpu] PASSED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-bf16-fc1-nf4-DQ_False-cpu] PASSED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 67%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[128-fp4-bf16-cpu] PASSED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant_large[blocksize=32-nf4-bf16-NOTSET] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-bf16-attn-nf4-DQ_True-cpu] PASSED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp32-fc2-nf4-DQ_True-cpu] PASSED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 68%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp32-attn_packed-nf4-DQ_True-cpu] PASSED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant_large[blocksize=32-nf4-fp32-NOTSET] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp16-attn-nf4-DQ_True-cpu] PASSED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-bf16-attn_packed-fp4-DQ_False-cpu] PASSED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[256-nf4-fp16-cpu] PASSED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp32-fc2-nf4-DQ_False-cpu] PASSED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-bf16-fc1-fp4-DQ_True-cpu] PASSED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp16-fc2-fp4-DQ_True-cpu] PASSED [ 69%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_compressed_stats[fp32-blocksize=32-nf4-cpu] PASSED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant_large[blocksize=32-fp4-bf16-NOTSET] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[256-nf4-fp32-cpu] PASSED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-bf16-attn-fp4-DQ_True-cpu] PASSED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_compressed_stats[fp16-blocksize=32-fp4-cpu] PASSED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp32-fc2-fp4-DQ_True-cpu] PASSED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 70%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp16-fc1-nf4-DQ_False-cpu] PASSED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp32-fc2-fp4-DQ_False-cpu] PASSED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[1024-nf4-bf16-cpu] PASSED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant_large[blocksize=64-nf4-fp32-NOTSET] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp16-fc1-fp4-DQ_True-cpu] PASSED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_eye_4bit[fp16-fp4-cpu] PASSED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-bf16-fc2-fp4-DQ_True-cpu] PASSED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 71%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-bf16-attn-nf4-DQ_True-cpu] PASSED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-bf16-fc1-fp4-DQ_False-cpu] PASSED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp32-fc2-nf4-DQ_True-cpu] PASSED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-bf16-attn_packed-nf4-DQ_True-cpu] PASSED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp32-attn-fp4-DQ_False-cpu] PASSED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-bf16-attn_packed-nf4-DQ_True-cpu] PASSED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant_large[blocksize=64-fp4-bf16-NOTSET] SKIPPED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp16-attn-fp4-DQ_True-cpu] PASSED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp16-attn_packed-fp4-DQ_False-cpu] PASSED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp32-attn_packed-fp4-DQ_False-cpu] PASSED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 72%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp16-fc2-nf4-DQ_False-cpu] PASSED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-bf16-attn-fp4-DQ_False-cpu] PASSED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp16-attn_packed-nf4-DQ_True-cpu] PASSED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-bf16-fc1-nf4-DQ_False-cpu] PASSED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-bf16-attn-fp4-DQ_True-cpu] PASSED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 73%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp32-attn-fp4-DQ_False-cpu] PASSED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-bf16-fc2-nf4-DQ_False-cpu] PASSED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-bf16-attn_packed-fp4-DQ_True-cpu] PASSED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-bf16-attn_packed-fp4-DQ_True-cpu] PASSED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp32-fc2-fp4-DQ_True-cpu] PASSED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[512-fp4-bf16-cpu] PASSED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant_large[blocksize=64-fp4-fp32-NOTSET] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-bf16-fc2-nf4-DQ_True-cpu] PASSED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[4096-nf4-bf16-cpu] PASSED [ 74%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp16-fc1-nf4-DQ_False-cpu] PASSED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[2048-nf4-fp32-cpu] PASSED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp32-fc2-fp4-DQ_False-cpu] PASSED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[32-fp4-fp32-cpu] PASSED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp16-fc1-nf4-DQ_True-cpu] PASSED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp16-attn_packed-fp4-DQ_True-cpu] PASSED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[2048-nf4-fp16-cpu] PASSED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[32-fp4-fp16-cpu] PASSED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 75%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp16-attn-nf4-DQ_True-cpu] PASSED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-bf16-attn-fp4-DQ_False-cpu] PASSED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[64-nf4-bf16-cpu] PASSED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp16-attn-fp4-DQ_False-cpu] PASSED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant_large[blocksize=64-nf4-bf16-NOTSET] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp16-fc1-fp4-DQ_False-cpu] PASSED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_compressed_stats[fp32-blocksize=32-fp4-cpu] PASSED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp32-attn_packed-nf4-DQ_True-cpu] PASSED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-bf16-fc1-fp4-DQ_False-cpu] PASSED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant_large[blocksize=128-nf4-bf16-NOTSET] SKIPPED [ 76%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp32-attn-fp4-DQ_False-cpu] PASSED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp16-fc2-fp4-DQ_False-cpu] PASSED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp32-fc1-nf4-DQ_False-cpu] PASSED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[1024-nf4-fp16-cpu] PASSED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp16-attn-fp4-DQ_False-cpu] PASSED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp16-fc2-fp4-DQ_True-cpu] PASSED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-bf16-fc1-fp4-DQ_True-cpu] PASSED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-bf16-attn-fp4-DQ_False-cpu] PASSED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 77%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant_large[blocksize=128-fp4-fp32-NOTSET] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[1024-nf4-fp32-cpu] PASSED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp32-fc1-nf4-DQ_True-cpu] PASSED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp32-attn-nf4-DQ_True-cpu] PASSED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 78%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_compressed_stats[fp16-blocksize=32-nf4-cpu] PASSED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp16-fc2-nf4-DQ_False-cpu] PASSED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[4096-nf4-fp16-cpu] PASSED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[512-fp4-fp16-cpu] PASSED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp32-attn_packed-fp4-DQ_True-cpu] PASSED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-bf16-attn_packed-fp4-DQ_False-cpu] PASSED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[64-nf4-fp32-cpu] PASSED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 79%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant_large[blocksize=128-fp4-bf16-NOTSET] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-bf16-fc2-nf4-DQ_False-cpu] PASSED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_eye_4bit[bf16-nf4-cpu] PASSED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp32-attn-fp4-DQ_True-cpu] PASSED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp32-fc1-fp4-DQ_True-cpu] PASSED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[64-nf4-fp16-cpu] PASSED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp16-fc1-fp4-DQ_False-cpu] PASSED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[2048-nf4-bf16-cpu] PASSED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-bf16-fc1-nf4-DQ_True-cpu] PASSED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[32-fp4-bf16-cpu] PASSED [ 80%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp16-fc2-nf4-DQ_True-cpu] PASSED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[4096-nf4-fp32-cpu] PASSED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-bf16-fc2-fp4-DQ_False-cpu] PASSED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[512-fp4-fp32-cpu] PASSED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant_large[blocksize=128-nf4-fp32-NOTSET] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp16-attn-fp4-DQ_False-cpu] PASSED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_bench_4bit_dequant[nf4] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 81%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[128-fp4-fp32-cpu] PASSED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp32-attn-nf4-DQ_True-cpu] PASSED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp32-fc1-nf4-DQ_True-cpu] PASSED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp32-fc1-fp4-DQ_False-cpu] PASSED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 82%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp16-fc1-nf4-DQ_True-cpu] PASSED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp16-attn_packed-fp4-DQ_True-cpu] PASSED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp16-attn_packed-fp4-DQ_False-cpu] PASSED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-bf16-fc2-nf4-DQ_True-cpu] PASSED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp32-attn_packed-fp4-DQ_False-cpu] PASSED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp16-fc2-fp4-DQ_False-cpu] PASSED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[128-fp4-fp16-cpu] PASSED [ 83%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp32-fc1-nf4-DQ_False-cpu] PASSED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp32-fc1-fp4-DQ_True-cpu] PASSED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp32-attn-fp4-DQ_True-cpu] PASSED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp32-fc2-nf4-DQ_False-cpu] PASSED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[256-nf4-bf16-cpu] PASSED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 84%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_eye_4bit[fp16-nf4-cpu] PASSED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-bf16-attn-nf4-DQ_False-cpu] PASSED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-bf16-fc2-fp4-DQ_False-cpu] PASSED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp32-attn_packed-nf4-DQ_False-cpu] PASSED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp16-attn_packed-nf4-DQ_False-cpu] PASSED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 85%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp32-attn-nf4-DQ_False-cpu] PASSED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-bf16-fc2-fp4-DQ_True-cpu] PASSED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-bf16-attn_packed-fp4-DQ_False-cpu] PASSED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp16-attn_packed-nf4-DQ_True-cpu] PASSED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp16-fc1-fp4-DQ_True-cpu] PASSED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[2048-fp4-fp16-cpu] PASSED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp16-fc2-fp4-DQ_True-cpu] PASSED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp32-attn-fp4-DQ_True-cpu] PASSED [ 86%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[32-nf4-fp16-cpu] PASSED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[64-fp4-bf16-cpu] PASSED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-bf16-fc2-fp4-DQ_False-cpu] PASSED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant_large[blocksize=128-nf4-fp16-NOTSET] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp32-fc1-nf4-DQ_True-cpu] PASSED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-bf16-attn_packed-nf4-DQ_False-cpu] PASSED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp16-fc1-nf4-DQ_False-cpu] PASSED [ 87%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-bf16-fc2-nf4-DQ_True-cpu] PASSED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp16-attn-nf4-DQ_False-cpu] PASSED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-bf16-fc2-nf4-DQ_False-cpu] PASSED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[512-nf4-bf16-cpu] PASSED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[2048-fp4-fp32-cpu] PASSED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 88%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[32-nf4-fp32-cpu] PASSED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[4096-fp4-bf16-cpu] PASSED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-bf16-fc1-nf4-DQ_False-cpu] PASSED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp32-fc1-fp4-DQ_True-cpu] PASSED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant_large[blocksize=128-fp4-fp16-NOTSET] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp32-fc1-fp4-DQ_False-cpu] PASSED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 89%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp16-fc2-nf4-DQ_False-cpu] PASSED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp32-attn-nf4-DQ_True-cpu] PASSED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp16-fc2-nf4-DQ_True-cpu] PASSED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_compressed_stats[fp32-blocksize=128-fp4-cpu] PASSED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp32-attn-nf4-DQ_False-cpu] PASSED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[1024-fp4-bf16-cpu] PASSED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-bf16-attn-nf4-DQ_False-cpu] PASSED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 90%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp16-attn-nf4-DQ_False-cpu] PASSED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp16-fc2-fp4-DQ_False-cpu] PASSED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-bf16-fc2-fp4-DQ_True-cpu] PASSED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp32-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp32-fc2-fp4-DQ_False-cpu] PASSED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[256-fp4-fp32-cpu] PASSED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-bf16-attn_packed-nf4-DQ_True-cpu] PASSED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 91%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-bf16-fc2-nf4-DQ_True-cpu] PASSED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-bf16-fc2-nf4-DQ_False-cpu] PASSED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-bf16-attn-fp4-DQ_False-cpu] PASSED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_eye_4bit[fp32-nf4-cpu] PASSED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-bf16-attn-fp4-DQ_True-cpu] PASSED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp32-fc2-fp4-DQ_True-cpu] PASSED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp32-attn-fp4-DQ_False-cpu] PASSED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 92%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp16-attn_packed-fp4-DQ_False-cpu] PASSED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp16-attn_packed-nf4-DQ_True-cpu] PASSED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp16-attn_packed-nf4-DQ_True-cpu] PASSED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp32-attn_packed-fp4-DQ_False-cpu] PASSED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp16-attn-nf4-DQ_True-cpu] PASSED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp16-fc2-fp4-DQ_True-cpu] PASSED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp16-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[256-fp4-fp16-cpu] PASSED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 93%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-bf16-attn_packed-nf4-DQ_False-cpu] PASSED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_quant[128-nf4-bf16-cpu] PASSED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=128-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=128-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_compressed_stats[fp16-blocksize=64-nf4-cpu] PASSED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-bf16-attn-nf4-DQ_True-cpu] PASSED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp32-fc2-nf4-DQ_True-cpu] PASSED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-fp32-fc1-nf4-DQ_False-cpu] PASSED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K512-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] PASSED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] PASSED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-bf16-fc2-fp4-DQ_True-cpu] PASSED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 94%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=64-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=32-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=64-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=512-bf16-attn_packed-fp4-DQ_True-cpu] PASSED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=32-nf4-compress_statistics=T-has_bias=T-cpu] PASSED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] PASSED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N5120K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_compressed_stats[fp16-blocksize=128-nf4-cpu] PASSED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp32-attn_packed-nf4-DQ_False-cpu] PASSED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M4N28672K128-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=32-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=4096-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=64-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp16-attn_packed-nf4-DQ_False-cpu] PASSED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-bf16-blocksize=64-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N21504K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=4096-fp4-compress_statistics=T-has_bias=T-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M48N8192K8192-bf16-blocksize=32-nf4-compress_statistics=F-has_bias=F-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_4bit_compressed_stats[fp32-blocksize=64-fp4-cpu] PASSED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp32-fc1-fp4-DQ_False-cpu] PASSED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp16-attn_packed-fp4-DQ_True-cpu] PASSED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=128-fp16-attn_packed-fp4-DQ_True-cpu] PASSED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N8192K128-fp16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 95%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp16-fc2-nf4-DQ_False-cpu] PASSED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M7N14336K128-fp16-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=32-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=1024-fp16-fc2-nf4-DQ_True-cpu] PASSED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=128-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=64-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=4096-fp4-compress_statistics=F-has_bias=T-cpu] SKIPPED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=128-nf4-compress_statistics=T-has_bias=F-cpu] PASSED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-bf16-blocksize=4096-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp32-blocksize=32-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N2048K128-fp16-blocksize=64-nf4-compress_statistics=F-has_bias=T-cpu] PASSED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_gemv_4bit[dim=256-fp16-attn-fp4-DQ_True-cpu] PASSED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M1N256K128-bf16-blocksize=128-fp4-compress_statistics=F-has_bias=T-cpu] PASSED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp32-blocksize=32-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp16-blocksize=64-fp4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M9N5120K128-fp32-blocksize=128-fp4-compress_statistics=T-has_bias=F-cpu] PASSED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M80N14336K128-fp32-blocksize=32-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 96%] tests/test_functional.py::TestQuantize4BitFunctional::test_matmul_4bit[M40N36864K128-fp16-blocksize=64-nf4-compress_statistics=T-has_bias=F-cpu] SKIPPED [ 96%] tests/test_functional.py::test_stable_embedding PASSED [ 96%] tests/test_functional.py::test_normal_map_tree PASSED [ 96%] tests/test_functional.py::TestLLMInt8Functional::test_int8_linear_matmul[ldb=0-dims=2-dim4=512-dim3=499-dim2=256-dim1=128-cpu] PASSED [ 96%] tests/test_functional.py::TestLLMInt8Functional::test_integrated_int8_linear_matmul[dim1=1,dim4=2,inner=4-cpu] PASSED [ 96%] tests/test_functional.py::TestLLMInt8Functional::test_coo_double_quant[dim2=4096-dim1=512-cpu] PASSED [ 96%] tests/test_functional.py::TestLLMInt8Functional::test_int8_double_quant[dim2=1024-dim1=2048] SKIPPED [ 96%] tests/test_functional.py::TestLLMInt8Functional::test_coo_double_quant[dim2=1024-dim1=512-cpu] PASSED [ 96%] tests/test_functional.py::TestLLMInt8Functional::test_dequant_mm[has_bias=T-dims=2-dim4=64-dim1=64-cpu] PASSED [ 96%] tests/test_functional.py::TestLLMInt8Functional::test_int8_double_quant[dim2=1024-dim1=4096] SKIPPED [ 96%] tests/test_functional.py::TestLLMInt8Functional::test_dequant_mm[has_bias=T-dims=2-dim4=1024-dim1=64-cpu] PASSED [ 96%] tests/test_functional.py::TestLLMInt8Functional::test_dequant_mm[has_bias=T-dims=2-dim4=1024-dim1=256-cpu] PASSED [ 96%] tests/test_functional.py::TestLLMInt8Functional::test_int8_linear_matmul[ldb=0-dims=2-dim4=512-dim3=512-dim2=256-dim1=128-cpu] PASSED [ 96%] tests/test_functional.py::TestLLMInt8Functional::test_integrated_int8_linear_matmul[dim1=2048,dim4=2048,inner=512-cpu] PASSED [ 96%] tests/test_functional.py::TestLLMInt8Functional::test_dequant_mm[has_bias=F-dims=2-dim4=1024-dim1=256-cpu] PASSED [ 97%] tests/test_functional.py::TestLLMInt8Functional::test_integrated_int8_linear_matmul[dim1=4096,dim4=4096,inner=4096-cpu] SKIPPED [ 97%] tests/test_functional.py::TestLLMInt8Functional::test_dequant_mm[has_bias=F-dims=2-dim4=64-dim1=64-cpu] PASSED [ 97%] tests/test_functional.py::TestLLMInt8Functional::test_dequant_mm[has_bias=F-dims=2-dim4=64-dim1=256-cpu] PASSED [ 97%] tests/test_functional.py::TestLLMInt8Functional::test_dequant_mm[has_bias=T-dims=2-dim4=64-dim1=256-cpu] PASSED [ 97%] tests/test_functional.py::TestLLMInt8Functional::test_integrated_int8_linear_matmul[dim1=8,dim4=128,inner=256-cpu] PASSED [ 97%] tests/test_functional.py::TestLLMInt8Functional::test_int8_linear_matmul_half[dims=2-dim4=32-dim3=32-dim2=32-dim1=32-cpu] PASSED [ 97%] tests/test_functional.py::TestLLMInt8Functional::test_coo_int8_vectorwise_quant[dim2=1024-dim1=2048-cpu] PASSED [ 97%] tests/test_functional.py::TestLLMInt8Functional::test_int8_double_quant[dim2=512-dim1=2048] SKIPPED [ 97%] tests/test_functional.py::TestLLMInt8Functional::test_coo_double_quant[dim2=4096-dim1=2048-cpu] PASSED [ 97%] tests/test_functional.py::TestLLMInt8Functional::test_int8_linear_matmul[ldb=0-dims=3-dim4=512-dim3=499-dim2=256-dim1=128-cpu] PASSED [ 97%] tests/test_functional.py::TestLLMInt8Functional::test_coo_double_quant[dim2=1024-dim1=2048-cpu] PASSED [ 97%] tests/test_functional.py::TestLLMInt8Functional::test_coo_int8_vectorwise_quant[dim2=4096-dim1=2048-cpu] PASSED [ 97%] tests/test_functional.py::TestLLMInt8Functional::test_dequant_mm[has_bias=F-dims=2-dim4=1024-dim1=64-cpu] PASSED [ 97%] tests/test_functional.py::TestLLMInt8Functional::test_int8_double_quant[dim2=512-dim1=4096] SKIPPED [ 97%] tests/test_functional.py::TestLLMInt8Functional::test_coo_int8_vectorwise_quant[dim2=1024-dim1=512-cpu] PASSED [ 97%] tests/test_functional.py::TestLLMInt8Functional::test_int8_linear_matmul[ldb=0-dims=3-dim4=512-dim3=512-dim2=256-dim1=128-cpu] PASSED [ 97%] tests/test_functional.py::TestLLMInt8Functional::test_coo_int8_vectorwise_quant[dim2=4096-dim1=512-cpu] PASSED [ 97%] tests/test_modules.py::test_embedding_lossless[Embedding8bit-None-(10,)-65-cpu] PASSED [ 97%] tests/test_modules.py::test_linear8bitlt_inference[threshold=0.0-cpu] PASSED [ 97%] tests/test_modules.py::test_kbit_backprop[dtype0-NF4+fp16-cpu] PASSED [ 97%] tests/test_modules.py::test_embedding_error[Embedding8bit-None-(10, 10, 10)-65-cpu] PASSED [ 97%] tests/test_modules.py::test_embedding_error[EmbeddingFP4-torch.float32-(10, 10, 10)-65-cpu] PASSED [ 97%] tests/test_modules.py::test_embedding_error[EmbeddingFP4-torch.uint8-(10,)-64-cpu] PASSED [ 97%] tests/test_modules.py::test_embedding_error[EmbeddingNF4-torch.float32-(10, 10)-65-cpu] PASSED [ 97%] tests/test_modules.py::test_embedding_lossless[EmbeddingNF4-torch.float32-(10, 10, 10)-64-cpu] PASSED [ 97%] tests/test_modules.py::test_embedding_not_implemented_error PASSED [ 97%] tests/test_modules.py::test_embedding_error[Embedding8bit-None-(10, 10)-64-cpu] PASSED [ 97%] tests/test_modules.py::test_kbit_backprop[dtype0-NF4+fp32-cpu] PASSED [ 97%] tests/test_modules.py::test_embedding_lossless[EmbeddingNF4-torch.float32-(10, 10)-65-cpu] PASSED [ 97%] tests/test_modules.py::test_embedding_lossless[EmbeddingNF4-torch.uint8-(10,)-64-cpu] PASSED [ 97%] tests/test_modules.py::test_embedding_lossless[EmbeddingNF4-torch.float32-(10,)-64-cpu] PASSED [ 97%] tests/test_modules.py::test_embedding_error[Embedding8bit-None-(10,)-65-cpu] PASSED [ 97%] tests/test_modules.py::test_4bit_embedding_weight_fsdp_fix[NOTSET] SKIPPED [ 97%] tests/test_modules.py::test_linear_kbit_fp32_bias[NF4-cpu] PASSED [ 97%] tests/test_modules.py::test_embedding_lossless[Embedding8bit-None-(10, 10)-64-cpu] PASSED [ 97%] tests/test_modules.py::test_kbit_backprop[dtype0-FP4+C-cpu] PASSED [ 98%] tests/test_modules.py::test_kbit_backprop[dtype0-4bit-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_error[EmbeddingFP4-torch.float32-(10,)-64-cpu] PASSED [ 98%] tests/test_modules.py::test_4bit_linear_weight_fsdp_fix[NOTSET] SKIPPED [ 98%] tests/test_modules.py::test_embedding_error[EmbeddingNF4-torch.uint8-(10, 10, 10)-64-cpu] PASSED [ 98%] tests/test_modules.py::test_kbit_backprop[dtype0-NF4-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_lossless[EmbeddingFP4-torch.uint8-(10, 10)-64-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_error[EmbeddingFP4-torch.float32-(10, 10)-64-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_error[EmbeddingFP4-torch.uint8-(10, 10)-65-cpu] PASSED [ 98%] tests/test_modules.py::test_linear_kbit_fp32_bias[Int8Lt-cpu] PASSED [ 98%] tests/test_modules.py::test_kbit_backprop[dtype1-NF4+bf16-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_lossless[EmbeddingNF4-torch.uint8-(10, 10, 10)-65-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_lossless[EmbeddingFP4-torch.uint8-(10,)-65-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_lossless[EmbeddingFP4-torch.float32-(10,)-65-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_error[EmbeddingNF4-torch.uint8-(10, 10)-65-cpu] PASSED [ 98%] tests/test_modules.py::test_kbit_backprop[dtype1-NF4+C-cpu] PASSED [ 98%] tests/test_modules.py::test_kbit_backprop[dtype0-Int8Lt-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_error[EmbeddingNF4-torch.uint8-(10,)-65-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_lossless[Embedding8bit-None-(10, 10, 10)-64-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_lossless[EmbeddingNF4-torch.uint8-(10, 10)-64-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_lossless[EmbeddingFP4-torch.uint8-(10, 10, 10)-64-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_error[EmbeddingNF4-torch.float32-(10, 10, 10)-65-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_lossless[EmbeddingFP4-torch.float32-(10, 10, 10)-64-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_lossless[EmbeddingFP4-torch.float32-(10, 10)-64-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_error[EmbeddingFP4-torch.uint8-(10, 10, 10)-65-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_error[EmbeddingNF4-torch.float32-(10,)-65-cpu] PASSED [ 98%] tests/test_modules.py::test_kbit_backprop[dtype1-FP4-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_error[EmbeddingFP4-torch.float32-(10, 10)-65-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_error[EmbeddingFP4-torch.uint8-(10, 10)-64-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_error[EmbeddingNF4-torch.uint8-(10, 10, 10)-65-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_lossless[EmbeddingFP4-torch.uint8-(10, 10)-65-cpu] PASSED [ 98%] tests/test_modules.py::test_linear8bitlt_no_fp16_weights[0.0-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_lossless[EmbeddingFP4-torch.uint8-(10,)-64-cpu] PASSED [ 98%] tests/test_modules.py::test_kbit_backprop[dtype0-FP4-cpu] PASSED [ 98%] tests/test_modules.py::test_embedding_lossless[EmbeddingNF4-torch.uint8-(10, 10, 10)-64-cpu] PASSED [ 98%] tests/test_modules.py::test_linear8bitlt_inference[threshold=3.0-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_lossless[Embedding8bit-None-(10, 10, 10)-65-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_error[EmbeddingNF4-torch.uint8-(10,)-64-cpu] PASSED [ 99%] tests/test_modules.py::test_kbit_backprop[dtype1-NF4+fp32-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_lossless[EmbeddingFP4-torch.uint8-(10, 10, 10)-65-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_lossless[EmbeddingNF4-torch.uint8-(10, 10)-65-cpu] PASSED [ 99%] tests/test_modules.py::test_kbit_backprop[dtype1-NF4+fp16-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_lossless[EmbeddingFP4-torch.float32-(10,)-64-cpu] PASSED [ 99%] tests/test_modules.py::test_kbit_backprop[dtype1-FP4+C-cpu] PASSED [ 99%] tests/test_modules.py::test_4bit_embedding_warnings[cpu] PASSED [ 99%] tests/test_modules.py::test_kbit_backprop[dtype1-NF4-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_error[EmbeddingNF4-torch.uint8-(10, 10)-64-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_error[EmbeddingFP4-torch.uint8-(10, 10, 10)-64-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_error[EmbeddingNF4-torch.float32-(10,)-64-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_lossless[EmbeddingFP4-torch.float32-(10, 10)-65-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_error[EmbeddingNF4-torch.float32-(10, 10, 10)-64-cpu] PASSED [ 99%] tests/test_modules.py::test_4bit_linear_warnings[cpu] PASSED [ 99%] tests/test_modules.py::test_kbit_backprop[dtype1-Int8Lt-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_lossless[EmbeddingFP4-torch.float32-(10, 10, 10)-65-cpu] PASSED [ 99%] tests/test_modules.py::test_linear8bitlt_no_fp16_weights[2.0-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_lossless[Embedding8bit-None-(10,)-64-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_error[Embedding8bit-None-(10, 10)-65-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_error[EmbeddingFP4-torch.float32-(10, 10, 10)-64-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_error[EmbeddingFP4-torch.uint8-(10,)-65-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_error[EmbeddingNF4-torch.float32-(10, 10)-64-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_error[Embedding8bit-None-(10, 10, 10)-64-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_lossless[EmbeddingNF4-torch.float32-(10, 10, 10)-65-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_lossless[EmbeddingNF4-torch.float32-(10, 10)-64-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_error[Embedding8bit-None-(10,)-64-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_lossless[EmbeddingNF4-torch.uint8-(10,)-65-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_lossless[EmbeddingNF4-torch.float32-(10,)-65-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_error[EmbeddingFP4-torch.float32-(10,)-65-cpu] PASSED [ 99%] tests/test_modules.py::test_kbit_backprop[dtype0-NF4+bf16-cpu] PASSED [ 99%] tests/test_modules.py::test_kbit_backprop[dtype1-4bit-cpu] PASSED [ 99%] tests/test_modules.py::test_embedding_lossless[Embedding8bit-None-(10, 10)-65-cpu] PASSED [ 99%] tests/test_modules.py::test_kbit_backprop[dtype0-NF4+C-cpu] PASSED [100%] ==================================== ERRORS ==================================== _ ERROR at setup of test_benchmark_blockwise[opt=paged_ademamix8bit_blockwise0-bf16-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=ademamix8bit_blockwise-fp32-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=paged_lion8bit_blockwise-bf16-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=paged_lion8bit_blockwise-fp16-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=paged_ademamix8bit_blockwise_scheduled-fp32-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=paged_ademamix8bit_blockwise0-fp16-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=lion8bit_blockwise-fp32-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=ademamix8bit_blockwise_scheduled-fp16-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=paged_ademamix8bit_blockwise1-fp16-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=paged_adam8bit_blockwise-bf16-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=paged_adam8bit_blockwise-fp16-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=paged_ademamix8bit_blockwise1-bf16-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=adam8bit_blockwise-fp32-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=ademamix8bit_blockwise_scheduled-bf16-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=paged_ademamix8bit_blockwise0-fp32-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=lion8bit_blockwise-fp16-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=ademamix8bit_blockwise-bf16-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=paged_lion8bit_blockwise-fp32-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=paged_ademamix8bit_blockwise_scheduled-fp16-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=ademamix8bit_blockwise-fp16-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=paged_ademamix8bit_blockwise_scheduled-bf16-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=lion8bit_blockwise-bf16-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=adam8bit_blockwise-fp16-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=paged_adam8bit_blockwise-fp32-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=paged_ademamix8bit_blockwise1-fp32-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=ademamix8bit_blockwise_scheduled-fp32-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 _ ERROR at setup of test_benchmark_blockwise[opt=adam8bit_blockwise-bf16-dim2=4096-dim1=4096] _ file /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py, line 547 @pytest.mark.parametrize("dim1", [4096], ids=id_formatter("dim1")) @pytest.mark.parametrize("dim2", [4096], ids=id_formatter("dim2")) @pytest.mark.parametrize("gtype", [torch.float32, torch.bfloat16, torch.float16], ids=describe_dtype) @pytest.mark.parametrize("optim_name", optimizer_names_benchmark, ids=id_formatter("opt")) @pytest.mark.benchmark def test_benchmark_blockwise(dim1, dim2, gtype, optim_name, device): E fixture 'device' not found > available fixtures: __pytest_repeat_step_number, _asyncio_loop_factory, _class_scoped_runner, _configure_application, _examples_to_update, _function_scoped_runner, _module_scoped_runner, _monkeypatch_response_class, _package_scoped_runner, _push_request_context, _session_faker, _session_scoped_runner, _syrupy_apply_ide_patches, accept_any, accept_json, accept_jsonp, accept_mimetype, add_implementation, add_specification, aiomisc_func_wrap, aiomisc_socket_factory, aiomisc_test_timeout, aiomisc_unused_port, aiomisc_unused_port_factory, allowed_hosts, anyio_backend, anyio_backend_name, anyio_backend_options, assert_all_responses_were_requested, base_dir, benchmark, benchmark_weave, block_network, cache, caller_from_implementation, capfd, capfdbinary, caplog, capsys, capsysbinary, capteesys, check, class_mocker, client, client_class, codspeed_benchmark, config, cov, dash_br, dash_duo, dash_duo_mp, dash_multi_process_server, dash_process_server, dash_thread_server, dashjl, dashjl_server, dashr, dashr_server, default_cassette_name, default_context, disable_recording, diskcache_manager, display_getter, do_memcached_clean, doctest_namespace, entrypoint, entrypoint_kwargs, eval_example, event_loop, event_loop_policy, fake_process, faker, faker_seed, fp, free_tcp_port, free_tcp_port_factory, free_udp_port, free_udp_port_factory, fs, fs_class, fs_module, fs_session, httpserver, httpserver_ipv4, httpserver_ipv6, httpserver_listen_address, httpserver_ssl_context, httpx_mock, iteration_index, live_server, localhost, lock_dir, lock_resource_timeout, loop_debug, make_httpserver, make_httpserver_ipv4, make_httpserver_ipv6, memcached, memcached_clean, memcached_client, memcached_connection, memcached_socket, memory_base_dir, memory_root_dir, memory_temp_dir, mocker, module_mocker, monkeypatch, mysql, mysql_base_dir, mysql_connection, mysql_data_dir, mysql_database, mysql_database_getter, mysql_database_name, mysql_defaults_file, mysql_pid, mysql_socket, mysql_system_database, mysql_watcher, no_cover, non_mocked_hosts, num_iterations, num_parallel_threads, package_mocker, port_getter, pytestconfig, record_mode, record_property, record_testsuite_property, record_xml_attribute, recwarn, requests_mock, requires_cuda, respx_mock, root_dir, run_dir, run_services, services, services_log, session_id, session_mocker, slave_id, snapshot, snapshot_check, socket_disabled, socket_enabled, subtests, tcp_proxy, temp_dir, temporary_hookimpl, test_plugin_manager, testrun_uid, thread_comp, thread_index, thread_pool_executor, thread_pool_size, time_machine, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory, unused_udp_port, unused_udp_port_factory, vcr, vcr_cassette_dir, vcr_config, vcr_markers, watcher_getter, weave, worker_id, xdoctest_namespace, xvfb, xvfb_display, xvfb_resolution > use 'pytest --fixtures [testpath]' for help on them. /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/tests/test_optim.py:547 =============================== warnings summary =============================== ../../../../../local/lib/python3.12/site-packages/torch/cuda/__init__.py:64 /usr/local/lib/python3.12/site-packages/torch/cuda/__init__.py:64: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. import pynvml # type: ignore[import] ../../../../../local/lib/python3.12/site-packages/torch/jit/_script.py:365: 14 warnings /usr/local/lib/python3.12/site-packages/torch/jit/_script.py:365: DeprecationWarning: `torch.jit.script_method` is deprecated. Please switch to `torch.compile` or `torch.export`. warnings.warn( ../../../../../local/lib/python3.12/site-packages/_pytest/python.py:124 /usr/local/lib/python3.12/site-packages/_pytest/python.py:124: PytestRemovedIn10Warning: Passing a non-Collection iterable to parametrize is deprecated. Test: tests/test_functional.py::TestLLMInt8Functional::test_integrated_int8_linear_matmul, argvalues type: generator Please convert to a list or tuple. See https://docs.pytest.org/en/stable/deprecations.html#parametrize-iterators metafunc.parametrize(*marker.args, **marker.kwargs, _param_mark=marker) tests/test_ops.py: 12 warnings /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/bitsandbytes/backends/cpu/ops.py:30: UserWarning: int_mm_out_cpu failed, switching to BLAS gemm: false INTERNAL ASSERT FAILED at "/wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp":85, please report a bug to PyTorch. mkldnn_matmul_i8i8i32: ATen not compiled with MKLDNN support Exception raised from mkldnn_matmul_i8i8i32 at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp:85 (most recent call first): frame #0: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6f0f03 in <_ZN3c105ErrorC1ENS_14SourceLocationENSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE+0xb3>) frame #1: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed6cd in <_ZN3c106detail14torchCheckFailEPKcS2_jRKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x8d>) frame #2: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed97c in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_RKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x4c>) frame #3: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891b59b51 in <_ZN2at6native21mkldnn_matmul_i8i8i32ERKNS_6TensorES3_S3_+0x61>) frame #4: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x8915427e8 in <_ZN2at6native15_int_mm_out_cpuERKNS_6TensorES3_RS1_+0x358>) frame #5: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891543f65 in <_ZN2at6native11_int_mm_cpuERKNS_6TensorES3_+0xe5>) frame #6: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x89260e26b in <_ZN2at3cpu14nanmedian_outfERKNS_6TensorElbRS1_S4_+0x3ab>) frame #7: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b07788 in <_ZN5torch8autograd30autogradNotImplementedFallbackEv+0x938>) frame #8: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891cc22ff in <_ZN2at4_ops24_fused_adagrad_tensor_lr10redispatchEN3c1014DispatchKeySetENS2_8ArrayRefINS_6TensorEEES6_S6_S6_RKS5_dddbRKNSt3__18optionalIS5_EESD_+0x1715f>) frame #9: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891de379e in <_ZN2at4_ops7_int_mm4callERKNS_6TensorES4_+0x20e>) frame #10: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88be87b74 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x1073a4>) frame #11: /usr/local/lib/libpython3.12.so.1.0 + (0x8217294b1 in ) frame #12: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #13: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #14: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #15: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #16: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #17: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #18: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b05fe4 in <_ZN5torch8autograd35basicAutogradNotImplementedFallbackEv+0x5e4>) frame #19: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #20: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #21: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #22: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #23: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #24: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #25: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #26: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #27: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #28: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #29: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #30: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #31: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #32: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #33: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #34: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b05fe4 in <_ZN5torch8autograd35basicAutogradNotImplementedFallbackEv+0x5e4>) frame #35: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #36: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #37: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #38: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c548ee1 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x31>) frame #39: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44a279 in ) frame #40: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #41: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #42: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2be7 in ) frame #43: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #44: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #45: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #46: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #47: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #48: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c6743 in ) frame #49: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2be7 in ) frame #50: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #51: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #52: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #53: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #54: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #55: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #56: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #57: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #58: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #59: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c68de in ) frame #60: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #61: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) (Triggered internally at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/LinearAlgebra.cpp:3729.) return torch._int_mm( tests/test_ops.py: 18 warnings /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/bitsandbytes/backends/cpu/ops.py:30: UserWarning: int_mm_out_cpu failed, switching to BLAS gemm: false INTERNAL ASSERT FAILED at "/wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp":85, please report a bug to PyTorch. mkldnn_matmul_i8i8i32: ATen not compiled with MKLDNN support Exception raised from mkldnn_matmul_i8i8i32 at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp:85 (most recent call first): frame #0: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6f0f03 in <_ZN3c105ErrorC1ENS_14SourceLocationENSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE+0xb3>) frame #1: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed6cd in <_ZN3c106detail14torchCheckFailEPKcS2_jRKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x8d>) frame #2: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed97c in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_RKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x4c>) frame #3: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891b59b51 in <_ZN2at6native21mkldnn_matmul_i8i8i32ERKNS_6TensorES3_S3_+0x61>) frame #4: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x8915427e8 in <_ZN2at6native15_int_mm_out_cpuERKNS_6TensorES3_RS1_+0x358>) frame #5: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891543f65 in <_ZN2at6native11_int_mm_cpuERKNS_6TensorES3_+0xe5>) frame #6: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x89260e214 in <_ZN2at3cpu14nanmedian_outfERKNS_6TensorElbRS1_S4_+0x354>) frame #7: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891de3738 in <_ZN2at4_ops7_int_mm4callERKNS_6TensorES4_+0x1a8>) frame #8: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88be87b74 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x1073a4>) frame #9: /usr/local/lib/libpython3.12.so.1.0 + (0x8217294b1 in ) frame #10: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #11: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #12: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #13: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #14: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #15: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #16: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #17: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #18: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #19: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #20: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #21: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #22: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #23: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #24: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #25: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #26: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #27: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #28: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #29: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #30: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #31: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #32: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #33: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #34: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #35: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #36: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #37: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #38: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #39: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #40: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #41: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #42: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c68de in ) frame #43: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c385f in ) frame #44: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c3e96 in ) frame #45: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c818e43 in <_ZN5torch42handle_torch_function_no_python_arg_parserEN3c108ArrayRefIP7_objectEES3_S3_PKcS3_S6_NS_17TorchFunctionNameE+0x573>) frame #46: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c132fa2 in <_Z16getPyInterpreterv+0x1122>) frame #47: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891233f5e in <_ZN2at4impl23MaybeSetTLSOnEntryGuardD2Ev+0x32e>) frame #48: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b05fe4 in <_ZN5torch8autograd35basicAutogradNotImplementedFallbackEv+0x5e4>) frame #49: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891234845 in <_ZN2at4impl23MaybeSetTLSOnEntryGuardD2Ev+0xc15>) frame #50: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #51: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #52: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #53: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #54: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #55: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #56: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #57: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #58: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #59: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #60: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #61: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c6743 in ) (Triggered internally at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/LinearAlgebra.cpp:3729.) return torch._int_mm( tests/test_ops.py::TestLLMInt8Ops::test_int8_scaled_mm[True-dtype=bf16-cpu] /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/bitsandbytes/backends/cpu/ops.py:30: UserWarning: int_mm_out_cpu failed, switching to BLAS gemm: false INTERNAL ASSERT FAILED at "/wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp":85, please report a bug to PyTorch. mkldnn_matmul_i8i8i32: ATen not compiled with MKLDNN support Exception raised from mkldnn_matmul_i8i8i32 at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp:85 (most recent call first): frame #0: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6f0f03 in <_ZN3c105ErrorC1ENS_14SourceLocationENSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE+0xb3>) frame #1: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed6cd in <_ZN3c106detail14torchCheckFailEPKcS2_jRKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x8d>) frame #2: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed97c in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_RKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x4c>) frame #3: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891b59b51 in <_ZN2at6native21mkldnn_matmul_i8i8i32ERKNS_6TensorES3_S3_+0x61>) frame #4: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x8915427e8 in <_ZN2at6native15_int_mm_out_cpuERKNS_6TensorES3_RS1_+0x358>) frame #5: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891543f65 in <_ZN2at6native11_int_mm_cpuERKNS_6TensorES3_+0xe5>) frame #6: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x89260e26b in <_ZN2at3cpu14nanmedian_outfERKNS_6TensorElbRS1_S4_+0x3ab>) frame #7: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b07788 in <_ZN5torch8autograd30autogradNotImplementedFallbackEv+0x938>) frame #8: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891cc22ff in <_ZN2at4_ops24_fused_adagrad_tensor_lr10redispatchEN3c1014DispatchKeySetENS2_8ArrayRefINS_6TensorEEES6_S6_S6_RKS5_dddbRKNSt3__18optionalIS5_EESD_+0x1715f>) frame #9: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891de379e in <_ZN2at4_ops7_int_mm4callERKNS_6TensorES4_+0x20e>) frame #10: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88be87b74 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x1073a4>) frame #11: /usr/local/lib/libpython3.12.so.1.0 + (0x8217294b1 in ) frame #12: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #13: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #14: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #15: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #16: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #17: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #18: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b05fe4 in <_ZN5torch8autograd35basicAutogradNotImplementedFallbackEv+0x5e4>) frame #19: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #20: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #21: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #22: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #23: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #24: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #25: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #26: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #27: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #28: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #29: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #30: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #31: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #32: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #33: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #34: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b05fe4 in <_ZN5torch8autograd35basicAutogradNotImplementedFallbackEv+0x5e4>) frame #35: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #36: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #37: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #38: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #39: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #40: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #41: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #42: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #43: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #44: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #45: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #46: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2be7 in ) frame #47: /usr/local/lib/libpython3.12.so.1.0 + (0x821918c05 in ) frame #48: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #49: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #50: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #51: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c6743 in ) frame #52: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2be7 in ) frame #53: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #54: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #55: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #56: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #57: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #58: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #59: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #60: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #61: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) (Triggered internally at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/LinearAlgebra.cpp:3729.) return torch._int_mm( tests/test_ops.py: 12 warnings /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/bitsandbytes/backends/cpu/ops.py:30: UserWarning: int_mm_out_cpu failed, switching to BLAS gemm: false INTERNAL ASSERT FAILED at "/wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp":85, please report a bug to PyTorch. mkldnn_matmul_i8i8i32: ATen not compiled with MKLDNN support Exception raised from mkldnn_matmul_i8i8i32 at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp:85 (most recent call first): frame #0: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6f0f03 in <_ZN3c105ErrorC1ENS_14SourceLocationENSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE+0xb3>) frame #1: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed6cd in <_ZN3c106detail14torchCheckFailEPKcS2_jRKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x8d>) frame #2: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed97c in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_RKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x4c>) frame #3: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891b59b51 in <_ZN2at6native21mkldnn_matmul_i8i8i32ERKNS_6TensorES3_S3_+0x61>) frame #4: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x8915427e8 in <_ZN2at6native15_int_mm_out_cpuERKNS_6TensorES3_RS1_+0x358>) frame #5: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891543f65 in <_ZN2at6native11_int_mm_cpuERKNS_6TensorES3_+0xe5>) frame #6: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x89260e214 in <_ZN2at3cpu14nanmedian_outfERKNS_6TensorElbRS1_S4_+0x354>) frame #7: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891de3738 in <_ZN2at4_ops7_int_mm4callERKNS_6TensorES4_+0x1a8>) frame #8: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88be87b74 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x1073a4>) frame #9: /usr/local/lib/libpython3.12.so.1.0 + (0x8217294b1 in ) frame #10: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #11: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #12: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #13: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #14: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #15: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #16: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #17: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #18: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #19: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #20: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #21: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #22: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #23: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #24: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #25: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #26: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #27: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #28: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #29: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #30: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #31: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #32: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #33: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #34: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #35: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #36: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #37: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #38: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #39: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #40: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #41: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #42: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c68de in ) frame #43: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c385f in ) frame #44: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c3e96 in ) frame #45: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c818e43 in <_ZN5torch42handle_torch_function_no_python_arg_parserEN3c108ArrayRefIP7_objectEES3_S3_PKcS3_S6_NS_17TorchFunctionNameE+0x573>) frame #46: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c132fa2 in <_Z16getPyInterpreterv+0x1122>) frame #47: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891233f5e in <_ZN2at4impl23MaybeSetTLSOnEntryGuardD2Ev+0x32e>) frame #48: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b05fe4 in <_ZN5torch8autograd35basicAutogradNotImplementedFallbackEv+0x5e4>) frame #49: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891234845 in <_ZN2at4impl23MaybeSetTLSOnEntryGuardD2Ev+0xc15>) frame #50: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #51: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #52: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #53: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #54: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #55: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #56: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #57: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #58: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #59: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #60: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #61: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c68de in ) (Triggered internally at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/LinearAlgebra.cpp:3729.) return torch._int_mm( tests/test_ops.py: 11 warnings /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/bitsandbytes/backends/cpu/ops.py:30: UserWarning: int_mm_out_cpu failed, switching to BLAS gemm: false INTERNAL ASSERT FAILED at "/wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp":85, please report a bug to PyTorch. mkldnn_matmul_i8i8i32: ATen not compiled with MKLDNN support Exception raised from mkldnn_matmul_i8i8i32 at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp:85 (most recent call first): frame #0: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6f0f03 in <_ZN3c105ErrorC1ENS_14SourceLocationENSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE+0xb3>) frame #1: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed6cd in <_ZN3c106detail14torchCheckFailEPKcS2_jRKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x8d>) frame #2: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed97c in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_RKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x4c>) frame #3: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891b59b51 in <_ZN2at6native21mkldnn_matmul_i8i8i32ERKNS_6TensorES3_S3_+0x61>) frame #4: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x8915427e8 in <_ZN2at6native15_int_mm_out_cpuERKNS_6TensorES3_RS1_+0x358>) frame #5: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891543f65 in <_ZN2at6native11_int_mm_cpuERKNS_6TensorES3_+0xe5>) frame #6: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x89260e26b in <_ZN2at3cpu14nanmedian_outfERKNS_6TensorElbRS1_S4_+0x3ab>) frame #7: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b07788 in <_ZN5torch8autograd30autogradNotImplementedFallbackEv+0x938>) frame #8: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891cc22ff in <_ZN2at4_ops24_fused_adagrad_tensor_lr10redispatchEN3c1014DispatchKeySetENS2_8ArrayRefINS_6TensorEEES6_S6_S6_RKS5_dddbRKNSt3__18optionalIS5_EESD_+0x1715f>) frame #9: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891de379e in <_ZN2at4_ops7_int_mm4callERKNS_6TensorES4_+0x20e>) frame #10: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88be87b74 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x1073a4>) frame #11: /usr/local/lib/libpython3.12.so.1.0 + (0x8217294b1 in ) frame #12: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #13: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #14: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #15: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #16: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #17: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #18: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b05fe4 in <_ZN5torch8autograd35basicAutogradNotImplementedFallbackEv+0x5e4>) frame #19: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #20: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #21: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #22: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #23: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #24: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #25: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #26: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #27: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #28: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #29: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #30: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #31: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #32: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #33: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #34: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b05fe4 in <_ZN5torch8autograd35basicAutogradNotImplementedFallbackEv+0x5e4>) frame #35: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #36: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #37: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #38: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #39: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #40: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #41: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #42: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #43: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #44: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #45: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #46: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2be7 in ) frame #47: /usr/local/lib/libpython3.12.so.1.0 + (0x821918c05 in ) frame #48: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #49: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #50: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c6743 in ) frame #51: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2be7 in ) frame #52: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #53: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #54: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #55: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #56: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #57: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #58: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #59: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #60: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #61: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c68de in ) (Triggered internally at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/LinearAlgebra.cpp:3729.) return torch._int_mm( tests/test_ops.py::TestLLMInt8Ops::test_int8_linear_matmul[cpu] tests/test_ops.py::TestLLMInt8Ops::test_int8_linear_matmul[cpu] /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/bitsandbytes/backends/cpu/ops.py:30: UserWarning: int_mm_out_cpu failed, switching to BLAS gemm: false INTERNAL ASSERT FAILED at "/wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp":85, please report a bug to PyTorch. mkldnn_matmul_i8i8i32: ATen not compiled with MKLDNN support Exception raised from mkldnn_matmul_i8i8i32 at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp:85 (most recent call first): frame #0: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6f0f03 in <_ZN3c105ErrorC1ENS_14SourceLocationENSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE+0xb3>) frame #1: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed6cd in <_ZN3c106detail14torchCheckFailEPKcS2_jRKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x8d>) frame #2: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed97c in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_RKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x4c>) frame #3: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891b59b51 in <_ZN2at6native21mkldnn_matmul_i8i8i32ERKNS_6TensorES3_S3_+0x61>) frame #4: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x8915427e8 in <_ZN2at6native15_int_mm_out_cpuERKNS_6TensorES3_RS1_+0x358>) frame #5: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891543f65 in <_ZN2at6native11_int_mm_cpuERKNS_6TensorES3_+0xe5>) frame #6: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x89260e26b in <_ZN2at3cpu14nanmedian_outfERKNS_6TensorElbRS1_S4_+0x3ab>) frame #7: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b07788 in <_ZN5torch8autograd30autogradNotImplementedFallbackEv+0x938>) frame #8: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891cc22ff in <_ZN2at4_ops24_fused_adagrad_tensor_lr10redispatchEN3c1014DispatchKeySetENS2_8ArrayRefINS_6TensorEEES6_S6_S6_RKS5_dddbRKNSt3__18optionalIS5_EESD_+0x1715f>) frame #9: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891de379e in <_ZN2at4_ops7_int_mm4callERKNS_6TensorES4_+0x20e>) frame #10: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88be87b74 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x1073a4>) frame #11: /usr/local/lib/libpython3.12.so.1.0 + (0x8217294b1 in ) frame #12: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #13: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #14: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #15: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #16: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #17: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #18: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b05fe4 in <_ZN5torch8autograd35basicAutogradNotImplementedFallbackEv+0x5e4>) frame #19: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #20: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #21: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #22: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #23: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #24: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #25: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #26: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #27: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #28: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #29: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #30: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c6743 in ) frame #31: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2be7 in ) frame #32: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #33: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #34: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #35: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #36: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #37: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #38: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #39: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #40: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #41: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c68de in ) frame #42: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #43: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #44: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #45: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #46: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #47: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #48: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #49: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #50: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #51: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #52: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #53: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #54: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #55: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e24aa in ) frame #56: /usr/local/lib/libpython3.12.so.1.0 + (0x8217de9dd in ) frame #57: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #58: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #59: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #60: /usr/local/lib/libpython3.12.so.1.0 + (0x821894096 in ) frame #61: /usr/local/lib/libpython3.12.so.1.0 + (0x82189387a in ) (Triggered internally at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/LinearAlgebra.cpp:3729.) return torch._int_mm( tests/test_ops.py::TestLLMInt8Ops::test_int8_linear_matmul[cpu] tests/test_ops.py::TestLLMInt8Ops::test_int8_linear_matmul[cpu] tests/test_ops.py::TestLLMInt8Ops::test_int8_linear_matmul[cpu] /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/bitsandbytes/backends/cpu/ops.py:30: UserWarning: int_mm_out_cpu failed, switching to BLAS gemm: false INTERNAL ASSERT FAILED at "/wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp":85, please report a bug to PyTorch. mkldnn_matmul_i8i8i32: ATen not compiled with MKLDNN support Exception raised from mkldnn_matmul_i8i8i32 at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp:85 (most recent call first): frame #0: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6f0f03 in <_ZN3c105ErrorC1ENS_14SourceLocationENSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE+0xb3>) frame #1: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed6cd in <_ZN3c106detail14torchCheckFailEPKcS2_jRKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x8d>) frame #2: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed97c in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_RKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x4c>) frame #3: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891b59b51 in <_ZN2at6native21mkldnn_matmul_i8i8i32ERKNS_6TensorES3_S3_+0x61>) frame #4: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x8915427e8 in <_ZN2at6native15_int_mm_out_cpuERKNS_6TensorES3_RS1_+0x358>) frame #5: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891543f65 in <_ZN2at6native11_int_mm_cpuERKNS_6TensorES3_+0xe5>) frame #6: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x89260e214 in <_ZN2at3cpu14nanmedian_outfERKNS_6TensorElbRS1_S4_+0x354>) frame #7: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891de3738 in <_ZN2at4_ops7_int_mm4callERKNS_6TensorES4_+0x1a8>) frame #8: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88be87b74 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x1073a4>) frame #9: /usr/local/lib/libpython3.12.so.1.0 + (0x8217294b1 in ) frame #10: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #11: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #12: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #13: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #14: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #15: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #16: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #17: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #18: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #19: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #20: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #21: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #22: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #23: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #24: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #25: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #26: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #27: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c68de in ) frame #28: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c385f in ) frame #29: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c3e96 in ) frame #30: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c818e43 in <_ZN5torch42handle_torch_function_no_python_arg_parserEN3c108ArrayRefIP7_objectEES3_S3_PKcS3_S6_NS_17TorchFunctionNameE+0x573>) frame #31: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c132fa2 in <_Z16getPyInterpreterv+0x1122>) frame #32: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891233f5e in <_ZN2at4impl23MaybeSetTLSOnEntryGuardD2Ev+0x32e>) frame #33: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b05fe4 in <_ZN5torch8autograd35basicAutogradNotImplementedFallbackEv+0x5e4>) frame #34: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891234845 in <_ZN2at4impl23MaybeSetTLSOnEntryGuardD2Ev+0xc15>) frame #35: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #36: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #37: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #38: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #39: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #40: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #41: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #42: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #43: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #44: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #45: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #46: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c6743 in ) frame #47: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2be7 in ) frame #48: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #49: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #50: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #51: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #52: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #53: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #54: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #55: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #56: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #57: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c68de in ) frame #58: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #59: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #60: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #61: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) (Triggered internally at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/LinearAlgebra.cpp:3729.) return torch._int_mm( tests/test_ops.py::TestLLMInt8Ops::test_int8_linear_matmul[cpu] tests/test_ops.py::TestLLMInt8Ops::test_int8_linear_matmul[cpu] /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/bitsandbytes/backends/cpu/ops.py:30: UserWarning: int_mm_out_cpu failed, switching to BLAS gemm: false INTERNAL ASSERT FAILED at "/wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp":85, please report a bug to PyTorch. mkldnn_matmul_i8i8i32: ATen not compiled with MKLDNN support Exception raised from mkldnn_matmul_i8i8i32 at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp:85 (most recent call first): frame #0: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6f0f03 in <_ZN3c105ErrorC1ENS_14SourceLocationENSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE+0xb3>) frame #1: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed6cd in <_ZN3c106detail14torchCheckFailEPKcS2_jRKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x8d>) frame #2: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed97c in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_RKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x4c>) frame #3: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891b59b51 in <_ZN2at6native21mkldnn_matmul_i8i8i32ERKNS_6TensorES3_S3_+0x61>) frame #4: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x8915427e8 in <_ZN2at6native15_int_mm_out_cpuERKNS_6TensorES3_RS1_+0x358>) frame #5: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891543f65 in <_ZN2at6native11_int_mm_cpuERKNS_6TensorES3_+0xe5>) frame #6: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x89260e26b in <_ZN2at3cpu14nanmedian_outfERKNS_6TensorElbRS1_S4_+0x3ab>) frame #7: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b07788 in <_ZN5torch8autograd30autogradNotImplementedFallbackEv+0x938>) frame #8: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891cc22ff in <_ZN2at4_ops24_fused_adagrad_tensor_lr10redispatchEN3c1014DispatchKeySetENS2_8ArrayRefINS_6TensorEEES6_S6_S6_RKS5_dddbRKNSt3__18optionalIS5_EESD_+0x1715f>) frame #9: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891de379e in <_ZN2at4_ops7_int_mm4callERKNS_6TensorES4_+0x20e>) frame #10: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88be87b74 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x1073a4>) frame #11: /usr/local/lib/libpython3.12.so.1.0 + (0x8217294b1 in ) frame #12: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #13: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #14: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #15: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #16: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #17: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #18: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b05fe4 in <_ZN5torch8autograd35basicAutogradNotImplementedFallbackEv+0x5e4>) frame #19: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #20: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #21: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #22: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #23: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #24: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #25: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #26: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #27: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #28: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #29: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #30: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2be7 in ) frame #31: /usr/local/lib/libpython3.12.so.1.0 + (0x821918c05 in ) frame #32: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #33: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #34: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c6743 in ) frame #35: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2be7 in ) frame #36: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #37: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #38: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #39: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #40: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #41: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #42: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #43: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #44: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #45: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c68de in ) frame #46: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #47: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #48: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #49: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #50: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #51: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #52: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #53: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #54: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #55: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #56: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #57: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #58: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #59: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e24aa in ) frame #60: /usr/local/lib/libpython3.12.so.1.0 + (0x8217de9dd in ) frame #61: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) (Triggered internally at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/LinearAlgebra.cpp:3729.) return torch._int_mm( tests/test_ops.py::TestLLMInt8Ops::test_int8_linear_matmul[cpu] tests/test_ops.py::TestLLMInt8Ops::test_int8_linear_matmul[cpu] /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/bitsandbytes/backends/cpu/ops.py:30: UserWarning: int_mm_out_cpu failed, switching to BLAS gemm: false INTERNAL ASSERT FAILED at "/wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp":85, please report a bug to PyTorch. mkldnn_matmul_i8i8i32: ATen not compiled with MKLDNN support Exception raised from mkldnn_matmul_i8i8i32 at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp:85 (most recent call first): frame #0: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6f0f03 in <_ZN3c105ErrorC1ENS_14SourceLocationENSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE+0xb3>) frame #1: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed6cd in <_ZN3c106detail14torchCheckFailEPKcS2_jRKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x8d>) frame #2: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed97c in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_RKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x4c>) frame #3: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891b59b51 in <_ZN2at6native21mkldnn_matmul_i8i8i32ERKNS_6TensorES3_S3_+0x61>) frame #4: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x8915427e8 in <_ZN2at6native15_int_mm_out_cpuERKNS_6TensorES3_RS1_+0x358>) frame #5: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891543f65 in <_ZN2at6native11_int_mm_cpuERKNS_6TensorES3_+0xe5>) frame #6: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x89260e214 in <_ZN2at3cpu14nanmedian_outfERKNS_6TensorElbRS1_S4_+0x354>) frame #7: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891de3738 in <_ZN2at4_ops7_int_mm4callERKNS_6TensorES4_+0x1a8>) frame #8: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88be87b74 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x1073a4>) frame #9: /usr/local/lib/libpython3.12.so.1.0 + (0x8217294b1 in ) frame #10: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #11: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #12: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #13: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #14: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #15: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #16: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #17: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #18: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #19: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #20: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #21: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #22: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #23: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #24: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #25: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #26: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #27: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c68de in ) frame #28: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c385f in ) frame #29: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c3e96 in ) frame #30: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c818e43 in <_ZN5torch42handle_torch_function_no_python_arg_parserEN3c108ArrayRefIP7_objectEES3_S3_PKcS3_S6_NS_17TorchFunctionNameE+0x573>) frame #31: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c132fa2 in <_Z16getPyInterpreterv+0x1122>) frame #32: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891233f5e in <_ZN2at4impl23MaybeSetTLSOnEntryGuardD2Ev+0x32e>) frame #33: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b05fe4 in <_ZN5torch8autograd35basicAutogradNotImplementedFallbackEv+0x5e4>) frame #34: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891234845 in <_ZN2at4impl23MaybeSetTLSOnEntryGuardD2Ev+0xc15>) frame #35: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #36: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #37: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #38: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #39: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #40: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #41: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #42: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #43: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #44: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #45: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #46: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c68de in ) frame #47: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #48: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c68de in ) frame #49: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #50: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c68de in ) frame #51: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #52: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #53: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #54: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #55: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #56: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #57: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #58: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #59: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #60: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2be7 in ) frame #61: /usr/local/lib/libpython3.12.so.1.0 + (0x821918c05 in ) (Triggered internally at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/LinearAlgebra.cpp:3729.) return torch._int_mm( tests/test_functional.py: 16 warnings /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/bitsandbytes/backends/cpu/ops.py:30: UserWarning: int_mm_out_cpu failed, switching to BLAS gemm: false INTERNAL ASSERT FAILED at "/wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp":85, please report a bug to PyTorch. mkldnn_matmul_i8i8i32: ATen not compiled with MKLDNN support Exception raised from mkldnn_matmul_i8i8i32 at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp:85 (most recent call first): frame #0: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6f0f03 in <_ZN3c105ErrorC1ENS_14SourceLocationENSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE+0xb3>) frame #1: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed6cd in <_ZN3c106detail14torchCheckFailEPKcS2_jRKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x8d>) frame #2: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed97c in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_RKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x4c>) frame #3: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891b59b51 in <_ZN2at6native21mkldnn_matmul_i8i8i32ERKNS_6TensorES3_S3_+0x61>) frame #4: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x8915427e8 in <_ZN2at6native15_int_mm_out_cpuERKNS_6TensorES3_RS1_+0x358>) frame #5: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891543f65 in <_ZN2at6native11_int_mm_cpuERKNS_6TensorES3_+0xe5>) frame #6: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x89260e26b in <_ZN2at3cpu14nanmedian_outfERKNS_6TensorElbRS1_S4_+0x3ab>) frame #7: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b07788 in <_ZN5torch8autograd30autogradNotImplementedFallbackEv+0x938>) frame #8: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891cc22ff in <_ZN2at4_ops24_fused_adagrad_tensor_lr10redispatchEN3c1014DispatchKeySetENS2_8ArrayRefINS_6TensorEEES6_S6_S6_RKS5_dddbRKNSt3__18optionalIS5_EESD_+0x1715f>) frame #9: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891de379e in <_ZN2at4_ops7_int_mm4callERKNS_6TensorES4_+0x20e>) frame #10: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88be87b74 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x1073a4>) frame #11: /usr/local/lib/libpython3.12.so.1.0 + (0x8217294b1 in ) frame #12: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #13: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #14: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #15: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #16: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #17: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #18: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #19: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #20: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #21: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b05fe4 in <_ZN5torch8autograd35basicAutogradNotImplementedFallbackEv+0x5e4>) frame #22: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #23: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #24: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #25: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #26: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #27: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #28: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #29: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #30: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #31: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #32: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #33: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #34: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #35: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c6743 in ) frame #36: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2be7 in ) frame #37: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #38: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #39: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #40: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #41: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #42: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #43: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #44: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #45: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #46: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #47: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #48: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #49: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #50: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #51: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #52: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #53: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #54: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #55: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #56: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #57: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #58: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #59: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #60: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #61: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) (Triggered internally at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/LinearAlgebra.cpp:3729.) return torch._int_mm( tests/test_modules.py::test_linear8bitlt_inference[threshold=0.0-cpu] tests/test_modules.py::test_linear8bitlt_no_fp16_weights[0.0-cpu] /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/bitsandbytes/backends/cpu/ops.py:30: UserWarning: int_mm_out_cpu failed, switching to BLAS gemm: false INTERNAL ASSERT FAILED at "/wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp":85, please report a bug to PyTorch. mkldnn_matmul_i8i8i32: ATen not compiled with MKLDNN support Exception raised from mkldnn_matmul_i8i8i32 at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp:85 (most recent call first): frame #0: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6f0f03 in <_ZN3c105ErrorC1ENS_14SourceLocationENSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE+0xb3>) frame #1: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed6cd in <_ZN3c106detail14torchCheckFailEPKcS2_jRKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x8d>) frame #2: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed97c in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_RKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x4c>) frame #3: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891b59b51 in <_ZN2at6native21mkldnn_matmul_i8i8i32ERKNS_6TensorES3_S3_+0x61>) frame #4: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x8915427e8 in <_ZN2at6native15_int_mm_out_cpuERKNS_6TensorES3_RS1_+0x358>) frame #5: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891543f65 in <_ZN2at6native11_int_mm_cpuERKNS_6TensorES3_+0xe5>) frame #6: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x89260e26b in <_ZN2at3cpu14nanmedian_outfERKNS_6TensorElbRS1_S4_+0x3ab>) frame #7: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b07788 in <_ZN5torch8autograd30autogradNotImplementedFallbackEv+0x938>) frame #8: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891cc22ff in <_ZN2at4_ops24_fused_adagrad_tensor_lr10redispatchEN3c1014DispatchKeySetENS2_8ArrayRefINS_6TensorEEES6_S6_S6_RKS5_dddbRKNSt3__18optionalIS5_EESD_+0x1715f>) frame #9: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891de379e in <_ZN2at4_ops7_int_mm4callERKNS_6TensorES4_+0x20e>) frame #10: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88be87b74 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x1073a4>) frame #11: /usr/local/lib/libpython3.12.so.1.0 + (0x8217294b1 in ) frame #12: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #13: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #14: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #15: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #16: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #17: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #18: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #19: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #20: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #21: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b05fe4 in <_ZN5torch8autograd35basicAutogradNotImplementedFallbackEv+0x5e4>) frame #22: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #23: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #24: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #25: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #26: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #27: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #28: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #29: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #30: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #31: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #32: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #33: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #34: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #35: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #36: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #37: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #38: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #39: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #40: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b05fe4 in <_ZN5torch8autograd35basicAutogradNotImplementedFallbackEv+0x5e4>) frame #41: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #42: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #43: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #44: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #45: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #46: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #47: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2be7 in ) frame #48: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #49: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #50: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #51: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #52: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #53: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c20bf36 in <_ZN5torch8autograd20THPCppFunction_CheckEP7_object+0xbed6>) frame #54: /usr/local/lib/libpython3.12.so.1.0 + (0x8217294b1 in ) frame #55: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2fa0 in <_PyObject_Call+0x90>) frame #56: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #57: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #58: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #59: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #60: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #61: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c68de in ) (Triggered internally at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/LinearAlgebra.cpp:3729.) return torch._int_mm( tests/test_modules.py::test_linear8bitlt_inference[threshold=3.0-cpu] tests/test_modules.py::test_linear8bitlt_no_fp16_weights[2.0-cpu] /usr/ports/misc/py-bitsandbytes/work-py312/bitsandbytes-0.50.2/bitsandbytes/backends/cpu/ops.py:30: UserWarning: int_mm_out_cpu failed, switching to BLAS gemm: false INTERNAL ASSERT FAILED at "/wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp":85, please report a bug to PyTorch. mkldnn_matmul_i8i8i32: ATen not compiled with MKLDNN support Exception raised from mkldnn_matmul_i8i8i32 at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/mkldnn/Matmul.cpp:85 (most recent call first): frame #0: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6f0f03 in <_ZN3c105ErrorC1ENS_14SourceLocationENSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE+0xb3>) frame #1: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed6cd in <_ZN3c106detail14torchCheckFailEPKcS2_jRKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x8d>) frame #2: /usr/local/lib/python3.12/site-packages/torch/lib/libc10.so + (0x89e6ed97c in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_RKNSt3__112basic_stringIcNS3_11char_traitsIcEENS3_9allocatorIcEEEE+0x4c>) frame #3: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891b59b51 in <_ZN2at6native21mkldnn_matmul_i8i8i32ERKNS_6TensorES3_S3_+0x61>) frame #4: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x8915427e8 in <_ZN2at6native15_int_mm_out_cpuERKNS_6TensorES3_RS1_+0x358>) frame #5: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891543f65 in <_ZN2at6native11_int_mm_cpuERKNS_6TensorES3_+0xe5>) frame #6: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x89260e26b in <_ZN2at3cpu14nanmedian_outfERKNS_6TensorElbRS1_S4_+0x3ab>) frame #7: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b07788 in <_ZN5torch8autograd30autogradNotImplementedFallbackEv+0x938>) frame #8: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891cc22ff in <_ZN2at4_ops24_fused_adagrad_tensor_lr10redispatchEN3c1014DispatchKeySetENS2_8ArrayRefINS_6TensorEEES6_S6_S6_RKS5_dddbRKNSt3__18optionalIS5_EESD_+0x1715f>) frame #9: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x891de379e in <_ZN2at4_ops7_int_mm4callERKNS_6TensorES4_+0x20e>) frame #10: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88be87b74 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x1073a4>) frame #11: /usr/local/lib/libpython3.12.so.1.0 + (0x8217294b1 in ) frame #12: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #13: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #14: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #15: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #16: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #17: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #18: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #19: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #20: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #21: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b05fe4 in <_ZN5torch8autograd35basicAutogradNotImplementedFallbackEv+0x5e4>) frame #22: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #23: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #24: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #25: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #26: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #27: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #28: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #29: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c22a7 in <_PyObject_FastCallDictTstate+0x127>) frame #30: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #31: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #32: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #33: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #34: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #35: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #36: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #37: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #38: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #39: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #40: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b05fe4 in <_ZN5torch8autograd35basicAutogradNotImplementedFallbackEv+0x5e4>) frame #41: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) frame #42: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5485b6 in <_ZN5torch3jit24invokeOperatorFromPythonERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEERKN8pybind114argsERKNSB_6kwargsENS1_8optionalIN3c1011DispatchKeyEEE+0xf6>) frame #43: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c5491d6 in <_ZN5torch3jit37_get_operation_for_overload_or_packetERKNSt3__16vectorINS1_10shared_ptrINS0_8OperatorEEENS1_9allocatorIS5_EEEEN3c106SymbolERKN8pybind114argsERKNSD_6kwargsEbNS1_8optionalINSB_11DispatchKeyEEE+0x326>) frame #44: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c44877b in ) frame #45: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88bbdf67a in <_ZTSN5torch11distributed3rpc9OwnerRRefE+0x1f4b6b>) frame #46: /usr/local/lib/libpython3.12.so.1.0 + (0x821728a03 in ) frame #47: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2be7 in ) frame #48: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #49: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c222e in <_PyObject_FastCallDictTstate+0xae>) frame #50: /usr/local/lib/libpython3.12.so.1.0 + (0x821752c61 in <_PyObject_GetState+0x5f31>) frame #51: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2463 in <_PyObject_MakeTpCall+0x113>) frame #52: /usr/local/lib/libpython3.12.so.1.0 + (0x8217e95e0 in <_PyEval_EvalFrameDefault+0x6f00>) frame #53: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #54: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #55: /usr/local/lib/libpython3.12.so.1.0 + (0x8217eb4bb in <_PyEval_EvalFrameDefault+0x8ddb>) frame #56: /usr/local/lib/libpython3.12.so.1.0 + (0x8216c2d35 in ) frame #57: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c02bb98 in <_ZN3c106detail23torchInternalAssertFailEPKcS2_jS2_NS0_22CompileTimeEmptyStringE+0x2ab3c8>) frame #58: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c498fe4 in ) frame #59: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_python.so + (0x88c84ea01 in <_ZN5torch10PythonArgs11scalar_slowEP7_object+0x2d421>) frame #60: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x895b05fe4 in <_ZN5torch8autograd35basicAutogradNotImplementedFallbackEv+0x5e4>) frame #61: /usr/local/lib/python3.12/site-packages/torch/lib/libtorch_cpu.so + (0x890f911c0 in <_ZN2at17functionalization21_unsafe_view_ViewMeta7reverseERKNS_6TensorES4_+0x6160>) (Triggered internally at /wrkdirs/usr/ports/misc/py-pytorch/work-py312/pytorch-v2.13.0/aten/src/ATen/native/LinearAlgebra.cpp:3729.) return torch._int_mm( -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html =========================== short test summary info ============================ SKIPPED [1] tests/test_linear4bit.py:593: FSDP requires an accelerator device SKIPPED [12] tests/test_optim.py:175: Skipped SKIPPED [60] tests/test_optim.py:169: Paged optimizers are not meaningful on CPU SKIPPED [18] tests/test_ops.py:456: Non-contiguous input handling not implemented for this backend SKIPPED [18] tests/test_ops.py:433: Non-contiguous input handling not implemented for this backend SKIPPED [9] tests/test_ops.py:102: CPU implementation is slow; only test blocksize=256 SKIPPED [12] tests/test_ops.py:235: CPU/MPS implementation only supports blocksize <= in_features SKIPPED [3] tests/test_linear8bitlt.py: got empty parameter set for (linear8bit) SKIPPED [1] tests/test_linear8bitlt.py:331: No accelerator device SKIPPED [8] tests/test_generation.py:74: need --slow option to run SKIPPED [36] tests/test_functional.py:123: Only blocksize 256 is used in CPU/MPS/XPU SKIPPED [18] tests/test_functional.py:227: CPU implementation only supports 8 bits SKIPPED [4] tests/test_functional.py:125: Only float32 is used in CPU/MPS/XPU SKIPPED [42] tests/test_functional.py:121: Not a typical use case. SKIPPED [3] tests/test_functional.py:171: No accelerator device SKIPPED [1] tests/conftest.py:23: Torch not compiled with CUDA enabled SKIPPED [864] tests/test_functional.py:994: narrowed on CPU SKIPPED [18] tests/test_functional.py:697: No accelerator device SKIPPED [1] tests/test_functional.py:729: CUDA is required SKIPPED [4] tests/test_functional.py:461: CUDA is required SKIPPED [1] tests/test_functional.py:510: Slow on CPU SKIPPED [1] tests/test_modules.py:451: got empty parameter set for (device) SKIPPED [1] tests/test_modules.py:469: got empty parameter set for (device) = 2341 passed, 1136 skipped, 30 xfailed, 99 warnings, 27 errors in 905.70s (0:15:05) = *** Error code 1 Stop. make: stopped making "test" in /usr/ports/misc/py-bitsandbytes