High-Dimensional Learning Dynamics of Quantized Models with Straight-Through Estimator

ORID bI9moH3UZw · tags icml2026-repro paper-bI9moH3UZw

#StatusPageArtifactClaim excerpt
1VERIFIED 2/201-high-dimensional-limit-microscopic-dynamics-straartifactIn the high-dimensional limit, the microscopic dynamics of straight-through esti…
2VERIFIED 2/202-macroscopic-summary-statistics-ste-trainingartifactThe macroscopic summary statistics of STE training concentrate onto a determinis…
3VERIFIED 2/203-ste-training-exhibits-extended-plateauartifactSTE training exhibits an extended plateau followed by a sharp drop in generaliza…
4VERIFIED 2/204-input-only-quantization-closed-form-stable-fixedartifactFor input-only quantization, a closed-form stable fixed point exists under the l…
5VERIFIED 2/205-asymptotic-deviation-ste-trained-quantized-modelartifactThe asymptotic deviation of the STE-trained quantized model from the unquantized…

Open logbook index · logbook.json