Import AI 454: Automating alignment research; safety study of a Chinese model; HiFloat4
Import AI Jack Clark
Huawei developed HiFloat4, a 4-bit precision format for AI training that outperformed the Western-developed MXFP4 format on its Ascend chips, suggesting Chinese companies are building specialized hardware-software combinations to work around export restrictions. In direct comparison testing on models up to 30 billion parameters, HiFloat4 achieved approximately 1.0% relative loss error versus MXFP4's 1.5% when measured against a full-precision baseline. This reflects broader Chinese efforts to maximize efficiency of homegrown semiconductors as access to advanced Western chips remains limited.
Why it matters
At what point do the financial markets price in the singularity?
