Import AI 454: Automating alignment research; safety study of a Chinese model; HiFloat4

Import AI · 2 months ago

Huawei developed HiFloat4, a 4-bit precision format for AI training that outperformed the Western-developed MXFP4 format on its Ascend chips, suggesting Chinese companies are building specialized hardware-software combinations to work around export restrictions. In direct comparison testing on models up to 30 billion parameters, HiFloat4 achieved approximately 1.0% relative loss error versus MXFP4's 1.5% when measured against a full-precision baseline. This reflects broader Chinese efforts to maximize efficiency of homegrown semiconductors as access to advanced Western chips remains limited.