Are AI Models Working Harder Than They Need to?

IEEE Spectrum · 1 month ago · 42

Researcher Lizy K. John has developed weightless neural networks that replace multiplication-based computations with binary lookups through interconnected tables, reducing model size and energy consumption by up to 1,000 times compared to conventional neural networks while maintaining accuracy. Her team has demonstrated the approach on specific tasks like medical sensors (achieving 14 kilobytes versus 17 megabytes for competitors) and keyword spotting (42-79 nanojoules per inference versus 5,000+ for industry standard models). If the approach scales to larger language models, it could shift AI deployment from energy-intensive servers to edge devices like smart sensors and flexible substrates, eliminating raw data transmission and reducing manufacturing water usage.