This new method could reduce the energy needs of AI applications by 95% but may also need whole new forms of hardware

Date:
Mon, 25 Nov 2024 22:29:00 +0000

Description:
New method could reduce energy consumption of AI applications by up to 95%.

FULL STORY ======================================================================Engineer s reveal alternative to floating-point multiplication New method could reduce AI energy consumption by up to 95% But new calculation method would also need alternative hardware to existing GPUs

As artificial intelligence ( AI ) technologies evolve, the demand for computing power - and consequently, electricity - has surged, as have
concerns about its energy consumption.

Now, engineers from BitEnergy AI offers a potential solution - a new method
of computation which could reduce the energy needs of AI applications by up
to 95%.

Linear-Complexity Multiplication could apparently reducing the energy needs
of AI applications by 95% by changing how AI calculations are performed, moving away from the traditional use of floating-point multiplication (FPM)
in favor of integer addition. From floating-point multiplication to linear-complexity multiplication

FPM is typically used in AI computations because it allows systems to handle very large or small numbers with high precision - however, it is also one of the most energy-intensive operations in AI processing. The precision FPM offers is necessary for many AI applications, particularly in areas like deep learning, where models require detailed calculations.

The researchers claim despite cutting energy consumption, there is no impact on the performance of AI applications. However, while the Linear-Complexity Multiplication method shows great promise, its adoption faces certain challenges.

One significant drawback is that the new technique requires different
hardware to what is currently in use. Most AI applications today run on hardware optimized for floating-point computations, such as GPUs made by companies like Nvidia. The new method would require redesigned hardware to function effectively.

The team notes the hardware needed for its method has already been designed, built, and tested. However, this new hardware will need to be licensed and there is no telling how this hardware will be made available to the broader market.

Estimates suggest ChatGPT alone currently consumes approximately 564 MWh of electricity daily, enough to power 18,000 US households. Some critics predict that in just a few years, AI applications could consume around 100 TWh of electricity annually, putting them on par with the energy-hungry Bitcoin mining industry.

Via TechXplore You might also like AIs energy demands are accelerating the climate crisis IT buyers not prepared for AIs energy demands These are the best AI writers around today



======================================================================
Link to news story: https://www.techradar.com/pro/this-new-method-could-reduce-the-energy-needs-of -ai-applications-by-95


--- Mystic BBS v1.12 A47 (Linux/64)
* Origin: tqwNet Technology News (1337:1/100)