Researchers upend AI status quo by eliminating matrix multiplication in LLMs
Researchers upend AI status quo by eliminating matrix multiplication in LLMs
https://arstechnica.com/information-technology/2024/06/researchers-upend-ai-status-quo-by-eliminating-matrix-multiplication-in-llms/2/
Running AI models without floating point matrix math could mean far less power consumption.