Fusing Adds and Shifts for Efficient Dot Products
Pavel Golikov, Karthik Ganesan, Gennady Pekhimenko, Mark C. Jeffrey · IEEE Computer Architecture Letters · 2025
Dot products are heavily used in applications like graphics, signal processing, navigation, and artificial intelligence (AI). These AI models in particular impose significant computational demands on modern computers. Current accelerators typically implement dot product hardware as a row of multipliers followed by a tree of adders. However, treating multiplication and summation operations separately leads to sub-optimal hardware. In contrast, we obtain significant area savings by considering the dot product operation as a whole. We proposeFASED, which fuses components of a Booth multiplier with the adder tree to eliminate a significant portion of full adders from a baseline INT8×INT8,4,2 design. Compared to popular dot product hardware units,FASEDreduces area by up to$1.9\times$.