Tensorized Optical Multimodal Fusion Network
Yequan Zhao, Xian Xiao, Géza Kurczveil, Raymond G. Beausoleil, Zheng Zhang · arXiv (Cornell University) · 2023
We propose the first tensorized optical multimodal fusion network architecture with a self-attention mechanism and low-rank tensor fusion. Simulation results show $51.3 \times$ less hardware requirement and $3.7\times 10^{13}$ MAC/J energy efficiency.