Efficient Convolutional Neural Networks for Image Processing Applications
Nicholas Chiapputo · 2022
Modern machine learning techniques focus on extremely deep and multi-pathed networks, resulting in large memory and computational requirements. This thesis explores techniques for designing efficient convolutional networks including pixel shuffling, depthwise convolutions, and various activation fucntions. These techniques are then applied to two image processing domains: single-image super-resolution and image compression. The super-resolution model, TinyPSSR, is one-third the size of the next smallest model in literature while performing similar to or better than other larger models on representative test sets. The efficient deep image compression model is significantly smaller than any other model in literature and performs similarly in both computational cost and reconstruction quality to the JPEG standard.