F3: A Compiler for Feature Engineering
Weixi Ma, Siyu Wang, Arnaud Venet, Junhua Gu, Subbu N. Subramanian, Rocky Liu, Yafei Yang, Daniel P. Friedman · 2024
In machine learning (ML), feature engineering is a crucial step that converts raw data to model inputs. This process traditionally relies on data processing languages (typically SQL), but now faces new challenges due to advancements in ML. We present the design of F3, a domain-specific language (DSL) and compiler developed at Meta. F3 leverages approaches developed in functional programming and type theory to support the ML engineers of a platform that serves billions of users