Using kerberized lustre over the WAN for high energy physics data
Josephine Palencia, Robert Budden, Kathy Benninger, J. L. Rodriguez, John Dilascio, D. Bourilkov, Paul Avery, Mengxing Cheng, Yu Ping Fu, Bockjoo Kim, Drew Oliver, Daniel Majchrzak, Dave Dykstra, Nirmal Seenu, Donald C. Shrum, James C. Wilgenbusch · 2012
This paper reports the design and implementation of a secure, wide area network, distributed filesystem by the ExTENCI project (Extending Science Through Enhanced National Cyber Infrastructure) based on lustre. The filesystem is used for remote access to analysis data from the Compact Muon Solenoid (CMS) experiment at the Large Hadron Collider (LHC), and from the Lattice Quantum ChromoDynamics (LQCD) project. Security is provided for by kerberos and reinforced with additional finegrained control using lustre ACLs and quotas. We show the impact of using kerberized lustre on the IO rates of CMS and LQCD applications on client nodes, both real and virtual. Pre-configured images of lustre virtual clients containing the complete software stack ease the difficulty of managing these systems.