A Multilevel Test and Evaluation Modularization for Test Event Optimization
Seunglim Lee, Mahmoud Efatmaneshnik, Ady James · 2024
Test and Evaluation (T&E) is essential in developing large-scale systems, as it is an enabling process assessing the system’s performance and reliability. At the same time, T&E is the most expensive, and most difficult phase to de-risk in system development. A particular difficulty with T&E activities in the Systems Engineering (SE) V-model is that T&E is in the reverse direction of system design, as attributed to its structure. A bottom-up approach for testing a system that is decomposed from a high-level perspective can often put tacit pressure on test practitioners to ensure that every detail is tested, and nothing is neglected. This can result in deficiencies and inefficiencies in system testing. To be an enabler in successful system acquisition, a test-oriented modular approach is needed, in which test events (type of test, schedule of test) can be optimized from a holistic perspective. Modularization is credited with many benefits in addressing the complexity of systems where many constituents are involved. Yet, in terms of multilevel T&E optimization, modularization has not been researched at the same level as some other system design practices. This paper provides a focused T&E view of the SE V-model which allows for better planning and execution of various test activities that are under-prescribed in the V-model towards T&E optimization. In this paper, a test-oriented modularization architecture is defined that enables better focus on different aspects of complex systems testing, such as cost, time and assurance.