Integration and test plans for complex manufacturing systems (2024)

Boumen, R. (2007). Integration and test plans for complex manufacturing systems. [Phd Thesis 1 (Research TU/e / Graduation TU/e), Mechanical Engineering]. Technische Universiteit Eindhoven. https://doi.org/10.6100/IR628120

Boumen, R.. / Integration and test plans for complex manufacturing systems. Eindhoven : Technische Universiteit Eindhoven, 2007. 186 p.

@phdthesis{bfcf9666394044f8a3f4981f9db4e797,

title = "Integration and test plans for complex manufacturing systems",

abstract = "The integration and test phases that are part of the development and manufacturing of complex manufacturing systems are costly and time consuming. As time-to-market is becoming increasingly important, it is crucial to keep these phases as short as possible, whilemaintaining system quality. This is especially true for the time-to-market driven semiconductor industry and for companies providing manufacturing systems to this industry such as ASML, a provider of lithographic systems. The Tangram research project has the goal, to shorten integration and test time by a model-based integration and test approach. The Ph.D. project described in this thesis is part of the Tangram project. To achieve integration and test time reduction, we developed three methods that each solve one of the following three integration and test problems: • Construction of an optimal test plan with respect to time, cost and/or quality. • Construction of an optimal integration plan with respect to time, cost and/or quality. • Construction of an optimal integration and test plan with respect to time, cost and/or quality. The test plan optimization method consists of two steps. The first step is the definition of a model of the test problem. This model consists of tests that can be performed with associated cost and duration, possible faults that can reside in the system with associated fault probability and impact (importance), and the relation between the tests and the possible faults, also denoted as the test coverage for each possible fault. The second step consists of calculating the optimal test plan based on this test model given an objective function and possible constraints on time, cost and/or risk, which is a parameter for the quality of the system. By constructing an AND/OR graph of the problem, where AND nodes denote tests and OR nodes denote system states represented by the ambiguous faults, all possible test sequences of this problem are obtained. An algorithm selects the best solution from this AND/OR graph. This solution is a set of test sequences, where the test sequence that is followed depends on the outcome (pass/fail) of the previous tests. The integration plan optimization method consists of the same two steps as the test plan optimization method. The integration model consists of modules with their development times, interfaces that denote which modules can be integrated with each other, and test phases with their durations. Furthermore, the model consists of the relation between test phases and modules indicating which modules should be integrated before the test phase may start. Also for this problem, an AND/OR graph is constructed. The AND nodes denote integration actions and the OR nodes denote system states represented by the modules that are integrated. An algorithm selects the optimal solution from this AND/OR graph. The optimal solution has the shortest possible integration time. The solution is a tree of integration actions and test phases indicating, for each module, the sequence of integration actions and test phases. The integration and test planning method is a combination of the two previously mentioned methods and also consists of two steps. The integration and test model is a combination of the test model and the integration model, with additional relations between modules and possible faults describing in which modules these possible faults are inserted. During the construction of the integration AND/OR graph, a test AND/OR graph is constructed for each integration AND node. This test AND/OR graph represents the test phase that is performed after that integration action. The start and stop moments of these test phases are determined by the test phase positioning strategy. We developed several test phase positioning strategies according to which test phases are started, for example periodically or when a certain risk level is reached. We applied the methods developed to industrial case studies in ASML to investigate the benefits of these methods. From a case study performed in the manufacturing of lithographic machines, we learned that the duration of a test phase may be reduced by approximately 20% when using the test plan optimization method instead of creating a test plan manually. From a case study performed in the integration phase of a new prototype system, we learned that using the integration planning method may reduce integration time by almost 10% compared to a manually created integration plan. From a case study performed in the integration and test phase of a software system, we learned that the final test phase durationmay be reduced by approximately 40% when applying a risk-based test phase positioning strategy instead of the currently used periodic test phase positioning strategy. We conclude that the methods developed can be used to construct optimal integration and test plans. These optimal integration and test plans are often more efficient than manually created plans, which reduces the time-to-market of a complex system while maintaining the same final system quality. Future research should indicate how to incorporate the methods developed in the complete integration and test process, and how to obtain the information needed to create the integration and test models.",

author = "R. Boumen",

year = "2007",

doi = "10.6100/IR628120",

language = "English",

isbn = "978-90-386-1067-2",

publisher = "Technische Universiteit Eindhoven",

type = "Phd Thesis 1 (Research TU/e / Graduation TU/e)",

school = "Mechanical Engineering",

}

Boumen, R 2007, 'Integration and test plans for complex manufacturing systems', Doctor of Philosophy, Mechanical Engineering, Eindhoven. https://doi.org/10.6100/IR628120

Integration and test plans for complex manufacturing systems. / Boumen, R.
Eindhoven: Technische Universiteit Eindhoven, 2007. 186 p.

Research output: Thesis › Phd Thesis 1 (Research TU/e / Graduation TU/e)

TY - THES

T1 - Integration and test plans for complex manufacturing systems

AU - Boumen, R.

PY - 2007

Y1 - 2007

N2 - The integration and test phases that are part of the development and manufacturing of complexmanufacturing systems are costly and time consuming. As time-to-market is becomingincreasingly important, it is crucial to keep these phases as short as possible, whilemaintainingsystem quality. This is especially true for the time-to-market driven semiconductor industryand for companies providing manufacturing systems to this industry such as ASML,a provider of lithographic systems. The Tangram research project has the goal, to shortenintegration and test time by a model-based integration and test approach. The Ph.D. projectdescribed in this thesis is part of the Tangram project.To achieve integration and test time reduction, we developed three methods that eachsolve one of the following three integration and test problems:• Construction of an optimal test plan with respect to time, cost and/or quality.• Construction of an optimal integration plan with respect to time, cost and/or quality.• Construction of an optimal integration and test plan with respect to time, cost and/orquality.The test plan optimization method consists of two steps. The first step is the definitionof a model of the test problem. This model consists of tests that can be performed withassociated cost and duration, possible faults that can reside in the system with associatedfault probability and impact (importance), and the relation between the tests and the possiblefaults, also denoted as the test coverage for each possible fault. The second step consists ofcalculating the optimal test plan based on this test model given an objective function andpossible constraints on time, cost and/or risk, which is a parameter for the quality of thesystem. By constructing an AND/OR graph of the problem, where AND nodes denote testsand OR nodes denote system states represented by the ambiguous faults, all possible testsequences of this problem are obtained. An algorithm selects the best solution from thisAND/OR graph. This solution is a set of test sequences, where the test sequence that isfollowed depends on the outcome (pass/fail) of the previous tests.The integration plan optimization method consists of the same two steps as the test planoptimization method. The integration model consists of modules with their developmenttimes, interfaces that denote which modules can be integrated with each other, and testphases with their durations. Furthermore, the model consists of the relation between testphases and modules indicating which modules should be integrated before the test phasemay start. Also for this problem, an AND/OR graph is constructed. The AND nodes denoteintegration actions and the OR nodes denote system states represented by the modules thatare integrated. An algorithm selects the optimal solution from this AND/OR graph. The optimalsolution has the shortest possible integration time. The solution is a tree of integrationactions and test phases indicating, for each module, the sequence of integration actions andtest phases.The integration and test planning method is a combination of the two previously mentionedmethods and also consists of two steps. The integration and test model is a combinationof the test model and the integration model, with additional relations between modulesand possible faults describing in which modules these possible faults are inserted. Duringthe construction of the integration AND/OR graph, a test AND/OR graph is constructed foreach integration AND node. This test AND/OR graph represents the test phase that is performedafter that integration action. The start and stop moments of these test phases aredetermined by the test phase positioning strategy. We developed several test phase positioningstrategies according to which test phases are started, for example periodically or when acertain risk level is reached.We applied the methods developed to industrial case studies in ASML to investigate thebenefits of these methods. From a case study performed in the manufacturing of lithographicmachines, we learned that the duration of a test phase may be reduced by approximately20% when using the test plan optimization method instead of creating a test planmanually. From a case study performed in the integration phase of a new prototype system,we learned that using the integration planning method may reduce integration time by almost10% compared to a manually created integration plan. From a case study performed inthe integration and test phase of a software system, we learned that the final test phase durationmaybe reduced by approximately 40% when applying a risk-based test phase positioningstrategy instead of the currently used periodic test phase positioning strategy.We conclude that the methods developed can be used to construct optimal integrationand test plans. These optimal integration and test plans are often more efficient than manuallycreated plans, which reduces the time-to-market of a complex system while maintainingthe same final system quality. Future research should indicate how to incorporate the methodsdeveloped in the complete integration and test process, and how to obtain the informationneeded to create the integration and test models.

AB - The integration and test phases that are part of the development and manufacturing of complexmanufacturing systems are costly and time consuming. As time-to-market is becomingincreasingly important, it is crucial to keep these phases as short as possible, whilemaintainingsystem quality. This is especially true for the time-to-market driven semiconductor industryand for companies providing manufacturing systems to this industry such as ASML,a provider of lithographic systems. The Tangram research project has the goal, to shortenintegration and test time by a model-based integration and test approach. The Ph.D. projectdescribed in this thesis is part of the Tangram project.To achieve integration and test time reduction, we developed three methods that eachsolve one of the following three integration and test problems:• Construction of an optimal test plan with respect to time, cost and/or quality.• Construction of an optimal integration plan with respect to time, cost and/or quality.• Construction of an optimal integration and test plan with respect to time, cost and/orquality.The test plan optimization method consists of two steps. The first step is the definitionof a model of the test problem. This model consists of tests that can be performed withassociated cost and duration, possible faults that can reside in the system with associatedfault probability and impact (importance), and the relation between the tests and the possiblefaults, also denoted as the test coverage for each possible fault. The second step consists ofcalculating the optimal test plan based on this test model given an objective function andpossible constraints on time, cost and/or risk, which is a parameter for the quality of thesystem. By constructing an AND/OR graph of the problem, where AND nodes denote testsand OR nodes denote system states represented by the ambiguous faults, all possible testsequences of this problem are obtained. An algorithm selects the best solution from thisAND/OR graph. This solution is a set of test sequences, where the test sequence that isfollowed depends on the outcome (pass/fail) of the previous tests.The integration plan optimization method consists of the same two steps as the test planoptimization method. The integration model consists of modules with their developmenttimes, interfaces that denote which modules can be integrated with each other, and testphases with their durations. Furthermore, the model consists of the relation between testphases and modules indicating which modules should be integrated before the test phasemay start. Also for this problem, an AND/OR graph is constructed. The AND nodes denoteintegration actions and the OR nodes denote system states represented by the modules thatare integrated. An algorithm selects the optimal solution from this AND/OR graph. The optimalsolution has the shortest possible integration time. The solution is a tree of integrationactions and test phases indicating, for each module, the sequence of integration actions andtest phases.The integration and test planning method is a combination of the two previously mentionedmethods and also consists of two steps. The integration and test model is a combinationof the test model and the integration model, with additional relations between modulesand possible faults describing in which modules these possible faults are inserted. Duringthe construction of the integration AND/OR graph, a test AND/OR graph is constructed foreach integration AND node. This test AND/OR graph represents the test phase that is performedafter that integration action. The start and stop moments of these test phases aredetermined by the test phase positioning strategy. We developed several test phase positioningstrategies according to which test phases are started, for example periodically or when acertain risk level is reached.We applied the methods developed to industrial case studies in ASML to investigate thebenefits of these methods. From a case study performed in the manufacturing of lithographicmachines, we learned that the duration of a test phase may be reduced by approximately20% when using the test plan optimization method instead of creating a test planmanually. From a case study performed in the integration phase of a new prototype system,we learned that using the integration planning method may reduce integration time by almost10% compared to a manually created integration plan. From a case study performed inthe integration and test phase of a software system, we learned that the final test phase durationmaybe reduced by approximately 40% when applying a risk-based test phase positioningstrategy instead of the currently used periodic test phase positioning strategy.We conclude that the methods developed can be used to construct optimal integrationand test plans. These optimal integration and test plans are often more efficient than manuallycreated plans, which reduces the time-to-market of a complex system while maintainingthe same final system quality. Future research should indicate how to incorporate the methodsdeveloped in the complete integration and test process, and how to obtain the informationneeded to create the integration and test models.

U2 - 10.6100/IR628120

DO - 10.6100/IR628120

M3 - Phd Thesis 1 (Research TU/e / Graduation TU/e)

SN - 978-90-386-1067-2

PB - Technische Universiteit Eindhoven

CY - Eindhoven

ER -

Boumen R. Integration and test plans for complex manufacturing systems. Eindhoven: Technische Universiteit Eindhoven, 2007. 186 p. doi: 10.6100/IR628120