Dave,

The measurement of piping stress analysis skills by tests could be separated into a statics topics test and a dynamics topics test like the divisions of the seminars (your topics 6 & 7). I agree with you that "engineering skill is required to verify the model, interpret results and redesign systems." Maybe a preliminary test would have visual evaluation of different piping systems to decide whether stress analysis would be required along with the particular problems or results to focus on for the stress analysis. Some of the questions on the forum do reflect a lack of experience to judge the relative importance of different aspects of piping design and its stress analysis (your topic 5). A good design avoids many problems, while a poor design may result in over-simplified analysis that hides a piping problem of stress, loads, or deflections. The approach to split into "two separate levels - technical (navigation and input) and engineering (verification, diagnosis and modification) could put the proper emphasis on the engineering aspect.