Modeling the computing based testing domain extending IMS QTI: framework, models and exemplary implementations

Abstract

Using technology to create new types of questions is important, but also exploring new types of test representations or analyzing the most adequate technological device to support a specific assessment activity based on tests. This paper presents a conceptual model that defines and relates three dimensions to be considered for advancing on Computing-Based Testing (CBT): the Question-item, the Test and the Activity. The framework assists in the categorization and design of advanced CBT scenarios and opens a new domain for questions and tests supported by ICT. Besides, the paper proposes two models for the technological design and implementation of the Test and Question-item dimensions. The models represent an extension of the IMS Question and Test Interoperability standard. They are platform-independent models (PIMs) that formulate the elements that can be mapped to platform-specific models (PSMs) for implementing advanced CBT solutions. To show the relevance, value and usability of the contributions, the paper also describes the application of the framework and PIMs to design and implement three exemplary CBT scenarios with their corresponding CBT-PSMs. Within the global scope of the CBT conceptual model, the first scenario shows how question-items can be enriched with specific multimedia information (web maps). The second scenario illustrates another particular case of the CBT domain where a test can be augmented with real physical elements. And finally, the third scenario describes an implementation that combines advanced question-items and tests using virtual worlds.