Photo by Dave Braunschweig on Wikimedia Commons, CC-BY-SA-3.0
For my Instructional Design and Technology Masters project, I developed an evaluation process to assess the user experience of the Integer Multiplication learning object, which was created using Articulate Storyline. Prior to the evaluation process, the Integer Multiplication learning object had been evaluated by subject matter experts (middle and high school math teachers, as well as a high school special education teacher). However, the learning object needed to be evaluated by potential users to determine if the learning object was effective at reinforcing students’ conceptual understanding of integer multiplication or whether it was effective at building students’ procedural fluency with integer multiplication. Additionally, users needed to determine whether the learning object was easy to use and engaging.
Click the button below to go to the Integer Multiplication Learning Object.
Evaluation Plan
The evaluation plan details the user experience evaluation that was designed to evaluate the Integer Multiplication learning object. The background and needs statement for the learning object as well as the instructional design models (Keller’s ARCS Model of Motivation and the ADDIE Instructional Design model) used in the development of the learning object. Additionally, the evaluation methodology and sampling methodology are detailed. The rationale for the evaluation instrument, which was developed from the Schrepp, Hinderks, and Thomaschewski’s User Experience Questionnaire+ (UEQ+) and Moshagen and Thielsch’s Visual Aesthetics of Websites Inventory (VisAWI), is also explained. Finally, the sampling methodology and intended data analysis procedures are enumerated.
Click the button below to go to the Evaluation Plan.
Evaluation Report
After conducting the user experience evaluation, I created an evaluation report which discusses how Keller’s ARCS Model of Motivation and the ADDIE Instructional Design model were instrumental to the design and evaluation of the Integer Multiplication Learning Object. For the evaluation, data was collected using Google Forms and one-on-one interviews, and data analyses were conducted using Microsoft Excel and R. The analyses allowed for clear, data-driven recommendations for improvements to the Integer Multiplication learning object. The final component of the evaluation report is a reflection of my personal insights and understandings from the evaluation process.
Click the button below to go to the Evaluation Report.
Emma Farrow 
