Process and pitfalls of online teaching and learning with Design Study 'Lite' Methodology: A retrospective analysis

@Article{Syeda2023ProcessPitfallsOnline,
  author   = {Syeda, Uzma Haque and Dunne, Cody and Borkin, Michelle A.},
  journal  = {Computer Graphics Forum},
  title    = {Process and pitfalls of online teaching and learning with {Design Study ``Lite'' Methodology}: A retrospective analysis},
  year     = {2023},
  note     = {EuroVis '23. Preprint \& supplemental material: \url{https://osf.io/4bjfs}},
  number   = {3},
  pages    = {75--86},
  volume   = {42},
  abstract = {Design studies are an integral method of visualization research with hundreds of instances in the literature. Although taught as a theory, the practical implementation of design studies is often excluded from visualization pedagogy due to the lengthy time commitments associated with such studies. Recent research has addressed this challenge and developed an expedited design study framework, the Design Study “Lite” Methodology (DSLM), which can implement design studies with novice students within just 14 weeks. The framework was developed and evaluated based on five semesters of in-person data visualization courses with 30 students or less and was implemented in conjunction with Service-Learning (S-L). With the growth and popularity of the data visualization field—and the teaching environment created by the COVID-19 pandemic—more academic institutions are offering visualization courses online. Therefore, in this paper, we strengthen and validate the epistemological foundations of the DSLM framework by testing its (1) adaptability to online learning environments and conditions and (2) scalability to larger classes with up to 57 students. We present two online implementations of the DSLM framework, with and without Service-Learning (S-L), to test the adaptability and scalability of the framework. We further demonstrate that the framework can be applied effectively without the S-L component. We reflect on our experience with the online DSLM implementations and contribute a detailed retrospective analysis using thematic analysis and grounded theory methods to draw valuable recommendations and guidelines for future applications of the framework. This work verifies that DSLM can be used successfully in online classes to teach design study methodology. Finally, we contribute novel additions to the DSLM framework to further enhance it for teaching and learning design studies in the classroom. The Supplementary Materials for this paper can be found at https://osf.io/4bjfs/.},
  doi      = {10.1111/cgf.14813},
  keywords = {CCS Concepts, • Human-centered computing → Visualization theory and methods, Visualization pedagogy},
  series   = {EuroVis/CGF},
}