Additional Books and Some interesting papers

Textbooks

• Required: Ben Shneiderman, Catherine Plaisant, Maxine S. Cohen, Steven M. Jacobs and Niklas Elmqvist, "Designing the User Interface: Strategies for Effective Human-Computer Interaction, 6th Edition" Addison-Wesley, 2017
  ISBN-13: 978-0-13-438038-4; ISBN-10: 0-13-438038-X

• Highly recommended, particularly for students interested in research: Frank E. Ritter, Gordon D. Baxter, and Elizabeth F. Churchill, "Foundations for Designing User-Centered Systems: What System Designers Need to Know about People". Springer, 2014.
  ISBN: 978-1-4471-5133-3

• Recommended, particularly for software engineering students: Mary Beth Rosson and John M. Carroll, "Usability Engineering: Scenario-Based Development of Human-Computer Interaction" Academic Press, 2002.
  ISBN 1-55860-712-9, 978-1-5586-0712-5

• The first two books are available at SMU bookstore, and all three are also available from the publishers, or your favorite online booksellers.

General (all, not classified) papers on UID, UI/UX, HCI/CHI, and usability

1. O. Amft, "How Wearable Computing Is Shaping Digital Health", IEEE Computing Edge, June, 2018, pp.18-24.

2. P. Bera, "How Colors in Business Dashboards Affect Users' Decision Making", Comm. of the ACM, Vol.59, No.4, pp.50-57, April, 2016.
   (tagline: "Business dashboard that overuse or misuse colors cause cognitive overload for users who then take longer to make decisions.")
   (metric: fixation time/sequence via eye-tracking, decision performance too (not affected))

3. Canfora, Gerardo, et al. "A Case Study of Automating User Experience-Oriented Performance Testing on Smartphones." 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation, IEEE, 2013, pp. 66-69, https://doi.org/10.1109/ICST.2013.16.

4. S.E. Chasins, E.L. Glassman and J. Sunshine, "PL and HCI: Better Together", Comm. ACM,64(8):98-106, Aug, 2021.

5. L. F. Cranor and N. Buchler, "Better Together: Usability and Security Go Hand in Hand", IEEE Computing Edge, Jan., 2015, pp.57-61.
   (orig. pub.: IEEE Security and Privacy, vol.12, no.6, 2014)
   (Relevant topics: Overview/Definition, UID process, UI/UX, and Social Impact chapters of DTUI.)

6. F. Dobrian, A. Awan, D. Joseph, A. Ganjam, J. Zhan, V. Sekar, I. Stoica, and H. Zhang, "Understanding the Impact of Video Quality on User Engagement", Comm. of the ACM, Vol.56, No.3, pp.89-99, March, 2013.
   (relevant topics: UI/UX chapter of DTUI, and also SE-HCI research at SMU.)

7. A.M. Feit, M. Nancel, M. John, A. Karrenbauer, D. Weir and A. Oulasvirta, "AZERTY ameliore: Computational Design on a National Scale", Comm. ACM, 64(2):48-58, Feb., 2021.
   (Comment: Even if you are not interested in French keyboard design, you can see the social/cultural influence of UI, and also amazingly, quantitative usability/performance evaluation often neglected in UI/UX papers.)

8. Y. Feng and H. X. Liu", "Augmented Reality for Robocars", IEEE Spectrum, Dec, 2019, pp.22-27.
   (Tagline: "Adding simulated vehicles to closed-course testing makes robocars safer")

9. S. Firmenich, A. Garrido, J. Grigera, J.M. Rivero, and G. Rossi, "Usability Improvement through A/B Testing and Refactoring", Software Quality Journal, Vol.27, pp.203-240. 2019.

10. S. Green, J. Heer, and C. D. Manning, "Natural Language Translation at the Intersection of AI and HCI", Comm. of the ACM, Vol.58, No.9, pp.46-53, Sept., 2015.

11. J. Grubert, E. Ofek, M. Pahud and P.O. Kristensson, "The Office of the Future: Virtual, Portable, and Global", IEEE Computing Edge, June, 2020, pp.8-14.
    (orig. pub.: IEEE Computer Graphics and Applications, vol.38, no.6, 2018)

12. A. Guo and J.P. Bigham, "Making Everyday Interfaces Accessible: Tactile Overlays by and for Blind People", IEEE Computing Edge, Nov., 2019, pp.38-42.
    (orig. pub.: IEEE Pervasive Computing, vol.17, no.6, 2018)

13. C. Harrison, D. Tan, and D. Morris, "Skinput: Appropriating the Skin as an Interactive Canvas", Comm. of the ACM, Vol.54, No.8, pp.111-118, Aug., 2011.
    (relevant topics: interaction devices chapter of DTUI. Also relevant to our hw#4 question on different I/O devices for different I.S.)

14. J. Harty "Finding Usability Bugs with Automated Tests", Comm. of the ACM, Vol.54, No.2, pp.44-49, Feb., 2011.
    (Relevant topic: ABCS-models, particularly at BC-level (keystroke, navigation, etc.), as basis. Also, Geng/Tian paper ideas.)

15. K. Hornbaek, "Flexible Displays, Rigid Design?", IEEE Computer, 48(3), March, 2015.

16. T. Hossfeld, C. Keimel and C. Timmerer, "Crowdsourcing Quality-of-Experience Assessments" IEEE Computer, Sep., 2014, pp.98-102.

17. B. Jones, H. Benko, E. Ofek and A.D. Wilson, "IllumiRoom: Immersive Experiences Beyond the TV Screen", Comm. ACM, 58(6):93-100, June, 2015.

18. C. Kumar, R. Menges and S. Staab, "Eye-Controlled Interfaces for Multimedia Interaction", IEEE Computing Edge, Jan., 2017, pp.26-33.
    (orig. pub.: IEEE MultiMedia, vol.23, no.4, 2016)

19. V. M. Manghisi, M. Fiorentino, M. Gattullo, A. Boccaccio, V. Bevilacqua, G. L. Cascella, M. Dassisti and A. E. Uva, "Experiencing the Sights, Smells, Sounds, and Climate of Southern Italy in VR", IEEE Computing Edge, Dec., 2018, pp.41-47.
    (orig. pub.: IEEE Computer Graphics and Applications, vol.37, no.6, 2017)
    (Multisensory VR: Sensorama, MATE (Mutilsensory Apulia Touistic Experience) mobile container.)

20. B. A. Myers and J. Stylos, "Improving API Usability", Comm. of the ACM, Vol.59, No.6, pp.62-69, June, 2016.
    (A general guide on the topic, and a nice companion to the more specific/metrics-focused Bokhary-Tian paper available on Canvas.)

21. B. Nuernberger, R. Tapella, S.-H. Berndt, S.Y. Kim and S. Samochina, "Under Water to Outer Space: Augmented Reality for Astronauts and Beyond", IEEE Computing Edge, June, 2020, pp.16-27.
    (orig. pub.: IEEE Computer Graphics and Applications, vol.40, no.1, 2020)

22. Passos, C., Cruzes, D. S., Dyba., & Mendonca M. (2012). Challenges of applying ethnography to study software practices. Proceedings of the ACM-IEEE International Symposium on Empirical Software Engineering and Measurement - ESEM '12. https://doi.org/10.1145/2372251.2372255

23. L. Raya, J.J. Garcia-Rueda, D. Lopez-Fernandez and J. Mayor, "Virtual Reality Application for Fostering Interest in Art", IEEE Computing Edge, Nov., 2021, pp.34-41.
    (orig. pub.: IEEE Computer Graphics and Applications, vol.41, no.2, 2021)

24. D. Rojo, J.J. Garcia Rueda, J. Mayor and L. Raya", "A Virtual Reality Training Application for Adults with Asperger's Syndrome", IEEE Computing Edge, March, 2020, pp.8-15.
    (orig. pub.: IEEE Computer Graphics and Applications, vol.39, no.2, 2019)

25. M. P. Robillard, "What makes APIs hard to learn?", IEEE Software, 26(6):27-34, Nov. 2009.

26. E.E. Sabelman and R. Lam", "The Real-Life Dangers of Augmented Reality", IEEE Spectrum, Jul, 2015, pp.48-53.
    (Tagline: Augmented reality can impair our perception, but good design can minimize the hazards.)

27. T. Scheller and E. Kuln, "Automated measurement of API usability: The API concepts framework", Information and Software Technology, Vol.61, pp.145-162, 2015.

28. M. Schmettow, "Sample Size in Usability Studies", Comm. ACM, 55(4), pp.64-70. April, 2012,
    (Summary: You really need more, not just around 10!)

29. A. Schmidt and E. Churchill, "Interaction Beyond the Keyboard", IEEE Computer, April, 2012, pp.21-24
    (Comment: This is the guest editors' intro to the special issue, which contains quite a few interesting papers.)

30. B. Shneiderman, "Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy", International J. of Human-Computer Interaction, Vol.36, No.6, pp.495-504, 2020.
    (Nice followup to our textbook.)

31. Schneidewind, L., Horold, S., Mayas, C., Kromker, H., Falke, S., & Pucklitsch, T. (2012). How personas support requirements engineering. 2012 First International Workshop on Usability and Accessibility Focused Requirements Engineering (UsARE). https://doi.org/10.1109/usare.2012.6226786

32. T. Someya, "Put Down That Smartphone: The Display Is on Your Skin", IEEE Spectrum, June, 2021, pp.38-43.

33. E. van den Hoven, E. van de Garde-Perik, S. Offermans, K. van Boerdonk, and K.-M. H. Lenssen, "Moving Tangible Interaction Systems to the Next Level", IEEE Computer, Aug., 2013, pp.70-76.
    (Tagline: By expanding visual interaction (GUI) to encompass all the senses, TI has tremendous potential to transform the way user interact with digital data.)
    (Well, in our class, we have emphasized that DM is more than GUI. In a sense, TI is more appropriately aligned with DM and other I.S.)

34. K. Vasylevska and H. Kaufmann, "Compressing VR: Fitting Large Virtual Environments with Limited Physical Space", IEEE Computing Edge, Sept., 2019, pp.33-39.
    (orig. pub.: IEEE Computer Graphics and Applications, vol.37, no.5, 2017)

35. J. O. Wobbrock, K. Z. Gajos, S. K. Kane and G. C. Vanderheiden, "Ability-Based Design", Comm. of the ACM, Vol.61, No.6, pp.62-71, June, 2018.
    (tagline: "By focusing on users' abilities rather than disabilities, designers can create interactive systems better matched to those abilities.")
    (relevant topics: communication and collaboration chapter of DTUI, location and duration to define context that may impair one's ability to use technology.)

36. M. Zibran. "What makes APIs hard to use?" Int. J. of Computer Science and Network Security, 8(4):256.261, 2008.

A lot other papers on AR/VR, BCI (HCI->BCI, direct brain-interface), etc., not individually listed here.

Relevant papers/publications from our SMU research group

• (P1) J. Tian, A. Bokhary and S. Alanazy, "A Comprehensive Framework for Measuring and Improving API Usability", 8th Annual Conf. on Computational Science & Computational Intelligence (CSCI'21), Las Vegas, NV, Dec., 2021,

• (P2) R. Geng and J. Tian, Improving Web Navigation Usability by Comparing Actual and Anticipated Usage, IEEE Trans. on Human Machine Systems, Vol.45, No.1, pp.84-94. Feb. 2015.

• (P3) R. Geng, M. Chen, and J. Tian, "In-Process Usability Problem Classification, Analysis and Improvement", 14th International Conference on Quality Software (QSIC'2014), Dallas, Texas, Oct. 2014.

• A. Bokhary and J. Tian, "Measuring Cloud Service APIs Quality and Usability", Proc. 16th Int. Conf. on Software Engineering Research and Practice (SERP'18, as part of Worldcomp 2018, the 2018 World Congress in Computer Science, Computer Engineering, and Applied Computing), Las Vegas, NV, July. 2018.

• J. Tian, S. Alanazy, A. Bokhary, S. Alharthi and S. Ghanem, "Measuring Influencing Factors of API Usability", 9th Annual Conf. on Computational Science & Computational Intelligence (CSCI'22), Las Vegas, NV, Dec., 2022,

• G. Karami and J. Tian, "Applying Task Models from Human Computer Interaction to Support and Improve Usage Based Statistical Testing for Web Applications", Int. J. of Computers and Their Applications, Vol.25, No.2, pp.64-75, June, 2018.

• Jeff Tian, "Software Quality Engineering: Testing, Quality Assurance, and Quantifiable Improvement", John Wiley and Sons, Inc. and IEEE Computer Society Press, 2005. ISBN: 0-471-71345-7.
  (relevant topics: relating usability to the general quality concepts and frameworks, usability assurance as part of the overall quality assurance (QA) activities and in the software quality engineering (SQE) process.)

Papers Organized by Topic Clusters

TC1: Inter/Multi-Disciplinary Approaches to UI/UX and Usability

1. Canfora, Gerardo, et al. "A Case Study of Automating User Experience-Oriented Performance Testing on Smartphones." 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation, IEEE, 2013, pp. 66-69, https://doi.org/10.1109/ICST.2013.16.

2. S.E. Chasins, E.L. Glassman and J. Sunshine, "PL and HCI: Better Together", Comm. ACM,64(8):98-106, Aug, 2021.

3. L. F. Cranor and N. Buchler, "Better Together: Usability and Security Go Hand in Hand", IEEE Computing Edge, Jan., 2015, pp.57-61.

4. A.M. Feit, M. Nancel, M. John, A. Karrenbauer, D. Weir and A. Oulasvirta, "AZERTY ameliore: Computational Design on a National Scale", Comm. ACM, 64(2):48-58, Feb., 2021.
   (Comment: Even if you are not interested in French keyboard design, you can see the social/cultural influence of UI, and also amazingly, quantitative usability/performance evaluation often neglected in UI/UX papers.)

5. S. Firmenich, A. Garrido, J. Grigera, J.M. Rivero, and G. Rossi, "Usability Improvement through A/B Testing and Refactoring", Software Quality Journal, Vol.27, pp.203-240. 2019.

6. (P2) R. Geng and J. Tian, Improving Web Navigation Usability by Comparing Actual and Anticipated Usage, IEEE Trans. on Human Machine Systems, Vol.45, No.1, pp.84-94. Feb. 2015.

7. S. Green, J. Heer, and C. D. Manning, "Natural Language Translation at the Intersection of AI and HCI", Comm. of the ACM, Vol.58, No.9, pp.46-53, Sept., 2015.

8. J. Harty "Finding Usability Bugs with Automated Tests", Comm. of the ACM, Vol.54, No.2, pp.44-49, Feb., 2011.

9. Passos, C., Cruzes, D. S., Dyba., & Mendonca M. (2012). C hallenges of applying ethnography to study software practices. Proceedings of the ACM-IEEE International Symposium on Empirical Software Engineering and Measurement - ESEM '12. https://doi.org/10.1145/2372251.2372255

10. B. Shneiderman, "Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy", International J. of Human-Computer Interaction, Vol.36, No.6, pp.495-504, 2020.

11. Schneidewind, L., Horold, S., Mayas, C., Kromker, H., Falke, S., & Pucklitsch, T. (2012). How personas support requirements engineering. 2012 First International Workshop on Usability and Accessibility Focused Requirements Engineering (UsARE). https://doi.org/10.1109/usare.2012.6226786

12. J. O. Wobbrock, K. Z. Gajos, S. K. Kane and G. C. Vanderheiden, "Ability-Based Design", Comm. of the ACM, Vol.61, No.6, pp.62-71, June, 2018.

TC2: Usability Measurement and Improvement (including Usability Problems/Sub-characteristics Classification and Analysis)

1. A. Bokhary and J. Tian, "Measuring Cloud Service APIs Quality and Usability", Proc. 16th Int. Conf. on Software Engineering Research and Practice (SERP'18, as part of Worldcomp 2018, the 2018 World Congress in Computer Science, Computer Engineering, and Applied Computing), Las Vegas, NV, July. 2018.

2. A.M. Feit, M. Nancel, M. John, A. Karrenbauer, D. Weir and A. Oulasvirta, "AZERTY ameliore: Computational Design on a National Scale", Comm. ACM, 64(2):48-58, Feb., 2021.
   (Comment: Even if you are not interested in French keyboard design, you can see the social/cultural influence of UI, and also amazingly, quantitative usability/performance evaluation often neglected in UI/UX papers.)

3. (P3) R. Geng, M. Chen, and J. Tian, "In-Process Usability Problem Classification, Analysis and Improvement", 14th International Conference on Quality Software (QSIC'2014), Dallas, Texas, Oct. 2014.

4. T. Hossfeld, C. Keimel and C. Timmerer, "Crowdsourcing Quality-of-Experience Assessments" IEEE Computer, Sep., 2014, pp.98-102.

5. B. A. Myers and J. Stylos, "Improving API Usability", Comm. of the ACM, Vol.59, No.6, pp.62-69, June, 2016.

6. M. P. Robillard, "What makes APIs hard to learn?", IEEE Software, 26(6):27-34, Nov. 2009.

7. T. Scheller and E. Kuln, "Automated measurement of API usability: The API concepts framework", Information and Software Technology, Vol.61, pp.145-162, 2015.

8. M. Schmettow, "Sample Size in Usability Studies", Comm. ACM, 55(4), pp.64-70. April, 2012,

9. J. Tian, S. Alanazy, A. Bokhary, S. Alharthi and S. Ghanem, "Measuring Influencing Factors of API Usability", 9th Annual Conf. on Computational Science & Computational Intelligence (CSCI'22), Las Vegas, NV, Dec., 2022,

10. (P1) J. Tian, A. Bokhary and S. Alanazy, "A Comprehensive Framework for Measuring and Improving API Usability", 8th Annual Conf. on Computational Science & Computational Intelligence (CSCI'21), Las Vegas, NV, Dec., 2021,

11. M. Zibran. "What makes APIs hard to use?" Int. J. of Computer Science and Network Security, 8(4):256.261, 2008.

TC3: Interactions (& Devices) Beyond Keyboard and 2D GUI

1. O. Amft, "How Wearable Computing Is Shaping Digital Health", IEEE Computing Edge, June, 2018, pp.18-24.

2. A. Guo and J.P. Bigham, "Making Everyday Interfaces Accessible: Tactile Overlays by and for Blind People", IEEE Computing Edge, Nov., 2019, pp.38-42.
   (orig. pub.: IEEE Pervasive Computing, vol.17, no.6, 2018)

3. C. Harrison, D. Tan, and D. Morris, "Skinput: Appropriating the Skin as an Interactive Canvas", Comm. of the ACM, Vol.54, No.8, pp.111-118, Aug., 2011.

4. K. Hornbaek, "Flexible Displays, Rigid Design?", IEEE Computer, 48(3), March, 2015.

5. C. Kumar, R. Menges and S. Staab, "Eye-Controlled Interfaces fro Multimedia Interaction", IEEE Computing Edge, Jan., 2017, pp.26-33.
   (orig. pub.: IEEE MultiMedia, vol.23, no.4, 2016)

6. V. M. Manghisi, M. Fiorentino, M. Gattullo, A. Boccaccio, V. Bevilacqua, G. L. Cascella, M. Dassisti and A. E. Uva, "Experiencing the Sights, Smells, Sounds, and Climate of Southern Italy in VR", IEEE Computing Edge, Dec., 2018, pp.41-47.

7. A. Schmidt and E. Churchill, "Interaction Beyond the Keyboard", IEEE Computer, April, 2012, pp.21-24
   (Comment to 5/7312 students: Not a full paper, but rather the guest editors' intro to the special issue, which contains quite a few interesting papers. So, it is not suitable as one of the required papers for your take home exam, but the other papers in the same issue may potentially be.)

8. T. Someya, "Put Down That Smartphone: The Display Is on Your Skin", IEEE Spectrum, June, 2021, pp.38-43.

9. E. van den Hoven, E. van de Garde-Perik, S. Offermans, K. van Boerdonk, and K.-M. H. Lenssen, "Moving Tangible Interaction Systems to the Next Level", IEEE Computer, Aug., 2013, pp.70-76.

TC4: AR/VR/Immersive Environment

1. Y. Feng and H. X. Liu", "Augmented Reality for Robocars", IEEE Spectrum, Dec, 2019, pp.22-27.

2. J. Grubert, E. Ofek, M. Pahud and P.O. Kristensson, "The Office of the Future: Virtual, Portable, and Global", IEEE Computing Edge, June, 2020, pp.8-14.
   (orig. pub.: IEEE Computer Graphics and Applications, vol.38, no.6, 2018)

3. B. Jones, H. Benko, E. Ofek and A.D. Wilson, "IllumiRoom: Immersive Experiences Beyond the TV Screen", Comm. ACM, 58(6):93-100, June, 2015.

4. V. M. Manghisi, M. Fiorentino, M. Gattullo, A. Boccaccio, V. Bevilacqua, G. L. Cascella, M. Dassisti and A. E. Uva, "Experiencing the Sights, Smells, Sounds, and Climate of Southern Italy in VR", IEEE Computing Edge, Dec., 2018, pp.41-47.
   (orig. pub.: IEEE Computer Graphics and Applications, vol.37, no.6, 2017)

5. B. Nuernberger, R. Tapella, S.-H. Berndt, S.Y. Kim and S. Samochina, "Under Water to Outer Space: Augmented Reality for Astronauts and Beyond", IEEE Computing Edge, June, 2020, pp.16-27.
   (orig. pub.: IEEE Computer Graphics and Applications, vol.40, no.1, 2020)

6. L. Raya, J.J. Garcia-Rueda, D. Lopez-Fernandez and J. Mayor, "Virtual Reality Application for Fostering Interest in Art", IEEE Computing Edge, Nov., 2021, pp.34-41.
   (orig. pub.: IEEE Computer Graphics and Applications, vol.41, no.2, 2021)

7. D. Rojo, J.J. Garcia Rueda, J. Mayor and L. Raya", "A Virtual Reality Training Application for Adults with Asperger's Syndrome", IEEE Computing Edge, March, 2020, pp.8-15.
   (orig. pub.: IEEE Computer Graphics and Applications, vol.39, no.2, 2019)

8. E.E. Sabelman and R. Lam", "The Real-Life Dangers of Augmented Reality", IEEE Spectrum, Jul, 2015, pp.48-53.