Dr Simone Stumpf

  • Reader in Responsible & Interactive Artificial Intelligence (School of Computing Science)

email: Simone.Stumpf@glasgow.ac.uk

SAWB 220c, University of Glasgow, 18 Lilybank Gardens, Glasgow, G12 8QN

ORCID iDhttps://orcid.org/0000-0001-6482-1973

Biography

Dr. Simone Stumpf is a Reader in Responsible and Interactive AI at University of Glasgow, UK. I have a long-standing research focus on user interactions with machine learning systems. My current research includes self-management systems for people living with long-term conditions, developing teachable object recognisers for people who are blind or low vision, and investigating AI fairness. My work has contributed to shaping the field of Explainable AI (XAI) through the Explanatory Debugging approach for interactive machine learning, providing design principles for enabling better human-computer interaction and investigating the effects of greater transparency. The prime aim of my work is to empower all users to use intelligent systems effectively.

Research interests

I am interested in the design and development of user interfaces that help end-users to interact with AI systems more successfully. Of particular interest to me is to help these users to better better understand and to appropriately trust the system, and I have conducted research in Explainable AI to do that. An underpinning of my approach is to design AI systems ethically and responsibly, so that they are free from bias, unfairness or inaccuracies, and to help users to correct them if they are. A lot of my work has therefore been in interactive machine learning to allow users to directly interact with AI systems and teach them how to behave.

I also have an interest in applying AI to user-generated and personal data, especially in the context of heath and well-being. I have worked closely with people who are blind or have low vision, and people living with dementia and/or Parkinson's Disease.

I am a firm believer in including everyone in design and I champion co-design approaches in my research. I take an intersectional approach to my work but am partciaulry invested in making solutions usable and useful to people with physical and cognitive impairments, as well as people of all genders.

Publications

List by: Type | Date

Jump to: 2021 | 2020 | 2019 | 2018 | 2017 | 2016 | 2014 | 2013 | 2012 | 2011 | 2010 | 2009 | 2004 | 2002
Number of items: 30.

2021

Theodorou, L., Massiceti, D., Zintgraf, L., Stumpf, S. , Morrison, C., Cutrell, E., Harris, M. T. and Hofmann, K. (2021) Disability-first Dataset Creation: Lessons from Constructing a Dataset for Teachable Object Recognition with Blind and Low Vision Data Collectors. In: 23rd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '21), 18-22 Oct 2021, p. 27. ISBN 9781450383066 (doi: 10.1145/3441852.3471225)

O'Sullivan, D., Basaru, R., Stumpf, S. and Maiden, N. (2021) Monitoring Quality of Life Indicators at Home from Sparse, and Low-Cost Sensor Data. In: Tucker, A., Henriques Abreu, P., Cardoso, J., Pereira Rodrigues, P. and Riaño, D. (eds.) Artificial Intelligence in Medicine: 19th International Conference on Artificial Intelligence in Medicine, AIME 2021, Virtual Event, June 15–18, 2021, Proceedings. Series: Lecture notes in computer science (12721). Springer: Cham, pp. 157-162. ISBN 9783030772109 (doi: 10.1007/978-3-030-77211-6_17)

Smith-Renner, A. M., Kleanthous Loizou, S., Dodge, J., Dugan, C., Lee, M. K., Lim, B. Y., Kuflik, T., Sarkar, A., Shulner-Tal, A. and Stumpf, S. (2021) TExSS: Transparency and Explanations in Smart Systems. In: 26th International Conference on Intelligent User Interfaces (IUI '21), 14-17 Apr 2021, pp. 24-25. ISBN 9781450380188 (doi: 10.1145/3397482.3450705)

Sredojev, S. M. and Stumpf, S. (2021) Voice Assistant Personalities for Health Information Seeking. In: ACM IUI 2021 Workshops, 13-17 Apr 2021,

Stumpf, S. , Strappelli, L., Ahmed, S., Nakao, Y., Naseer, A., Gamba, G. D. and Regoli, D. (2021) Design Methods for Artificial Intelligence Fairness and Transparency. In: ACM IUI 2021 Workshops, 13-17 Apr 2021,

2020

Bussone, A., Kasadha, B., Stumpf, S. , Durrant, A. C., Tariq, S., Gibbs, J., Lloyd, K. C. and Bird, J. (2020) Trust, identity, privacy, and security considerations for designing a peer data sharing platform between people living with HIV. Proceedings of the ACM on Human-Computer Interaction, 4(CSCW2), 173. (doi: 10.1145/3415244)

Ahmed, S., Balasubramanian, H., Stumpf, S. , Morrison, C., Sellen, A. and Grayson, M. (2020) Investigating the Intelligibility of a Computer Vision System for Blind Users. In: 25th International Conference on Intelligent User Interfaces Companion, Cagliari, Italy, 17-20 Mar 2020, pp. 419-429. ISBN 9781450371186 (doi: 10.1145/3377325.3377508)

Smith-Renner, A., Kleanthous, S., Lim, B., Kuflik, T., Stumpf, S. , Otterbacher, J., Sarkar, A., Dugan, C. and Shulner, A. (2020) EXSS-ATEC: Explainable Smart Systems and Algorithmic Transparency in Emerging Technologies 2020. In: Workshop on Explainable Smart Systems for Algorithmic Transparency in Emerging Technologies, 17 Mar 2020,

Stumpf, S. , Peters, A., Bardzell, S., Burnett, M., Busse, D., Cauchard, J. and Churchill, E. (2020) Gender-inclusive HCI research and design: a conceptual review. Foundations and Trends in Human-Computer Interaction, 13(1), pp. 1-69. (doi: 10.1561/1100000056)

2019

Gunning, D., Stefik, M., Choi, J., Miller, T., Stumpf, S. and Yang, G.-Z. (2019) XAI-explainable artificial intelligence. Science Robotics, 4(37), eaay7120. (doi: 10.1126/scirobotics.aay7120) (PMID:33137719)

Mendez, C., Letaw, L., Burnett, M., Stumpf, S. , Sarma, A. and Hilderbrand, C. (2019) From GenderMag to InclusiveMag: an Inclusive Design Meta-Method. In: 2019 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), Memphis, TN, USA, 14-18 Oct 2019, pp. 97-106. ISBN 9781728108100 (doi: 10.1109/VLHCC.2019.8818889)

Bussone, A., Stumpf, S. and Wilson, S. (2019) Designing for Reflection on Shared HIV Health Information. In: 13th Biannual Conference of the Italian SIGCHI Chapter (CHItaly '19), Padova, Italy, 23-25 Sep 2019, p. 3. ISBN 9781450371902 (doi: 10.1145/3351995.3352036)

Booth, T., Bird, J., Stumpf, S. and Jones, S. (2019) Designing troubleshooting support cards for novice end-user developers of physical computing prototypes. In: Maliza, A., Valtolina, S., Morch, A., Serrano, A. and Stratton, A. (eds.) End-User Development: 7th International Symposium, IS-EUD 2019, Hatfield, UK, July 10–12, 2019, Proceedings. Series: Lecture notes in computer science (11553). Springer: Cham, pp. 191-199. ISBN 9783030247805 (doi: 10.1007/978-3-030-24781-2_15)

Neate, T., Bourazeri, A., Roper, A., Stumpf, S. and Wilson, S. (2019) Co-Created Personas: Engaging and Empowering Users with Diverse Needs Within the Design Process. In: 2019 CHI Conference on Human Factors in Computing Systems (CHI '19), Glasgow, UK, 04-09 May 2019, p. 650. ISBN 9781450359702 (doi: 10.1145/3290605.3300880)

Tewell, J., O'Sullivan, D., Maiden, N., Lockerbie, J. and Stumpf, S. (2019) Monitoring meaningful activities using small low-cost devices in a smart home. Personal and Ubiquitous Computing, 23(2), pp. 339-357. (doi: 10.1007/s00779-019-01223-2)

Stumpf, S. (2019) Horses for Courses: Making the Case for Persuasive Engagement in Smart Systems. In: ACM IUI 2019 Workshops, Los Angeles, CA, USA, 20 Mar 2019,

Lim, B., Sarkar, A., Smith-Renner, A. and Stumpf, S. (2019) ExSS: Explainable Smart Systems 2019. In: 24th International Conference on Intelligent User Interfaces (IUI '19), Marina del Ray, CA, USA, 16-20 Mar 2019, pp. 125-126. ISBN 9781450366731 (doi: 10.1145/3308557.3313112)

2018

Bourazeri, A. and Stumpf, S. (2018) Co-Designing Smart Home Technology with People with Dementia or Parkinson's Disease. In: 10th Nordic Conference on Human-Computer Interaction (NordiCHI '18), Oslo, Norway, 29 Sep - 03 Oct 2018, pp. 609-621. ISBN 9781450364379 (doi: 10.1145/3240167.3240197)

Stumpf, S. and Nichols, J. (2018) Welcome letter. Proceedings of the ACM on Human-Computer Interaction, 2(EICS), 1. (doi: 10.1145/3179426)

2017

Bussone, A., Stumpf, S. and Wilson, S. (2017) The use of online forums by people living with HIV for help in understanding personal health information. International Journal of Medical Informatics, 108, pp. 64-70. (doi: 10.1016/j.ijmedinf.2017.10.001) (PMID:29132633)

2016

Burnett, M., Stumpf, S. , Macbeth, J., Makri, S., Beckwith, L., Kwan, I., Peters, A. and Jernigan, W. (2016) GenderMag: a method for evaluating software's gender inclusiveness. Interacting with Computers, 28(6), pp. 760-787. (doi: 10.1093/iwc/iwv046)

Göker, A., Butterworth, R., MacFarlane, A., Ahmed, T. S. and Stumpf, S. (2016) Expeditions through image jungles: the commercial use of image libraries in an online environment. Journal of Documentation, 72(1), pp. 5-23. (doi: 10.1108/JD-01-2014-0019)

2014

Groce, A. et al. (2014) You are the only possible oracle: effective test selection for end users of interactive machine learning systems. IEEE Transactions on Software Engineering, 40(3), pp. 307-323. (doi: 10.1109/TSE.2013.59)

2013

Das, S., Moore, T., Wong, W.-K., Stumpf, S. , Oberst, I., McIntosh, K. and Burnett, M. (2013) End-user feature labeling: supervised and semi-supervised approaches based on locally-weighted logistic regression. Artificial Intelligence, 204, pp. 56-74. (doi: 10.1016/j.artint.2013.08.003)

2012

Markova, M. S., Wilson, S. and Stumpf, S. (2012) Tangible user interfaces for learning. International Journal of Technology Enhanced Learning, 4(3-4), pp. 139-155. (doi: 10.1504/IJTEL.2012.051578)

2011

Kulesza, T., Stumpf, S. , Wong, W.-K., Burnett, M. M., Perona, S., Ko, A. J. and Oberst, I. (2011) Why-oriented end-user debugging of naive Bayes text classification. ACM Transactions on Interactive Intelligent Systems, 1(1), 2. (doi: 10.1145/2030365.2030367)

2010

Metoyer, R., Stumpf, S. , Neumann, C., Dodge, J., Cao, J. and Schnabel, A. (2010) Explaining how to play real-time strategy games. Knowledge-Based Systems, 23(4), pp. 295-301. (doi: 10.1016/j.knosys.2009.11.006)

2009

Stumpf, S. , Rajaram, V., Li, L., Wong, W.-K., Burnett, M., Dietterich, T., Sullivan, E. and Herlocker, J. (2009) Interacting meaningfully with machine learning systems: three experiments. International Journal of Human-Computer Studies, 67(8), pp. 639-662. (doi: 10.1016/j.ijhcs.2009.03.004)

2004

Stumpf, S. and McDonnell, J. (2004) An investigation into sharing metadata: "I'm not thinking what you are thinking". Journal of Universal Computer Science, 10(6), pp. 740-748.

2002

Stumpf, S.C. and McDonnell, J.T. (2002) Talking about team framing: Using argumentation to analyse and support experiential learning in early design episodes. Design Studies, 23(1), pp. 5-23. (doi: 10.1016/S0142-694X(01)00020-5)

This list was generated on Fri Jan 21 20:54:40 2022 GMT.
Number of items: 30.

Articles

Bussone, A., Kasadha, B., Stumpf, S. , Durrant, A. C., Tariq, S., Gibbs, J., Lloyd, K. C. and Bird, J. (2020) Trust, identity, privacy, and security considerations for designing a peer data sharing platform between people living with HIV. Proceedings of the ACM on Human-Computer Interaction, 4(CSCW2), 173. (doi: 10.1145/3415244)

Stumpf, S. , Peters, A., Bardzell, S., Burnett, M., Busse, D., Cauchard, J. and Churchill, E. (2020) Gender-inclusive HCI research and design: a conceptual review. Foundations and Trends in Human-Computer Interaction, 13(1), pp. 1-69. (doi: 10.1561/1100000056)

Gunning, D., Stefik, M., Choi, J., Miller, T., Stumpf, S. and Yang, G.-Z. (2019) XAI-explainable artificial intelligence. Science Robotics, 4(37), eaay7120. (doi: 10.1126/scirobotics.aay7120) (PMID:33137719)

Tewell, J., O'Sullivan, D., Maiden, N., Lockerbie, J. and Stumpf, S. (2019) Monitoring meaningful activities using small low-cost devices in a smart home. Personal and Ubiquitous Computing, 23(2), pp. 339-357. (doi: 10.1007/s00779-019-01223-2)

Stumpf, S. and Nichols, J. (2018) Welcome letter. Proceedings of the ACM on Human-Computer Interaction, 2(EICS), 1. (doi: 10.1145/3179426)

Bussone, A., Stumpf, S. and Wilson, S. (2017) The use of online forums by people living with HIV for help in understanding personal health information. International Journal of Medical Informatics, 108, pp. 64-70. (doi: 10.1016/j.ijmedinf.2017.10.001) (PMID:29132633)

Burnett, M., Stumpf, S. , Macbeth, J., Makri, S., Beckwith, L., Kwan, I., Peters, A. and Jernigan, W. (2016) GenderMag: a method for evaluating software's gender inclusiveness. Interacting with Computers, 28(6), pp. 760-787. (doi: 10.1093/iwc/iwv046)

Göker, A., Butterworth, R., MacFarlane, A., Ahmed, T. S. and Stumpf, S. (2016) Expeditions through image jungles: the commercial use of image libraries in an online environment. Journal of Documentation, 72(1), pp. 5-23. (doi: 10.1108/JD-01-2014-0019)

Groce, A. et al. (2014) You are the only possible oracle: effective test selection for end users of interactive machine learning systems. IEEE Transactions on Software Engineering, 40(3), pp. 307-323. (doi: 10.1109/TSE.2013.59)

Das, S., Moore, T., Wong, W.-K., Stumpf, S. , Oberst, I., McIntosh, K. and Burnett, M. (2013) End-user feature labeling: supervised and semi-supervised approaches based on locally-weighted logistic regression. Artificial Intelligence, 204, pp. 56-74. (doi: 10.1016/j.artint.2013.08.003)

Markova, M. S., Wilson, S. and Stumpf, S. (2012) Tangible user interfaces for learning. International Journal of Technology Enhanced Learning, 4(3-4), pp. 139-155. (doi: 10.1504/IJTEL.2012.051578)

Kulesza, T., Stumpf, S. , Wong, W.-K., Burnett, M. M., Perona, S., Ko, A. J. and Oberst, I. (2011) Why-oriented end-user debugging of naive Bayes text classification. ACM Transactions on Interactive Intelligent Systems, 1(1), 2. (doi: 10.1145/2030365.2030367)

Metoyer, R., Stumpf, S. , Neumann, C., Dodge, J., Cao, J. and Schnabel, A. (2010) Explaining how to play real-time strategy games. Knowledge-Based Systems, 23(4), pp. 295-301. (doi: 10.1016/j.knosys.2009.11.006)

Stumpf, S. , Rajaram, V., Li, L., Wong, W.-K., Burnett, M., Dietterich, T., Sullivan, E. and Herlocker, J. (2009) Interacting meaningfully with machine learning systems: three experiments. International Journal of Human-Computer Studies, 67(8), pp. 639-662. (doi: 10.1016/j.ijhcs.2009.03.004)

Stumpf, S. and McDonnell, J. (2004) An investigation into sharing metadata: "I'm not thinking what you are thinking". Journal of Universal Computer Science, 10(6), pp. 740-748.

Stumpf, S.C. and McDonnell, J.T. (2002) Talking about team framing: Using argumentation to analyse and support experiential learning in early design episodes. Design Studies, 23(1), pp. 5-23. (doi: 10.1016/S0142-694X(01)00020-5)

Book Sections

O'Sullivan, D., Basaru, R., Stumpf, S. and Maiden, N. (2021) Monitoring Quality of Life Indicators at Home from Sparse, and Low-Cost Sensor Data. In: Tucker, A., Henriques Abreu, P., Cardoso, J., Pereira Rodrigues, P. and Riaño, D. (eds.) Artificial Intelligence in Medicine: 19th International Conference on Artificial Intelligence in Medicine, AIME 2021, Virtual Event, June 15–18, 2021, Proceedings. Series: Lecture notes in computer science (12721). Springer: Cham, pp. 157-162. ISBN 9783030772109 (doi: 10.1007/978-3-030-77211-6_17)

Booth, T., Bird, J., Stumpf, S. and Jones, S. (2019) Designing troubleshooting support cards for novice end-user developers of physical computing prototypes. In: Maliza, A., Valtolina, S., Morch, A., Serrano, A. and Stratton, A. (eds.) End-User Development: 7th International Symposium, IS-EUD 2019, Hatfield, UK, July 10–12, 2019, Proceedings. Series: Lecture notes in computer science (11553). Springer: Cham, pp. 191-199. ISBN 9783030247805 (doi: 10.1007/978-3-030-24781-2_15)

Conference Proceedings

Theodorou, L., Massiceti, D., Zintgraf, L., Stumpf, S. , Morrison, C., Cutrell, E., Harris, M. T. and Hofmann, K. (2021) Disability-first Dataset Creation: Lessons from Constructing a Dataset for Teachable Object Recognition with Blind and Low Vision Data Collectors. In: 23rd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '21), 18-22 Oct 2021, p. 27. ISBN 9781450383066 (doi: 10.1145/3441852.3471225)

Smith-Renner, A. M., Kleanthous Loizou, S., Dodge, J., Dugan, C., Lee, M. K., Lim, B. Y., Kuflik, T., Sarkar, A., Shulner-Tal, A. and Stumpf, S. (2021) TExSS: Transparency and Explanations in Smart Systems. In: 26th International Conference on Intelligent User Interfaces (IUI '21), 14-17 Apr 2021, pp. 24-25. ISBN 9781450380188 (doi: 10.1145/3397482.3450705)

Sredojev, S. M. and Stumpf, S. (2021) Voice Assistant Personalities for Health Information Seeking. In: ACM IUI 2021 Workshops, 13-17 Apr 2021,

Stumpf, S. , Strappelli, L., Ahmed, S., Nakao, Y., Naseer, A., Gamba, G. D. and Regoli, D. (2021) Design Methods for Artificial Intelligence Fairness and Transparency. In: ACM IUI 2021 Workshops, 13-17 Apr 2021,

Ahmed, S., Balasubramanian, H., Stumpf, S. , Morrison, C., Sellen, A. and Grayson, M. (2020) Investigating the Intelligibility of a Computer Vision System for Blind Users. In: 25th International Conference on Intelligent User Interfaces Companion, Cagliari, Italy, 17-20 Mar 2020, pp. 419-429. ISBN 9781450371186 (doi: 10.1145/3377325.3377508)

Smith-Renner, A., Kleanthous, S., Lim, B., Kuflik, T., Stumpf, S. , Otterbacher, J., Sarkar, A., Dugan, C. and Shulner, A. (2020) EXSS-ATEC: Explainable Smart Systems and Algorithmic Transparency in Emerging Technologies 2020. In: Workshop on Explainable Smart Systems for Algorithmic Transparency in Emerging Technologies, 17 Mar 2020,

Mendez, C., Letaw, L., Burnett, M., Stumpf, S. , Sarma, A. and Hilderbrand, C. (2019) From GenderMag to InclusiveMag: an Inclusive Design Meta-Method. In: 2019 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), Memphis, TN, USA, 14-18 Oct 2019, pp. 97-106. ISBN 9781728108100 (doi: 10.1109/VLHCC.2019.8818889)

Bussone, A., Stumpf, S. and Wilson, S. (2019) Designing for Reflection on Shared HIV Health Information. In: 13th Biannual Conference of the Italian SIGCHI Chapter (CHItaly '19), Padova, Italy, 23-25 Sep 2019, p. 3. ISBN 9781450371902 (doi: 10.1145/3351995.3352036)

Neate, T., Bourazeri, A., Roper, A., Stumpf, S. and Wilson, S. (2019) Co-Created Personas: Engaging and Empowering Users with Diverse Needs Within the Design Process. In: 2019 CHI Conference on Human Factors in Computing Systems (CHI '19), Glasgow, UK, 04-09 May 2019, p. 650. ISBN 9781450359702 (doi: 10.1145/3290605.3300880)

Stumpf, S. (2019) Horses for Courses: Making the Case for Persuasive Engagement in Smart Systems. In: ACM IUI 2019 Workshops, Los Angeles, CA, USA, 20 Mar 2019,

Lim, B., Sarkar, A., Smith-Renner, A. and Stumpf, S. (2019) ExSS: Explainable Smart Systems 2019. In: 24th International Conference on Intelligent User Interfaces (IUI '19), Marina del Ray, CA, USA, 16-20 Mar 2019, pp. 125-126. ISBN 9781450366731 (doi: 10.1145/3308557.3313112)

Bourazeri, A. and Stumpf, S. (2018) Co-Designing Smart Home Technology with People with Dementia or Parkinson's Disease. In: 10th Nordic Conference on Human-Computer Interaction (NordiCHI '18), Oslo, Norway, 29 Sep - 03 Oct 2018, pp. 609-621. ISBN 9781450364379 (doi: 10.1145/3240167.3240197)

This list was generated on Fri Jan 21 20:54:40 2022 GMT.

Grants

  • 2019-2021, Fujitsu Ltd., Japan, Principal Investigator, CoFAI: Codesigning Fair AI Interactions, ‎¥‎21,500,000. Industry-funded investigation into interfaces for human-in-the-loop AI fairness for a variety of stakeholders, and cultural aspects in fairness perceptions. 
  • 2019-2021, Microsoft AI for Accessibility, UK, Principal Investigator, ORBIT: Meta Learning for Personalised Object Recognition, $193,000. Collection of  a large dataset for teachable object recognition using few-shot learning from blind and low vision people. Release of public dataset containing 4733 videos of 588 objects from 97 collectors. Developing a curriculum for AI for accessibility for people who are blind and low vision as additional impact activity.
  • 2018-2022, Engineering and Physical Sciences Research Council (EPSRC), UK, Co-Investigator, INTUIT: Interaction design for trusted sharing of personal health data to live well with HIV, £816,126. Work package leader for investigating trust, identify, privacy and security attitudes for data-sharing between people living with HIV, with input to the design and implementation of a personal information management app. 
  • 2017-2020, Engineering and Physical Sciences Research Council (EPSRC), UK, Co-Investigator, SCAMPI: Self-Care Advice, Monitoring, Planning and Intervention, £1,006,003. Work package leader for co-designing an app to set up and monitor goals and activities as part of a selfcare plan. Input to sensor-based activity recognition as part of wider toolset. .

Teaching

I am co-cordinator for COMPSCI5012 Internet Technologies (ITECH) in Session 2, 2021/22.

Professional activities & recognition

Professional & learned societies

  • Senior Member, Association of Computing Machinery (ACM)
  • Member, AAAI
  • Memeber, UXPA UK