Multisensory Experiences: Where the Senses meet Technology
Multisensory experiences, that is, experiences that involve more than one of our senses, are part of our everyday life. We often tend to take them for granted, at least when our different senses function normally (normal sight functioning) or are corrected-to-normal (using glasses). However, closer inspection to any, even the most mundane experiences, reveals the remarkable sensory world in which we live in. While we have built tools, experiences and computing systems that have played to the human advantages of hearing and sight (e.g., signage, modes of communication, visual and musical arts, theatre, cinema and media), we have long neglected the opportunities around touch, taste, or smell as interface/interaction modalities. Within this keynote I will share my vision for the future of computing/HCI and what role touch, taste, and smell can play in it.
Bio
Marianna Obrist is Professor of Multisensory Interfaces and, before joining UCL, she was head of the Sussex Computer Human Interaction (SCHI 'sky') Lab at the School of Engineering and Informatics at the University of Sussex. Her research ambition is to establish touch, taste, and smell as interaction modalities in human-computer interaction (HCI). Her research is mainly supported by an ERC starting grant. As part of her research, she developed a novel scent-delivery technology that was exhibited at the World Economic Forum (WEF) 2019 and 2020 in Davos. Supported by an ERC proof-of-concept, this technology is now commercialised through OWidgets Ltd, a University start-up she co-founded in 2019. Before joining Sussex, Marianna was a Marie Curie Fellow at Newcastle University. She was selected Young Scientist 2017 and 2018 to attend the WEF in China, and become an inaugural member of the ACM Future of Computing Academy (ACM-FCA) in 2017. More recently, Marianna was appointed as a Visiting Professor at the Burberry Material Futures Research Group at RCA and spent the summer 2019 as a Visiting Professor at the HCI Engineering Group at MIT CSAIL. More details on her research can be found at http://www.multi-sensory.info
Human-Centered AI: A New Synthesis
Researchers, developers, business leaders, policy makers and others are expanding the technology-centered scope of Artificial Intelligence (AI) to include Human-Centered AI (HCAI) ways of thinking. This expansion from an algorithm-focused view to embrace a human-centered perspective, can shape the future of technology so as to better serve human needs. Educators, designers, software engineers, product managers, evaluators, and government agency staffers can build on AI-driven technologies to design products and services that make life better for the users. These human-centered products and services will enable people to better care for each other, build sustainable communities, and restore the environment.
Bio
Ben Shneiderman (http://www.cs.umd.edu/~ben) is an Emeritus Distinguished University Professor in the Department of Computer Science, Founding Director (1983-2000) of the Human-Computer Interaction Laboratory (http://hcil.umd.edu), and a Member of the UM Institute for Advanced Computer Studies (UMIACS) at the University of Maryland. He is a Fellow of the AAAS, ACM, IEEE, NAI, and the Visualization Academy and a Member of the U.S. National Academy of Engineering, in recognition of his pioneering contributions to human-computer interaction and information visualization. His widely-used contributions include the clickable highlighted web-links, high-precision touchscreen keyboards for mobile devices, and tagging for photos. Shneiderman’s information visualization innovations include dynamic query sliders for Spotfire, development of treemaps for viewing hierarchical data, novel network visualizations for NodeXL, and event sequence analysis for electronic health records. Ben is the lead author of Designing the User Interface: Strategies for Effective Human-Computer Interaction (6th ed., 2016). He co-authored Readings in Information Visualization: Using Vision to Think (1999) and Analyzing Social Media Networks with NodeXL (2nd edition, 2019). His book Leonardo’s Laptop (MIT Press) won the IEEE book award for Distinguished Literary Contribution. The New ABCs of Research: Achieving Breakthrough Collaborations (Oxford, 2016) describes how research can produce higher impacts. His forthcoming book on Human-Centered AI, will be published by Oxford University Press in January 2022.
"Don’t Tell Me The Cybersecurity Moon Is Shining… (Cybersecurity Show and Tell)”
“Show, don’t tell” has become the literary commandment for any writer. It applies to all forms of fiction, and to non-fiction, including scientific writing, where it lies at the heart of many scientific communication and storytelling approaches. In this talk, I will discuss how “show and tell” is actually often the best approach when one wants to present, teach or explain complicated ideas such as those underlying notions and results in mathematics and science, and in particular in cybersecurity. I will discuss how different kinds of artworks can be used to explain cybersecurity and I illustrate how telling (i.e., explaining notions in a formal, technical way) can be paired with showing through visual storytelling or other forms of storytelling. I will also discuss four categories of artworks and the explanations they help provide. As concrete examples, I will focus on 15 films starring Nicolas Cage which directly revolve around cybersecurity or can be used to explain cybersecurity notions in such a way that they can be understood by non-experts. This talk covers research that I have described in my three papers "Explaining Cybersecurity Using Films and the Arts”, "Don’t Tell Me The Cybersecurity Moon Is Shining… (Cybersecurity Show and Tell)” and, finally, "Nicolas Cage is the Center of the Cybersecurity Universe”, which is included in the proceedings of the conference. I will also present some results that are still unpublished about experiments that we have carried out to understand the quantitative and qualitative impact of films and other popular artworks.
Bio
Luca Viganò is Professor at the Department of Informatics of King's College London, UK, where he heads the Cybersecurity Group. His research focuses on formal methods and tools for the specification, verification and testing of cybersecurity and privacy. He is particularly interested in formal analysis of socio-technical systems, whose security depends intrinsically on human users, and of cyber-physical systems, where one needs to explicitly consider the underlying physical processes. He also works on explainable cybersecurity, where, in addition to more formal approaches, he has been investigating how different kinds of artworks can be used to explain cybersecurity and how telling (i.e., explaining notions in a formal, technical way) can be paired with showing through visual storytelling or other forms of storytelling. He is Global Envoy for King’s College London and Vice Dean (Enterprise& Engagement) of the Faculty of Natural & Mathematical Sciences.
Future digital challenges: social-emotional skills as critical enablers for good technical design work
Technology is becoming increasingly entangled in all aspects of our lives often unintended negative consequences. While there is increasing recognition of the ethical and value-based aspects in our technology design work, and while there is increasing support for the multidisciplinary collaborations need to address current and future challenges, little focus has been put on the skills needed by people practically engaging in this work. Good technical and design skills are necessary but not sufficient. We also need good social-emotional-ethical skills, with implications for education, collaborations, and leadership development.
Bio
Geraldine Fitzpatrick is Professor of Technology Design and Assessment and heads the Human Computer Interaction Group at TU Wien. She is also an ACM Distinguished Scientist, IFIP Fellow, and IFIP TC-13 Pioneer Award recipient. Previously, she was Director of the Interact Lab at the Uni of Sussex, User Experience consultant and Senior Manager at Sapient London, and Snr Researcher at the Distributed Systems Technology Centre (DSTC) and Center for Online Health in Australia. She also has a healthcare background and has been in charge of various hospital departments including ENT operating theatres, as well as setting up a private practice. Her research is at the intersection of social and computer sciences to support social interaction using mobile, tangible and sensor-based technologies in everyday contexts, with a particular interest in supporting collaboration, health and well-being, social and emotional skills learning, community building and active engagement for older people. She has a published book and over 200 refereed journal and conference publications in diverse areas such as HCI, CSCW, health informatics, pervasive computing. She sits on various international advisory boards and review panels, and serves in many program committee/chair roles for various CSCW/CHI/health related international conferences, most recently general co-chair for CHI2019 and papers co-chair for CSCW2018. In 2018 she completed a Masters in Applied Positive Psychology and Coaching Practice.
POISE: A Framework for Designing Perfect Interactive Systems with and for Imperfect People
The operator is frequently considered as the main sources of vulnerability in command and control systems; for example, in a 2006 survey 79% of fatal accidents in aviation were attributed to “human error.” Beyond the case of command and control systems, users’ faults occur not only at use time but also during the design and development of systems. Following Avizienis et al.’s taxonomy for faults, human-made error can be characterized as the operator’s failure to deliver services while interacting with the interactive system. Non human-made errors are called natural faults and may occur during development or set the interactive system as well as its users into an error-state during its use. Focusing on interactive systems specificities, this paper presents a comprehensive description of faults covering both development and operation phases. In correspondence with this taxonomy, we present mechanisms to avoid, remove, tolerate and mitigate faults in order to design and develop what we call “perfect” interactive systems taking into account the organization, the interactive system, the environment and the people operating them. We define an interactive system as perfect when it blends multiple and diverse properties such as usability, security, user experience, dependability, learnability, resilience … We present multiple concrete examples, from aviation and other domains, of faults affecting socio-technical systems and associated fault-tolerant mechanisms.
Bio
Dr. Philippe Palanque is Professor in Computer Science at the University Toulouse 3 "Paul Sabatier" and is head of the Interactive Critical Systems group at the Institut de Recherche en Informatique de Toulouse (IRIT) in France. Since the late 80s he has been working on the development and application of formal description techniques for interactive system. He has worked for more than 10 years on research projects to improve interactive Ground Segment Systems at the Centre National d'Etudes Spatiales (CNES) and is also involved in the development of software architectures and user interface modeling for interactive cockpits in large civil aircraft (funded by Airbus). He is also involved in the research network HALA! (Higher Automation Levels in Aviation) funded by SESAR programme which targets at building the future European air traffic management system. The main driver of Philippe's research over the last 20 years has been to address in an even way Usability, Safety and Dependability in order to build trustable safety critical interactive systems. As for conferences he is a member of the program committee of conferences in these domains such as SAFECOMP 2016 (35th conference on Computer Safety, Reliability and Security), DSN 2014 (44th conference on Dependable Systems and Networks), EICS 2016 (23rd annual conference on Engineering Interactive Computing Systems) and was co-chair of ACM CHI 2014 (32nd conference on Human Factors in Computing Systems).
