WG 2

Across the month of April 2019, ARKWORK (through its Working Group 2 on Knowledge Production and Archaeological Collections) sponsored two major events on User Experience (UX) Design in Archaeology and Heritage, led by Francesca Dolcetti and Dr Sara Perry (University of York), and Dr Rachel Opitz (University of Glasgow). Below Francesca, Sara and Rachel provide an overview and brief summary of outcomes associated with each event:

• a two-day workshop on the co-design of digital experiences for archaeology (hosted in York and attended by 23 people from two dozen European countries)
• a roundtable session on UX design at the annual Computing Applications in Archaeology conference (held in Kraków, featuring 10 talks by 20 people from across Europe, Canada, the US and Australia, and attended by upwards of 75 people)

 

More information on these events can be found online, including a blog post by Dr Anna Wessman of the SuALT project (University of Helsinki) who attended the co-design workshop, as well as details on contributions to the roundtable session compiled on Sara’s blog, and a Twitter thread which accompanied the roundtable compiled by Rachel.

Motivations

Concern for users’ experiences of digital resources, and for explicitly designing these resources in cooperation with – or led by – individual users themselves, has a long history, and is now considered imperative amongst most product designers today. However within the archaeological and cultural heritage sectors, despite the growing range of digital products developed for both specialist and non-specialist audiences (from websites to digital books, apps to videogames, databases to 3D viewers, etc.), design theory and participatory design practices are comparatively unknown or infrequently applied. The implications of this lack of engagement with core design approaches and audiences are tremendous, not least in terms of alignment of product/project goals with user outcomes and impactful forms of knowledge exchange.

We, as practitioners, may be inclined to develop digital resources with ourselves and our immediate colleagues in mind, not recognising just how diverse and unspoken are the needs of others (even others who may seem much like us). Indeed, we may not even be aware of the means by which we can involve others in the design process (Ciolfi et al. 2016; Mazel et al. 2012; Mason 2015; McDermott et al. 2014), leading us to create outputs without the benefit of any informed design thinking whatsoever.

With this predicament in mind and through the events described below, ARKWORK sought to explore two major themes around UX design:

 

1. How do we do design as archaeologists and heritage practitioners?
2. Where are we explicitly deploying design principles in our day-to-day practices, our records, archives and wider publications? And if we aren’t, why not?

 

Knowing that it is not uncommon for new methodological and theoretical approaches to be adopted quickly and potentially uncritically into the discipline, we were also interested to consider critical and value-led design. Herein ethics and explicit concern for problematising the design process, the product itself and its intended impacts, are woven into all stages of the development of new resources for our discipline. By our reckoning, such value-led approaches are rare in archaeology, and indeed they are uncommon even in the field of design itself (but see Jet Gispen’s Ethics for Designers as one exception). However they provide us with a roadmap for weaving design thinking in our practices in ways that minimise potential harms and increase potential benefits to specialists and wider audiences alike.

 

Below we offer background and reflection on the two main events that have structured our work to date.

 

Workshop on the co-design of digitally-mediated experiences in archaeology. University of York, UK, 1-2 April 2019

 

Activity summary

This workshop was designed as a two-day event aimed at providing a forum for testing the benefits of design strategies and tools coming from the participatory design (PD) field, and devising a digital publication work pipeline that involves end users and stakeholders from the outset. It was structured in four phases with participants working in four groups on the following activities: 1) case study description; 2) UX design; 3) prototyping; 4) evaluation.

 

Participants were recruited amongst practitioners working on projects focused on the creation of digital resources related to archaeological collections and heritage sites; or who have research interests in UX design, UX evaluation and the participatory design fields. They were assigned by Francesca to working groups based on their expertise, gender and skillset in order to create balanced teams. To use real case studies and ensure that participants were able to focus entirely on the design process, we assigned to each group a facilitator whose role was to provide a case study, along with a brief, and facilitate the group in creating a digitally-mediated experience that matches that brief (see more below about the facilitators and their case studies). Facilitators were recruited amongst researchers and practitioners with expertise in designing digital interactive experiences for various audiences, as well as in co-design and PD practices.

 

1) Case study description: During the first phase of the workshop each group was asked to work on a preselected case study, provided by one of our four facilitators, by articulating key information and available sources. Moreover, the facilitator outlined the design brief, defining the intended audience, technologies available and the expected outcomes.

 

2) UX design: Here participants defined how to structure their experience to match the facilitator’s brief. During this phase participants used some of the most common PD techniques, including:

• scenarios: description of a person’s interaction with a system, from a user perspective. Design techniques help to define how the proposed design is likely to be used in real life situations.
• Personas: fictional characters created to represent potential users and used to shape the design focus and to identify opportunities and challenges in designing for different user groups.
• Cards: design cards help to visualise exactly how design ideas can be created, modified and re-purposed, breaking down the components of a design object and demonstrating what kind of media, gestures and functionality can be supported by the design object.

 

3) Prototyping: During this phase each group created mock-ups of their designed experience to visualise and make it tangible. Participants were provided with a set of design resources, including wireframe and storyboard templates and Lego.

 

4) Evaluation: A two-stage evaluation of design results (prototypes), process and outcomes (participants’ gain) was incorporated within the workshop structure. During the first stage each group pitched their design to the other participants, by presenting features, components and intended audience of the experience. Then participants interacted and evaluated the prototype by completing an open-ended questionnaire. The second phase included observations carried out during the activities, and a focus group at the end of the workshop to gather participant feedback and triangulate it with the observations previously made.

 

In total, 23 participants from around Europe took part in the event, all working in the archaeological or museums sector designing digital resources (e.g., databases, online publications, digital archives, video games, interactive experiences, mobile apps, etc.) for different types of specialist and public audience. The case studies and their facilitators include:

Designing digital archaeogames – Facilitator: Juan Hiriart (University of Salford, Manchester, UK)

This case study aims at designing a digital archaeogame based on the early Anglo-Saxon period and the village of West Stow. This game will be used as an educational resource to teach students from primary schools (8-11 years old) about the Anglo-Saxon period. The aims of this project are:

• give players access to a historically accurate representation of the Anglo-Saxon world;
• understand the processes of historical change;
• convey historically based narratives of the chosen period;
• motivate pupils to play

Prehistory Performing – Facilitator: Gavin MacGregor (Northlight Heritage, UK)

The focus of this case study is on the co-design of a web-based interface to attract wider audiences to support and attend prehistoric themed events and experiences. The focus in the first instance is the prehistoric resources and associated stories relating to the Neolithic and Bronze Age of Scotland (c4100 – 800 BC) but with potential to place it in a wider British and European context. The aim is to design a platform which blends provocative digital content to grow demand for event / experience-based products and potentially associated merchandise / rewards

Micro-Engagements at Castlegate – Facilitator: Claire Boardman (University of York)

This case study focuses on the co-design of a place based, cumulative heritage experience for daily commuters (workers) passing through the Castlegate area of York. Accessed through mobile devices, with no restriction to the number or type of media and drawing on the city’s rich archaeological and historical archives, commuters will be able to meaningfully engage with over 1000 years of heritage via short (max 5min) micro-engagements or ‘happenings’.

Designing online interfaces – Facilitator: Eleonora Gandolfi (King’s College London, UK)

The main aim of this case study is to design an online interface/platform based on the Southampton Library special collections and archival material to increase engagement with local museums, historical groups and communities in Hampshire. Material offered online could also include descriptions from archive specialists to help users navigate the content. There might also be different audience groups formed by independent researchers and enthusiasts. Local historical groups might include volunteers that might have different levels of knowledge about archives, historical materials and catalogue format.

Outcomes

As reported in the focus group and evaluation sessions, the majority of participants enjoyed the event and the collaborative approach adopted. In most cases the activities were carried out in a collegial and fun atmosphere, also due to the important role played by facilitators in ensuring that every participant, in particular the ones less familiar with co-design practices, had a say in the design process.

 

In general, participants were pleasantly surprised by the methodology adopted and recognised the value of the multidisciplinary nature of the event and being able to work on broader and more varied themes. They also appreciated the potential applications of the co-design process and the possible transferability of some elements into their day to day work. Moreover, participants liked the focus on practical activities and the learning-through-doing approach that allowed them to work on concrete solutions and move away from abstraction. They also found the design resources helpful to focus better on the task at hand; however, they thought the toolkit needs to be more flexible and tailorable to the project.

 

Data gathered through both workshops provide useful insights on how the collaborative process unfolds and how different dynamics of participation take place within the same design phases, in a context where all participants are encouraged to develop ideas without worrying about technological, time or budget constraints. In all four groups, the process of sharing knowledge and skills and the forms of participants’ involvement varied greatly, due also to the role that facilitators decided to take in the participatory activities.

Roundtable Session #36: User Experience Design in Archaeology and Cultural Heritage. CAA Conference, Kraków, Poland, 23-27 April 2019

Activity summary

CAA roundtable #S36 was designed to build on our previous activities, including the workshop described above, as well as a workshop on digital publications and user interface design hosted by Rachel in Glasgow in May 2018, and a pilot workshop on co-design of digitally mediated experience hosted by Francesca and Sara in York in February 2019. Our CAA roundtable entailed three sets of short papers presented on user experiences, design processes and practice, and knowledge production. Each set of paper presentations was followed by a group discussion, and the session concluded with an extended discussion amongst all the speakers.

 

Presenters designed their talks around our session abstract:

 

“Despite the widespread dissemination of digital tools and applications in both archaeology and heritage, relatively little is known about their real effectiveness and impact on diverse audiences (specialists and lay publics alike). A new iterative design workflow, involving end users and stakeholders from the outset, as well as an accompanying design evaluation methodology, may open new avenues for engagement while, at once, constructively influencing our research objectives and epistemologies. In this Roundtable session, we seek to bring together a multidisciplinary group looking at different aspects of archaeological knowledge production to discuss theoretical and methodological issues in the field of participatory design and user experience, fostering a critical understanding of how this knowledge is used and its social impact. The aim is to convene researchers and practitioners in a dialogue that is focused on examples of interdisciplinary co-creation and user testing of Augmented, Virtual and Mixed Reality (AR, VR, and MR) and related digitally-mediated experiences for museums, archaeological and cultural heritage sites, and varied teaching and research contexts. We are particularly interested in practical experiences around how to integrate archaeological data, storytelling and digital platforms to create experiences truly tailored to the needs and expectations of users. The format of this Roundtable is a series of flash position papers (10 minutes maximum) followed by periods of moderated discussion. The session concludes with an open floor discussion and a wrap-up report summarising the discussion and suggesting follow-up activities. Position papers will be submitted in advance to the session chairs and shared with all panelists. The session welcomes participants from different sectors including but not limited to digital humanities, archaeology, museology, design research and Human-Computer Interaction (HCI).”

 

As described above, presentations in the session were grouped into three themes: ‘online first’ designs, ‘in person first’ designs, and design processes. The titles and speakers are listed below, accompanied in some cases by links to the presentations themselves. The session was actively live-tweeted using hashtags #KrakCAA and #S36, providing a parallel discussion area for both CAA participants and external audiences.

 

Introduction

User Experience Design in Archaeology and Cultural Heritage, Sara Perry, Francesca Dolcetti, Rachel Opitz

Part 1: ‘online first’ designs

Ksar es Said: Building Tunisian young people’s critical engagement with their heritage, Paola Di Giuseppantonio Di Franco, Mark Winterbottom, Fabrizio Galeazzi, Michael Gogan

 

From heterogeneous data to heterogeneous public: thoughts on transmedia applications for digital heritage research and dissemination, Damien Vurpillot, Perrine Pittet, Johann Forte, Benoist Pierre

 

User Interface Design and Evaluation for Online Professional Search in Dutch Archaeology, Alex Brandsen

 

Part 2: ‘in person first’ designs

Unintended Outcomes – VR, Heritage and User Engagement, William Michael Carter, Rhonda Bathurst, William Ciaran Lim-Carter

 

Engaging visitors with ‘invisible’ heritage: lessons learned on the impact of digital media, immersion, sound and storytelling, Jenny Wilkinson

 

Mixable reality, Collaboration, and Evaluation, Erik M Champion

 

Part 3: design process

Interaction Design (IxD) and Digital Heritage, Edward Gonzalez-Tennant

 

Managing Engagement Design Risk through Creative Constraints, Claire Boardman

 

Creating a unified design system across web, mobile, AR and VR, Damir Kotorić, Luke Hollis

 

Inclusive Digital Engagement for Heritage, Eleonora Gandolfi

Outcomes

The CAA is an important, high profile venue within the digital and computational archaeology and heritage communities. As such, we believe the CAA session raised the profile of the series of events organized by this group by presenting key questions and issues of relevance to UX design in archaeology and heritage, elucidated through earlier discussions including those at the workshops in Glasgow and York, and extending them to a wider audience both at the CAA itself and online through social media. The questions used to facilitate discussion at the CAA, which will provide focus for future work by our team on the topic, were:

 

• What does ‘success’ look like in terms of the user experience (UX) design process for archaeology/heritage? What constitutes ‘failure’?

 

• What should the role of archaeologists and cultural heritage practitioners be in the development of UX and User Interface approaches for use in the discipline?

 

• What are the unconscious choices you’ve made in your design processes, of which you later became aware?

 

• Are practitioners ethically obligated to state the values driving their design practices & explore the role their values play in the process? Why or why not?

 

• What values are implicitly embedded in your design processes and products? Have you ever considered applying ethical, feminist, queer, decolonial, or value-sensitive design? How did – or might – you structure it? And where (i.e., in relation to which processes, outputs, practices, tools, etc.) would you apply it first?

 

The concluding discussion of the roundtable addressed issues raised in the presentations, reflected responses to the key questions listed above, and attended to the overarching themes of critical thinking and reflection in design and value-led design and the need to identify the spaces in our workflows and practices that afford more experimentation with design. The CAA session was well attended, with upwards of 75 audience participants throughout the day.

Next steps

Lessons learned both from our workshops and from our CAA roundtable will form the basis of future research and design of resources for the wider professional community. We now aim to reengage participants from these various events, as well as others who’ve approached us separately about their shared interests in UX design, to:

 

• explore how we might structure co-design activities in ways that balance more open and creative approaches with more constrained approaches
• refine our design resources and processes to propose a fluid methodology for UX design in archaeology/heritage and to create a tailorable toolkit for practitioners
• explore an evaluation strategy which would allow us to effectively and robustly examine how collaborative design processes unfold in different ways, and if – and in what ways – these processes lead to personal and professional benefits for participants
• Promote value-led design and co-design as models that may be adopted by publishers and authors as they work together to develop new design-led formats, at a stage when innovative forms of digital publication are emerging

 

If you are interested to contribute to these future activities or have questions or insights to add to the conversation, please do not hesitate to get in touch with Francesca ([email protected]) who will be leading our work over the coming months.

 

Additionally, our experiences from these events, alongside data gathered during the workshop, are informing Francesca’s PhD research project, whose iterations have focused on:

• evaluation of the impact that interactive 3D models of archaeological sites have upon different audiences
• assessment of the design process behind the creation of digitally-mediated experiences in archaeology using participatory design practices

 

Findings from the events we’ve hosted are being integrated into Francesca’s dissertation to promote her own critical reflection on how the User Experience (UX) design process is adopted and incorporated into archaeological practice. Moreover, they will allow Francesca to articulate practical guidelines and provide insights and resources to other practitioners and archaeologists who wish to create digitally-mediated experiences by incorporating:

• UX design and co-design approaches to include intended audiences in the creative process
• An evaluation framework and iterative process to integrate users’ feedback into re-design and improvements

 

As above, please don’t hesitate to contact Francesca ([email protected]) for more information.

 

Acknowledgments

We’d like to thank all participants for their contributions to and ongoing support for our workshops and CAA session, as well as the leaders and administrators of ARKWORK and Vicky Moore for her administrative expertise in York. Photo credit for the images presented here goes to Sara Perry and Alex Brandsen.

 

References

Ciolfi, L., Avram, G., Maye, L., Dulake, N., Marshall. M., Van Dijk, D. and McDermott, F. (2016). Articulating co-design in museums: Reflections on two participatory processes. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, 13–25. New York: ACM.

 

Mazel, A., Galani, A., Maxwell, D. and Sharpe, K. (2012). ‘I want to be provoked’: Public involvement in the development of the Northumberland Rock Art on Mobile Phones project. World Archaeology, 44 (4), 592–611.

 

Mason, M. (2015). Prototyping practices supporting interdisciplinary collaboration in digital media design for museums. Museum Management and Curatorship, 30 (5), 394–426.

 

McDermott, F., Maye, L. and Avram, G. (2014). Co-designing a collaborative platform with cultural heritage professionals. In Proceedings of the 8thIrish Human computer Interaction Conference (iHCI 2014), 18-24. Dublin: Dublin City University.

 

https://twitter.com/ArchaeologistSP/status/1121305773173346304

https://www.researchgate.net/publication/331541097_Ksar_Said_Building_Tunisian_Young_People’s_Critical_Engagement_with_Their_Heritage

https://hal.archives-ouvertes.fr/view/index/docid/2172713

https://www.slideshare.net/nzerik/mixable-reality-collaboration-and-evaluation-s36-user-experience-design-in-archaeology-and-cultural-heritage

https://vimeo.com/332037964

https://www.academia.edu/39818586/INCLUSIVE_DIGITAL_ENGAGEMENT