PlayFutures: Imagining Civic Futures with AI and Puppets


Abstract

Children are the builders of the future and crucial to how the technologies around us develop. They are not voters but are a participants in how the public spaces in a city are used. Through a workshop designed around kids of age 9-12, we investigate if novel technologies like artificial intelligence can be integrated in existing ways of play and performance to 1) re-imagine the future of civic spaces, 2) reflect on these novel technologies in the process and 3) build ways of civic engagement through play. We do this using a blend AI image generation and Puppet making to ultimately build future scenarios, perform debate and discussion around the futures and reflect on AI’s role and potential in their process. We present our findings of how AI helped envision these futures, aid performances, and report some initial reflections from children about the technology.

<ccs2012> <concept> <concept_id>10003120.10003121</concept_id> <concept_desc>Human-centered computing Human computer interaction (HCI)</concept_desc> <concept_significance>500</concept_significance> </concept> </ccs2012>

1 Introduction↩︎

In educational settings, fostering a sense of criticality among children is increasingly recognized as essential. Iversen et al. [1] point out how the importance of embedding critical thinking into technology education underscores the need to move beyond traditional computational thinking (CT) methodologies, which significantly lacks in encouraging a critical and reflective stance towards our digitized society, thereby limiting children’s capacity to make informed choices about technology and participate in its development.

Participatory design (PD) emerges as a paradigm to bridge this gap, offering an avenue for children to engage critically with technology. PD, by its very nature, is inclusive and collaborative, inviting participants to actively contribute to the design process, while also bringing out aspects of their identity [2]. This methodology aligns with the concept of computational empowerment (CE) [1], suggesting an enriched educational framework where children are not mere consumers of technology but active participants in its critique and creation. Design Futuring involves imagining and crafting future scenarios to inform design decisions and anticipate potential alternative realities. This practice underlines the necessity for a plurality of perspectives [3], advocating for a future that is inclusively envisioned and resonates with diverse societal needs and aspirations. The importance of this pluralistic approach is echoed with the works on values in design [4] and reflective design [5], emphasizing the need to challenge the status quo and envisage futures that are equitable and just.

Making becomes an essential mechanism for both exploring criticality [6]and futuring. The act of making, especially within educational settings, serves as a tangible means through which children can engage with concepts of technology and futuring. It provides a hands-on experience that not only facilitates a deeper understanding of technology’s potential and limitations but also empowers children to envision and shape future technological landscapes.

Performance allows children to embody and enact future scenarios, making the abstract tangible and the future immediate. [7] This engagement is not merely performative but deeply participatory, fostering a connection between the children and the material, in this case, the puppets, which become proxies for exploring and critiquing future technologies and societal configurations.

Lastly, the role of civic spaces in leveraging participatory methods for engaging with technology and society is crucial. By integrating PD practices into Civic Research, particularly with children through the workshop PlayFutures, we contribute to an expanding field of work [8] that seeks to democratize technological futures and civic engagement.

2 Methodology↩︎

The workshop is designed for 9-12 year old’s, targeting an age where their capability for active engagement, coupled with a balance of independence and imaginative play, make them an ideal age group for critical engagement. The workshop begins with an introduction to AI image generation and public spaces, where children articulate their perceptions and aspirations for the future of communal areas.

Subsequently iterating on the images in ChatGPT, a chat based interface for the GPT-4 large language model for text and image generation, children are able to creatively add, remove, modify elements from original images of the spaces. This is achieved through prompt structures called "spells," that guide the children in articulating their desires for visualise the change, incorporating both their individual preferences and collective decision making.

The reflective phase prompts children to evaluate the outcomes of their image generation processes, and considering the role of AI in shaping their visions for public spaces.

The next phase, children transition from designers to storytellers and performers. They create characters who are part of the city council, with one agreeing with the re-imagined changes to the public place in the image generation phase, one who disagrees and, if they are a group of more than two, an additional character who would try to mediate the debate between the former two. The dialogue and scenes are generated ChatGPT, but with the children having the freedom to change contents.

Figure 1: 1) Kids discussed public places of they want to redesign and formed three council 2)The Piku Niku Council, Cat Lovers Council, and the Oogy Woogy Council. 3) They used AI Image generation using prompts to re-image their chosen places throughout Atlanta, Georgia, USA. The figure also shows the kind of prompts used to approach this.

Figure 2: The second part of the workshop focused on Council in Session: where 4) participants generated city council debate scripts, starring characters they thought of, with ChatGPT. They were also told that they had the freedom to change anything about the script. 5) After an hour of making these puppets, 6) we taped the scripts with the changes behind the curtain for them to read aloud and perform

The workshop culminates in a play of council session, where children, through their making puppets, engage in a performance of a city council debate, enacting different perspectives of the council members on the future of the chosen space. This performance is instrumental in embodying the dialogues and tensions inherent in civic decision-making, offering insights into the complexities of participatory civic research where puppets act as a probe [9].

The workshop concludes with a reflective session, allowing participants to articulate their experiences, changes made to the AI-generated stories, and their feelings towards the futures envisioned. This final stage covers the learning outcomes and personal growth experienced by the children through the workshop.

3 Initial Findings and Discussion↩︎

The workshop was conducted in a community makerspace, which in turn allowed access to materials, space and equipment. An open call for children who were interested to explore Puppets and AI was made. In total, 7 Participants were present and the workshop was scheduled for around 4 hours. We formed groups, based on a common public place children were interested in, who named themselves Cat Lovers Council, Oogy Woogy Council, and Piku Niku Council. They were formed to tackle different types of public spaces, including libraries, parks, and museums, using ChatGPT for image generation and script writing. The process was hands-on and iterative, with participants engaging directly with AI to visualize their ideas and receive immediate feedback through generated images and scripts.

As seen in Fig.1 the teams worked on sites of Piedmont Park, Clarkston Library and the Fernbank Museum to imagine how they envision the future of these spaces. The Cat Lovers Council focused on making a library more inviting, incorporating ideas like increased natural light and comfortable seating. Oogy Woogy group considered environmental enhancements to outdoor spaces, emphasizing sustainability. The discussion around Piedmont Park by the Piku Niku Council involved making the lake clearer, adding more life around it. Throughout these sites, the emphasis was on using AI as a tool for visualising ideas, pushing the boundaries of conventional planning and design.

Our initial findings suggest, reflecting on the image generation, participants found value in the process beyond the immediate visualisation. Participants appreciated the empowerment that came from being able to quickly visualize changes to public spaces, even if the AI’s execution was not always precise. They recognized the need for clear instructions and the benefits of an iterative approach, allowing for refinement and adjustment.

The teams learnt to refine their communication with AI, generating scripts about a debate scenario in the City Council, where characters would agree and disagree with the changes. Adjustments to their scripts were based on their own preferences, allowing them the freedom to change generated content. They engaged in making these characters as puppets while making the changes along the way. These changes to the scripts become a crucial part of our reflections with them. Finally, all teams were able to perform. The image generated in the initial phases of the workshop was used as the backdrop for the performance to keep the focus on the future. At the end, all teams ended up changing elements of their scripts. One of the teams decided to improvise, completely rejecting the script, finding the script not "fun" and lacking "soul". They iterated that "The whole thing felt really AI-y." One team agreed with the ending, while the other two completely changed it. The reflections highlighted their understanding of AI as system, with optimism about future advancements in AI tools as support.

In conclusion, the workshop served as an exploration of ways in which AI can intersect with play and performance to re-imagine public spaces. It explored play as a means to reflect and play as a way to design. Through teamwork, iterative learning, and direct engagement with AI through embodied play, participants gained insights into both the potential and challenges of leveraging AI in creative processes and the futures of civic spaces.

4 Future Work↩︎

This is a work in progress with preliminary findings from data. Next steps are a more deeper analysis with more nuanced reporting of findings along with their implications to design research practices for Child Computer Interaction, Civic Research and Design Futuring.

References↩︎

[1]
Ole Sejer Iversen, Rachel Charlotte Smith, and Christian Dindler.2018. . In Proceedings of the 15th Participatory Design Conference: Full Papers - Volume 1(PDC ’18). Association for Computing Machinery, New York, NY, USA, 1–11. ://doi.org/10.1145/3210586.3210592.
[2]
Merijke Coenraad, Jen Palmer, Diana Franklin, and David Weintrop.2019. . In Proceedings of the 18th ACM International Conference on Interaction Design and Children. ACM, Boise ID USA, 185–196. ://doi.org/10.1145/3311927.3323148.
[3]
Noura Howell, Britta F. Schulte, Amy Twigger Holroyd, Rocío Fatás Arana, Sumita Sharma, and Grace Eden.2021. . In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems(CHI EA ’21). Association for Computing Machinery, New York, NY, USA, 1–10. ://doi.org/10.1145/3411763.3450364.
[4]
Batya Friedman David G. Hendry.2019. Value Sensitive Design: Shaping Technology with Moral Imagination. The MIT Press. ://doi.org/10.7551/mitpress/7585.001.0001.
[5]
Phoebe Sengers, Kirsten Boehner, Shay David, and Joseph ’Jofish’ Kaye.2005. . In Proceedings of the 4th decennial conference on Critical computing: between sense and sensibility(CC ’05). Association for Computing Machinery, New York, NY, USA, 49–58. ://doi.org/10.1145/1094562.1094569.
[6]
Matt Ratto.2011. . The Information Society27, 4(July2011), 252–260. ://doi.org/10.1080/01972243.2011.583819.
[7]
Richard Schechner Richard Schechner.2013. Performance Studies: An Introduction (3 ed.). Routledge, London. ://doi.org/10.4324/9780203125168.
[8]
Netta Iivari, Sumita Sharma, Leena Ventä-Olkkonen, Tonja Molin-Juustila, Kari Kuutti, Jenni Holappa, and Essi Kinnunen.2022. . International Journal of Child-Computer Interaction32(June2022), 100408. ://doi.org/10.1016/j.ijcci.2021.100408.
[9]
Bill Gaver, Tony Dunne, and Elena Pacenti.1999. . Interactions6, 1(Jan.1999), 21–29. ://doi.org/10.1145/291224.291235.