Human Creativity in the Age of LLMs

Harsh Kumar, Jonathan Vincentius, Ewan Jordan, Ashton Anderson
University of Toronto
Paper Supplementary Divergent Interface Convergent Interface Interface Walkthrough
Banner Image


We investigate the impact of Large Language Models (LLMs) assistance on human creativity by examining the two fundamental components of creativity: divergent and convergent thinking.

Abstract

Large language models are transforming the creative process by offering unprecedented capabilities to algorithmically generate ideas. While these tools can enhance human creativity when people cocreate with them, it’s unclear how this will impact unassisted human creativity. We conducted two large pre-registered parallel experiments involving 1,100 participants attempting tasks targeting the two core components of creativity, divergent and convergent thinking. We compare the effects of two forms of large language model (LLM) assistance—a standard LLM providing direct answers and a coach-like LLM offering guidance—with a control group receiving no AI assistance, and focus particularly on how all groups perform in a final, unassisted stage. Our findings reveal that while LLM assistance can provide short-term boosts in creativity during assisted tasks, it may inadvertently hinder independent creative performance when users work without assistance, raising concerns about the long-term impact on human creativity and cognition.


We designed and conducted two pre-registered parallel experiments with 1,100 participants that assess how these forms of LLM assistance influence unassisted human creativity, compared to a control group with no AI assistance.

Banner Image


Divergent Thinking

Divergent Thinking is the generation of multiple, unique ideas, fostering exploration and innovation. The creative task we used to measure this is the Alternate Uses Test (AUT), where participants were asked to come up with creative uses for common objects. Feel free to try out the interface below.

For the following object, come up with alternative uses different from its typical intended use.

The ideas don't have to be practical/realistic, so long as they strike people as clever, original, unusual, and innovative.

Bottle Image

Bottle

Enter alternative uses one by one

Here are some ideas generated by AI:

Note: You are allowed to freely use the following AI suggestion for your answers

  • Self-Watering Planter: Cut a bottle in half, invert the top half, and place it into the bottom half. Fill the bottom with water and plant your herbs or small plants in the top half. The water will wick up through the soil, keeping your plants hydrated.
  • Bird Feeder: Poke holes in the sides of a bottle and insert wooden spoons or dowels through them to create perches. Fill the bottle with birdseed and hang it outside.
  • Message in a Bottle: Use a bottle to send a heartfelt message or a time capsule. Seal it well and either bury it or keep it as a keepsake.
  • Sand Art: Fill a bottle with layers of colored sand to create a beautiful decorative piece.
  • Bottle Terrarium: Create a mini-ecosystem by placing small plants, soil, and decorative elements inside a clear bottle.
  • Musical Instrument: Fill bottles with varying levels of water and blow across the tops to create different musical notes. You can also use them as percussion instruments by tapping them.


Convergent Thinking

Convergent thinking, in contrast, focuses on refining these ideas to select the most effective solutions. The creative task we used to measure this is Remote Associates Test (RAT), which requires finding a word that connects three given words. Feel free to try out the interface below.

Find a fourth word that is related to all three of the following:
fur / rack / tail
Here is some AI generated support
Note: You are allowed to freely use the following AI suggestion for your answers.
Answer: Coat. (Fur coat, Coat rack, Coat tail)