Flag

We stand with Ukraine and our team members from Ukraine. Here are ways you can help

Get exclusive access to thought-provoking articles, bonus podcast content, and cutting-edge whitepapers. Become a member of the UX Magazine community today!

Home ›› Design ›› Imagineering in a Box: Sound Design

Imagineering in a Box: Sound Design

by Shelly Warmuth
5 min read
Share this post on
Tweet
Share
Post
Share
Email
Print

Save

sd_Slider

Whether you are creating a marketing campaign, a trade show booth, an experience or a land, sound is part of telling that story and getting your audience to feel.

The importance of sound design wasn’t new to me when I started this class. I had studied sound design as part of game development and had attended a sound panel at an IGDA meeting (International Game Developers Association)

Silent Hill 2 Nature Trail

I think the first time I really noticed how important sound design was to immersive design was on the nature trail at the beginning of Silent Hill 2. Everything is foggy and gray and you’re walking down a gravel trail, but it sounds like someone is following you. When you stop, it stops. The sound was very important in Silent Hill 2 because the entire game was shrouded in dense fog. But, highlighting that was the realization of how much detail went into that sound design — that gravel sounds like gravel and blacktop sounds like a hard cement surface. Layers of sound make the world feel more real.

This can be experienced again in Hellblade: Senua’s Sacrifice. This game uses binaural sound to help the player experience schizophrenia. You don’t notice the ambient sounds as much, but it is a game in which playing with or without headphones affects the experience. Hint: You really need the headphones, even if you’re playing alone in a quiet space.

Yet, when it came time to do this assignment, I knew it was going to be tough. I still thought of sound design as something you hand over to the sound guys with some direction. Don’t get me wrong. I knew the direction had to be specific. For instance:

  • “I want this to be fast and angry. “
  • “This part should feel comforting and compassionate. “

I also knew that working with voice-over actors was still like directing. They’re still actors. Still, I picture sound design more like this: Lead Sound Designer sits in front of the movie and writes the score while watching the movie over and over. Similarly, sound effects are added in the appropriate places.

The choices the sound designer makes while scoring the movie will greatly affect the overall aesthetic of the film. The comical tune at 1:17 really doesn’t work for this scene, does it? But, neither does sad and thoughtful. It’s not just that we know the movie and what’s supposed to be happening here. It’s the scene itself.

When it came to designing for my land, I realized I had to own it. It is my design, after all. Don’t get me wrong — no large scale project is completed by one person. You absolutely need to surround yourself with experts in their fields and listen to them. Bring them on early; ask for their input. But, as the designer, pulling off the vision starts with you.

I realized that I had to have a vision for my land’s aesthetic, and I couldn’t pass the buck to the experts.

I started by listening to soundscapes from Disney because I was fascinated with stories I’d heard about all of the ambient sounds in Disney parks being shut off on 9/11 when the parks were being evacuated. Cast Members said they’d never heard the parks without the ambient music. It was disquieting according to people who were there. This is the first that I’d heard anything about the ambient sounds.

It’s difficult to find these soundtracks without knowing specifically what you’re looking for and much of what I did find seemed a little cloying. I doubted the validity of those tracks.

Next I searched for soundtracks from the movie, Ready Player One. I wanted to see what choices Spielberg and John Williams came up with.

I’ll be honest. This didn’t help me. Even when finding multiple tracks, I found that the music didn’t tell me what was going on in the scene. I wound up watching the movie again just to pay attention to the sound design. In reality, I should have minimized the screen and just listened to the movie. Now, however, I could see where hope, joy, or tension were all reflected in the music.

The question I was having a difficult time answering wasn’t reflected in the score, however. What does it sound like in The Stacks? What does the music make you feel like? What does it sound like in the city? Nope, these designs decisions hadn’t been made for me. I didn’t draw inspiration for my land from it.

I went to look for documentaries about how movies were scored and finally learned the lesson for this class.

How To Do Sound Design When You’re Not A Sound Designer

Musical score and sound design as part of the overall design needs to be done like everything else. You need to create a palette, storyboard or inspiration board for your composer or sound design team.

In practice, this will look like temp tracks. A temporary track is a piece of existing music that is similar to what you want your soundtrack to sound like at any given point in, in this case, your land.

For instance, does this seem familiar?

George Lucas may have given this to composer John Williams as an example of what he wanted and John Williams took it from there.

In reality, this could be two pieces on my decisions for the sounds for my land, but I’ll just give the cliff notes. The present layers of sounds would be nature — frogs, crickets, birds, pets, the wind in the grass and trees. The music would be cheerful, yet summery. To me, music is different in summer. The city would sound more hurried and hard-angled. The layers of ambient sound are more white noise, machine-related noises. Still, I don’t want people to feel rushed through this area. You want people to want to stay here. It’s fun. The Stacks area would be sad and thoughtful with almost no natural ambient noise. You’d hear the sounds of people throwing trash on a pile, papers blowing in the wind, and the cacophony of the sounds made by people living in close quarters.

SUMMARY

  • Whether you are creating a marketing campaign, a trade show booth, an experience or a land, sound is part of telling that story and getting your audience to feel.
  • Decide how you want participants to feel as they move through your experience. Create a storyboard that includes tracks that feel like you want your score to feel.
  • Get a sound designer involved early. Be specific about what you want, but acknowledge his/her expertise and listen to them.
  • Sound, like lighting design, happens in layers.
  • What are the ambient layers of your environment? If the area was quiet, what would you hear?
  • The musical layer will use rhythm, tone, and speed to create a mood for your environment.

Don’t pencil-whip this part. Working to decide on a sound design for your experience will set your designs apart for reasons that other designers will have difficulty pinpointing.

post authorShelly Warmuth

Shelly Warmuth

Shelly is an experience designer who is passionate about immersive design including games, theme parks, LARP, mixed reality/VR/AR, immersive theater, & everyday life. She has the creative background, experience, and education to find creative solutions to weird problems. She believes media should be truly immersive and it should augment reality.

Tweet
Share
Post
Share
Email
Print

Related Articles

The role of the Head of Design is transforming. Dive into how modern design leaders amplify impact, foster innovation, and shape strategic culture, redefining what it means to lead design today.

Article by Darren Smith
Head of Design is Dead, Long Live the Head of Design!
  • The article examines the evolving role of the Head of Design, highlighting shifts in expectations, responsibilities, and leadership impact within design teams.
  • It discusses how design leaders amplify team performance, foster innovation, and align design initiatives with broader business goals, especially under changing demands in leadership roles.
  • The piece emphasizes the critical value of design leadership as a multiplier for organizational success, offering insights into the unique contributions that design leaders bring to strategy, culture, and team cohesion.
Share:Head of Design is Dead, Long Live the Head of Design!
9 min read

Discover how digital twins are transforming industries by enabling innovation and reducing waste. This article delves into the power of digital twins to create virtual replicas, allowing companies to improve products, processes, and sustainability efforts before physical resources are used. Read on to see how this cutting-edge technology helps streamline operations and drive smarter, eco-friendly decisions

Article by Alla Slesarenko
How Digital Twins Drive Innovation and Minimize Waste
  • The article explores how digital twins—virtual models of physical objects—enable organizations to drive innovation by allowing testing and improvements before physical implementation.
  • It discusses how digital twins can minimize waste and increase efficiency by identifying potential issues early, ultimately optimizing resource use.
  • The piece emphasizes the role of digital twins in various sectors, showcasing their capacity to improve processes, product development, and sustainability initiatives.
Share:How Digital Twins Drive Innovation and Minimize Waste
5 min read

Discover how venture capital firms are shaping the future of product design — and why experienced design leaders need to be consulted to ensure creativity and strategy aren’t left behind. This article delves into the power VCs hold in talent acquisition and team dynamics, highlighting the need for a collaborative approach to foster true innovation.

Article by Darren Smith
How Venture Capital Firms Are Shaping the Future of Product Design, & Why Design Leaders Need to Be Part of the Solution
  • The article explores how venture capital (VC) firms shape product design by providing startups with critical resources like funding, strategic advice, and network access, but often lack an understanding of design’s strategic value.
  • It discusses the impact of VC-led hiring practices in design, which can lead to misaligned job roles, undervalued design leadership, and teams focused more on output than innovation.
  • The piece calls for a collaborative approach where design leaders work alongside VCs in talent acquisition and strategic planning, establishing design as a key partner to drive product innovation and long-term brand success.
Share:How Venture Capital Firms Are Shaping the Future of Product Design, & Why Design Leaders Need to Be Part of the Solution
8 min read

Join the UX Magazine community!

Stay informed with exclusive content on the intersection of UX, AI agents, and agentic automation—essential reading for future-focused professionals.

Hello!

You're officially a member of the UX Magazine Community.
We're excited to have you with us!

Thank you!

To begin viewing member content, please verify your email.

Tell us about you. Enroll in the course.

    This website uses cookies to ensure you get the best experience on our website. Check our privacy policy and