Sep 21

Sound effects created by robots, can AI really replace sound designers and Foley artists?

MIT’s Computer Science and Artificial Intelligence Lab recently conducted research to see if a computer could digitally recreate sound effects using synthesis from recognising real world actions and materials from videos.

The team spent several months recording around 1000 videos of actions producing sound effects and fed these into the system they have been creating. The result, they say is a system well on the way to being able to fool the human brain into believing the sound it produces in response to the video is the real acoustic sound result from the action.

The resulting sounds from the tests of the system were then played to humans, who were inclined to pick the fake sounds over the real ones twice as often. However, the study reveals that ‘less clean’ sounds such as leaves and dirt where easier to fake over cleaner sounds sucg as wood and metal strikes.

You can read the full in-depth article here. 

While we need to embrace technology and progression in industry, I hope that such technology doesn’t remove the human being from the role of sound designer of foley artist creating sound effects in the future!

About The Author

I'm the founder of and professional sound designer. I provide free sound effects for games, TV, radio, filmmaking, podcasts, YouTube and more. You can download all my sounds free as mp3 and wav files here at ZapSplat.

Generating Download Link...

Download Ready Below...

Remember, you must credit us/provide attribution when using our sounds/music in your work. An example would be:

Sound from

Get Unlimited Downloads, Attribution Free and More When you Upgrade for Just £5

  • Unlimited downloads
  • Removal of the attribution requirement
  • Higher quality sounds (get the wavs too)
  • Thousands of extra sounds
  • Premium professional soundfx packs
  • Create and organise sounds into lists
  • More results per page & ad free

Basic members can download 4 sounds & packs every hour to save bandwidth

left to go

Get unlimited downloads and more!

  • Unlimited downloads
  • Removal of the attribution requirement
  • Ad free
  • Pro quality sounds (get the wavs too)
  • Thousands of extra sounds
  • Lists, more results per page & more

All this from just £5