Muze: a musical instrument that plays with you

A couple of us started talking about the state of musical instruments, digital music creation, and how so much of it buckles under the weight of heavy user interfaces and the desire for more knobs, buttons and faders. What if we were to create a device that sings to you and has its own musical inclinations, yet can also engage in a two way dialog with another musician? Not something that can be controlled as much as be guided and influenced – and as a result guides and influences the user.

The proposition is relatively simple. We have educated Muze with a palette of notes that it can in-turn interpret and compose into various rhythms and phrases that are strung together to form something musical. The user can then influence these strings of notes and rhythms to create entirely new compositions. Much like you would a tune a radio to get a new song, Muze can be tuned to provide new and different melodies.

But Muze also has its own desire to explore and will continually improvise on the melodies it creates with you. It is out of this ability for it to self-create that Muze becomes a partner and not just an instrument. For instance, we have played with it and then left it to play over lunch. When we return it has come-up with something completely new, yet derivative. Sometimes what Muze creates is enjoyable, sometimes not. At which point you give Muze a little nudge and it creates something new.

In the interest of keeping Muze from becoming another knob laden techno-fest of an instrument, we have limited the interaction to one input. The input takes the form an aperture into which the user places a color coded knob. There are 6-8 knobs (still a work in progress) and each colored knob represents a new way to nudge Muze into a deviation. No single knob controls a single function, but rather a blend of functions. In playing in a band, you might suggest to a fellow guitarist to pick-up the tempo during a jam, and he not only speeds up, but becomes more syncopated, or staccato, or loud. How a musician picks-up the pace is not just a function of mathematics, but style and mood. Muze, likewise, is free to interpret your suggestions to give back to the creative process.

Technically, Muze is still evolving and growing. All of the code and circuits are open source, so feel free to check out the Arduino code and Eagle circuit schematic if you’re curious and want to try it out yourself. There’s still plenty of work to make it more musical, robust, and simple. If you have thoughts, we’d love to hear them!

June 14th, 2011

23 Comments »

23 Comments on “Muze: a musical instrument that plays with you”

  1. 1 Gregg Williams said at 1:40 am on June 15th, 2011:

    Wow–serious genius, both in the code and the clever UI. Keep going, and good luck!

  2. 2 Muze is a musical instrument that 'plays with you' / project by @teaguelabs #arduino #sound | CreativeApplications.Net said at 1:39 pm on June 15th, 2011:

    [...] [...]

  3. 3 Muze, an Arduino Music Maker with Evolving Melodies | dev.SquareCows.com said at 3:32 pm on June 15th, 2011:

    [...] Maruska and Adam Kumpf from Teague Labs created an interesting Arduino-based musical instrument called Muze, which synthesizes evolving melodies. According to their site, they’ve [...]

  4. 4 An instrument that plays along with you - Hack a Day said at 5:03 pm on June 15th, 2011:

    [...] The resulting creation is Muse, a simple musical instrument with only a single user input. Muse has been programmed with a palette of notes that it can combine and remix into a nearly infinite number of musical combinations. Muse is perfectly happy composing on its own, and will create music that evolves over time, if left alone long enough. [...]

  5. 5 An instrument that plays along with you | You've been blogged! said at 5:23 pm on June 15th, 2011:

    [...] The resulting creation is Muze, a simple musical instrument with only a single user input. Muze has been programmed with a palette of notes that it can combine and remix into a nearly infinite number of musical combinations. Muze is perfectly happy composing on its own, and will create music that evolves over time, if left alone long enough. [...]

  6. 6 Muze, an Arduino Music Maker with Evolving Melodies « Tools « tools-shop said at 7:09 pm on June 15th, 2011:

    [...] Maruska and Adam Kumpf from Teague Labs created an interesting Arduino-based musical instrument called Muze, which synthesizes evolving melodies. According to their site, they’ve [...]

  7. 7 Products & Tech News » Muze, an Arduino Music Maker with Evolving Melodies said at 7:35 pm on June 15th, 2011:

    [...] Maruska and Adam Kumpf from Teague Labs created an interesting Arduino-based musical instrument called Muze, which synthesizes evolving melodies. According to their site, they’ve [...]

  8. 8 hackaholicballa - An instrument that plays along with you said at 5:26 am on June 17th, 2011:

    [...] The resulting creation is Muze, a simple musical instrument with only a single user input. Muze has been programmed with a palette of notes that it can combine and remix into a nearly infinite number of musical combinations. Muze is perfectly happy composing on its own, and will create music that evolves over time, if left alone long enough. [...]

  9. 9 music instruments said at 7:23 am on June 20th, 2011:

    Awesomer idea. I would create a more commercial design andf make sure to patent it asap.

  10. 10 Bert M said at 1:20 pm on June 22nd, 2011:

    Nice work, the music that is produced in this way is quite nice to listen to.

    The source code could have been better. As I’m porting this to an Arduino Duemilanove, memory usage is important. Replacing all int[]s by char[]s reduces the memory usage by a factor of 4 (not to mention the processing power as well)! That could also enable more voices and longer phrases.

  11. 11 akumpf said at 3:54 am on June 23rd, 2011:

    Thanks, Bert.

    We’ll definitely take a look at switching over to chars instead of ints where possible. We initially used ints to allow for simple math and debugging as the design evolved, but improving the speed and memory footprint is always nice — good catch. :)

  12. 12 Open Source Generative Music Maker | LED World said at 11:56 am on June 24th, 2011:

    [...] folks over at Teague labs have built a fun Arduino based Muze. Instead of directly manipulating instruments, you use a color coded knob to tune or influence [...]

  13. 13 Open Source Generative Music Maker « Tools « tools-shop said at 2:19 pm on June 24th, 2011:

    [...] a fun Arduino based generative music maker with a unique minimalist keyed user interface called Muze. Instead of directly manipulating instruments, you use a color coded knob to tune or influence [...]

  14. 14 Products & Tech News » Open Source Generative Music Maker said at 3:00 pm on June 24th, 2011:

    [...] folks over at Teague labs have built a fun Arduino based Muze. Instead of directly manipulating instruments, you use a color coded knob to tune or influence [...]

  15. 15 Open Source Generative Music Maker | dev.SquareCows.com said at 11:30 am on June 25th, 2011:

    [...] a fun Arduino based generative music maker with a unique minimalist keyed user interface called Muze. Instead of directly manipulating instruments, you use a color coded knob to tune or influence [...]

  16. 16 Gary said at 1:59 am on August 15th, 2011:

    Hi,

    This sounds really good.

    Can this setup play chords? I want to build an instrument myself.

    Thanks.

  17. 17 akumpf said at 4:30 pm on August 15th, 2011:

    Gary,

    You can definitely play chords using this setup. In fact, we have experimented with as many as 8 voices and had no problems.

    Hooray for MIDI. :)

  18. 18 Karl Hansen said at 4:53 pm on September 30th, 2011:

    It took me half the video before I realized they were putting in different colored knobs. Once I realized that, the coolness factor jumped up an order of magnitude.

  19. 19 Gary said at 10:41 pm on October 24th, 2011:

    What kind of board are you using as a MIDI voice/synth? Is it sold anywhere?

    Is the one with the sensor and knobs a self-developed setup or can it be bought?

  20. 20 inspiration by jcamachor - Pearltrees said at 3:13 am on January 14th, 2012:

    [...] Labs » Muze: a musical instrument that plays with you In the interest of keeping Muze from becoming another knob laden techno-fest of an instrument, we have limited the interaction to one input. [...]

  21. 21 Musique by sadeden - Pearltrees said at 3:16 am on January 14th, 2012:

    [...] Labs » Muze: a musical instrument that plays with you – Vimperator In the interest of keeping Muze from becoming another knob laden techno-fest of an instrument, we have limited the interaction to one input. The input takes the form an aperture into which the user places a color coded knob. There are 6-8 knobs (still a work in progress) and each colored knob represents a new way to nudge Muze into a deviation. No single knob controls a single function, but rather a blend of functions. In playing in a band, you might suggest to a fellow guitarist to pick-up the tempo during a jam, and he not only speeds up, but becomes more syncopated, or staccato, or loud. How a musician picks-up the pace is not just a function of mathematics, but style and mood. [...]

  22. 22 Teague Labs » Muze Radio: a virtual musician in your browser! said at 9:39 pm on January 20th, 2012:

    [...] few months ago, we created Muze, a musical instrument that plays with you. Unlike most digital music creations tools, Muze doesn’t allow the listener to directly play [...]

  23. 23 Teague Labs : Muze said at 9:18 am on January 22nd, 2012:

    [...] [...]


Leave a Reply