YouTube Symphony Orchestra experimental AR musical app :: use your phone to make music

Working with Tellart we built an online musical instrument where you take a photo (or print) an Augmented Reality marker and then show your phone (or printout) to a webcam that will 'play' music as you move it around the screen. It sounds odd, (and it should...) it's best played rather than explained.
So far people seem a bit confused - so we'll have to work on that.

From the moment we started talking about the second YTSO [YouTube Symphony] we started to get excited about this little part of it. Bringing some classic Google geek-out digital experimentation to the whole circus. Intended both to inspire and disrupt - and maybe even to feature in the improvised section of Mason Bates' amazing piece - we hope it will at least give people some ideas.