Very proud of my team for this fab experiment from our Creative Lab Fivers.
Semi-Conductor puts you in front of your very own AI orchestra. It uses Tensorflow & PoseNet to allow you to conduct music by moving your arms, using only your browser and a webcam.
For us, it was a fun experiment in AI and interfaces – how can AI help us interact with computers more naturally? Can we control music the way a real conductor would, instead of with buttons and a screen?
Semi-Conductor was built with beautiful design & UX from Melissa Lu and Haylie Craig, who were absolutely instrumental in the core of the project.
Using digital to bring the physical world to life. A write-up and video and repository for our recent project at the British Museum.
The Sydney Creative Lab worked with the Japanese design and research agency AQ to explore the concept of mood-mapping via a small hand-held device. The intention was no more than to explore the space, and the outcome of the project is an essay and a video talking about the outcomes of this thought experiment.