Very proud of my team for this fab experiment from our Creative Lab Fivers.
Semi-Conductor puts you in front of your very own AI orchestra. It uses Tensorflow & PoseNet to allow you to conduct music by moving your arms, using only your browser and a webcam.
For us, it was a fun experiment in AI and interfaces – how can AI help us interact with computers more naturally? Can we control music the way a real conductor would, instead of with buttons and a screen?
Semi-Conductor was built by Rupert Paryy with beautiful design & UX from Melissa Lu and Haylie Craig, who were absolutely instrumental in the core of the project.