Summary - Link to Project
So for this project, I decided to revisit an old project that I had created last summer. I created a simple ball catching game where the user controlled a character at the bottom of the screen to catch the falling balls from the top of the screen. I replicated the basics of this sketch using PoseNet so the user utilizes their nose to control a basket to catch the balls.
Process
I first used the old sketch to recreate the basic forms of the game and switched the controls to follow the mouse instead of the character.
Once I had this, I used Moon's sketch from class to help implement the PoseNet into the design. This was easy to switch the mouse controls over to the face controls once I understood how to pull the key points and access each x and y value from the array. I also decide to add a counter to make it a little more interesting. Once the user collects 10 balls, the balls start slowly falling faster and faster from the screen.
Once I got this working, I felt like I wanted to do more with the sketch other than just recreating it. I looked more at Moon's sketches and got inspired by the Semi-Conductor Google Experiment. This experiment used the body to control an orchestra while they played Eine Kleine Nachtmusik. I also found a p5.js sketch from another user who created a midi piano that users could play. I wanted to add notes to my design that corresponded with the color of the ball that was falling to play a mini song. Although I was able to get the note playing when the user connects with the ball, I wasn't able to figure out how to connect the note with the color of the ball at first.
I ended up messaging Moon and he was able to help me with correcting the image so your head could follow the ball better instead of your head going in the opposite direction of the ball. He was also able to help me with the sound so it plays a different depending on the color of the ball. I could figure out how to attach color to the ball and get it to change when the user caught the ball, but I needed help syncing the two arrays.
Final Project
Resources
Comments