The project

This project was developed as a private event for the employees of Amita Motion with the goal of creating an interactive Karaoke Booth experience. Participants would step into the booth, view the lyrics of a promotional song on-screen, and sing along. Once finished, each participant would receive a video of their performance as a personalized keepsake. The game provided a QR-code for the participant to download his/ her performance.

Challenges

This was a fast-paced project with a tight deadline, and it involved several complex technical challenges, including:

  • Real-time Uploads: Ensuring each video was uploaded online immediately after recording.
  • Simultaneous Audio/Video Capture in Unity: Finding a reliable way to record both microphone input and camera footage at the same time inside a Unity environment.

Technical Approach

  • Uploading to the Cloud: To handle real-time uploading, I integrated custom Unity-compatible libraries that facilitated a secure connection with Google Drive, where the recordings were saved in a private folder.
  • Audio & Video Recording in Unity: Unity natively supports microphone and camera input, but recording them simultaneously and combining them is not straightforward. I utilized separate Unity plugins to capture audio and video streams independently, and then used the FFmpeg library to synchronize and merge the recordings into a single video file.