This talk introduces an innovative proof of concept that leverages gesture recognition technology to create seamless, real-time interaction within everyday environments. Starting with a tool designed for American Sign Language (ASL) interpretation, this system uses advanced machine learning and frontend technologies like Python and Pyodide to enable rapid transcription and categorization of gestures. In collaboration with my team, we’ll showcase how this technology can be adapted for controlling household devices, offering an intuitive and responsive user experience. Join us for a deep dive into the technical architecture, hardware setup, and a look at the future of gesture-based interfaces in smart homes.