2023

JANUS

an AI doorknob

Janus is a playful, multimodal guardian of thresholds. Otherwise known as a doorknob.

CONTEXT

Interaction Intelligence + Intelligent Multi-Modal User Interfaces

MIT SAP + EECS

SOFTWARE

Python, C++, Arduino, 3D printing, wood fabrication, laser cutting

SUPERVISORS

Marcelo Coelho, Randall Davis

"Hello. How are you today? It's my pleasure to be your doorknob tonight."

This project examines the possibility of having a "digital doorman", or a door that is able to playfully guard the threshold while knowing what is physically on both ends. Janus is able to not only recognize if the person approaching is on its list to let into the space, but also begins to playfully engage with those that do not have permission to enter.

If Janus is not allowed to let you in, it will stall by giving you a string of challenges. It might ask you to sing, dance, to a handshake, tell a joke, answer a riddle, and more.

If you satisfy its requirements it might let you in.....

HOW IT WORKS

This system is connected to several APIs that allow it to perform it's tasks, including OpenAI, Computer Vision API, Facial Recognition API, Speech to Text and Text to Speech.

Here is a rough diagram of the process:

The basic framework is that the microphone listens for user input, then crafts a prompt for openAI to then respond to, which is translated to audio, transmitted to the user, and then the cycle repeats itself again. This system is made more complex by the supplemental sensors and functions.