Remotion: The New Robotic Telepresence by Cornell Researchers

It’s no secret that nonverbal cues play an essential role in our daily interactions, often offering a sense of engagement that words simply cannot. What if we could recreate this in a remote setting?

That question was the guiding force behind a new project out of Cornell University that has led to the creation of a robot, the aptly named Remotion, that represents a remote user in physical space, in real time with their Mimics movements and conveys important nonverbal communication. ,

bridging the gap in nonverbal communication

In our digitally driven age, the need to foster effective communication irrespective of physical distances has become immense. Moses Sakashita, a doctoral student in information science at Cornell who is also the lead author of “Remotion: Supporting Remote Collaboration in Open Space with Automatic Robotic Embodyment,” expressed this concern:

“Pointing gestures, the perception of another’s gaze, instinctively knowing where one’s attention is directed—in remote settings, we lose these nonverbal, implicit cues that are critical to carrying out design activities.” “

Remotion offers a solution to this concern, acting as a slim, roughly six-foot-tall avatar of a remote user. The device sports a monitor for the head, omnidirectional wheels for the feet, and a sophisticated game-engine software for the mind. By incorporating another Cornell-manufactured device, the NeckFace, which the remote user wears, ReMotion can accurately mirror the user’s head and body movements.

A step forward in remote collaboration

While telepresence robots are not entirely new to the tech world, most require manual operations from remote users, often taking their attention away from primary tasks. However, ReMotion changes the game, providing a smooth, automated experience that preserves the user’s focus. It also outperforms other existing systems such as virtual reality and mixed reality collaboration that typically require active user participation and may be hindered by peripheral awareness.

In a preliminary study, most participants reported feeling a higher sense of connection with their remote partners when using ReMotion compared to other telerobotic systems. This feature is fundamental as the shared attention between partners was reportedly enhanced when using ReMotion.

future horizon

The current prototype of Remotion primarily supports face-to-face interactions in the same physical locations. However, the developers plan to explore more varied and odd scenarios in future iterations. Sakashita envisions a broad range of applications for ReMotion, potentially revolutionizing virtual collaborative environments, classrooms and other educational settings.

The project, a significant step forward in AI-powered remote collaboration, is testament to the researchers’ drive to improve human-robot interaction and remote collaboration. This innovation promises a future where distance is no longer a barrier for efficient and effective communication.