Symmetrical Reality

[MM 2024] In Situ 3D Scene Synthesis for Ubiquitous Embodied Interfaces

In this paper, we propose a scene agent that synthesizes situated 3D virtual scenes as a kind of ubiquitous embodied interface in VR for users. The scene agent synthesizes scenes by perceiving the user’s physical environment as well as inferring the user’s demands.

Haiyan Jiang, Leiyu Song, Dongdong Weng, Zhe Sun, Huiying Li, Xiaonuo Dongye, Zhenliang Zhang

[MM 2024] In Situ 3D Scene Synthesis for Ubiquitous Embodied Interfaces

[VR 2024] On the Emergence of Symmetrical Reality

In this paper, we introduce the symmetrical reality framework, which offers a unified representation encompassing various forms of physical-virtual amalgamations.

Zhenliang Zhang, Zeyu Zhang, Ziyuan Jiao, Yao Su, Hangxin Liu, Wei Wang, Song-Chun Zhu

[VR 2024] On the Emergence of Symmetrical Reality

[UIST 2023] Neighbor-Environment Observer: An Intelligent Agent for Immersive Working Companionship

In this paper, we propose a joint observation strategy for artificial agents to support users across virtual and physical environments.

Zhe Sun, Qixuan Liang, Meng Wang, Zhenliang Zhang

[UIST 2023] Neighbor-Environment Observer: An Intelligent Agent for Immersive Working Companionship

[VR 2023] Building symmetrical reality systems for cooperative manipulation

In this paper, we discuss the symmetrical reality-based human-robot interaction and show the general pipeline of building the symmetrical reality system with two minds.

Zhenliang Zhang

[VR 2023] Building symmetrical reality systems for cooperative manipulation

[VR 2021] Symmetrical cognition between physical humans and virtual agents

In this paper, we discuss the cognition problem from some perspectives, i.e., attention, perception, pattern recognition, and communication.

Zhenliang Zhang

[VR 2021] Symmetrical cognition between physical humans and virtual agents

[ISMAR 2020] Machine intelligence matters: Rethink human-robot collaboration based on symmetrical reality

We introduce the contents of the symmetrical reality-based human-robot collaboration and interpret the humanrobot collaboration from the perspective of equivalent interaction.

Zhenliang Zhang, Xuejiao Wang

[ISMAR 2020] Machine intelligence matters: Rethink human-robot collaboration based on symmetrical reality

[ISMAR 2020] Understanding physical common sense in symmetrical reality

We emphasize the bi-directional mechanical control within the symmetrical reality framework and why free wills of machines can break the common sense.

Zhenliang Zhang

[ISMAR 2020] Understanding physical common sense in symmetrical reality

[IROS 2020] Graph-based hierarchical knowledge representation for robot task transfer from virtual to physical world

We study the hierarchical knowledge transfer problem using a cloth-folding task, wherein the agent is first given a set of human demonstrations in the virtual world using an Oculus Headset, and later transferred and validated on a physical Baxter robot.

Zhenliang Zhang, Yixin Zhu, Song-Chun Zhu

[IROS 2020] Graph-based hierarchical knowledge representation for robot task transfer from virtual to physical world

Symmetrical Reality Project

A Project of Symmetrical Reality.

Symmetrical Reality Project

[VR 2019] Symmetrical reality: Toward a unified framework for physical and virtual reality

In this paper, we review the background of physical reality, virtual reality, and some traditional mixed forms of them. Based on the …

Zhenliang Zhang, Cong Wang, Dongdong Weng, Yue Liu, Yongtian Wang

[VR 2019] Symmetrical reality: Toward a unified framework for physical and virtual reality