Abstract: In order to realistically reproduce the interactive process of collaborative plotting of holographic electronic sand table under the augmented reality environment, a video-based distributed collaborative plotting reconstruction method was proposed. Firstly, the operators were tracked based on YOLO using a single RGB camera simultaneously to estimate the relative position of those people in 3D space. And an improved ResNet network was used to predict 3D joint positions for every operator. Then the estimated joint positions of the local operators were sent to other place to drive the avatar's movement in real time through low-pass filter and the method of inverse kinematics. The experiment results show that the proposed method can reproduce the operator's motion and meet the application requirements.