Heads-Up Multitasker

Heads-Up Multitasker -- Code Repository. This is the more than the project's playground, but also replication factory, and the extension start-off place. Please wait for my updates patiently, thank you.

Publications

Proceedings of the CHI Conference on Human Factors in Computing Systems, CHI'24

@inproceedings{bai2024hum,
  title={Heads-Up Multitasker: Simulating Attention Switching On Optical Head-Mounted Displays},
  author={Bai, Yunpeng and Ikkala, Aleksi and Oulasvirta, Antti and Zhao, Shengdong and Wang, Lucia J and Yang, Pengzhi and Xu, Peisen},
  booktitle={Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems},
  pages={1--18},
  year={2024},
  doi={10.1145/3613904.3642540},
}

Contact person

• Bai Yunpeng

Project links

• CHI presentation slides
• CHI presentation video
• Download presentation slides from Shareslide
• Project folder
• Full paper; Of course you may access it through ACM digital lib.
• Version info

Requirements

• As in requirement.txt
• But a more effective way:

  pip install -e .

• Then you need to install PyTorch that fits your hardware (windows/mac/linux)

Installation

• Just copy the repo to your local machine.
• If you want to train the model, GPU is needed. If you want to use my pre-trained model, good luck! Since models are dependent on hardware, I trained models on two different machines, sadly one cannot run on the other ...
• If you want to run codes on google cloud or any linux platform, remember to

  export MUJOCO_GL=egl

Application Execution

• If you want to replicate this work, run main.py; remember to set up the configuration file!
• If you want to replicate study results, use data in the study folder, and run jupyter-notebook files. These files also contain important parameter inference process.
• Contacting me for help is the most efficient replicating way. I am still maintaining the current repo.

Contributors

Bai Yunpeng, Aleksi Ikkala, Antti Oulasvirta, Shengdong Zhao,