MuJoFil aims to make vision RL training cheaper on GPU

MuJoFil is a new simulator meant to reduce some limits of MuJoCo. MuJoCo depends heavily on the CPU for physics work, so it can hit limits when many need to run at the same time. MJX adds , but it is not aimed at vision-based pipelines.

NVIDIA Isaac is another option, but it can require a powerful GPU and licensing, which may make it harder to access. MuJoFil combines NVIDIA's Newton Physics Engine with Google's Filament Render Engine. The has been changed so multiple can be rendered directly on the GPU in parallel, with ongoing .

The project is still under development, so serious bugs may remain.

Key points

  • MuJoCo can be limited by its CPU-heavy physics work when many run at once.
  • MJX supports but is not built mainly for vision-based workflows.
  • NVIDIA Isaac can be powerful but may need expensive hardware and licensing.
  • MuJoFil combines Newton Physics Engine and Filament Render Engine to run parallel visual on GPU.
  • The project is still early, so important bugs are expected.
Read original