Research Scientist – Full Body Motion

About Mecka AI Mecka AI is building the data infrastructure layer for robotics and embodied AI. We design and operate global systems for data capture, data labeling, and hardware-enabled workflows used by leading AI labs and robotics companies to train and validate humanoid and embodied AI systems. We work closely with frontier robotics teams to bridge real-world data, simulation, learning-based systems, and deployed hardware.

Our recording rigs are egocentric: a head-mounted stereo or mono camera, sometimes with body-worn sensors, plus a smaller multi-camera ego-exo volume that gives us triangulated ground truth. From the wearer's point of view the hands and forearms are almost always visible, the torso partly, the legs and feet rarely. Today our pipeline fits Meta's Momentum Human Rig (MHR) to the hands, the upper-body keypoints and the metric camera trajectory, and places the result in the world. The lower body is inferred, the feet are an ankle-plus-offset pushed onto an assumed flat floor, and contact is a check that removes frames rather than a property of the estimate. You will build the model that replaces that. The evidence you can condition on: the metric camera trajectory, hand and wrist poses, upper-body keypoints, 2D detections of whatever leg is in frame, and, in the ego-exo volume, full-body ground truth. The output we need: a full-body pose per frame in one metric world frame, on MHR / SOMA-X, that stands on the floor it is standing on, does not slide or sink, kneels and lies down when the wearer does — floor yoga is a real case — and reports per-frame contact with calibrated confidence. Motion capture, IMU suits and the ego-exo volume are yours to commission when the benchmark needs them. We think the answer lives where physics-based character control meets human motion generation: a learned full-body motion prior conditioned on partial evidence, and simulation-based tracking or a contact-aware solver that makes the result physically consistent. If you have a better answer, that is the job.

Full-body motion prior. Train generative motion models — diffusion, autoregressive or masked — on mocap-scale data and our own rig data, conditioned on the partial evidence an egocentric rig produces, so they produce the lower body and feet when nothing sees them. Physical consistency. Physics-based tracking or imitation of the kinematic estimate in simulation, or contact-aware optimisation on the body model, so the output has ground contact, no penetration, no foot skate and plausible balance — including floor work, where the standing assumption fails. Contact as an output. Per-frame foot and body contact and the ground plane, with calibrated confidence, delivered alongside the pose. The body model. MHR / SOMA-X native output; pose priors and constraints the production solver can consume. Measurement, with the audit team. Define the lower-body, feet and contact metrics and the cohort they run on (ego-exo, mocap, IMU suit); commission captures against named gaps. Hand-off. Prototype → runnable model on the cohort in a repo we own → the pod's production owners integrate. Publish what you learn; we are generous on publication.

A research record in physics-based character animation, human motion generation, or 3D human pose and shape — a PhD or an equivalent body of work, with publications at SIGGRAPH / SIGGRAPH Asia, CVPR / ICCV / ECCV, NeurIPS / ICLR or CoRL. Generative motion models. You have trained diffusion, autoregressive or masked motion models on mocap-scale data and conditioned them on constraints — keyframes, end effectors, paths, text. Physics-based control. Motion imitation and tracking for simulated humanoids in the DeepMimic / AMP / MaskedMimic lineage; comfortable in Isaac Gym / Isaac Lab or MuJoCo and with reinforcement learning at scale. Body models and kinematics. SMPL-X, MHR or SOMA-X; retargeting; contact and collision modelling. Engineering