Jonghoon Ahn.← Video Algorithms Research
05 · 4D Human Controllability / Gaussian Deformation

When a digital human moves, does the learned representation move locally?

I audited deformation locality in pretrained HUGS digital humans. The question was not whether the model could render a person, but whether a small articulated edit stayed anatomically local once motion passed through learned Gaussian skinning weights.

This is a diagnostic study of an existing method. It does not claim a new correction architecture. The current public result is intentionally bounded to the tested checkpoints, joints, and poses.

Independent models3Seattle · Parkinglot · Jogging
Tested joints2Left wrist + predeclared left elbow
Nested pose tests3618 wrist + 18 elbow
Worst K6 reduction99.71%Minimum across all joint × checkpoint cells
Research question

Separate expected kinematic propagation from learned nonlocal coupling.

A wrist or elbow edit naturally propagates through its kinematic descendants. The useful locality question is whether Gaussians anatomically assigned to the opposite upper body acquire learned support from the perturbed branch, and whether those small weights causally mediate the resulting response.

Diagnostic hierarchy: intended part → same-side local kinematic chain → nonlocal remainder. I use a subject-specific SMPL-derived K=6 target as the anatomical deformation reference, then compare it against the learned HUGS deformation field under matched pose perturbations.
Frozen protocol

Predeclare the generalization test before looking at its displacement result.

The left wrist was the primary probe. The left elbow was selected and frozen before inspecting elbow displacement: joint 18, z-axis, +10 degrees, with branch channels [18,20,22]. Failures were kept as results rather than changing the endpoint after inspection.

Three checkpoints

Independently pretrained HUGS NeuMan models: Seattle, Parkinglot, and Jogging.

Two interventions

Subject-specific K6 replacement and selective removal of learned perturbed-branch LBS components on the fixed contralateral subset.

Pose robustness

Seattle 4 poses, Parkinglot 4 poses, Jogging 10 poses, for 18 nested tests per joint.

Two-joint result

The same causal pattern survives checkpoint, joint, and pose changes.

All six joint × checkpoint diagnostic cells passed the frozen criteria. The independent model-level unit remains the checkpoint, n=3. Joint and pose observations are repeated diagnostics within those models.

CheckpointJointPosesMin K6 reductionMin ablation reductionMin mass/reduction corrMax ablated contra
SeattleLeft wrist499.8175%100%0.98080.0
SeattleLeft elbow499.8187%100%0.96890.0
ParkinglotLeft wrist499.7086%100%0.99750.0
ParkinglotLeft elbow499.8913%100%0.99590.0
JoggingLeft wrist1099.8178%100%0.98990.0
JoggingLeft elbow1099.8881%100%0.98460.0

Combined benchmark: 3 independently pretrained checkpoints, 2 tested joints, 36 nested pose diagnostics, 6/6 joint × checkpoint cells passed. Global minimum K6 reduction was 99.708575%; selective branch ablation removed 100% of the tested contralateral response in every nested pose diagnostic; global minimum removed-mass correlation was 0.968898.

Failure-aware research

I preserve the assumptions that failed, not only the result that survived.

Several provenance and implementation assumptions were contradicted during the audit. They remain part of the research record because they change how the evidence should be interpreted and reproduced.

Mask-threshold hypothesis

A Seattle count mismatch was initially suspected to come from ≥0.9 versus >0.9. The audit disproved that and traced the difference to the historical saved anatomy source.

Model-name alias hypothesis

The downloaded configs said hugs_triplane, so I tested whether an alias mapped it to HUGS_TRIMLP. No such alias exists in the released source. Exact numeric reconstruction still matched the checkpoint tensors.

Locality target correction

An early ankle interpretation counted expected same-leg upstream propagation as leakage. The target was corrected to separate local kinematic propagation from the nonlocal remainder.

Implementation failure log

A full-pose cell was once truncated during transfer and failed with a syntax error before scientific execution. It was logged separately rather than confused with an experimental failure.

Why this matters

Compression and rendering are not the only systems constraints for dynamic Gaussian media.

For articulated 4D representations, controllability is also a representation property. Small unintended cross-joint weights can produce structured motion far from the edited body part. Diagnosing that behavior gives me a concrete bridge from Gaussian representation research into interactive digital humans and controllable 4D media.