5D Registration of 3D Meshes

The Early Warning Scan system is a new technique being developed to detect breast cancer at an early stage. The technique is fast and painless and is intended to be used alongside mammography to compensate for the latter's shortcomings.

3D scanning is a key component of this technique. The system produces forty 3D images (meshes) per second of the breast in motion. By analyzing this motion, the system learns to recognize abnormal patterns that could be related to disruptions in tissue elasticity. To perform this analysis, reference points are required in the 3D representation of the body, which are not present in the mesh. These must be calculated.

The 3D meshes are all generated individually and have no corresponding vertices or faces. You will develop a system that derives the body position for each mesh and calculates fixed reference points using an AI-based 4D human pose estimation system (PHALP). An additional step adds a fifth dimension that validates the accuracy of the reference points (Blender 3D). Using the validated reference points, you register the 3D meshes and place the torsos in a standardized starting position (Blender 3D).

Blender 3D plug-in file