Medicine is inherently multimodal, synthesizing diverse data sources to draw clinical conclusions. If we want to simulate health, we need to build machines the same way.