SMS dit: Multimodal probabilistic reasoning for prediction and coordination problems in machine learning