Zaslat SMS: The nature of luminous X-ray sources with mid-infrared counterparts