Landmark detection is an essential step in the diagnosis of bone pathologies and pelvis morphometry. Hence, we propose a Deep Learning based method for automatic landmark detection on multi-modality hips magnetic resonance (MR) scans. Our method is based on a synergistic analysis of appearance and shape information by using deep networks for the detection of landmark candidate locations and then adjusting these locations using inter-landmark spatial properties. Our best model gives an average of 1.74 mm over all the landmarks, where 67% of the proposed landmarks are within the spatial matching error of at most 2mm.