Exploring conformations and non-covalent interactions in complex molecular systems with rotational spectroscopy