Towards Adaptive, Continual Embodied Agents