Enabling Deep Learning Inference On Resource Constrained Devices