Learning Temporal Variations For Action Recognition