Can we only move forward in time?