Some apps/games may have an unplayable segment.. a phone or ammo clip that is 2 feet below floor level, or something important 2 feet beyond your physical tv screen. The ability to drag/rotate the environment for a moment to safely reach the item/button would solve several problems.