Deletes the depth maps when they are not needed anymore, or the scene has changed too much to use the same depth maps.