Abstract: In this paper, we propose a novel method for high dynamic environment sequence sampling. Without future frame information, our approach achieves temporal coherence by mapping sampling information from previous frame to current frame based on temporal superpixels. However, temporal superpixels have unbalanced importance for rendering, although light regions in environment sequences can be tracked across frames. To solve this issue, we develop an adaptive merge-and-split scheme to adjust sample segments to achieve a more importance-balanced sample distribution. Compared with several state-of-the-art methods, our approach gets consistently improved rendering quality across environment sequences. Experiment results also show decent temporal coherence of our approach in sequence rendering.