Abstract: We propose a new image registration scheme for remote sensing images. This scheme includes three steps in sequence. First, a segmentation process is performed on the input image pair. Then the boundaries of the segmented regions in two images are extracted and matched. These matched regions are called confidence regions. Finally, a non-linear optimization is performed in the matched regions only to obtain a global set of transform parameters. Experiments show that this scheme is more robust and converges faster than registration of the original image pair. We also develop a new curve-matching algorithm based on curvature scale space to facilitate the second step.