During the process of target tracking

the template should be updated properly in order to adapt the change of the target pose. In this paper

a new template update method is proposed. On the base of affine tracking

moving object detection is performed. We estimate the pose change of the object according to the detection result image. A new update method is used as follows: Firstly

pixels belong to target and those belong to background are updated with different power; Second

because the template size does not change during tracking

some strategies must be adopted: if the object is turning bigger

the old template is stretched to the proper size and placed in the new template's proper position

the rest pixels in the template are determined by the corresponding pixels in the input image. Otherwise

if the object is turning smaller

the old template is shrunk to the proper size and placed in the new template's proper position. The rest pixels in the template are determined by the corresponding pixels in the input image in the same way. Experiments using these algorithms show this method could keep robustness under complicated environments.