隨著電腦科技的進步，人機互動方式也隨之在改變，如任天堂所推出的WII、蘋果推出的iPhone...等。脫離傳統的按鍵與搖桿，以體感輸入、觸控輸入等方式進行操作。而這些人機互動界面之改變使人們在機器操作上更加直觀與便利。 近年來以電腦視覺為基礎之三維人機互動研究發展蓬勃，利用手勢與機器互動為其中較熱門之研究。肢體中手部之自由度較大，較可做出多變化之動作，方便下達較為複雜的指令。 本篇論文中，我們提出了利用Kinect之追蹤方法。將Kinect輸出之彩色影像經ASM人臉偵測與膚色偵測後結合深度影像濾除背景得以濾出手部資訊，再以粒子濾波器來達到雙手的追蹤，最後判斷雙手間距離之變化以及單手位移方向，進而控制電腦之軟體。 With the advances of computer technology, human-computer interaction also will be changed. Such as the WII invented by the Nintendo, and the iPhone devised by Apple, etc. To operate the machine is from using the traditional buttons and joysticks to apply "sensing motion", and touching, etc. These changes in human-computer interaction make us more intuitive and convenient on operation. In recent years, the researchs on three-dimensional human-computer interaction based on computer vision are developed well. The interaction using gestures is the most popular study. The hands can do more free movements than any other body, also can execute more complex comments easily. In this paper, we propose a tracking method using by Kinect. We use the color images from the Kinect after the ASM algorithm and the skin color detection to track the face, then combine the depth image after doing removing the background to get the hands'' information. Therefore, we apply the particle filter for tracking the hands. Finally, we can determine the distance between the hands and the direction of one hand, and then we can control the computer''s software.