This paper introduces a new method for real-time gesture recognition using infrared thermal images. We propose a lightweight gesture recognition network based on CNN, called TGNet (ThermoGestureNet).