A robust human intrusion detection technique using hue-saturation histograms is presented in this paper. Initially a region of interest (ROI) is manually identified in the scene viewed by a single fixed CCTV camera. All objects in the ROI are automatically demarcated from the background using brightness and chromaticity distortion parameters. The segmented objects are then tracked using correlation between hue-saturation based bivariate distributions. The technique has been applied on all the 'Sterile Zone' sequences of the United Kingdom Home Office iLIDS dataset and its performance is evaluated with over 70% positive results.