Heart Rate Variability (HRV) is one of the important physiological parameter which is used to early detect many fatal disease. In this paper a non-contact remote Heart Rate Variability (HRV) monitoring system is developed using the facial video based on color variation of facial skin caused by cardiac pulse. The lab color space of the facial video is used to extract color values of skin and signal processing algorithms i.e., Fast Fourier Transform (FFT), Independent Component Analysis (ICA), Principle Component Analysis (PCA) are applied to monitor HRV. First, R peak is detected from the color variation of skin and then Inter-Beat-Interval (IBI) is calculated for every consecutive R-R peak. HRV features are then calculated based on IBI both in time and frequency domain. MySQL and PHP programming language is used to store, monitor and display HRV parameters remotely. In this study, HRV is quantified and compared with a reference measurement where a high degree of similarities is achieved. This technology has significant potential for advancing personal health care especially for telemedicine.