The Correlation Coefficient) is a metric that measures the relation between two dimensional datasets such as height and weight.
There are several types of correlation coefficient, among them the most widely used is called the Pearson’s correlation coefficient.
Let us consider the two dimensional datasets . These datasets may represents the data for Height (X) and Weight (Y) in a population, or scores in Mathematics (X) and English (Y) subjects by group of students.
Then, the correlation coefficient is given by
Here, and denote the average of the dataset and , respectively. In addition, and is the standard deviation of dataset and , respectively.
From the definition of the Correlation Coefficient , we can show that .
When the Correlation Coefficient is close to 1, it implies that two datasets are strongly positively correlated. On the other hand,
when the Correlation coefficient is close to -1, it denotes that two datasets are strongly negatively correlated. In case that the Correlation Coefficient is close to zero, there is no significant relationship or correlation between both datasets.
to verify if the two datasets are significantly correlated or not, we have to pay attention to the size of datasets .
For example, even though the Correlation Coefficient is 0.6, sometimes there is real correlation but in other cases the correlation may not be significant enough due to small size of datasets.
In general, by increasing the dataset size, the correlation coefficient becomes more reliable.
This issue will be explained in more detail in the statistical test section.