Correlation

Correlations describe data moving together

Correlations are useful for describing simple relationships among data. For example, imagine that you are looking at a dataset of campsites in a mountain park. You want to know whether there is a relationship between the elevation of the campsite (how high up the mountain it is), and the average high temperature in the summer.

For each individual campsite, you have two measures: elevation and temperature. When you compare these two variables across your sample with a correlation, you can find a linear relationship: as elevation increases, the temperature drops. They are negatively correlated.

What do correlation numbers mean?

We describe correlations with a unit-free measure called the correlation coefficient which ranges from -1 to +1 and is denoted by r. Statistical significance is indicated with a p-value. Therefore, correlations are typically written with two key numbers: r = and p = .

• The closer r is to zero, the weaker the linear relationship.
• Positive r values indicate a positive correlation, where the values of both variables tend to increase together.
• Negative r values indicate a negative correlation, where the values of one variable tend to increase when the values of the other variable decrease.
• The p-value gives us evidence that we can meaningfully conclude that the population correlation coefficient is likely different from zero, based on what we observe from the sample.
• "Unit-free measure" means that correlations exist on their own scale: in our example, the number given for r is not on the same scale as either elevation or temperature. This is different from other summary statistics. For instance, the mean of the elevation measurements is on the same scale as its variable.

Once we’ve obtained a significant correlation, we can also look at its strength. A perfect positive correlation has a value of 1, and a perfect negative correlation has a value of -1. But in the real world, we would never expect to see a perfect correlation unless one variable is actually a proxy measure for the other. In fact, seeing a perfect correlation number can alert you to an error in your data! For example, if you accidentally recorded distance from sea level for each campsite instead of temperature, this would correlate perfectly with elevation.

Another useful piece of information is the N, or number of observations. As with most statistical tests, knowing the size of the sample helps us judge the strength of our sample and how well it represents the population. For example, if we only measured elevation and temperature for five campsites, but the park has two thousand campsites, we’d want to add more campsites to our sample.

Visualizing correlations with scatterplots

Back to our example from above: as campsite elevation increases, temperature drops. We can look at this directly with a scatterplot. Imagine that we’ve plotted our campsite data:

• Each point in the plot represents one campsite, which we can place on an x- and y-axis by its elevation and summertime high temperature.
• The correlation coefficient (r) also illustrates our scatterplot. It tells us, in numerical terms, how close the points mapped in the scatterplot come to a linear relationship. Stronger relationships, or bigger r values, mean relationships where the points are very close to the line which we’ve fit to the data.

What about more complex relationships?

Scatterplots are also useful for determining whether there is anything in our data that might disrupt an accurate correlation, such as unusual patterns like a curvilinear relationship or an extreme outlier.

Correlations can’t accurately capture curvilinear relationships. In a curvilinear relationship, variables are correlated in a given direction until a certain point, where the relationship changes.

For example, imagine that we looked at our campsite elevations and how highly campers rate each campsite, on average. Perhaps at first, elevation and campsite ranking are positively correlated, because higher campsites get better views of the park. But at a certain point, higher elevations become negatively correlated with campsite rankings, because campers feel cold at night!

We can get even more insight by adding shaded density ellipses to our scatterplot. A density ellipse illustrates the densest region of the points in a scatterplot, which in turn helps us see the strength and direction of the correlation.

Density ellipses can be various sizes. One common choice for examining correlation is a 95% density ellipse, which captures approximately the densest 95% of the observations. If two variables are moving together, like our campsites’ elevation and temperature, we would expect to see this density ellipse mirror the shape of the line. And we can see that in a curvilinear relationship, the density ellipse looks round: a correlation won’t give us a meaningful description of this relationship.