一组高度相关的变量

Question

我有一个数据框，我想找出哪组变量具有最高的相关性。例如：

mydata <- structure(list(V1 = c(1L, 2L, 5L, 4L, 366L, 65L, 43L, 456L, 876L, 78L, 687L, 378L, 378L, 34L, 53L, 43L), 
                         V2 = c(2L, 2L, 5L, 4L, 366L, 65L, 43L, 456L, 876L, 78L, 687L, 378L, 378L, 34L, 53L, 41L), 
                         V3 = c(10L, 20L, 10L, 20L, 10L, 20L, 1L, 0L, 1L, 2010L,20L, 10L, 10L, 10L, 10L, 10L), 
                         V4 = c(2L, 10L, 31L, 2L, 2L, 5L, 2L, 5L, 1L, 52L, 1L, 2L, 52L, 6L, 2L, 1L), 
                         V5 = c(4L, 10L, 31L, 2L, 2L, 5L, 2L, 5L, 1L, 52L, 1L, 2L, 52L, 6L, 2L, 3L)), 
                    .Names = c("V1", "V2", "V3", "V4", "V5"), 
                    class = "data.frame", row.names = c(NA,-16L))

我可以计算相关性并找到相关性高于阈值的每一对：

var.corelation <- cor(as.matrix(mydata), method="pearson")

fin.corr = as.data.frame( as.table( var.corelation ) )
combinations_1 = combn( colnames( var.corelation ) , 2 , FUN = function( x )  paste( x , collapse = "_" ) )
fin.corr = fin.corr[ fin.corr$Var1 != fin.corr$Var2 , ]

fin.corr = fin.corr [order(fin.corr$Freq, decreasing = TRUE) , ,drop = FALSE]

fin.corr = fin.corr[ paste( fin.corr$Var1 , fin.corr$Var2 , sep = "_" ) %in% combinations_1 , ]

fin.corr <- fin.corr[fin.corr$Freq > 0.62, ]

fin.corr <- fin.corr[order(fin.corr$Var1, fin.corr$Var2), ]
fin.corr

到目前为止的输出是：

Var1 Var2      Freq
V1   V2      0.9999978
V3   V4      0.6212136
V3   V5      0.6220380
V4   V5      0.9992690

这里V1和V2组成一个组，而其他V3、V4、V5组成另一个组，每对变量的相关性更高比阈值。我想将这两组变量作为列表获取。例如

list(c("V1", "V2"), c("V3", "V4", "V5"))

Answer 1

使用图论和 igraph 包得到了答案。

var.corelation <- cor(as.matrix(mydata), method="pearson")

library(igraph)
# prevent duplicated pairs
var.corelation <- var.corelation*lower.tri(var.corelation)
check.corelation <- which(var.corelation>0.62, arr.ind=TRUE)

graph.cor <- graph.data.frame(check.corelation, directed = FALSE)
groups.cor <- split(unique(as.vector(check.corelation)),         clusters(graph.cor)$membership)
lapply(groups.cor,FUN=function(list.cor){rownames(var.corelation)[list.cor]})

哪个returns:

$`1`
[1] "V1" "V2"

$`2`
[1] "V3" "V4" "V5"

我还会检查我的评论，这对我来说会带来更好的见解，因为您的相关性可能低于您的（任意）切点，但确实与集群相关。

一组高度相关的变量

Group of Highly correlated variables

grouping

r

correlation