将排名最高的单词与数据帧列R中的文本进行匹配



我有两个数据帧,df1:

df1 <- c("A large bunch of purple grapes", "large green potato sack", "small red tomatoes", "yellow and black bananas")
df1 <- data.frame(df1)

df2:

Word <- c("green", "purple", "grapes", "small", "sack", "yellow", "bananas", "large)
Rank <- c(20,18,22,16,15,17,6,12)
df2 <- data.frame(Word,Rank)

df1:

ID      Sentence  
1      A large bunch of purple grapes  
2      large green potato sack 
3      small red tomatoes  
4      yellow and black bananas   

df2:

ID      Word      Rank
1      green      20
2      purple     18
3      grapes     22
4      small      16
5      Sack       15
6      yellow     17
7      bananas    6
8      large      12

我想做的是;将df2中的单词与"句子"列中包含的单词进行匹配,并在df1中插入一个新列,其中包含df2中排名最高的匹配单词。这样的东西:

df1:

ID     Sentence                         Word
1     A large bunch of purple grapes   grapes
2     large green potato sack          green
3     small red tomatoes               small
4     yellow and black bananas         yellow

我最初习惯于使用以下代码来匹配单词,但这当然会创建一个包含所有匹配单词的列:

x <- sapply(df2$Word, function(x) grepl(tolower(x), tolower(df1$Sentence)))
df1$top_match <- apply(x, 1, function(i) paste0(names(i)[i], collapse = " "))

这里有一个tidyverse+stringr解决方案:

library(tidyverse)
library(stringr)
df1$Sentence %>%
str_split_fixed(" ", Inf) %>%
as.data.frame(stringsAsFactors = FALSE) %>%
cbind(ID = rownames(df1), .) %>%
gather(word_count, Word, -ID) %>%
inner_join(df2, by = "Word") %>%
group_by(ID) %>%
filter(Rank == max(Rank)) %>%
select(ID, Word) %>%
right_join(rownames_to_column(df1, "ID"), by = "ID") %>%
select(ID, Sentence, Word)

结果:

# A tibble: 4 x 3
# Groups:   ID [4]
ID                       Sentence   Word
<chr>                          <chr>  <chr>
1     1 A large bunch of purple grapes grapes
2     2        large green potato sack  green
3     3             small red tomatoes  small
4     4       yellow and black bananas yellow

注意:

您可以忽略将ID从因子强制转换为字符的警告。我还修改了您的数据集,使其包含df1的正确列名,并抑制自动将字符强制为因子。

数据:

df1 <- c("A large bunch of purple grapes", "large green potato sack", "small red tomatoes", "yellow and black bananas")
df1 <- data.frame(Sentence = df1, stringsAsFactors = FALSE)
Word <- c("green", "purple", "grapes", "small", "sack", "yellow", "bananas", "large")
Rank <- c(20,18,22,16,15,17,6,12)
df2 <- data.frame(Word,Rank, stringsAsFactors = FALSE)

我写了一个小片段(但有不同的变量名)

> inp1 
ID                           Word new_word
1  1        large green potato sack    green
2  2 A large bunch of purple grapes   grapes
3  3       yellow and black bananas   yellow
> 
> inp2
ID    Word Rank
1  1   green   20
2  2  purple   18
3  3  grapes   22
4  4   small   16
5  5    Sack   15
6  6  yellow   17
7  7 bananas    6
8  8   large   12
> 
> inp1$new_word <- lapply(inp1$Word, function(text){ inp2$Word[inp2$Rank == max(inp2$Rank[inp2$Word %in% unique(as.vector(str_match(text,inp2$Word)))])]})
> 
> inp1
ID                           Word new_word
1  1        large green potato sack    green
2  2 A large bunch of purple grapes   grapes
3  3       yellow and black bananas   yellow
> 

最新更新