在 R 中需要一种有效的方法将彩色 utf-8 表情符号字符转换为其默认皮肤

Question

有没有什么有效的方法可以去除矢量图中的彩色表情符号并使其成为标准形式？例如，请查看两个输出，我可能没有使用适当的术语。目前我是这样做的：

library(rjson)
library(stringi)
library(stringr)

# this function gets name from emojis one at a time
emoji_json_file <- "https://raw.githubusercontent.com/ToadHanks/emojisLib_json/master/emojis.json"
json_data <- rjson::fromJSON(paste(readLines(emoji_json_file), collapse = "")) #read line by line make 

# gets the name i.e. get_name_from_emoji("") output should be "yum"

get_name_from_emoji <- function(emoji_unicode, emoji_data = json_data) {

  emoji_evaluated <- stringi::stri_unescape_unicode(emoji_unicode) 

  vector_of_emoji_names_and_characters <- unlist(
    lapply(json_data, function(x){
      x$char
    })
  )

  name_of_emoji <- attr(
    which(vector_of_emoji_names_and_characters == emoji_evaluated)[1],
    "names"
  )

  return(name_of_emoji)
}

# Fill an empty vector with names
emoji_pouch_copy <- c("","","","","","") #we can't render U+1F3FB (light-skin graft), U+1F3FF (dark-skin graft) here that's why "?"
emoji_keywords_pouch <- c() 
for(i in 1: length(emoji_pouch_copy)){
  emoji_keywords_pouch <- c(emoji_keywords_pouch, get_name_from_emoji(emoji_pouch_copy[i]))
}

emoji_keywords_pouch #output: "shushing","point_down_fairly_dark","point_right_dark","fu_light","dark_skin_tone","light_skin_tone" 

#Function to remove the skin tones
remove_all_skins <- function(string, pattern) {
  str_replace_all(string, pattern, "000")
}

#remove these and their nativ renders at a positions
skin_tones <- c("medium_skin_tone", "fairly_dark_skin_tone", "dark_skin_tone", "fairly_light_skin_tone", "light_skin_tone", "_light","_dark","_medium","_fairly") 

emoji_keywords_pouch <- remove_all_skins(emoji_keywords_pouch, skin_tones[1])
emoji_keywords_pouch <- remove_all_skins(emoji_keywords_pouch, skin_tones[2])
emoji_keywords_pouch <- remove_all_skins(emoji_keywords_pouch, skin_tones[3])
emoji_keywords_pouch <- remove_all_skins(emoji_keywords_pouch, skin_tones[4])
emoji_keywords_pouch <- remove_all_skins(emoji_keywords_pouch, skin_tones[5])

emoji_keywords_pouch <- emoji_keywords_pouch[emoji_keywords_pouch != "000"] #free the memory

#It has to be this order, otherwise good strings will go bad in the variable containing keywords
emoji_keywords_pouch <- stringr::str_remove_all(emoji_keywords_pouch, skin_tones[6])
emoji_keywords_pouch <- stringr::str_remove_all(emoji_keywords_pouch, skin_tones[7])
emoji_keywords_pouch <- stringr::str_remove_all(emoji_keywords_pouch, skin_tones[8])
emoji_keywords_pouch <- stringr::str_remove_all(emoji_keywords_pouch, skin_tones[9])

#Reverse the function get_name... to get_emoji and rebuild the emoji_pouch
#i.e. get_emoji_from_name("yum") output should be ""

get_emoji_from_name <- function(emoji_name, emoji_data = json_data) {

  vector_of_emoji_names_and_characters <- unlist(
    lapply(json_data, function(x){
      x$char
    })
  )

  emoji_character <- unname(
    vector_of_emoji_names_and_characters[
      names(vector_of_emoji_names_and_characters) == emoji_name
      ]
  )

  return(emoji_character)
}

#reset the original emoji_...copy to include standard tones
emoji_pouch_copy <- c()

for(i in 1: length(emoji_keywords_pouch)){
  # Sys.sleep(1)
  emoji_pouch_copy <- c(emoji_pouch_copy, get_emoji_from_name(emoji_keywords_pouch[i]))
}

#All of the skin tones are removed, because there are no standad skin tones
emoji_pouch_copy #output: """" "" ""

#Finished

简而言之，我将从表情符号到他们的名字。然后通过去除皮肤状况来清理他们的名字，然后恢复到他们的表情符号形式。我有将近 1000 个表情符号，for 循环导致大约 5 秒的延迟。有没有比我能更好地完成这项工作的软件包？

Answer 1

我不确定我是否理解了你的问题。但是你可以像这样去掉不同的颜色：

从数据开始

library(rjson)

# this function gets name from emojis one at a time
emoji_json_file <- "https://raw.githubusercontent.com/ToadHanks/emojisLib_json/master/emojis.json"
json_data <- rjson::fromJSON(paste(readLines(emoji_json_file), collapse = "")) #read line by line make

只提取表情符号：

emojis <- sapply(json_data, function(x) x$char)

现在着色的方式是将两个 Unicode 字符粘在一起。例如：

emojis[114]
#> raised_hands_light 
#> "<U+0001F64C><U+0001F3FB>"

我们可以将它们拆分为 strsplit(emojis, "")。如果没有着色，这将导致一个向量长度为 1 的列表，如果表情符号被着色或以其他方式更改（例如 male/female），则向量长度为 2。我们只保留列表中每个向量的第一个元素：

emojis_clean <- sapply(strsplit(emojis, ""), "[[", 1)

现在表情符号 114 看起来像这样：

emojis_clean[114]
#> raised_hands_light 
#>     "<U+0001F64C>"

额外：标志问题

上述方法很快但很笨。它无法识别组合的表情符号何时正确组合。例如，标志由两个放在一起的 Unicode 字符组成。可能还有其他例子。我们可以通过在 emoji 向量的 names 中寻找一些关键字来用原始向量替换它们：

# Look for flags
flags <- grep("flag", names(emojis))

# replace flags with original values
emojis_clean[flags] <- emojis[flags]

此方法可用于其他类型的表情符号。

在 R 中需要一种有效的方法将彩色 utf-8 表情符号字符转换为其默认皮肤

Need an efficient way in R to convert coloured utf-8 emoji characters to their default skin

unicode

r

utf-8

emoji

data-cleaning

额外：标志问题