我想对德语推文做一个情绪分析。我使用的代码适用于英语，但是当我加载德语单词列表时，所有分数只是结果为零。据我所知，它必须与单词列表的不同结构有关。所以我需要知道的是，如何使我的代码适应德语单词列表的结构。有人可以看看这两个清单吗？
English Wordlist German Wordlist
# load the wordlists
pos.words = scan("~/positive-words.txt",what='character', comment.char=';')
neg.words = scan("~/negative-words.txt",what='character', comment.char=';')
# bring in the sentiment analysis algorithm
# we got a vector of sentences. plyr will handle a list or a vector as an "l"
# we want a simple array of scores back, so we use "l" + "a" + "ply" = laply:
score.sentiment = function(sentences, pos.words, neg.words, .progress='none')
{
require(plyr)
require(stringr)
scores = laply(sentences, function(sentence, pos.words, neg.words)
{
# clean up sentences with R's regex-driven global substitute, gsub():
sentence = gsub('[[:punct:]]', '', sentence)
sentence = gsub('[[:cntrl:]]', '', sentence)
sentence = gsub('\\d+', '', sentence)
# and convert to lower case:
sentence = tolower(sentence)
# split into words. str_split is in the stringr package
word.list = str_split(sentence, '\\s+')
# sometimes a list() is one level of hierarchy too much
words = unlist(word.list)
# compare our words to the dictionaries of positive & negative terms
pos.matches = match(words, pos.words)
neg.matches = match(words, neg.words)
# match() returns the position of the matched term or NA
# we just want a TRUE/FALSE:
pos.matches = !is.na(pos.matches)
neg.matches = !is.na(neg.matches)
# and conveniently enough, TRUE/FALSE will be treated as 1/0 by sum():
score = sum(pos.matches) - sum(neg.matches)
return(score)
},
pos.words, neg.words, .progress=.progress )
scores.df = data.frame(score=scores, text=sentences)
return(scores.df)
}
# and to see if it works, there should be a score...either in German or in English
sample = c("ich liebe dich. du bist wunderbar","I hate you. Die!");sample
test.sample = score.sentiment(sample, pos.words, neg.words);test.sample
这可能对你有用：
readAndflattenSentiWS <- function(filename) {
words = readLines(filename, encoding="UTF-8")
words <- sub("\\|[A-Z]+\t[0-9.-]+\t?", ",", words)
words <- unlist(strsplit(words, ","))
words <- tolower(words)
return(words)
}
pos.words <- c(scan("positive-words.txt",what='character', comment.char=';', quiet=T),
readAndflattenSentiWS("SentiWS_v1.8c_Positive.txt"))
neg.words <- c(scan("negative-words.txt",what='character', comment.char=';', quiet=T),
readAndflattenSentiWS("SentiWS_v1.8c_Negative.txt"))
score.sentiment = function(sentences, pos.words, neg.words, .progress='none') {
# ... see OP ...
}
sample <- c("ich liebe dich. du bist wunderbar",
"Ich hasse dich, geh sterben!",
"i love you. you are wonderful.",
"i hate you, die.")
(test.sample <- score.sentiment(sample,
pos.words,
neg.words))
# score text
# 1 2 ich liebe dich. du bist wunderbar
# 2 -2 ich hasse dich, geh sterben!
# 3 2 i love you. you are wonderful.
# 4 -2 i hate you, die.
在德语列表中，列表的名称为：SentiWS_v1.8c_Negative.txt和SentiWS_v1.8c_Positive.txt在加载方式中没有，这仅适用于英文版本：
pos.words = scan("~/positive-words.txt",what='character', comment.char=';')
neg.words = scan("~/negative-words.txt",what='character', comment.char=';')
除此之外，列表的格式不同： 德语版本是这样的：
Abbau|NN -0.058 Abbaus,Abbaues,Abbauen,Abbaue
Abbruch|NN -0.0048 Abbruches,Abbrüche,Abbruchs,Abbrüchen
Abdankung|NN -0.0048 Abdankungen
Abdämpfung|NN -0.0048 Abdämpfungen
Abfall|NN -0.0048 Abfalles,Abfälle,Abfalls,Abfällen
Abfuhr|NN -0.3367 Abfuhren
英文版：
魅力 慈善 魅力 迷人 迷人 贞 便宜 最便宜
德国人遵循这种模式：word|NN\tnumber <similar words comma separated>\n
英国人遵循这种模式word\n
并且每个文档的标题都不同，因此您可能希望跳过标题（在英文列表中似乎是文章，而不是推文或推文的文字）
解决方案，使两个文件的格式相同，然后执行任何操作或准备代码以从两种类型的数据中读取。
现在您的程序适用于英文版本，因此我建议您更改德语列表的格式。您可以更改\n的每个空格或逗号，然后消除所有| NN和数字。