将 NLP WordNetLemmatizer 应用于整个句子显示错误且位置未知

Question

我想在整个句子上应用 NLP WordNetLemmatizer。问题是我得到一个错误：

KeyError: 'NNP'

好像我得到了未知的 'pos' 值，但我不知道为什么。我想获得单词的基本形式，但没有 'pos' 它不起作用。你能告诉我我做错了什么吗？

import nltk

from nltk.tokenize import PunktSentenceTokenizer
from nltk.tokenize import word_tokenize
from nltk.tokenize import RegexpTokenizer
from nltk.stem import WordNetLemmatizer 

nltk.download('averaged_perceptron_tagger')

sentence = "I want to find the best way to lemmantize this sentence so that I can see better results of it"

taged_words = nltk.pos_tag(sentence)
print(taged_words)


lemmantised_sentence = []

lemmatizer = WordNetLemmatizer()
for word in taged_words:

     filtered_text_lemmantised =  lemmatizer.lemmatize(word[0], pos=word[1])
     print(filtered_text_lemmantised)

     lemmantised_sentence.append(filtered_text_lemmantised)

lemmantised_sentence = ' '.join(lemmantised_sentence)
print(lemmantised_sentence)

Answer 1

在将句子发送到 pos_tag 函数之前，应将其拆分。此外，pos 参数在它接受的字符串类型方面也有所不同。它只接受 'N'、'V' 等。我已经从 .

更新了你的代码

import nltk

from nltk.tokenize import PunktSentenceTokenizer
from nltk.tokenize import word_tokenize
from nltk.tokenize import RegexpTokenizer
from nltk.stem import WordNetLemmatizer
from nltk.corpus import wordnet

def main():
    nltk.download('averaged_perceptron_tagger')
    nltk.download('wordnet')

    sentence = "I want to find the best way to lemmantize this sentence so that I can see better results of it"

    taged_words = nltk.pos_tag(sentence.split())
    print(taged_words)

    lemmantised_sentence = []


    lemmatizer = WordNetLemmatizer()
    for word in taged_words:
        if word[1]=='':
            continue
        filtered_text_lemmantised = lemmatizer.lemmatize(word[0], pos=get_wordnet_pos(word[1]))
        print(filtered_text_lemmantised)

        lemmantised_sentence.append(filtered_text_lemmantised)

    lemmantised_sentence = ' '.join(lemmantised_sentence)
    print(lemmantised_sentence)

def get_wordnet_pos(treebank_tag):

    if treebank_tag.startswith('J'):
        return wordnet.ADJ
    elif treebank_tag.startswith('V'):
        return wordnet.VERB
    elif treebank_tag.startswith('N'):
        return wordnet.NOUN
    else:
        return wordnet.ADV


if __name__ == '__main__':
    main()

将 NLP WordNetLemmatizer 应用于整个句子显示错误且位置未知

Apply NLP WordNetLemmatizer on whole sentence show error with unknown pos

python

nlp

nltk