使用 gensim 的短语获取三元组时出错

Question

我想提取给定句子的所有bigram和trigrams。

from gensim.models import Phrases
documents = ["the mayor of new york was there", "Human Computer Interaction is a great and new subject", "machine learning can be useful sometimes","new york mayor was present", "I love machine learning because it is a new subject area", "human computer interaction helps people to get user friendly applications"]
sentence_stream = [doc.split(" ") for doc in documents]
bigram = Phrases(sentence_stream, min_count=1, threshold=2, delimiter=b' ')
trigram = Phrases(bigram(sentence_stream, min_count=1, threshold=2, delimiter=b' '))
for sent in sentence_stream:
    #print(sent)
    bigrams_ = bigram[sent]
    trigrams_ = trigram[bigrams_]
    print(bigrams_)
    print(trigrams_)

该代码适用于Bigrams，并捕获"纽约"one_answers"机器学习"广告Bigrams。

但是，当我尝试插入Trigrams时，我会遇到以下错误。

TypeError: 'Phrases' object is not callable

请让我知道，如何更正我的代码。

我正在遵循Gensim的示例文档。

Answer 1

根据文档，您可以做：

from gensim.models import Phrases
from gensim.models.phrases import Phraser 
phrases = Phrases(sentence_stream)
bigram = Phraser(phrases)
trigram = Phrases(bigram[sentence_stream])

bigram是一个 Phrases对象，无法再次调用。