MALLET 从文档分类器中获得最具影响力的功能

Question

我按照这里的 MALLET 示例构建了一个文档分类器 http://mallet.cs.umass.edu/classifier-devel.php

我接下来要做的是为每个类获取最具影响力的功能。我确定这很简单，但我无法从 Java 中找到如何做到这一点。

任何帮助，不胜感激。

Answer 1

我遇到了同样的问题。这是对我有用的方法。（不是完全独立的，例如，假设你已经有一个分类器和一些测试数据）

PrintWriter debugOut = new PrintWriter(new File(<filePath>));
InstanceList testInstances = new InstanceList(classifier.getInstancePipe());
CsvIterator reader = new CsvIterator(new FileReader(<path_to_testdata>), \w+)\s+(\w+)\s+(.*)", 3, 2, 1);  // (data, label, name) field indices         
testInstances.addThruPipe(reader);
PerLabelInfoGain plig = new PerLabelInfoGain (testInstances);
Alphabet alpha = classifier.getAlphabet();
LabelAlphabet la = classifier.getLabelAlphabet();
debugOut.println("debugging label numbers: " + la.size());
for (int q = 0 ; q < la.size(); q++){
    debugOut.println("Class: " + la.lookupLabel(q));
    for (int j = 0; j < 10; j++){
        int alphaId = plig.getInfoGain(q).getIndexAtRank(j);
        Object label = alpha.lookupObject(alphaId);
        debugOut.println(j + "t" + plig.getInfoGain(q).getValueAtRank(i) + "t" + label);
    }
    debugOut.println("===============");
}
debugOut.close();

结果是：

debugging label numbers: 3
Class: sexism
0   0.1257616291393775  sexist
1   0.1257616291393775  rt
2   0.1257616291393775  female
3   0.1257616291393775  notsexist
4   0.1257616291393775  m
5   0.1257616291393775  women
6   0.1257616291393775  mt8_9
7   0.1257616291393775  sports
8   0.1257616291393775  islam
9   0.1257616291393775  men
===============
Class: none
0   0.09383300761779656 sexist
1   0.09383300761779656 mkr
2   0.09383300761779656 female
3   0.09383300761779656 muslims
4   0.09383300761779656 rt
5   0.09383300761779656 notsexist
6   0.09383300761779656 women
7   0.09383300761779656 islam
8   0.09383300761779656 mt8_9
9   0.09383300761779656 mohammed
===============
Class: racism
0   0.062072998255453926    islam
1   0.062072998255453926    muslims
2   0.062072998255453926    mkr
3   0.062072998255453926    mohammed
4   0.062072998255453926    muslim
5   0.062072998255453926    maxblumenthal
6   0.062072998255453926    quran
7   0.062072998255453926    years
8   0.062072998255453926    prophet
9   0.062072998255453926    1400
===============

编辑： plig.getInfoGain（q）.

getValueAtRank（i） 显然应该是 plig.getInfoGain（q）.getValueAtRank（j）