在pandas数据框中搜索关键字组合进行分类

Question

这是在pandas数据框中搜索某些关键字进行分类的后续问题。

我有一个关键词列表，我想根据这些关键词对职位描述进行分类。以下是输入文件、示例关键字和代码

job_description
Managing engineer is responsible for
This job entails assisting to
Engineer is required the execute
Pilot should be able to control
Customer specialist advices
Different cases brought by human resources department

cat_dict = {
"manager": ["manager", "president", "management", "managing"],
"assistant": ["assistant", "assisting", "customer specialist"],
"engineer": ["engineer", "engineering", "scientist", "architect"],
"HR": ["human resources"]
}
def classify(desc):
for cat, lst in cat_dict.items():
if any(x in desc.lower() for x in lst):
return cat
df['classification'] = df["job_description"].apply(classify)

如果有一个单词，例如" manager "或";assistant"但当出现"客户专员"等两个词时，就无法识别了。或者"人力资源">

Answer 1

我想你的cat_dict字典里少了一个逗号。我试了你的例子:

import pandas as pd
cat_dict = {
"manager": ["manager", "president", "management", "managing"],
"assistant": ["assistant", "assisting", "customer specialist"],
"engineer": ["engineer", "engineering", "scientist", "architect"],
"HR": ["human resources"]
}
def classify(desc):
for cat, lst in cat_dict.items():
if any(x in desc.lower() for x in lst):
return cat
text_df = pd.Series(text.split('n')[1:])
text_df.apply(classify)

结果:

0      manager
1    assistant
2     engineer
3         None
4    assistant
5           HR
dtype: object

成功分类为"客户专员"助理;HR代表"人力资源"。