我正在尝试在数据集上制作分类器。我首先使用XGBoost:
import xgboost as xgb
import pandas as pd
import numpy as np
train = pd.read_csv("train_users_processed_onehot.csv")
labels = train["Buy"].map({"Y":1, "N":0})
features = train.drop("Buy", axis=1)
data_dmat = xgb.DMatrix(data=features, label=labels)
params={"max_depth":5, "min_child_weight":2, "eta": 0.1, "subsamples":0.9, "colsample_bytree":0.8, "objective" : "binary:logistic", "eval_metric": "logloss"}
rounds = 180
result = xgb.cv(params=params, dtrain=data_dmat, num_boost_round=rounds, early_stopping_rounds=50, as_pandas=True, seed=23333)
print result
的结果是:
test-logloss-mean test-logloss-std train-logloss-mean
0 0.683539 0.000141 0.683407
179 0.622302 0.001504 0.606452
我们可以看到它约为0.622;
但是,当我使用完全相同的参数(我认为)切换到sklearn
时,结果大不相同。以下是我的代码:
from sklearn.model_selection import cross_val_score
from xgboost.sklearn import XGBClassifier
import pandas as pd
train_dataframe = pd.read_csv("train_users_processed_onehot.csv")
train_labels = train_dataframe["Buy"].map({"Y":1, "N":0})
train_features = train_dataframe.drop("Buy", axis=1)
estimator = XGBClassifier(learning_rate=0.1, n_estimators=190, max_depth=5, min_child_weight=2, objective="binary:logistic", subsample=0.9, colsample_bytree=0.8, seed=23333)
print cross_val_score(estimator, X=train_features, y=train_labels, scoring="neg_log_loss")
,结果是:[-4.11429976 -2.08675843 -3.27346662]
,逆转距离
我将一个突破点扔进了cross_val_score
,并看到分类器通过试图预测测试集中的每个元组为负面的每个元组,以大约0.99的概率来做出疯狂的预测。
我想知道我出了什么问题。有人可以帮我吗?
这个问题有点老了,但是我今天遇到了问题,并弄清楚为什么xgboost.cv
和sklearn.model_selection.cross_val_score
给出的结果完全不同。
默认情况下,cross_val_score使用KFold
或StratifiedKFold
的shuffle参数为false,因此不会从数据中随机提取折叠。
因此,如果您这样做,那么您应该得到相同的结果:
cross_val_score(estimator, X=train_features, y=train_labels, scoring="neg_log_loss",
cv = StratifiedKFold(shuffle=True, random_state=23333))
将random state
保留在StratifiedKfold
中,xgboost.cv
中的CC_11保持相同的结果。