xgboost 中的错误

数据挖掘 r xgboost 多类分类
2022-02-22 18:10:24

这是我的脚本:

    library(xgboost)
library(tidyverse)
library(caret)
library(readxl)

library(data.table)
library(mlr)

data <- iris
righe_train <- sample(nrow(data),nrow(data)*0.8)
train <- data[righe_train,]
test <- data[-righe_train,]

setDT(train) 
setDT(test)

labels <- train$Species
ts_label <- test$Species
new_tr <- model.matrix(~.+0,data = train[,-c("Species"),with=F]) 
new_ts <- model.matrix(~.+0,data = test[,-c("Species"),with=F])

#convert factor to numeric 
labels <- as.numeric(labels)-1
ts_label <- as.numeric(ts_label)-1


#preparing matrix 
dtrain <- xgb.DMatrix(data = new_tr,label = labels) 
dtest <- xgb.DMatrix(data = new_ts,label=ts_label)

#default parameters
params <- list(booster = "gbtree",
                 objective = "binary:logistic",
                 eta=0.3,
                 gamma=0,
                 max_depth=6,
                 min_child_weight=1,
                 subsample=1,
                 colsample_bytree=1)

xgbcv <- xgb.cv( params = params,
                 data = dtrain,
                 nrounds = 100,
                 nfold = 5,
                 showsd = T,
                 stratified = T,
                 print_every_n = 10,
                 early_stopping_round = 20,
                 maximize = F)
##best iteration = 79

min(xgbcv$test.error.mean)


#first default - model training
xgb1 <- xgb.train (params = params, data = dtrain, nrounds = 79, watchlist = list(val=dtest,train=dtrain), print.every.n = 10, early.stop.round = 10, maximize = F , eval_metric = "error")
#model prediction
xgbpred <- predict (xgb1,dtest)
xgbpred <- ifelse (xgbpred > 0.5,1,0)

#confusion matrix
library(caret)
confusionMatrix (xgbpred, ts_label)
#Accuracy - 86.54%` 

#view variable importance plot
mat <- xgb.importance (feature_names = colnames(new_tr),model = xgb1)
xgb.plot.importance (importance_matrix = mat[1:20])

但是当我运行指令时,xgbcv我有这个错误:

xgb.iter.update(fd dtrain,迭代 - 1,obj)中的错误: [15:21:18] amalgamation/../src/objective/regression_obj.cu:103:标签必须在 [0, 1] 用于逻辑回归bst,fd

为什么?我该如何解决?

1个回答

Iris 数据具有三个目标值(“物种”)。中的目标函数params设置为objective = "binary:logistic",它只接受两个类(二进制标记)。

如果您有两个以上的类,则需要一个多类目标函数,例如multi:softmaxmulti:softprob

文档中所述:

“binary:logistic” ——二元分类的逻辑回归,输出概率

[...]

“multi:softmax” – 设置 XGBoost 使用 softmax 目标进行多类分类,您还需要设置 num_class(类数)

“multi:softprob” ——和softmax一样,但是输出一个ndata * nclass的向量,可以进一步reshape成ndata,nclass矩阵。结果包含属于每个类的每个数据点的预测概率。

请注意可用于xgboost.