XGBClassifier ValueError: operands could not be broadcast together with shapes (2557,) (8,) (2557,)

Question

我正在做一个文本class化项目。

在探索不同的 class 时，我遇到了 XGBClassifier

我的class化任务是多项class。我在尝试为 classifier 评分时遇到上述错误 - 我猜需要进行一些重塑，但我不明白为什么。对我来说奇怪的是其他 classifiers 工作得很好（即使这个有默认参数）

这是我的代码中的相关部分：

algorithms = [    
    svm.LinearSVC(),  # <<<=== Works    
    linear_model.RidgeClassifier(), # <<<=== Works    
    XGBClassifier(),  # <<<=== Works    
    XGBClassifier(objective='multi:softprob', num_class=len(groups_count_dict), eval_metric='merror')  # <<<=== Not working
]

def train(algorithm, X_train, y_train):
    model = Pipeline([       
        ('vect', transformer),
        ('classifier', OneVsRestClassifier(algorithm))
    ])
    model.fit(X_train, y_train)

    return model

score_dict = {}
algorithm_to_model_dict = {}
for algorithm in algorithms:
    print()
    print(f'trying {algorithm}')
    model = train(algorithm, X_train, y_train)
    score = model.score(X_test, y_test)
    score_dict[algorithm] = int(score * 100)
    algorithm_to_model_dict[algorithm] = model
    
sorted_score_dict = {k: v for k, v in sorted(score_dict.items(), key=lambda item: item[1])}
for classifier, score in sorted_score_dict.items():
    print(f'{classifier.__class__.__name__}: score is {score}%')

又是这个错误：

ValueError: operands could not be broadcast together with shapes (2557,) (8,) (2557,)

不确定它是否相关，但我还是会提到它 - 我的 transformer 是这样创建的：

tuples = []
tfidf_kwargs = {'ngram_range': (1, 2), 'stop_words': 'english', 'sublinear_tf': True}
for col in list(features.columns):
    tuples.append((f'vec_{col}', TfidfVectorizer(**tfidf_kwargs), col))

transformer = ColumnTransformer(tuples, remainder='passthrough')

提前致谢

编辑：

添加完整跟踪：

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-15-576cd62f3df0> in <module>
     84     print(f'trying {algorithm}')
     85     model = train(algorithm, X_train, y_train)
---> 86     score = model.score(X_test, y_test)
     87     score_dict[algorithm] = int(score * 100)
     88     algorithm_to_model_dict[algorithm] = model

/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/sklearn/utils/metaestimators.py in <lambda>(*args, **kwargs)
    118 
    119         # lambda, but not partial, allows help() to work with update_wrapper
--> 120         out = lambda *args, **kwargs: self.fn(obj, *args, **kwargs)
    121         # update the docstring of the returned function
    122         update_wrapper(out, self.fn)

/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/sklearn/pipeline.py in score(self, X, y, sample_weight)
    620         if sample_weight is not None:
    621             score_params['sample_weight'] = sample_weight
--> 622         return self.steps[-1][-1].score(Xt, y, **score_params)
    623 
    624     @property

/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/sklearn/base.py in score(self, X, y, sample_weight)
    498         """
    499         from .metrics import accuracy_score
--> 500         return accuracy_score(y, self.predict(X), sample_weight=sample_weight)
    501 
    502     def _more_tags(self):

/Library/Frameworks/Python.framework/Versions/3.9/lib/python3.9/site-packages/sklearn/multiclass.py in predict(self, X)
    365             for i, e in enumerate(self.estimators_):
    366                 pred = _predict_binary(e, X)
--> 367                 np.maximum(maxima, pred, out=maxima)
    368                 argmaxima[maxima == pred] = i
    369             return self.classes_[argmaxima]

ValueError: operands could not be broadcast together with shapes (2557,) (8,) (2557,)

打印 X_test 和 y_test 的形状得到：(2557, 12) (2557,)

我能够理解 (8,) 的来源 - 它是 groups_count_dict

的长度

Answer 1

原来解决方案是从管道中删除 OneVsRestClassifier 用法

XGBClassifier ValueError: operands could not be broadcast together with shapes (2557,) (8,) (2557,)

XGBClassifier ValueError: operands could not be broadcast together with shapes (2557,) (8,) (2557,)

python

nlp

machine-learning

scikit-learn