我怎样才能使 Multi-Class Classification 的运行时间更快？

Question

我正在尝试训练运行 Multi-Class 随机森林和逻辑回归分类器。截至目前，在我拥有 8GB RAM 和 i5 内核的机器上，尽管数据大小几乎没有 34K 条记录，但运行需要相当长的时间。有什么方法可以通过调整一些参数来加快当前现有的运行时间吗？

我只是在下面给出逻辑回归随机搜索的一个例子。

X.shape
Out[9]: (34857, 18)

Y.shape
Out[10]: (34857,)

Y.unique()
Out[11]: array([7, 3, 8, 6, 1, 5, 9, 2, 4], dtype=int64)

params_logreg={'C':[0,0.1,0.2,0.3,0.4,0.5,0.6,0.7,0.8,0.9,1.0],
            'solver':['newton-cg', 'lbfgs', 'liblinear', 'sag', 'saga'],
            'penalty':['l2'],
            'max_iter':[100,200,300,400,500],
            'multi_class':['multinomial']}
folds = 2
n_iter = 2
scoring= 'accuracy'
n_jobs= 1

model_logregression=LogisticRegression()
model_logregression = RandomizedSearchCV(model_logregression,X,Y,params_logreg,folds,n_iter,scoring,n_jobs)

[CV] solver=newton-cg, penalty=l2, multi_class=multinomial, max_iter=100, C=0.9 
[Parallel(n_jobs=1)]: Using backend SequentialBackend with 1 concurrent workers.
[CV]  solver=newton-cg, penalty=l2, multi_class=multinomial, max_iter=100, C=0.9, score=0.5663798049340218, total= 2.7min
[CV] solver=newton-cg, penalty=l2, multi_class=multinomial, max_iter=100, C=0.9 
[Parallel(n_jobs=1)]: Done   1 out of   1 | elapsed:  2.7min remaining:    0.0s

[CV]  solver=newton-cg, penalty=l2, multi_class=multinomial, max_iter=100, C=0.9, score=0.5663625408848338, total= 4.2min
[CV] solver=sag, penalty=l2, multi_class=multinomial, max_iter=400, C=0.8 
[Parallel(n_jobs=1)]: Done   2 out of   2 | elapsed:  7.0min remaining:    0.0s

[CV]  solver=sag, penalty=l2, multi_class=multinomial, max_iter=400, C=0.8, score=0.5663798049340218, total=  33.9s
[CV] solver=sag, penalty=l2, multi_class=multinomial, max_iter=400, C=0.8 
[CV]  solver=sag, penalty=l2, multi_class=multinomial, max_iter=400, C=0.8, score=0.5664773053308085, total=  26.6s
[Parallel(n_jobs=1)]: Done   4 out of   4 | elapsed:  8.0min finished```


It's taking about 8 mins to run for Logistic Regression. In contrast RandomForestClassifier takes only about 52 seconds.

Is there any way in which I can make this run faster by tweaking the parameters?

Answer 1

尝试对逻辑回归模型的数据进行标准化。归一化数据将有助于模型快速收敛。 Scikit-learn 有几种方法，因此请查看其预处理部分以获取更多信息。

您还使用 RandomizedSearchCV 进行回归，这需要时间，因为要创建、计算和比较多个模型以获得最佳参数。

我怎样才能使 Multi-Class Classification 的运行时间更快？

How can i make the run time of Multi-Class Classification faster?

random-forest

scikit-learn

logistic-regression

multilabel-classification

xgboost

我怎样才能使 Multi-Class Classification 的 运行 时间更快？

How can i make the run time of Multi-Class Classification faster?

random-forest

scikit-learn

logistic-regression

multilabel-classification

xgboost

我怎样才能使 Multi-Class Classification 的运行时间更快？