xgboost not running in parallel

Created on 12 Apr 2016  路  7Comments  路  Source: dmlc/xgboost

I recently reinstalled my operational system (ubuntu 14.04 LTS) and, strangely, xgboost is not able to run in parallel anymore. Even though I set the nthreads parameter to the number of cores I have, the parallel processing is not working at all.

I have tested both R and python packages without success. Is there some dependency that I must install to be able to run the algorithm in parallel?

Most helpful comment

Did you rebuild xgboost? I noticed when using build.sh script it switches to building single-threaded xgboost if it runs into any problems at all. I now avoid that script and do make instead. That way I can see and fix the problems.

All 7 comments

Did you rebuild xgboost? I noticed when using build.sh script it switches to building single-threaded xgboost if it runs into any problems at all. I now avoid that script and do make instead. That way I can see and fix the problems.

Hi @edi-bice I'm having problem to execute xgboost on multiple workstations, does this parallel means multiple threads or multiple workstations?

@dirceusemighini in this thread parallel means multiple threads on the same workstation, i.e. does xgboost make full use of multicore workstations.

Thanks @edi-bice I can run xgboost in paralllel if I follow the instructions of https://github.com/dmlc/xgboost/issues/1106#issuecomment-245727917 although I can't make it to run with more than 1 nWorkers, as described here

I am also facing the same issue. It is taking lots of time please suggest some solution.

I have compiled XGBoost with multi-threading enabled. But it still doesn't run in multiple threads (I set nthreads=-1 on an 8 core machine, no luck)

@why-not You should set nthread=0 to use all available cores.

Was this page helpful?
0 / 5 - 0 ratings

Related issues

trivialfis picture trivialfis  路  3Comments

nicoJiang picture nicoJiang  路  4Comments

lizsz picture lizsz  路  3Comments

tqchen picture tqchen  路  4Comments

choushishi picture choushishi  路  3Comments