/xgboost

Large-scale and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, on single node, hadoop yarn and more.

Primary LanguageC++OtherNOASSERTION

eXtreme Gradient Boosting

Build Status Documentation Status GitHub license CRAN Status Badge PyPI version Gitter chat for developers at https://gitter.im/dmlc/xgboost

An optimized general purpose gradient boosting library. The library is parallelized, and also provides an optimized distributed version.

It implements machine learning algorithms under the Gradient Boosting framework, including Generalized Linear Model (GLM) and Gradient Boosted Decision Trees (GBDT). XGBoost can also be distributed and scale to Terascale data

XGBoost is part of Distributed Machine Learning Common <img src=https://avatars2.githubusercontent.com/u/11508361?v=3&s=20> projects

Contents

What's New

Version

  • Current version xgboost-0.4
    • Change log
    • This version is compatible with 0.3x versions

Features

  • Easily accessible through CLI, python, R, Julia
  • Its fast! Benchmark numbers comparing xgboost, H20, Spark, R - benchm-ml numbers
  • Memory efficient - Handles sparse matrices, supports external memory
  • Accurate prediction, and used extensively by data scientists and kagglers - highlight links
  • Distributed version runs on Hadoop (YARN), MPI, SGE etc., scales to billions of examples.

Bug Reporting

Contributing to XGBoost

XGBoost has been developed and used by a group of active community members. Everyone is more than welcome to contribute. It is a way to make the project better and more accessible to more users.

License

© Contributors, 2015. Licensed under an Apache-2 license.

XGBoost in Graphlab Create

  • XGBoost is adopted as part of boosted tree toolkit in Graphlab Create (GLC). Graphlab Create is a powerful python toolkit that allows you to do data manipulation, graph processing, hyper-parameter search, and visualization of TeraBytes scale data in one framework. Try the Graphlab Create
  • Nice blogpost by Jay Gu about using GLC boosted tree to solve kaggle bike sharing challenge: