The following implementation is a part of competition: https://www.kaggle.com/c/titanic

Features considered:

  1. gender
  2. age
  3. fare
  4. siblings + parents travelling
  5. Embarked feature
  6. Name abbreviation feature (Mr. Mrs etc)
  7. Surname + siblings + parents travelling count

I achieved a score of 0.77512 in the following competition using GradientBoostingClassifier.