/security-workshops

Workshops on how to setup security on Hadoop using HDP sandboxes

Primary LanguageShell

Securing the Hadoop Data Lake workshop

These workshops is part of a 'Securing the Data Lake' webinar.

Also see webinar on Ambari 2.0 for demo on using custom services for KDC, OpenLDAP, NSLCD

Goals

To demonstrate:

  • Authentication: Configure kerberos with LDAP on HDP sandbox
  • Authorization & Audit: To allow users to specify access policies and enable audit around Hadoop from a central location via a UI, integrated with LDAP
  • Enable Perimeter Security: Enable Knox to work with kerberos enabled cluster to enable perimeter security using single end point

Why integrate security with LDAP?

  • To show how Hadoop plugs in to the enterprise's existing Identity Management system

Workshop Materials

Beta release:
  1. Enable security on HDP 2.3.3/Ambari 2.1.3 multi-node setup using ActiveDirectory as LDAP
  • Instructions to setup AD here
  • Instructions to enable security here
Current release:

HDP 2.3

  1. Enable security on HDP 2.3/Ambari 2.1 single node setup using FreeIPA as LDAP
  1. Enable security on HDP 2.3/Ambari 2.1 single node setup using ActiveDirectory as LDAP
  • Instructions available here
Previous releases:

HDP 2.2.4.2

  1. Enable security on HDP 2.2.4.2/Ambari 2.0 single node setup using OpenLDAP as LDAP
  • Instructions available here

Note that FreeIPA will not work with Ambari 2.0 because the manual kerberos wizard option was removed. This will be added back in future release (by end of summer)

HDP 2.2.0

  1. Enable security on HDP 2.2.0 single node setup using FreeIPA as LDAP
  • Instructions available here
  • Prebuilt secured sandbox VM available here
  1. Enable security on HDP 2.2.0 single node setup using OpenLDAP as LDAP
  • Instructions available here - WIP

HDP 2.1

  1. Enable security on HDP 2.1 sandbox using FreeIPA as LDAP