naiborhujosua/Data-Scientist-learning-path-using-databricks

This is the summary of learning Data Science using Databricks

Being a self-taught data scientist is quite challenging. There are many factors that i have to face in order to fill the gap in this field. That's why i would like to take notes for every online courses that i will take in Databricks Academy. I hope i can reinforce my learning rate into the right skills that could be implemented in my new career as a Data Scientist. This certification workshop is taken from one of the workshop from Databricks called Data Scientist learning path. The exercises and activities will be excuted in Jupyter Notebooks through Databricks platform. The courses are really comprehensive through theory and practical implementation. The contents of the courses including the theory and implementation of data lake, delta lake, and the Model Management of Machine learning in MLflow.

Lists of the contents in Notebooks

• DataFrames and Transformations Review
• Streaming Query
• Delta Lake
• Delta Lake Rapid Start with Python
• Delta Lake Rapid Start with SQL
• ML Flow with ML Model Implementation
• Hyperopt with ML Model Implementation
• Preparing a Machine Learning Model

Data Science on Databricks: The Bias-Variance Tradeoff

• Create Aggregate Sample
• Explore Aggregate Sample

References

• Spark In Action
• Spark ML Programming Guide
• Data Science with Apache Spark