CI/CD in Azure Databricks using Azure DevOps
Databricks and Azure DevOps- Master CI/CD deployment across two environments with ease in this straightforward course.
Description
In this Course, Firstly, I have discussed about what is CI/CD, how we will be using it for deploying Azure Databricks notebook from dev to prod and the merging techniques that we are going to follow for building the CI/CD pipelines.
Then, I have discussed about the different environment setup required for building the CI/CD pipelines. Things like Integrating the Azure DevOps with Azure Databricks workspace, Branch protection and merging techniques are seen in this video with Demo. I have also discussed about the process of the Continuous Integration (CI) pipeline and created the setup required for creating the CI pipelines. Then, I have discussed about the process of the Continuous Integration (CI) pipeline and explained the different YAML code used for creating the pipeline and followed by the actual creation of the CI/CD pipeline using the YAMl file.
After creating the CI part, I have discussed about the Continuous Deployment part where it deploys changes from DEV to PROD databricks workspace.
Finally, I have discussed about how to setup permissions for the PROD environment before deploying the changes in PROD and also the complete end to end CI/CD pipeline testing. I Hope you learn more in this course.
#cicd #azuredevops #devops #databricks #azuredatabricks
What You Will Learn!
- Build CI/CD Pipelines using Azure DevOps
- Azure Databricks CI/CD Process
- Understanding YAML code
- Data Integration
- Get Familiar with Azure Concepts
- Infrastructure and Security
Who Should Attend!
- This course is for absolute beginners who is looking to become an Azure Data Engineer and DevOps Engineer.