Apache Airflow on Linux - VM: Oracle Cloud Infrastructure

Apche Airflow on Linux (VM) using Oracle Cloud Infrastructure includes task trigger on Autonomous Oracle DB task extract

Ratings: 2.95 / 5.00




Description

This course covers three different niche topics on which one can build their technical expertise:

             1. Apache Airflow - Installation and DAG basics & scheduling DAG programs

            2. Linux -VM on Oracle cloud Infrastructure (Provisioning of Oracle Linux - cloud & install Apache airflow & operating it)

            3. Oracle Autonomous Database on Cloud ( Provisioning the DB and understand Data extract through Apache airflow task scheduling).

Note : Since Oracle is offering always free tier option - you can provision Linux VM and Oracle Autonomous DB even after expiry of 30 days free trial and make your learning more effective at any point of time.

Apache Airflow is an open-source  platform to programmatically author, schedule and monitor workflows.

Apache Airflow  is a fully managed workflow orchestration service that empowers you to author, schedule, and monitor pipelines that span across clouds and on-premises data centers.  Apache Airflow open source project and operated using the Python programming language.

Apache Airflow pipelines are configured as directed acyclic graphs (DAGs) using Python, making it easy for users of any experience level to author and schedule a workflow.

With Cloud Computing gaining significance – Virtualization (Virual Machine)  are gaining momentum and re-defining & optimizing Hardware and Software solutions. In this course you would learn about building a cloud virtual environement through Oracle Linux using Oracle cloud - free tier. This course will present you with sequence of steps towards installation of Apache Airflow on Oracle Cloud Infrastructure and then view them through VNC viewer.

Finally, as we would be using Oracle Cloud Infrastructure, one can create Oracle Autonomous Database quite easily and work towards creating a DAG file, which will be scheduled from Apache airflow towards data extract from Oracle Database, through Linux shell scripting task. This is one of the most common use case for Apache Airflow.

Happy Learning!!


What You Will Learn!

  • Provisioning Oracle Linux Virtual Machine - environment though Oracle Cloud infrastructure
  • Apache Airflow Installation on Oracle Linux and operating the task scheduling through DAG
  • Provisioning Autonomous Oracle Database on OCI
  • Accessing Autonomous Oracle Database though Client (sqlplus) on Linux
  • DAG - Directed Acyclic Graph programs
  • DAG program for Data extract from Autonomous Database with Linux / Unix Shell scripting.
  • Enabling and Provisioning GUI environment in Oracle Linux - Oracle Cloud Infrastructure.

Who Should Attend!

  • IT consultants
  • ETL developers
  • Data Engineers