Git and Github Quickstart section introduction

Git and Github - What are they

Git Installation - Windows

Git Installation - MacOS

Git Installation - Linux

Github - Account creation

Adding an SSH key pair to GitHub account - Linux

Adding an SSH key pair to GitHub account - Windows

Adding an SSH key pair to GitHub Account - MacOS

Reverting Your Changes Back

Git and GitHub - Basic workflow

Commit History

Aliases

Git Diff

Reverting Back to a Previous Commit

Branching and Merging

Pull Request and Code Review

Rebase

Stashing

Tagging

Cherry Pick

Git and GitHub - Final Words

Tips To Improve Your Course Taking Experience

Why This Course

Why Too Many Companies Fail

Docker Quickstart section introduction

What Is Docker and Why Do We Use It

Installation - Linux

Installation - Windows

Installation - MacOS

Docker Containers

Why Docker Is So Good

Docker Containers - Hands On

Docker Images

Dockerfile

Persistent Data In Docker

More about Dockerfile

Persistent Data In Docker - Volumes - Hands On

Persistent Data in Docker - Bind Mounting - Hands On

Docker Compose

Dockerfile Best Practices

DVC - Section Introduciton

Accessing Your Data

Pipelines - Part 1

Data Versioning

Metrics And Experiments

Pipelines - Part 3

Hydra - Section Introduction

How to Use Hydra From Command-Line

Specifying A Config File

Grouping Config Files

More About OmegaConf

Selecting Default Configs

Logging

Output And Working Directory

Multirun

Debugging

Instantiate

Packages

Small Project - Assignment

A Small Project To See The Big Picture

Structured Configs

Tab Completion

Structured Configs Basic Usage

Hierarchical Static Configuration

Small Project - Assignment Solution

Config Groups in Structured Configs

Defaults List in Structured Configs

Extending The Small Project With Structured Configs - Course Assignment

Validating Config Parameters Using Pydantic

Structured Config Schema

Extending The Small Project With Structured Configs - Assignment Solution

Extending The Small Project With Structured Configs

Google Cloud Platform - Section Introduction

How to Create An Account

How to Create a Project

gsutils and gcloud commands

Google Cloud Storage (GCS) - Bucket Usage

Google Cloud Storage (GCS) - Bucket Creation

Google Compute Engine (GCE) - Quotas

Firewall Rules

Artifact Registry

Google Compute Engine (GCE)

Instance Groups

MLFlow - Section introduction

MLFlow Tracking

Storage Types

MLFlow Tracking - Hands-on

Projects - Hands-on

Projects

Models

Model Registry

Model Registry - Hands-on

Artifact Store Creation on GCP

General Overview of the Production MLFlow Architecture

Models - Hands-on

Local MLFlow Setup

Backend Store Creation on GCP

Testing the Deployed Tracking Server

Tracking Server Deployment on GCP

Dask - Section Introduction

Dask DataFrame

Getting Started with Dask

Creating and Storing Dask DataFrames

Shuffling for GroupBy and Join

Dask DataFrame - Best Practices

Scheduling

Deploying Clusters - Command Line

Futures

Delayed

Deploying Clusters - Python API

Python API

Introduction

Startup Script Creation

Instance Group Creation

Creating Configs

Instance Template Creation

Other Tools You Might Use For Distributed Model Training

Launching Jobs

Usage Examples

Introduction

Installation And Our First App

Request Body

Path Parameters

Query Parameters

Section Introduction

Where how to get the project template

What are make and Makefile

What is Poetry and Why Do We Need It

make and Makefile In Practice

Code Formatting Sorting Linting Type Checking

Poetry In Practice

Configuring Black Isort Flake8 MyPy

Creating Dockerfile Template

gitignore and .gitattributes files

Creating Docker Compose Template

Makefile setup

Hydra configuration setup

A few changes in the template

Caching

Common Widgets

Initializing DVC Storage

Datasets

Initializing DVC

Adjusting Project Template for Data Versioning

Creating a New Data Version

Data Versioning Course Assignment

Data Versioning Course Assignment Solution

Data Versioning

Getting a Secret Value From GCP

Repository Creation

Creating a Secret on GCP for GitHub Access Token

Updating Config with Raw Data Parameters

Getting Specific Raw Data Version

Exploratory Data Analysis for Dataset Readers

Dataset Readers - Course Assignment - Twitter Dataset

JTC Dataset Reader

Filtering Warnings

GHC Dataset Reader

Dataset Readers - Course Assignment - Twitter Dataset - Solution

Exploratory Data Analysis for Dataset Cleaners

Dataset Cleaners - Part 2

Dataset Cleaners - Part 1

Dataset Cleaner Schemas

Dataset Cleaners - Course Assignment

Dataset Cleaner Configs

Dataset Cleaners - Course Assignment - Solution

Formatting Sorting Linting Type Checking

Local Data Processing

Local Dask Cluster Setup

Adding Firewall Rules for Dask Cluster

Creating Dask Cluster Config Schema

Generating Final Config

Preparing Dataset Readers for Distributed Data Processing

Building and Pushing Docker Image to GCP Artifact Registry

Creating GCP Dask Cluster Config

IAM and Service Account Permissioons

Running Distributed Data Processing on Cloud

Filtering Our Dataset

Easily Switching Between Local and Remote Data Processing

Generating Final Config

Updating Python Dependencies

Preparing Tokenizer Trainer - Part 1

Tokenizers Library Components

Creating Config Schemas

Preparing Tokenizer Trainer - Part 2

Creating Config Files and Tokenizer Training

Updating Docker Compose File

General Architecture

A Note About Model Training Code

What is PyTorch Lightning Data Module

Generating Final Config

Building Docker Image

What is PyTorch Lightning Lightning Module

What is PyTorch Lightning Trainer

A Note About Config Schemas

How Our Config is Going to Look Like

Architecture Details

Data Module Practice

Data Module Config Schemas

Models Introduction

Data Module Creation

Transformations

Backbones

Heads

Models

Loss Functions

Adapters

Schedulers

Model Schemas

Training Tasks Part 1

Lightning Module

Lightning Module Schemas

Trainer Schema

Setting Up Entry-point Script

Training Tasks Part 2

Creating Data Module Config

Creating Backbone Config

Creating Model Config

Creating Task Config

Creating the Final Config

Model Exporting Theory

Resolving Problems in the Training Code

Logging Parameters to MLFlow

Model Exporting Logic

Evaluation Tasks

Evaluation Task Schemas

Model Exporting Task

Model Evaluation

Model Selector Schemas for Model Versioning

Distributed Model Training - How Does it Work in General

Distributed Model Training - A Reminder

Model Selector for Model Versioning

Model Versioning

Distributed Model Training - Deploying ETCD server on GCP

Distirbuted Model Training - Multiple Nodes Multiple GPUs

Distributed Model Training - Single Node Multiple GPUs

Distributed Model Training - Setup

Experimentation Configs

Making Our Model Better

Data Processing Service

Inference Service

Web App Setup

Streamlit App

Final Words