Testing Airflow DAGs: A Comprehensive Guide
Unit test tasks, validate DAG structure, mock external services, and build CI/CD pipelines for Airflow. Prevent silent data loss with systematic testing.
15 posts · page 1 of 1
Unit test tasks, validate DAG structure, mock external services, and build CI/CD pipelines for Airflow. Prevent silent data loss with systematic testing.
Automate code quality checks with Git hooks. Set up pre-commit linting, pre-push testing, commit message validation, and manage hooks with Husky across teams.
Compare blue-green and canary deployment strategies with practical examples to choose the right zero-downtime release approach for your team.
Reduce Docker image size and build time with multi-stage builds, layer caching, distroless bases, and practical Dockerfile patterns.
Integrate security scanning into your CI/CD pipeline with practical examples covering SAST, SCA, container scanning, and secrets detection.
Learn how to wire AWS CodeBuild and CodeDeploy together to build artifacts, run tests, and deploy to EC2, ECS, or Lambda with blue/green and canary strategies.
Compare blue-green and canary deployment strategies, including how they handle rollback, traffic shifting, and observability, with concrete Kubernetes and AWS examples.
Learn how to ship canary releases on Kubernetes using Flagger. Covers the control loop, metric analysis, traffic shifting, and how to roll back automatically when a release misbehaves.
An overview of rollback strategies in modern CI/CD: redeploy previous, blue-green flip, canary reverse, database-safe rollbacks, and the trade-offs between speed and safety.
Keep API keys, tokens, and database credentials safe in CI/CD with rotation, scoping, secret managers, and OIDC-based authentication.
A practical guide to running your own CI/CD runners. Learn when self-hosting beats cloud runners, how to set them up safely, and how to keep them healthy in production.
Stop copy-pasting CI YAML across repos. Learn how to build reusable GitHub Actions workflows with inputs, secrets, outputs, and per-environment overrides.
How to design a CI/CD pipeline that stays fast, reliable, and reversible: stages, caching, parallelism, environments, and rollback strategies that scale with the team.
How Docker multi-stage builds work, why they shrink images dramatically, and patterns for Python, Node, and Go services that need a clean runtime layer.
Compare trunk-based development, gitflow, and GitHub flow. Learn when each strategy fits, how they affect release cadence, and which commands to actually use day to day.