-
Continue reading →: Automating ETL Workflows with Apache Airflow: A Comprehensive Guide
Apache Airflow has become a cornerstone tool in the data engineering world, offering robust workflow orchestration capabilities. As someone who has extensively used Airflow, I can attest to its flexibility and power in automating ETL processes. In this guide, I’ll walk you through setting up Airflow using Docker, creating and…
-
Continue reading →: Why I Switched to dbt (Data Build Tool) and How It Improved our Data Workflow
As a seasoned software engineer, I’m always on the lookout for tools that can streamline my workflow and enhance productivity. Over the past month, I’ve been using dbt (Data Build Tool), and it has transformed the way I handle data operations. In this blog post, I’ll share why I made…
-
Continue reading →: Useful collection of public cheatsheets
Linux tools cheatsheets Awk Awk in 6 steps TechRepublic Awk & Sed Cheatsheet Git How to turn back time How to squash and rebase Grep Dev Hints Grep VIM https://vim.rtorr.com/ The great vim cheatseet Keyboard organised cheatsheet Vim Cheatsheet for programmers 5 of the best Dev Hints Vim Programming cheatsheets…
-
Continue reading →: Is MVP beneficial for learning and development
What is a minimum viable product (MVP)? An MVP is intended to create the minimum amount of product to be able to get something in front of your user (or leaner). The intention is that it shortens the time that it takes to work out what your customer (in our…
-
Continue reading →: Notes on variance
Notes on Variance I’ve recently been working through the Rock The Jvm Cats course having previously completed the Scala Advanced course and being very impressed with his explanations and training materials. Here are my take away notes on variance in Scala based on the session by Daniel Ciocîrlan. package RockTheJvm.cats.chapter1…
-
Continue reading →: Hello
Thanks for visiting There are no bells or whistles here, just a simple site with some software engineering content which you probably wont find useful but I do. I finally decided to put together this very simple site. What to expect? Short notes on programming particular with Scala