My learnings as a data engineer

Azure

How to implement a time-to-live (TTL) in specific folders in an Azure Storage Account

In today’s world of big data, storage is one of the biggest challenges faced by organizations. With the amount of data growing rapidly, it becomes imperative to have a system in place to manage the data effectively. One way to…

Git, Good Practices

Good Practices: Windows reserved words vs Git

Have you ever tried to clone/pull a repository in your local machine with git and you got this error? fatal: cannot create directory at ‘<folder_name>/aux’: Invalid argument

Architecture, Azure, Security

Azure Data Lake governance: Strategy by layers

Do you have to create an Azure Data Lake (Gen2)? In this post I show you a strategy to keep it secured, having different accesses for different groups/users/SP (Service Principals) in each layer.