Photo by Fotis Fotopoulos on Unsplash Recently several consulting calls started with people asking, “Do we need a data warehouse?” This isn’t a question about whether you need data warehouse consultants, but instead whether you should event start a data warehouse project. Which is a very fair question. Not every company needs a data warehouse.…
Read more
Photo by JESHOOTS.COM on Unsplash Modern data stack consultant plays an important role in companies looking to become data-driven. They help companies design and deploy centralized data sets that are easy to use and reliable. They do so by using cloud based solutions that help automate data pipelines and processes with less code than in…
Read more
Good Design Is Easier to Change Than Bad Design – The Pragmatic Programmer Programming is just one aspect of the difficulties of tech work for data engineers. Creating simple yet robust systems that help manage your data infrastructure is equally important. This challenge of building a simple yet robust data infrastructure remains even with no-code/low-code solutions. Just…
Read more
Photo by Sigmund on Unsplash 2022 is coming to an end. What is the state of data infra? Are Snowflake and Databricks still fighting over total cost of ownership? Is everyone switching to DuckDB? Are data engineers all learning Rust? Let’s try to answer these questions. Building field-level lineage for modern data systems Lineage…
Read more
Data has been consistently demonstrated to be a valuable asset for businesses of all sizes. Consulting firms, like McKinsey, have found that companies using AI and analytics attribute 20% of their earnings to it. As a consultant, I have personally witnessed how data can uncover new sources of revenue and cost reduction opportunities for clients…
Read more
AWS has jumped on the bandwagon of removing the need for ETLs. Snowflake announced this both with their hybrid tables and their partnership with Salesforce. Now, I do take a little issue with the naming “Zero ETLs”. Because at the very surface the functionality described is often closer to a zero integration future, which probably…
Read more
By Reseun McClendon Today, your enterprise must effectively collect, store, and integrate data from disparate sources to both provide operational and analytical benefits. Whether its helping increase revenue by finding new customers or reducing costs, all of it starts with data. Data analysts, data scientists, engineers, and managers all require a robust data storage solution for…
Read more
If you haven’t started looking for ways to improve your data analytics budget for 2023, then you’re probably already behind. The truth is that between all of the various economic indicators and investor letters, everyone is looking to improve audit all parts of their business. Especially where there has likely been bloat. One of those…
Read more
At my very first job in data, I was an analyst on a finance team. I was working with a senior engineer who had built out several new automated processes and was managing a data warehouse and several other applications. We were supporting 4-5 financial analysts who were relying on our data to report to…
Read more
If you’ve worked as a DBA or data engineer, then you’ve likely had to deal with data access requests. These basic data requests can go from quick requests to endless data access requests that bog down entire data teams. This has been heavily driven by the fact that companies want to be data-driven. Meaning an…
Read more