Photo by Sigmund on Unsplash Companies in all industries and of all sizes now deal with an ever-increasing amount of data, far beyond human comprehension. This vital information is rendered practically useless unless you have an efficient way to process and analyze it to reveal valuable insights within the clutter. The ETL (extract, transform, load)…
Read more
Photo by Nana Smirnova on Unsplash There is a lot of discussion on how you should implement your data stacks today. Should you bundle or unbundle, should you use a traditional data warehouse, lakes, lake houses, or mesh? Or a hybrid of all of them? With all these different ways you can put together your…
Read more
Data and analytics teams are often responsible for several key pillars in a company. This can pose a challenge when you’re the head of data and analytics and you need to pick your next data project. Where do you even start when you’re constantly bombarded with requests from your management team. In this article I…
Read more
Photo by JESHOOTS.COM on Unsplash Depending on your outlook, your small business might be inspired or intimidated by data science. No matter which end of the spectrum you’re on, one thing you can’t afford to do is ignore it. Data may be the single most important thing you can use to boost profits and cut…
Read more
Companies are continually setting up programs and initiatives to become more data-driven. Millions are being spent on new infrastructure, hiring employees, and creating processes to drive value with data. The need for better tooling, faster data, and experienced data professionals will become even more important as data sources, size, and speed grow. However, eventually, the…
Read more
Billions of dollars have been put into investing into companies that fall under the concept of “Modern Data Stack. Fivetran nearly has one billion dollars funding them, DBT has 150 million(and is looking to raise more), Starburst has 100 million…and I could really go on and on about all the companies being funded. So that means every company has…
Read more
Photo by Anika Huizinga on Unsplash Billions of dollars have been put into investing into companies that fall under the concept of “Modern Data Stack”. Fivetran nearly has one billion dollars funding them, DBT has 150 million(and is looking to raise more), Starburst has 100 million…and I could really go on and on about all the companies being…
Read more
Your business’s digital presence is generating an incredible amount of raw data. Data visualization is the way that access to this data has been made available to everyone within a company. No longer is the IT department the gatekeeper to useful information about your customers, users, visitors, and funnels. Data visualization is a way of…
Read more
Photo by Pawel Czerwinski on Unsplash Big data is touted as the solution to many problems. However, the truth is, big data has caused a lot of big problems. Yes, big data can provide more context and provide insights we have never had before. It also makes queries slow, data expensive to manage, requires a lot of expensive…
Read more
Over the last 3 months, I have taken on two different migrations that involved taking companies from manually managing Airflow VMs to going over to using Cloud Composer and MWAA (Managed Workflows For Apache Airflow). These are two great options when it comes to starting your first Airflow project. They help reduce a lot of issues…
Read more