At my very first job in data, I was an analyst on a finance team. I was working with a senior engineer who had built out several new automated processes and was managing a data warehouse and several other applications. We were supporting 4-5 financial analysts who were relying on our data to report to…
Read more
If you’ve worked as a DBA or data engineer, then you’ve likely had to deal with data access requests. These basic data requests can go from quick requests to endless data access requests that bog down entire data teams. This has been heavily driven by the fact that companies want to be data-driven. Meaning an…
Read more
Photo by Christopher Gower on Unsplash By Reseun McClendon Data Governance is the set of principles and procedures an organization uses to manage data during its life cycle. More specifically, data governance encompasses all that is done to ensure data is private, secure, accurate, available, and usable. The data life cycle may include the data’s acquisition, use, and disposal…
Read more
It can be easy to take certain tools for granted when you work for companies with mature infrastructure. One of my favorite tools at Facebook was iData. iData was Facebook’s data discoverability tool. It provided a lot of functionality that I have started to miss. This included the baseline functions you would expect including the…
Read more
Databricks is a company that aims to make managing big data easy. By utilizing Apache Spark as its core processing engine, Databricks aims to make managing and processing big data easy. As one of the leading providers of big data solutions, Databricks has made a name for itself in the industry. What is Databricks? So,…
Read more
Over the last 20 years or so, Big Data completely changed the face of business. Then the pandemic hit. While other industries skidded to a stop, the pace of technology development skyrocketed. Suddenly, our whole lives, from work to entertainment to hanging out with friends, were happening online. Worldwide, 97 percent of businesses sped up…
Read more
Photo by Maarten van den Heuvel on Unsplash There are plenty of cliches about data and its likeness to oil or companies being data-driven. Is there truth to all this hype about data strategy, predictive modeling, data visualization, and machine learning? In our experience, these cliches are true. In the past few years, we have already helped several…
Read more
The modern data stack has been discussed heavily in 2020 and 2021. But what wasn’t discussed enough was how to set up a successful data strategy. Truthfully, to drive value from your data you’re going to need to focus less on modernizing and more on your actual business problems. Driving business value with your data…
Read more
Photo by Victoriano Izquierdo on Unsplash Companies that are serious about using raw data for business intelligence need some way to centralize and control that data. Many of them are using specialized vendor products to do so. Fivetran is one choice for getting all of that data wherever it resides and centralizing it in an…
Read more
Photo by Pawel Czerwinski on Unsplash Big data is touted as the solution to many problems. However, the truth is, big data has caused a lot of big problems. Yes, big data can provide more context and provide insights we have never had before. It also makes queries slow, data expensive to manage, requires a lot of expensive…
Read more