Photo by Pawel Czerwinski on Unsplash Big data is touted as the solution to many problems. However, the truth is, big data has caused a lot of big problems. Yes, big data can provide more context and provide insights we have never had before. It also makes queries slow, data expensive to manage, requires a lot of expensive…
Read more
Over the last 3 months, I have taken on two different migrations that involved taking companies from manually managing Airflow VMs to going over to using Cloud Composer and MWAA (Managed Workflows For Apache Airflow). These are two great options when it comes to starting your first Airflow project. They help reduce a lot of issues…
Read more
Big data is the new commodity that companies need to drive the business forward. Having access to all your companies data sets used to be limited to large companies that could afford a whole team of data engineers and software developers. But this is no longer the case. Traditionally you would need to have a…
Read more
Photo by Leohoho on Unsplash Migrating to the modern data stack means poising your organization to meet the varying demands of modern data. The modern data stack seeks to overcome the problems and challenges associated with modern data while enabling an organization to innovate and automate like never before. As more organizations migrate to the modern…
Read more
Photo by Startaê Team on Unsplash 2022 is around the corner and it is time to start looking towards improving your data strategy. Our team has seen several trends in 2021 in terms of methods which can help improve your data analytics strategy. Whether it be optimizing your Snowflake table structures to save $20,000 a…
Read more
Data is an integral aspect of any business. It allows for solution development, metric tracking, and creates a structure for streamlined and integrated processes. Data empowers business decisions. I say that both from the fact that consulting firms like McKinsey have found that in their research companies that are using AI and analytics can attribute 20%…
Read more
It’s becoming difficult to keep track of all the new data warehouse solutions that are trying to challenge the current incumbents. Choosing the best data warehouse to meet the needs and objectives of your operation is a crucial component of your business strategy. Unfortunately, many organizations are still struggling with this decision. To add to…
Read more
Source Apache Airflow is a popular open-source tool that helps teams create, schedule, and monitor sequences of tasks, known as “workflows.” Managed Workflows for Apache Airflow, abbreviated as MWAA, is a managed service designed for orchestration in Apache Airflow. With MWAA, users can easily operate data pipelines at scale, setting up and managing them from…
Read more
Companies of all sizes are looking for faster and easier ways to take advantage of data through analytics and BI. In particular, knowing who your customers are, how they interact with your business, products and services is a modern necessity. In a customer-centric world where data can help improve the overall customer experience and relationships,…
Read more
Photo by Myriam Jessier on Unsplash The modern data stack (MDS) is a new approach to data integration capable of saving your engineers time while allowing both engineers and analysts to focus on high-value pursuits. With a suite of tools to support data integration, the modern data stack will free your teams of monotony while empowering…
Read more