Billions of dollars have been put into investing into companies that fall under the concept of “Modern Data Stack. Fivetran nearly has one billion dollars funding them, DBT has 150 million(and is looking to raise more), Starburst has 100 million…and I could really go on and on about all the companies being funded. So that means every company has…
Read more
Photo by Anika Huizinga on Unsplash Billions of dollars have been put into investing into companies that fall under the concept of “Modern Data Stack”. Fivetran nearly has one billion dollars funding them, DBT has 150 million(and is looking to raise more), Starburst has 100 million…and I could really go on and on about all the companies being…
Read more
Your business’s digital presence is generating an incredible amount of raw data. Data visualization is the way that access to this data has been made available to everyone within a company. No longer is the IT department the gatekeeper to useful information about your customers, users, visitors, and funnels. Data visualization is a way of…
Read more
Source https://unsplash.com/photos/sb7RUrRMaC4 Snowflake is a cloud data platform. To be more specific it’s the first cloud built data platform. Its architecture allows data specialists to not only create data warehouses but also cloud data lake-houses because it can manage both structured and unstructured data easily. Being that Snowflake is based in the cloud, this means that it…
Read more
Photo by Jakub Skafiriak on Unsplash Born out of frustration with the only open source distributed programming implementation of the time, Apache Spark was created in the UC Berkeley AMPLab in 2014 to replace it’s predecessor Hadoop MapReduce. MapReduce was robust but burdened by excessive boiler plating, serialization and deserialization. MapReduce was created to anticipate node…
Read more
Photo by CHUTTERSNAP on Unsplash In our last article, we outlined what to avoid when you modernize your data architecture. That was more of an introduction piece for people to know what to do when they start developing their data strategies. Now we are going to work to start developing a strategy to modernize your…
Read more
Photo by CHUTTERSNAP on Unsplash When it comes to best practices and business alignment, most new data engineers learn as they go on the job. From building overly complex and unsustainable systems to putting too much faith in existing data structures, here are five of the most common mistakes and traps that even the most…
Read more
Photo by Tim Mossholder on Unsplash By Travis Wolf The goal of completing a machine learning model lifecycle is to deploy and maintain a working pipeline of data. As more companies look to implement ML models to optimize data-driven functions, being able to deliver and maintain these models will require a web framework that can…
Read more
“Futuristic research from International Data Corporation (IDC) indicates by 2022 organizations will devote approximately $1.97 trillion to enable Digital Transformation” Introduction Technology is continuously evolving, and with every new turn, results in the consumption of large amounts of data. Researches from firms such as IBM show we create approximately 2.5 quintillion bytes of data per…
Read more
*Stationary, Auto-correlation, Differencing Accurately forecasting costs, sales, user growth, patient readmission, etc is an important step to providing directors actionable information. This can be difficult to model by hand or in Excel. In addition, using traditional methods like moving averages might not provide enough insight into the various trends and seasonality that occur in real…
Read more