Maybe it’s the 6 figure salaries, the opportunity to work with cool technology or people are finally learning that data engineering is where everything starts in the data field. Whatever the reason, people are noticing. VCs are investing in data storage and ingestion platforms and companies are interviewing more data engineers compared to previous years. But how…
Read more
Scaling data talent is hard. It’s hard to hire. Hard to grow and just overall hard in terms of managing processes and output. But there are brilliant leaders and managers doing it everyday. I recently interviewed Veronica Zhai, the principal product manager at Fivetran. She has led Fivetran’s analytical team for nearly the last year…
Read more
Photo by Christina @ wocintechchat.com on Unsplash Why does it feel like so many more articles are discussing the data engineering profession? Perhaps it’s because Dice’s 2020 tech jobs report cites data engineering as the fastest-growing field in 2020, increasing by a staggering 50%, while data science roles only increased by 10%? Or maybe it’s just because the Medium…
Read more
Photo by Martin Sanchez on Unsplash There are plenty of clichés about data and its likeness to oil. But it’s far from easy to get value from data. Companies are creating more data than ever before. At our current pace, 2.5 quintillion bytes of data are created every day. Companies went from pulling data solely…
Read more
Photo by ThisisEngineering RAEng on Unsplash 2021 is almost halfway over and it seems like hundreds of millions of dollars has gone into investing in data, data start-ups and machine learning. In particular funding has also shifted heavily from just focusing on the data science and machine learning space to the data engineering and data management…
Read more
Software engineer vs. data engineer. People outside these professions are often confused about the differences between these experts. They may think these are two different names for the same thing: a programming expert. Of course, the duties of each engineer type are different, but their roles are similar enough to confuse people who are in…
Read more
Photo by Windows on Unsplash It seems like it might be finally happening. Data engineering is finally getting a little bit of the data lime light. Which makes sense. The data being stored and analyzed is not only becoming more voluminous but its speed, complexity and variety are also increasing. Making it difficult to wrangle. With…
Read more
Photo by Guille Álvarez on Unsplash With an extensive background in data science, analytics, and cloud computing, I am consistently asked the same questions repeatedly. Besides wanting to know the difference between a data engineer and a data scientist, one of the most common questions is, what skills should I learn as a data engineer?…
Read more
Photo by Alexandre Debiève on Unsplash. There are plenty of cliches about data and its likeness to oil or companies being data-driven. The one truth I have learned from consulting over the past few years is that companies of all sizes are trying to figure out how to get to and utilize their data. The traditional methods of…
Read more
Photo by CHUTTERSNAP on Unsplash In our last article, we outlined what to avoid when you modernize your data architecture. That was more of an introduction piece for people to know what to do when they start developing their data strategies. Now we are going to work to start developing a strategy to modernize your…
Read more