Today’s leading cloud platforms include numerous components for storing, processing, and analyzing large volumes of data. All the basics are there: storage, analysis, and processing, streaming data processing, data pipelining, data warehousing, BI, and even AI. But while it’s great to have all those raw components, how do you tie them together and build a true data pipelining and analysis solution? While the parts are great, they still must be assembled into the whole
This paper will explore the various services available to you on the Amazon Web Services platform. We’ll discuss the powerful solutions possible with each of them and get a sense of how they can be combined. Then we’ll review various options for tying them together, including methods somewhat bespoke and using products that sit atop these components, integrating them seamlessly in the background.
The cloud provides a platform — it doesn’t always provide a full solution. Our goal in this paper is to set you on the right path to obtain a solution that mitigates risk and frustration and safeguards project success.