Big Data for Architects

This course provides a comprehensive guide to selecting the right Big Data technology and understanding Big Data architecture and pipelines. The course starts by introducing the structure and learning goals, followed by a step-by-step setup of the environment. It covers the logical structure of Big Data, the evolution of Big Data technologies, and the Big Data pipelines. Ingestion frameworks like Flume, Nifi, and Kafka are explored, along with key storage frameworks such as HDFS, HBase, and Kudu. Different data formats are also discussed, as well as key data processing and analysis frameworks. By the end of this course, you will have a solid understanding of Big Data architecture and technologies, as well as the skills to create real-world Big Data pipelines.