Chapter 1: What Is Data Engineering Chapter 2: Building Our Data Engineering Infrastructure Chapter 3: Reading and Writing Files Chapter 4: Working with Databases Chapter 5: Cleaning and Transforming Data Chapter 6: Building a 311 Data Pipeline Chapter 7: Features of a Production Data Pipeline Chapter 8: Version Control Using the NiFi Registry Chapter 9: Monitoring and Logging Data Pipelines Chapter 10: Deploying Your Data Pipelines Chapter 11: Building a Production Data Pipeline Chapter 12: Building an Apache Kafka Cluster Chapter 13: Streaming Data with Kafka Chapter 14: Data Processing with Apache Spark Chapter 15: Real-Time Edge Data – Kafka, Spark, and MiNiFi Appendix