Course Handout A. Course Handout (Student & Faculty) Institute/School Name Department Name Programme Name Course Name Course Code Chitkara University Institute of Engineering and Technology Department of Computer Applications Bachelor of Computer Applications Data Warehousing & ETL Session July-Dec 2025 Technologies 22CA022 5th /2023 Semester/Batch L-T-P (Per Week) Course Coordinator 4-0-2 Dr. Ruchi Mittal Course Credits 5 1. Scope & Objective of the Course: To comprehend the principles of Data Analytics. To understand the characteristics of data, Big Data, Data Warehousing & ETL Technologies To implement Data Integration principles and create ETL Pipelines. The main objectives of the course are: The students should be able to Understand the architecture of Data Warehouse & Data Marts. Analyze the difference between ER Modelling and Multi-Dimensional Modelling. Understand the concepts of data mining. Learn the methods of data pre-processing. 2. Course Learning Outcomes: Course Learning Outcome POs CL KC PO1, PO2 K2 Fundamental Conceptual 8 PO2, PO4 K4 Factual Conceptual 12 PO1, PO4 K3 Conceptual Procedural 8 CLO04 Analyze the potential use of multidimensional model PO1, PO2, PO4 and OLAP in data analysis. K3 Conceptual Procedural 11 the architectural design patterns, PO2, PO4 CLO05 Recall summarizability problems, and design methodologies and apply these concepts to mini case studies on data warehouse design. K4 Factual Procedural 6 Understand and apply the data integration principles PO1, PO8, PO9 using Pentaho K4 Factual Procedural 13 Differentiate between the types of data and learn CLO01 about historical reasons and goals for development Sessions of data warehouse technology CLO02 Identify the major frameworks of data warehousing, data analytics and business intelligence (BI). CLO03 Understand how to start-small and think-big using data integration technologies. CLO06 Total Contact Hours Data Warehousing & ETL Technologies/ 22CA022 58 Page 1 of 9 Course Handout Mapping COPO: CLO PO CLO1 PO1 PO2 H H CLO2 CLO3 CLO4 PO4 H M M CLO5 CLO6 PO3 PO5 PO6 PO7 PO8 PO9 H H PO10 H H H H H H M 3. ERISE Grid Mapping Feature Enablement Level(1-5, 5 being highest) Entrepreneurship 1 Research 1 Innovation 2 Skills 2 Employability 2 4. Recommended Books (Reference Books/Text Books): B1: Data Warehousing, Data Mining, & OLAP, Alex Berson, Stephen J. Smith, Tata McGraw, July 2017. B2: Fundamentals of Business Analytics, R.N. Prasad, Seema Acharya, Wiley Publishing, First Edition 2011 B3: F undamentals of Data Warehousing, Paul Raj Poonia, John Wiley & Sons, 2003. 5. Other readings & relevant websites: S. No. Link 1 Link 2 Link 3 Link 4 Link of Journals, Magazines, websites and Research Papers https://www.tutorialspoint.com/dwh/dwh_data_warehousing.htm https://www.guru99.com/data-warehouse-architecture.html www.learndatamodeling.com/dw_concepts.php http://www.indigo.co.nz/data-warehousing/benefits-of-data-warehousing 6. Recommended Tools and Platforms: Pentaho, Weka Data Warehousing & ETL Technologies/ 22CA022 Page 2 of 9 Course Handout 7. Complete Theory course coverage plan: Lecture No. Recommended Books (B) Topic(s) 1-2 Unit 1: Introduction to Data Structured, Semi Structured and Unstructured Data B1 3-5 Unit 2: Introduction to Data Warehouse Need for Data Warehousing, Data warehousing definition, Characteristics of Data warehousing, Goals of Data warehousing. Unit 3: Warehouse Architecture Warehouse Architecture: Ralph Kimball’s Approach vs. W.H. Inman’s Approach, Architectural Types, B1 6-8 9-13 14 15-19 20-24 25-28 B3 Data Ware housing Components: Overall architecture, Access Tools, Sourcing, B2 Acquisition, Cleanup and Transformation Tools, Design Considerations, Meta Data. B2 Data Marts and its types, Data Warehouse and Data Marts Unit 4: ETL architecture and its Process ETL architecture; ETL Process: Introduction and challenges in ETL process, Data Extraction – identification of data sources and extracting data, Data Transformation – tasks involved in data transformation, Data Loading – techniques of data loading Unit 5: Multidimensional Data Modeling Multidimensional Data Modelling: Introduction to data modelling techniques, Fact Table, Dimensional Table. Typical Dimensional Models: Star Schema, Snowflake Schema, Fact constellation Schema ST1 B2 B1 and B2 B1 29-30 Introduction to OLTP and OLAP: Difference between OLTP and OLAP, OLAP Guidelines, categories, OLAP Tools, OLAP operations. B3 31-34 Unit 6: Introduction to Business Intelligence Introduction to Business Intelligence, Business Intelligence Users and Applications, Business Intelligence Roles and Responsibilities Unit 7: ETL Architecture & ETL Testing , importance of ETL testing, ETL Testing Work flow activities involved, Challenges in DWH ETL Testing compare to other testing Types of ETL Testing: Data completeness, Data transformation, Data quality, Performance and scalability B2 35-49 40-42 B2 ,B3 B2 ST2 43-45 Integration testing, User-acceptance testing. SQL Queries for ETL Testing, Incremental load testing, Initial Load / Full load testing, Different ETL tools available in the market,Informatica ,Ab Initio , IBM Data stage. B2 End Term Data Warehousing & ETL Technologies/ 22CA022 Page 3 of 9 Course Handout 8. Delivery/Instructional Resources: Session No. 1 2 3 4 Web References Audio – Video Topic(s) Unit 1: Introduction to Data Structured, Semi Structured and Unstructured Data https://www.ibm.com/cloud/lea https://www.youtube.co rn/structured-vs-unstructured- m/watch?v=Zp07oHss data GS0 https://www.techtarget.com/sea https://www.coursera.or rchdatamanagement/definition/s g/lecture/datatructured-data warehousing-intro/1-2structured-semistructured-andunstructured-dataQnUmB https://www.youtube.co Unit 2: Introduction to Data warehouse https://www.oracle.com/dataNeed for Data Warehousing, Data warehouse/what-is-a-datam/watch?v=uvRB4IV7 warehousing definition, Characteristics warehouse.html p-U of Data warehousing, Goals of Data warehousing. https://learn.microsoft.com/e https://www.linkedin.co n-us/sql/analysism/learning/learningservices/datadata-warehousing-2 warehousing/datawarehousing-sql-server Unit 3: Warehouse Architecture https://www.kimballgroup.com/ https://www.youtube.co Warehouse Architecture: Ralph data-warehouse-businessm/watch?v=xcM_PdN1 Kimball’s Approach vs. W.H. Inman’s nFE intelligence-resources/ Approach, Architectural Types. Data Ware housing Components: Overall architecture, Access Tools, Sourcing, https://www.dummies.com/pro https://www.udemy.co Acquisition, Cleanup and gramming/big-data/datam/course/dataTransformation Tools, Design warehousing-architecturesConsiderations, Meta Data. Data Marts warehouse-concepts/ inmon-versus-kimball/ and its types, Data Warehouse and Data Marts Unit 4: The ETL Architecture https://www.ibm.com/docs/en/ii https://www.youtube.co and its Process m/watch?v=lD1cn8RG s/11.7?topic=etl-process ETL architecture; ETL Process: k4E Introduction and challenges in ETL process, Data Extraction – identification https://www.talend.com/resourc https://www.coursera.or of data sources and extracting data, Data es/what-is-etl/ g/lecture/dataTransformation – tasks involved in data warehousing-etl/etltransformation, Data Loading – techniques of data loading process-QFsqY Unit 5: Multidimensional Data https://docs.oracle.com/databas https://www.youtube.co Modeling e/121/DWHSG/concept.htm#D m/watch?v=NGyyzjH_t N4 Multidimensional Data Modelling: WHSG001 Introduction to data modelling https://www.coursera.or techniques, Fact Table, Dimensional g/learn/dataTable. Typical Dimensional Models: https://olap.com/olap-datawarehousing/lecture/3d Star Schema, Snowflake Schema, Fact modeling/ dgb/multidimensionalconstellation Schema. . data-modeling Introduction to OLTP and OLAP: Difference between OLTP and OLAP, OLAP Guidelines, categories, OLAP Data Warehousing & ETL Technologies/ 22CA022 Page 4 of 9 Course Handout Tools, OLAP operations. Unit 6: Introduction to Business Intelligence Introduction to Business Intelligence, Business Intelligence Users and Applications, Business Intelligence Roles and Responsibilities 5 Unit 7: ETL Architecture & ETL Testing ETL architecture, importance of ETL testing, ETL Testing Work flow activities involved, Challenges in DWH ETL Testing compare to other testing, Types of ETL Testing:Data completeness, Data transformation, Data quality, Performance and scalability, Integration testing, Useracceptance testing. SQL Queries for ETL Testing, Incremental load testing, Initial Load / Full load testing, Different ETL tools available in the market, Informatica, Ab Initio, IBM Data stage. 6 https://www.tableau.com/lear n/articles/businessintelligence https://www.youtube.co m/watch?v=9URiGfA2 QA8 https://powerbi.microsoft.com /en-us/what-is-businessintelligence/ https://www.informatica.com/re https://www.youtube.co m/watch?v=8s71g9I9R sources/articles/etl5k architecture.html https://www.udemy.co https://databricks.com/glossary/ m/course/etl-testing101/ etl-testing 9. Action plan for different types of learners: Slow Learners Remedial Classes on Saturdays Encouragement for improvement using Peer Tutoring Use of Audio and Visual Materials Use of Real-Life Examples Average Learners Fast Learners Design complex problem based Formative Exercises used to on real life problem. highlight concepts Presentation on topics beyond E-notes and E-exercises to read those covered in CHO. ahead of the pedagogic material. Engaging students to hold hands Doubt session on the Saturdays of slow learners by creating a and according the slot free in time Peer Tutoring Group. table. 10. Evaluation Scheme & Components: Evaluation Type of Component Component # Component 1 Lab Evaluations and Internal Viva Component 2 Sessional Tests (STs) # Component 3 End Term Examination Total No. of Assessments Weightage of Component Mode of Assessment 03* 20% Offline ** 02 30% Offline 01*** 50% Offline 100% #Component 1 and component 3 are mandatory components and require 40% marks in each for clearing the subject. *Lab Evaluation have2 Lab performances- LP1 and LP2 and one Internal viva which shall be considered for evaluation based on experiments. **Out of 02 STs, the ERP system automatically picks the best 01 ST. ***Further, as per Academic Guidelines, minimum 75% attendance is required to become eligible for appearing in the End Semester Examination. Data Warehousing & ETL Technologies/ 22CA022 Page 5 of 9 Course Handout 11. Complete Lab Course Coverage plan Lab Lab Session Virtual lab link/ Multisim link No. 1-2. Illustrating Data Analysis using Pivot Table and Charts https://www.howtogeek.com/701536/how-to-usepivot-tables-to-analyze-excel-data/ Lab Activity: How to illustrate data analysis using Pivot Table and Charts and Use of functions (count, Average, Product etc) and Exercise questions 3-4. Illustrating Data Analysis using Pivot Table and Charts Lab Activity: Use of functions such as refresh, https://www.youtube.com/watch?v=9NUjHBNWe 9M https://www.linkedin.com/learning/exceladvanced-formulas-and-functions filters, drill down option of pivot tale and Exercise questions on Pivot table and chart implementation 5-6. Slicing and Dicing operations in MS Excel Lab Activity: How to perform slicing and dicing operation in MS Excell. 7-8. Implementation of VLook Up and Hlookup https://support.microsoft.com/en-us/excel/slice-anddice-your-data-with-pivot-tables-7d4e5af1-2d3e46d0-9a685e50https://help.hitachivantara.com/Documentation/ Pentaho/9.0/Setup/Install_PDIa9a8a9e3 https://support.microsoft.com/en-us/office/vlookupfunction-0bbc8083-26fe-4963-8ab8-93a18ad188a1 Lab Activity: How to perform the VLookUpHLook Up operation in MS Excel 9-10. Introduction to PDI and Weka tools https://support.microsoft.com/en-us/office/hlookupfunction-efbfd3b2-2aeb-45e3-98b8-872c11a65df5 https://help.hitachivantara.com/Documentation/Pent aho/9.0/Setup/Install_PDI Lab Activity: How to Install and Run Pentaho Data Integration IDE and Weka Installation 11-12. Introduction to Various Transformation: https://www.youtube.com/watch?v=4vLzvYLbiGk https://help.hitachivantara.com/Documentation/Pent aho/9.2/ Lab Activity: Create a Simple PDI Transformation for transforming data from: a. From Text File to Excel file. b. From Excel file to Text File From Text to XML File 13-14. Performing Transformation on Multiple Files: https://help.hitachivantara.com/Documentation/Pent aho/9.2/ Lab Activity: a. Create a Simple PDI Transformation for transforming data from Multiple Excel File to One Excel File. Data Warehousing & ETL Technologies/ 22CA022 Page 6 of 9 Course Handout b. Create a Simple PDI Transformation for transforming data from multiple text File to One Text File. c. Create a Simple PDI Transformation for transforming data from Multiple text File to One Excel File 15-16. Filtration of records: https://help.hitachivantara.com/Documentation/Pent aho/9.2/ Lab Activity: a. Use of Filter rows for dividing Source data to two destinations. b. Distribution of data from one excel file to text file and excel file c. Distribution of data from one Text file to Multiple excel files. 17-18. Creating Database Connection and Performing https://help.hitachivantara.com/Documentation/Pent Database to files Transformation aho/9.2/ Lab Activity: Create Database connection in PantaHo with MySQL and Create a Simple PDI Transformation for transforming data from: a. From Database table to Flat File. b. From Database table to Excel file c. From Access to Excel file. 19-20. Performing Files to database Transformation: https://help.hitachivantara.com/Documentation/Pent aho/9.2/ Lab Activity: Create a Simple PDI Transformation for transforming data from: a. From Excel file to Database table. b. From Text file to Database table. c. From Excel to Access File 21-22. Perform basic data quality operation on the data in https://help.hitachivantara.com/Documentation/Pent flat file and load it back to a flat file (data quality aho/9.2/ operations such as checking for null values). 23-24. Understand Weka Interface and various File formats used in Weka https://www.cs.waikato.ac.nz/ml/weka/documentati on.html Lab Activity: a. Understand the features of Weka Toolkit such as Explorer, Knowledge-flow, Experimenter, and CLI Data Warehousing & ETL Technologies/ 22CA022 Page 7 of 9 Course Handout b. Various file formats like CSV, ARFF c. Understand various types of data (Numeria, Nominal, categorical) and explore the data sets available in Weka. 25-26. Data Preprocessing using Weka a. https://www.cs.waikato.ac.nz/ml/weka/documentati on.html Load data set, List attributes and their types, No. of instances, identify Class attribute, Plot histogram. b. Determine number of records in each class. c. Navigate the options available in the WEKA(select attributes panel, preprocess panel) d. Explore various options in Weka for Preprocessing data such as handling missing values, normalization, discretization) on a dataset. 1. Syllabus of the Course: Name of the course: Data Warehousing & ETL Technologies Subject Code: 22CA022 Contents No. of Lectures 1 Weightage Unit 2: Introduction to Data Warehouse Need for Data Warehousing, Data warehousing definition, Characteristics of Data warehousing, Goals of Data warehousing. 1 5% Unit 3: Warehouse Architecture Warehouse Architecture: Ralph Kimball’s Approach vs. W.H. Inman’s Ajpproach, Architectural Types. Data Ware housing Components: Overall architecture, Access Tools, Sourcing, Acquisition, Cleanup and Transformation Tools, Design Considerations, Meta Data. Data Marts and its types, Data Warehouse and Data Marts 2 25% Unit 1: Introduction to Data Structured, Semi Structured and Unstructured Data Data Warehousing & ETL Technologies/ 22CA022 5% Page 8 of 9 Course Handout Unit 4: The ETL Process The ETL Process: Introduction and challenges in ETL process, Data Extraction – identification of data sources and extracting data, Data Transformation – tasks involved in data transformation, Data Loading – techniques of data loading 2 5% Unit 5: Multidimensional Data Modeling Multidimensional Data Modelling: Introduction to data modelling techniques, Fact Table, Dimensional Table. Typical Dimensional Models: Star Schema, Snowflake Schema, Fact constellation Schema. . Introduction to OLTP and OLAP: Difference between OLTP and OLAP, OLAP Guidelines, categories, OLAP Tools, OLAP operations. Unit 6: Introduction to Business Intelligence Introduction to Business Intelligence, Business Intelligence Users and Applications, Business Intelligence Roles and Responsibilities Unit 7: ETL Architecture & ETL Testing ETL architecture, importance of ETL testing, ETL Testing Work flow activities involved, Challenges in DWH ETL Testing compare to other testing, Types of ETL Testing:Data completeness, Data transformation, Data quality, Performance and scalability, Integration testing, User-acceptance testing. SQL Queries for ETL Testing, Incremental load testing, Initial Load / Full load testing, Different ETL tools available in the market,Informatica ,Ab Initio , IBM Data stage. 3 35% 2 5% 3 20% 2. Academic Honesty policy: Chitkara University ensures the implementation of the highest level of academic integrity in all the documents being prepared / adopted by its Faculty members and students. Any branch of the same will be tantamount to severe academic penalties. This Document is approved by: Designation Name Course Coordinator Dr. Ruchi Mittal Program Incharge Dr. Maninder Singh Khanna Pro Vice Chancellor Dr. Jaiteg Singh Date (DD/MM/YYYY) 27/06/2025 Data Warehousing & ETL Technologies/ 22CA022 Signature Page 9 of 9
0
You can add this document to your study collection(s)
Sign in Available only to authorized usersYou can add this document to your saved list
Sign in Available only to authorized users(For complaints, use another form )