Application of Data Engineering Techniques

This 4 week online course will teach you practical skills for how to prepare your data for use in real-world analytics scenarios by using techniques such as advanced data modeling, ETL/ELT, SQL, and data pipelines in GCP. Additionally, you will cover how to use cloud data in Python/R solutions.

Date

July 15 to August 12, 2024

Duration

4 weeks, 5 hours per week

PRICE

US rate $1,088; Int'l rate $1,000

FUTURE DATES

Oct 14 - Nov 11, 2024

CEUs

2.0 CEUs

Description Goes Here

Course Number

ADETxB

Description Goes Here

TOPICS COVERED

Advanced SQL techniques
Advanced data processing techniques in R/Python
Working with real-time data
Introduction to Google Pub/Sub
Streaming data into BigQuery
ETL processing pipelines
Data cleaning – GCP based techniques for cleaning data
Python/R integration with the Google data management environment and data manipulation
Advanced data cleansing using pipelines
Data pipelines and automation, Airflow, Config and management
Case study, a real world example of building a data pipeline

Why this training is relevant

Discover how data engineering skills can unlock the potential of generative AI:

Data Pipeline Management: Data engineers build and maintain pipelines for collecting, cleaning, and preparing large volumes of data crucial for training generative AI models.
Data Storage and Management: Data engineers are responsible for developing systems to store and manage data generated by generative AI models.
Quality Improvement of Existing Data: Generative AI models, under data engineers' guidance, fill in missing data, correct errors, and generate new features in existing datasets.
Efficiency and Scalability: Data engineers leverage data processing and distributed computing knowledge. Knowledge and skills on AI help engineers design and implement efficient and scalable data pipelines and computing systems for training and running generative AI models.
Reliability and Robustness: Data engineers ensure high-quality data through knowledge of data quality and governance. Data engineer skills are required to train and run generative AI models in a reliable and robust manner.
Accessibility and User-Friendly Models: Data engineers use software engineering and user experience design. These skills are requiered to develop tools and platforms for easy training, running, and deployment of generative AI models.

TARGET AUDIENCE

Data Engineers
Data Architects
Data Scientists
Data Analysts
IT staff, & anyone who needs to work with and structure data for use for analysis, reporting, machine learning or applications

PREREQUISITES

Knowledge of how to engineer foundational data solutions
Knowledge of the various types of data storage and data management techniques that are available in Google Cloud
Understand the modern data stack and how to set up pipelines for data engineering automation
Understand basic data transformation techniques
Knowledge of SQL for basic data engineering operations

LEARNING OUTCOMES

Understand how to engineer advanced data solutions, including setting up Cloud-based data pipelines.

Understand and manage different types of advanced databases (streaming, NoSQL, scalable) and examine when to use the most appropriate type for each situation.

Understand how to design and implement data pipelines, DevOps, and data transformation methods.

Understand advanced structuring and data querying.

Manage data and apply advanced visualization techniques.

OTHER CLOUD DATA ANALYTICS TRANSFORMATION COURSES

Upon successful completion of all "Fundamentals of Data" courses, you will be rewarded with a program certificate on Cloud Data Analytics Transformation, in addition to each individual course certificate.

Application of Data Visualization

Application of Data Science

Fundamentals of Data Visualization

Fundamentals of Data Engineering

Fundamentals of Data Science

MIT INSTRUCTORS

John Williams

Professor of Information Engineering and Civil and Environmental Engineering at MIT

Abel Sanchez

Executive Director, Research Scientist, Laboratory for Manufacturing and Productivity, MIT

The MIT xPRO Learning Experience

We bring together an innovative pedagogy paired with world class faculty.

Learn by doing

Practice process and methods through labs, simulations, assessments, case studies, and tools.

Learn from others

Connect with an international community of professionals while working on projects based on real-world examples.

Learn on demand

Access all of the content online and watch videos on the go.

Reflect and Apply

Bring your new skills to your organization, through examples from technical work environments and ample prompts for reflection.

Demonstrate your success

Earn a Professional Certificate from MIT xPRO and Continuing Education Units (CEUs).

Learn from the best

Gain insights from MIT faculty and industry experts and connect with your course team and faculty over discussion forums and live virtual office hours.

HOW TO ENROLL

Boeing employees: All courses on this page are eligible for the Learning Together Program (LTP). Please check your eligibility to participate and then follow these instructions to enroll. Note: All vouchers must be submitted 5 business days prior to the course start date.

Review LTP policy and process details on Worklife > Browse Menu > Career > Learning Together Program.
Identify the MIT xPRO course(s) you would like to enroll in.
Courses may be added to the LTP system within 60 days of the course start date (U.S.), or up to one year in advance (ILHE – International Locally Hired Employee).
Drop Policy: Course refunds are given (no questions asked) through the first Monday of each course. You must cancel your course in the LTP system as well as with MIT xPRO. Follow instructions on Worklife to cancel in LTP system. To drop with MIT, please email support@xpro.mit.edu.
Go to My LTP from LTP Worklife portal. Select Massachusetts Institute of Technology as the school for enrollment. Complete all required fields on the LTP online enrollment.
U.S. employees will populate a tuition Voucher for billing purposes for each course by way of the LTP enrollment.
Employees outside the U.S. will populate a Sponsorship Letter for billing purposes. Please note:
- International Locally Hired Employees (ILHEs) must personally pay upfront (corp card is not permitted) and request reimbursement from LTP.
- Effective October 1, 2023, ILHEs from India will be asked to add 18% to the tuition price representing the tax levy that India is imposing on all online educational programs from US universities.
Create an account at xpro.mit.edu or login with an existing account. Use one of the supported browsers: Chrome, Safari or Firefox.
U.S. employees must upload the Boeing LTP Voucher to xpro.mit.edu/boeing/upload to authorize payment to be made to school. After you successfully upload your Voucher, you will be asked to confirm your course selection.
ILHE participants must complete this form and upload along with your Sponsorship Letter. Note: ILHE participants will need to upload the school's document of tuition cost for each course and the local payment center will process reimbursement.
You will need to submit your certificate of completion to the LTP system to confirm grade requirements are met and to close out each course.

Important Note:

If errors are found on the Vouchers -- for example, the course start date is incorrect -- MIT xPRO will identify the error and request that you resubmit the Voucher with the correct information.

If you have any questions about the enrollment process or if your Voucher is not accepted, please visit the MIT xPRO Support Center. For LTP-related questions, call or submit an electronic ticket via Worklife > Get Support.