Overview
Join over 9 million learners and start Building Data Engineering Pipelines in Python today!
In any data-driven company, you will undoubtedly cross paths with data engineers. Among other things, they facilitate some of your work by making data readily available to everyone within the organization, and possibly in bringing machine learning models into production. One way to speed up this process is through building an understanding of what it means to bring processes into production and what features are of high-grade code. In this course, we’ll be looking at various data pipelines the data engineer is building, and how some of the tools he or she is using can help you in getting your models into production or run repetitive tasks consistently and efficiently.
In this Building Data Engineering Pipelines in Python course at Data Camp, we illustrate common elements of data engineering pipelines. In Chapter 1, you will learn how to ingest data. Chapter 2 will go one step further with cleaning and transforming data. In Chapter 3, you will learn how to safely deploy code. Finally, in Chapter 4 you will schedule complex dependencies between applications.Programme Structure
Chapters include:
- Ingesting Data
- Testing your data pipeline
- Creating a data transformation pipeline with PySpark
- Managing and orchestrating a workflow
Key information
Duration
- Part-time
- 1 days
Start dates & application deadlines
You can apply for and start this programme anytime.
Language
English
Delivered
Online
Disciplines
Software Engineering View 548 other Short Courses in Software Engineering in United StatesAcademic requirements
We are not aware of any specific GRE, GMAT or GPA grading score requirements for this programme.
English requirements
We are not aware of any English requirements for this programme.
Other requirements
General requirements
Prerequisites
- Introduction to Shell
- Intermediate Importing Data in Python
- Introduction to Data Engineering
- Introduction to PySpark
- Unit Testing for Data Science in Python
Tuition Fee
To always see correct tuition fees
-
International
FreeTuition FeeBased on the tuition of 0 USD for the full programme during 1 days. -
National
FreeTuition FeeBased on the tuition of 0 USD for the full programme during 1 days.
Basic Access: Free; Premium (for individuals): $12.42 per month billed annually; Teams: $25 per month billed annually; Enterprise: Contact sales for pricing
Funding
Improve page content