Professional Data Engineer

The published domains and objectives for Professional Data Engineer. Your missions come from these objectives, and your progress is recorded against them.

• 22%

  1

  Designing data processing systems

  • 1.1Designing for security and compliance
  • 1.2Designing for reliability and fidelity
  • 1.3Designing for flexibility and portability
  • 1.4Designing data migrations

• 25%

  2

  Ingesting and processing the data

  • 2.1Planning the data pipelines
  • 2.2Building the pipelines
  • 2.3Deploying and operationalizing the pipelines

• 20%

  3

  Storing the data

  • 3.1Selecting storage systems
  • 3.2Planning for using a data warehouse
  • 3.3Using a data lake
  • 3.4Designing for a data platform

• 15%

  4

  Preparing and using data for analysis

  • 4.1Preparing data for visualization
  • 4.2Preparing data for AI and ML
  • 4.3Sharing data

• 18%

  5

  Maintaining and automating data workloads

  • 5.1Optimizing resources
  • 5.2Designing automation and repeatability
  • 5.3Organizing workloads based on business requirements
  • 5.4Monitoring and troubleshooting processes
  • 5.5Maintaining awareness of failures and mitigating impact