BITE-SIZED NEWS

Exam Professional Data Engineer topic 1 question 286 discussion - ExamTopics

See original article

Problem

Migrate thousands of Apache Spark jobs from an on-premises Apache Hadoop cluster to Google Cloud, minimizing code changes and using managed services.

Options

  • A. Move data to BigQuery; convert Spark scripts to SQL.
  • B. Rewrite jobs in Apache Beam; run on Dataflow.
  • C. Copy data to Compute Engine disks; manage jobs directly on instances.
  • D. Move data to Cloud Storage; run jobs on Dataproc.

Suggested Answer

The suggested answer is D: Move data to Cloud Storage and run jobs on Dataproc.

Sign up for a free account and get the following:
  • Save articles and sync them across your devices
  • Get a digest of the latest premium articles in your inbox twice a week, personalized to you (Coming soon).
  • Get access to our AI features
    • Sign In With Google Sign Up With Email