Exam Professional Machine Learning Engineer topic 1 question 177 discussion - ExamTopics


AI Summary Hide AI Generated Summary

Problem:

A Vertex AI pipeline with two steps (data preprocessing and model training) needs optimization to reduce execution time and cost while enabling testing of different algorithms. The preprocessing step takes an hour for 10 TB of data.

Options:

  • A. Add a pipeline parameter and step to conditionally skip preprocessing.
  • B. Create a new pipeline without preprocessing, hardcoding the preprocessed data location.
  • C. Increase CPU/RAM for the preprocessing step.
  • D. Enable caching for the pipeline job, disabling it for model training.

Solution:

The suggested answer is D. Enabling caching for the pipeline job allows reuse of the preprocessed data, avoiding repeated processing. Disabling caching for model training ensures the use of the latest algorithm version.

Sign in to unlock more AI features Sign in with Google

You have created a Vertex AI pipeline that includes two steps. The first step preprocesses 10 TB data completes in about 1 hour, and saves the result in a Cloud Storage bucket. The second step uses the processed data to train a model. You need to update the modelโ€™s code to allow you to test different algorithms. You want to reduce pipeline execution time and cost while also minimizing pipeline changes. What should you do?

  • A. Add a pipeline parameter and an additional pipeline step. Depending on the parameter value, the pipeline step conducts or skips data preprocessing, and starts model training.
  • B. Create another pipeline without the preprocessing step, and hardcode the preprocessed Cloud Storage file location for model training.
  • C. Configure a machine with more CPU and RAM from the compute-optimized machine family for the data preprocessing step.
  • D. Enable caching for the pipeline job, and disable caching for the model training step.
Show Suggested Answer Hide Answer
Suggested Answer: D ๐Ÿ—ณ๏ธ

Was this article displayed correctly? Not happy with what you see?

Tabs Reminder: Tabs piling up in your browser? Set a reminder for them, close them and get notified at the right time.

Try our Chrome extension today!


Share this article with your
friends and colleagues.
Earn points from views and
referrals who sign up.
Learn more

Facebook

Save articles to reading lists
and access them on any device


Share this article with your
friends and colleagues.
Earn points from views and
referrals who sign up.
Learn more

Facebook

Save articles to reading lists
and access them on any device