Exam Professional Data Engineer topic 1 question 284 discussion - ExamTopics


A data engineer needs to store and efficiently access time-series data from 1000 sensors, requiring both low-latency retrieval and daily complex analytics, leading to the optimal solution of using Bigtable for storage with daily exports to BigQuery.
AI Summary available — skim the key points instantly. Show AI Generated Summary
Show AI Generated Summary

You have a network of 1000 sensors. The sensors generate time series data: one metric per sensor per second, along with a timestamp. You already have 1 TB of data, and expect the data to grow by 1 GB every day. You need to access this data in two ways. The first access pattern requires retrieving the metric from one specific sensor stored at a specific timestamp, with a median single-digit millisecond latency. The second access pattern requires running complex analytic queries on the data, including joins, once a day. How should you store this data?

  • A. Store your data in BigQuery. Concatenate the sensor ID and timestamp, and use it as the primary key.
  • B. Store your data in Bigtable. Concatenate the sensor ID and timestamp and use it as the row key. Perform an export to BigQuery every day.
  • C. Store your data in Bigtable. Concatenate the sensor ID and metric, and use it as the row key. Perform an export to BigQuery every day.
  • D. Store your data in BigQuery. Use the metric as a primary key.
Show Suggested Answer Hide Answer
Suggested Answer: B 🗳️

Was this article displayed correctly? Not happy with what you see?

Taskify Tabs Logo
💡 Tip: Keep your browser clean

If you're reading a lot of articles and drowning in open tabs, try our official companion tool, Taskify Tabs. It instantly converts your cluttered open tabs into an organized task board so you can save articles for later and free up memory.

Install Taskify Tabs for Chrome →

Share this article with your
friends and colleagues.

Facebook



Share this article with your
friends and colleagues.

Facebook