Building an IoT Analytics Pipeline on Google Cloud | GSP088 | Data Engineering #2
Overview
The term Internet of Things (IoT) refers to the interconnection of physical devices with the global Internet. These devices are equipped with sensors and networking hardware, and each is globally identifiable. Taken together, these capabilities afford rich data about items in the physical world.
Cloud IoT Core is a fully managed service that allows you to easily and securely connect, manage, and ingest data from millions of globally dispersed devices. The service connects IoT devices that use the standard Message Queue Telemetry Transport (MQTT) protocol to other Google Cloud data services.
Cloud IoT Core has two main components:
A device manager for registering devices with the service, so you can then monitor and configure them.
A protocol bridge that supports MQTT, which devices can use to connect to Google Cloud.
What You’ll Learn
In this lab, you will dive into Google Cloud’s IoT services and complete the following tasks:
Connect and manage MQTT-based devices using Cloud IoT Core (using simulated devices)
Ingest a stream of information from Cloud IoT Core using Cloud Pub/Sub.
Process the IoT data using Cloud Dataflow.
Analyze the IoT data using BigQuery.
Prerequisites
This is an advanced level lab and having a baseline level of knowledge on the following services will help you better understand the steps and commands that you’ll be writing:
BigQuery
Cloud Pub/Sub
Dataflow
IoT
If you want to get up to speed in any of the above services, check out the following Qwiklabs:
BigQuery: Qwik Start – Console
Weather Data in BigQuery
Dataflow: Qwik Start – Templates
Internet of Things: Qwik Start
#BigQuery_wikStart _Console
#WeatherDataBigQuery
#DataflowQwikStartTemplates
#InternetofThingsQwikStart
linux foundation
