Edit

Share via

Get events from Google Cloud Pub/Sub into Real-Time hub

This article describes how to add Google Cloud Pub/Sub as an event source in Fabric Real-Time hub. Google Pub/Sub is a messaging service that enables you to publish and subscribe to streams of events.

Prerequisites

  • Access to a workspace in the Fabric capacity license mode (or) the Trial license mode with Contributor or higher permissions.
  • A Google Cloud account with the Pub/Sub service enabled and a role with the required permissions.
  • Your Google Cloud Pub/Sub source should be publicly accessible and not be behind a firewall or secured in a virtual network. If it resides in a protected network, connect to it by using Eventstream connector virtual network injection.

Data sources page

  1. Sign in to Microsoft Fabric.

  2. If you see Power BI at the bottom-left of the page, switch to the Fabric workload by selecting Power BI and then by selecting Fabric.

    Screenshot that shows how to switch to the Fabric workload.

  3. Select Real-Time on the left navigation bar.

    Screenshot that shows how to launch Connect to data source experience.

  4. The Streaming data page opens by default. Click on the Add data button to get to the Data sources page.

    Screenshot that shows the Data sources page in the Real-Time hub.

    You can also get to the Data sources page directly by selecting the Add data option in the left navigation bar.

    Screenshot that shows the Connect data source button.

On the Data sources page, select Google Cloud Pub/Sub.

Screenshot that shows the Select a data source page with Google Cloud Pub/Sub selected.

Configure Google Cloud Pub/Sub source

  1. On the Connect screen, under Connection, select New connection.

    Screenshot that shows the Connect page for Google Cloud Pub/Sub.

  2. On the Connection settings screen, fill out the required information.

    A screenshot of the Connection settings for the Google Cloud Pub/Sub source.

  3. For Project ID, enter the Project ID from your Google Cloud Console.

    A screenshot of the Project ID in the Google Cloud Console.

  4. For Subscription name, open your Google Pub/Sub and select Subscriptions. You can find the Subscription ID in the list.

    A screenshot of a computer Description automatically generated.

  5. Service account key is a JSON file that contains the credentials of your service account. Follow the next steps to generate the file in Google Cloud.

    1. Select IAM & Admin in your Google Cloud Console.

      A screenshot of selecting IAM & Admin in Google Cloud Console.

    2. On the IAM & Admin page, under Service Accounts, select CREATE SERVICE ACCOUNT.

      A screenshot of selecting Create service account.

    3. After configuring, give your role appropriate Owner permission, and then select Done.

      A screenshot of giving your role Owner permissions and then selecting Done.

    4. On the Service accounts page, select your role and then select Manage keys under Actions.

      A screenshot of selecting Manage keys under Actions.

    5. Under ADD KEY, select Create new key.

      A screenshot of selecting Create new key.

    6. Download the JSON file, copy the JSON content, and enter it as Service account key on the Fabric Connection settings screen.

      Important

      This JSON file can be downloaded only once.

  6. Select Connect on the Connection settings screen.

Stream or source details

  1. On the Connect page, follow one of these steps based on whether you're using Eventstream or Real-Time hub.

    • Eventstream:

      In the Source details pane to the right, follow these steps:

      1. For Source name, select the Pencil button to change the name.

      2. Notice that Eventstream name and Stream name are read-only.

    • Real-Time hub:

      In the Stream details section to the right, follow these steps:

      1. Select the Fabric workspace where you want to create the eventstream.

      2. For Eventstream name, select the Pencil button, and enter a name for the eventstream.

      3. The Stream name value is automatically generated for you by appending -stream to the name of the eventstream. This stream appears on the real-time hub's All data streams page when the wizard finishes.

  2. Select Next at the bottom of the Configure page.

Review and connect

On the Review + connect screen, review the summary, and select Add (Eventstream) or Connect (Real-Time hub).

View data stream details

  1. On the Review + connect page, if you select Open eventstream, the wizard opens the eventstream that it created for you with the selected Google Cloud Pub/Sub as a source. To close the wizard, select Close or X* in the top-right corner of the page.
  2. You should see the stream in the Recent streaming data section of the Real-Time hub home page. For detailed steps, see View details of data streams in Fabric Real-Time hub.

Related content

To learn about consuming data streams, see the following articles:

  • Last updated on