Add Amazon Kinesis Data Streams as source in Real-Time hub

This article describes how to add Amazon Kinesis Data Streams as an event source in Fabric Real-Time hub.

Prerequisites

• Access to a workspace in the Fabric capacity license mode or the Trial license mode with Contributor or higher permissions.
• An Amazon Web Services (AWS) account with the Kinesis Data Streams service enabled.
• Your Amazon Kinesis data stream must be publicly accessible and not be behind a firewall or secured in a virtual network. If it resides in a protected network, connect to it by using Eventstream connector virtual network injection.

Data sources page

1. Sign in to Microsoft Fabric.

2. If you see Power BI at the bottom-left of the page, switch to the Fabric workload by selecting Power BI and then by selecting Fabric.

   

3. Select Real-Time on the left navigation bar.

   

4. The Streaming data page opens by default. Click on the Add data button to get to the Data sources page.

   

   You can also get to the Data sources page directly by selecting the Add data option in the left navigation bar.

   

Select Amazon Kinesis Data Streams as data source type

On the Data sources page, search for Amazon Kinesis Data Streams, and select Connect on the Amazon Kinesis Data Streams tile.

Configure and connect to Amazon Kinesis Data Streams

1. On Connect, select New connection to create a connection.

   

2. In Connection settings, enter the data stream name from Amazon Kinesis for Data Stream name.

   

3. In Connection credentials, complete the following steps:

   1. Enter a name for this cloud connection in Connection name.
   2. Confirm that Kinesis key is selected for Authentication kind.
   3. Enter the credentials you use to access your Kinesis Data Stream for API Key and API Secret. Go to the Amazon Identity and Access Management (IAM) console and select Security credentials. Copy an Access Key ID from the Access keys screen and paste it into API Key and API Secret.

   

4. Select Connect.

   

5. On Connect, enter a source name for this new eventstream source in Source name.

6. Scroll down, and under Configure Amazon Kinesis data source, enter a Region for the data source. You can find the Amazon region code such as us-west-2 from the Kinesis Data stream summary.

   

Stream or source details

1. On the Connect page, follow one of these steps based on whether you're using Eventstream or Real-Time hub.

   • Eventstream:

     In the Source details pane to the right, follow these steps:

     1. For Source name, select the Pencil button to change the name.

     2. Notice that Eventstream name and Stream name are read-only.

   • Real-Time hub:

     In the Stream details section to the right, follow these steps:

     1. Select the Fabric workspace where you want to create the eventstream.

     2. For Eventstream name, select the Pencil button, and enter a name for the eventstream.

     3. The Stream name value is automatically generated for you by appending -stream to the name of the eventstream. This stream appears on the real-time hub's All data streams page when the wizard finishes.

2. Select Next at the bottom of the Configure page.

Review and connect

On the Review + connect screen, review the summary, and select Add (Eventstream) or Connect (Real-Time hub).

View data stream details

1. On the Review + connect page, if you select Open eventstream, the wizard opens the eventstream that it created for you with the selected Confluent Cloud Kafka source. To close the wizard, select Close at the bottom of the page.
2. You should see the stream in the Recent streaming data section of the Real-Time hub home page. For detailed steps, see View details of data streams in Fabric Real-Time hub.

Related content

To learn about consuming data streams, see the following articles:

• Process data streams
• Analyze data streams
• Set alerts on data streams