Stream Data from Remote Sources
- Capella Analytics
- how-to
If you want to stream data to your Capella Analytics database, you create a remote data source.
Capella Analytics streams data from remote data sources and stores it in one or more collections. As long as it remains connected to the remote source, Capella Analytics copies any changes in the remote data to the local copy. If you disconnect it from the remote source, Capella Analytics still retains a copy of the data. If you later reconnect the link, it catches up on any updates it missed and continues streaming data changes.
Configuring Streaming
Configuring Capella Analytics to stream data from a remote source is a three-step process:
-
Create a Capella Analytics remote link that defines the data source and the credentials to access the data.
-
Create a linked collection to receive the streamed data.
-
Connect the link to start the flow of data.
The collections Capella Analytics saves the streamed data into are dedicated to streamed data. To shadow data in different source topics or collections, you set up a collection for each one. You can associate all of the collections that require the same access credentials with the same link.
Required Privileges
Your Capella Analytics account must have either the Project Owner or Project Manager role to be able to create a link and its associated collection.
In addition, you must have credentials to connect to the remote system and access the data you want to stream.