The Kafka connector integrates seamlessly with Apache Kafka, enabling efficient data streaming and event processing. It offers robust capabilities for secure, scalable, and real-time data exchange.
Authentication
Before you begin integration, ensure you have the following information:
Connection Name
: Choose a meaningful name for your connection. This name helps you identify the connection within your application or integration settings. It could be something descriptive like "MyAppKafkaIntegration".Bootstrap Server URLs
: Broker server URLs separated by a comma (","). Eg: kafka-broker-001:9092,kafka-broker-002:9092Endpoint
(Deprecated): The Kafka brokers' IP address or DNS name.Port Number
(Depracated): The port on which your Kafka server listens for connections. Default value: 9094.Database Username
: The authenticated user with the permissions to read tables in your database.Database Password
: The password for the database user.Topic Prefix
: The prefix to filter topics by. Leave blank to fetch all topics.Properties
: Kafka connections often require advanced configurations through key-value pairs to tailor the connection to specific security protocols and operational needs. These properties can be set here.Key
: The property key. Kafka-specific configuration options can be set here. Example: “sasl.mechanism”.Value
: The value for the specified property key. Example: “PLAIN”.
SSL Secure
: Enable this option to Connect over an SSL-encrypted connection.Client Certificate
: Obtain a valid client certificate from a trusted Certificate Authority (CA). This certificate authenticates your client to the database server.SSL Certificate Key
: This private key corresponds to your client certificate.Server Certificate
: Obtain the database server's SSL certificate. This certificate verifies the server's identity to your client. Often provided by your database administrator or hosting service.
Actions
Actions | Description |
| Bulk Create records in Kafka |
| Commit offsets in Kafka |
| Create a record in Kafka |
| Creates a topic in Kafka |
| Gets group metadata from Kafka |
| Gets topic metadata from Kafka |
| Polls for new records from Kafka topic |
Triggers
Triggers | Description |
| Triggers on record in Kafka |