1 of 5

Connectors

This page describes how Lenses integrates with Kafka Connect to create, manage, and monitor connectors via multiple connect clusters.

Overview

This page describes an overview of managing Kafka Connectors in Lenses.

For documentation about the available Lenses Apache 2.0 Connectors, see the Stream Reactor documentation.

To connect your Connect Clusters see provisioning.

Lenses connects to Connect Clusters via Connects APIs. You can deploy connectors outside of Lenses and Lenses will still be able to see and manage them

You can connect Lenses to one or more Kafka Connect clusters. Once connected, Lenses will list the available Connector plugins installed in each Cluster. Additionally, Connectors can automatically be restarted and alert notifications sent.

Listing Connectors

To list the deployed connectors go to Environments->[Your Environment]->Workspace->Connectors. Lenses will display a list of connectors and their status.

View Connector details

Once a connector has been created, selecting the connector allows us to:

View its configuration
Update its configurations (Action)
View individual task configurations
View metrics
View exceptions.

View a Connector as Code

To view the YAML specification as Code, select the Code tab in the Connector details page.

Download a Connector as Code

To download the YAML specification, click the Download button.

Creating a Connector

To create a new connector go to Environments->[Your Environment]->Workspace->Connectors->New Connectors.

Select the Connect Cluster you want to use and Lenses will display the plugins installed in the Connect Cluster.

Connectors are searchable by:

Type
Author

After selecting a connector, enter the configuration of the connector instance. Lenses will show the documentation for the currently selected option.

To deploy and start the connector, click Create.

Create a Connector as Code

Creation of a Connector as code can be done via either

Selecting Environments->[Your Environment]->Connectors->Configure Connector->Configure As Code from the main connector page, or
Selecting a Connect Cluster and Connector, then the Code tab

Both options allow for direct input of a Connectors YAML specification or uploading of an existing file.

Managing a Connector's lifecycle

Connectors can be stopped, restarted, and deleted via the Actions button.

Sources

This page describes the available Apache 2.0 Source Connectors from Lenses. Lenses can also work with any other Kafka Connect Connector.

Lenses supports any Connector implementing the Connect APIs, bring your own or use community connectors.

Enterprise support is also offered for connectors in the Stream Reactor project, managed and maintained by the Lenses team.

Sinks

This page describes the available Apache 2.0 Sink Connectors from Lenses. Lenses can also work with any other Kafka Connect Connector.