Features, Improvements & Fixes

Changelog details for Lenses 6.1.3

New 🎉

Kafka to Kafka Replication

The latest release of Lenses K2K integration now supports bi-directional. This feature allows data to be copied from Cluster A's Topic One to Cluster B's Topic Two and vice versa. The bi-directional support ensures that the data does not replicate indefinitely, preventing continuous loops. Two K2K instances should be deployed one copying from cluster A to cluster B, the second one from cluster B to cluster A, and both should have the bi-directional flag on.

SQL Studio

A bunch of great improvements to make the experience of building and troubleshooting streaming applications better.

Topic and Schema listing support

In addition to the global topic listing page, in Studio you can now list all topics and schemas per environment. The listing, as a tab, in Studio, provides all the same functionality as the main topic listing, but allows you to split the view for IDE style work, list all your topics, while you work on schema or other resources in one view.

Click the "open listing in a new tab" on the topic or schema nodes in the navigation tree.

Preview Panel

We added a preview panel to help you quickly identify key information about topics, such as replication factor, message counts, size and partitions.

Improved search

A new search has been added, its more intuitive and lists per resource type what is found, and giving you access to the context menu actions available.

Bookmark Schemas

You can now bookmark schemas in addition to environments and topics.

IAM Role Policy creation & templates

The IAM role policy creation flow now lets you directly choose from a default template and select groups to add the role to, previously this had to be performed in separate steps.

Additionally the Policy editor has been enhanced with more JSON schema support, a problem panel to see issues and a diff editor to see what you have changed in the policy.

Alerts

Alert events are now available in HQ, no need to drill down to the Legacy Agent UX to:

1. View events
2. Manage alert channels
3. Create alert rules

Audits

Audit events are now available in HQ, no need to drill down to the Legacy Agent UX to:

1. View audit events
2. Manage audit channels

CLI SQL Studio Support

The lenses-cli now supports SQL Studio operations

Improvements 💪

Collapsible configuration panel

Details pages now include fully collapsible side panels.

Topic details page on the Topics screen has been simplified and improved to share the basic information.

Bulk Actions

Kafka ACL, Quotas and Data policies now support bulk deletion allowing you to delete multiple in one go.

SQL Processors Avro alias support

Avro schema support field alias. With this release, SQL processors support writing queries referencing the alias field. For example given this schema:

{
  "type": "record",
  "name": "InsuranceContribution",
  "namespace": "com.example.insurance",
  "doc": "Insurance contribution payment record",
  "fields": [
    {
      "name": "id",
      "type": "string"
    },
    {
      "name": "paymentDuration",
      "aliases": [
        "contributionDuration"
      ],
      "type": [
        "null",
        "int"
      ],
      "default": null,
      "doc": "Payment duration in months"
    },
    {
      "name": "amount",
      "type": [
        "null",
        "double"
      ],
      "default": null
    },
    {
      "name": "timestamp",
      "type": {
        "type": "long",
        "logicalType": "timestamp-millis"
      }
    }
  ]
}

The following SQL processor projection is valid:

INSERT INTO alias_avro_copied
SELECT STREAM
  contributionDuration as a,
  paymentDuration as b 
FROM alias_avro

Numerous UX improvements

• Added quick access to legacy agent UI from HQ environments
• Excel-style cell selection in data grids
• Better diff visualization when editing environments
• and much more

Fixes 🛠️

• Fixed duplicate alert rule creation for consumer and producer alerts
• Fixed tag visibility in topic drawer
• Fixed topic marker sizing and letter centering
• Fixed reset button not clearing grid filters
• Fixed Monaco tooltip display in SQL studio
• Fixed YAML worker disposal and file upload issues
• Improved IAM policy examples and core roles