SQL Studio

A declarative SQL interface, for querying, transforming and manipulating data at rest and data in motion. It works with Apache Kafka topics and other data sources. It helps developers and Kafka users

The Lenses SQL Snapshot engine accesses the data at the point in time the query is executed. This means, that for Apache Kafka, data added just after the query was initiated will not be processed.

Typical use cases are but are not limited to:

• Identifying a specific message.

• Identifying a particular transaction of payment that your system has processed

• Identifying all thermostats readings for a specific customer if you are working for an energy provider

• Counting transactions processed within a given time window.

The Snapshot engine presents a familiar SQL interface, but remember that it queries Kafka with no indexes. Use Kafka's metadata (partition, offset, timestamp) to improve query performance.

Global Studio

To write queries from HQ, select the SQL icon from the left hand side bar. From here you can search for topics across the environments.

Selecting a topic will automatically fire a query to show you the latest data in the topic (default to limit 10 records).

Each tab can be:

1. renamed

2. clone

3. closed

By selecting the ellispe (thee dots) in the results grid you can further filter and perform actions on the resultset

This is based on the data returned by the query in the grid. To filter on the backend of Lenses adjust the SQL Statement.

Comparing data between environments

To compare data, clone the tab left or right and change the environment connection in the tab.

Agent Studio

To write queries at the agent level. Go to Environments->[Your Environment]->Workspace->Sql Studio, enter your query, and click run.