Rate Limiting

Rate limit the calls the Lenses Agent makes to Schema Registries and Connect Clusters.

Rate limiting calls to Schema Registries and Connect Clusters

To rate limit the calls the Agent makes to Schema Registries or Connect Clusters set the following the Agent configuration:

# schema registry
lenses.schema.registry.client.http.rate.type="sliding" 
lenses.schema.registry.client.http.rate.maxRequests= 200
lenses.schema.registry.client.http.rate.window="2 seconds"

# connect clusters
lenses.connect.client.http.rate.type="sliding"                 
lenses.connect.client.http.rate.maxRequests=200        
lenses.connect.client.http.rate.window="2 seconds"  

The exact values provided will depend on your setup, for example the number of schemas, how often are new schemas added, so some trial and error is required.

Limiting Concurrent SQL Queries

Starting with 6.1.3 version, there's a global limit on concurrent queries, as well as a limit per user. They can be set via the agent configuration:

lenses.sql.settings.max.concurrent.queries=200
lenses.sql.settings.max.concurrent.queries.per.user=2