SQL Streaming

Streaming SQL processing of real-time data can run in three modes:

  • Kubernetes : the preferred and advised option. It offers best isolation and scaling capabilities which come out of the box with Kubernetes
  • Kafka Connect: the second option to use, if Kubernetes is not available. Never run a Connect Cluster in Kubernetes to run SQL processor in CONNECT mode.
  • Lenses process or in-process : for low data-in-motion volume only or for non-production environments
Streaming SQL runs as KStreams in memory/in threads within the Lenses JVM.
Deploy SQL Processor to Kafka Connect.
Deploy SQL Processor to Kubernetes.