4.3

Release notes

2.2.0 

  • AWS S3 Sink Connector
    • Prevent null pointer exception in converters when maps are presented will null values
    • Offset reader optimisation to reduce S3 load
    • Ensuring that commit only occurs after the preconfigured time interval when using WITH_FLUSH_INTERVAL
  • AWS S3 Source Connector (New Connector)
  • Cassandra Source Connector
    • Add Bucket Timeseries Mode
    • Reduction of logging noise
    • Proper handling of uninitialized connections on task stop()
  • Elasticsearch Sink Connector
    • Update default port
  • Hive Sink
    • Improve Orc format handling
    • Fixing issues with partitioning by non-string keys
  • Hive Source
    • Ensuring newly written files can be read by the hive connector by introduction of a refresh frequency configuration option.
  • Redis Sink
    • Correct Redis writer initialisation

2.1.0 

  • AWS S3 Sink Connector
  • Elasticsearch 7 Support

2.0.1 

  • Hive Source

    • Rename option connect.hive.hive.metastore to connect.hive.metastore
    • Rename option connect.hive.hive.metastore.uris to connect.hive.metastore.uris
  • Fix Elastic start up NPE

  • Fix to correct batch size extraction from KCQL on Pulsar

2.0.0 

  • Move to Scala 2.12
  • Move to Kafka 2.4.1 and Confluent 5.4
  • Deprecated:
    • Druid Sink (not scala 2.12 compatible)
    • Elastic Sink (not scala 2.12 compatible)
    • Elastic5 Sink(not scala 2.12 compatible)
  • Redis
    • Add support for Redis Streams
  • Cassandra
    • Add support for setting the LoadBalancer policy on the Cassandra Sink
  • ReThinkDB
    • Use SSL connection on Rethink initialize tables is ssl set
  • FTP Source
    • Respect connect.ftp.max.poll.records when reading slices
  • MQTT Source
    • Allow lookup of avro schema files with wildcard subscriptions