Single Message Transforms InsertWallclockDateTimePart A Kafka Connect Single Message Transform (SMT) that inserts the system clock year, month, day, minute, or seconds as a message header, with a value of type STRING.
Use InsertWallclockHeaders SMT if you want to use more than one date time part. This avoids multiple SMTs and is more efficient.
For example, if you want to partition the data by yyyy-MM-dd/HH
, then you can use InsertWallclockHeaders
which inserts multiple headers: date, year, month, day, hour, minute, second.
Transform Type Class
Copy io.lenses.connect.smt.header.InsertWallclockDateTimePart
Configuration
Name
Description
Type
Default
Valid Values
Importance
The name of the header to insert the timestamp into.
The date time part to insert.
year, month, day, hour,minute, second
Sets the timezone. It can be any valid java timezone.
Example
To store the year, use the following configuration:
Copy transforms= InsertWallclockDateTimePart
transforms.InsertWallclockDateTimePart.type= io.lenses.connect.smt.header.InsertWallclockDateTimePart
transforms.InsertWallclockDateTimePart.header.name= wallclock
transforms.InsertWallclockDateTimePart.date.time.part= year
To store the month, use the following configuration:
Copy transforms= InsertWallclockDateTimePart
transforms.InsertWallclockDateTimePart.type= io.lenses.connect.smt.header.InsertWallclockDateTimePart
transforms.InsertWallclockDateTimePart.header.name= wallclock
transforms.InsertWallclockDateTimePart.date.time.part= month
To store the day, use the following configuration:
Copy transforms= InsertWallclockDateTimePart
transforms.InsertWallclockDateTimePart.type= io.lenses.connect.smt.header.InsertWallclockDateTimePart
transforms.InsertWallclockDateTimePart.header.name= wallclock
transforms.InsertWallclockDateTimePart.date.time.part= day
To store the hour, use the following configuration:
Copy transforms= InsertWallclockDateTimePart
transforms.InsertWallclockDateTimePart.type= io.lenses.connect.smt.header.InsertWallclockDateTimePart
transforms.InsertWallclockDateTimePart.header.name= wallclock
transforms.InsertWallclockDateTimePart.date.time.part= hour
To store the hour, and apply a timezone, use the following configuration:
Copy transforms= InsertWallclockDateTimePart
transforms.InsertWallclockDateTimePart.type= io.lenses.connect.smt.header.InsertWallclockDateTimePart
transforms.InsertWallclockDateTimePart.header.name= wallclock
transforms.InsertWallclockDateTimePart.date.time.part= hour
transforms.InsertWallclockDateTimePart.timezone= Asia/Kolkata
To store the minute, use the following configuration:
Copy transforms= InsertWallclockDateTimePart
transforms.InsertWallclockDateTimePart.type= io.lenses.connect.smt.header.InsertWallclockDateTimePart
transforms.InsertWallclockDateTimePart.header.name= wallclock
transforms.InsertWallclockDateTimePart.date.time.part= minute
To store the second, use the following configuration:
Copy transforms= InsertWallclockDateTimePart
transforms.InsertWallclockDateTimePart.type= io.lenses.connect.smt.header.InsertWallclockDateTimePart
transforms.InsertWallclockDateTimePart.header.name= wallclock
transforms.InsertWallclockDateTimePart.date.time.part= second
Last updated 8 months ago