Bloomberg Source

Download connector Bloomberg Connector for Kafka 2.1.0 Bloomberg Connector for Kafka 1.0

A Bloomberg Kafka Connector to subscribe to Bloomberg feeds and source via the Bloomberg labs open API data and write to Kafka.

Prerequisites

  • Apache Kafka 0.11.x or above
  • Kafka Connect 0.11.x or above
  • Bloomberg subscription

Connector QuickStart

The easiest way to quick-start with this connector is to try out the Lenses Development Environment as it’s a docker image ready for your laptop, runs Kafka and Kafka Connect, and has the connector already available in the classpath

Select Connectors -> New Connector -> Bloomberg and paste the following configuration.

../../_images/lenses-create-bloomberg-source-connector.png

Note

You will need a Bloomberg subscription to proceed

name=bloomberg-source
connector.class=com.datamountaineer.streamreactor.connect.bloomberg.BloombergSourceConnector
connect.bloomberg.server.host=localhost
connect.bloomberg.server.port=8194
connect.bloomberg.service.uri=//blp/mkdata
connect.bloomberg.subscriptions=AAPL US Equity:LAST_PRICE,BID,ASK;IBM US Equity:BID,ASK,HIGH,LOW,OPEN
connect.bloomberg.authentication.mode=USER_AND_APPLICATION
connect.bloomberg.authentication.mode=bloomberg
connect.bloomberg.buffer.size=4096
connect.bloomberg.payload.type=avro
connect.bloomberg.kafka.topic=bloomberg

Configurations

The Kafka Connect framework requires the following in addition to any connectors specific configurations:

Config Description Type Value
name Name of the connector string  
tasks.max The number of tasks to scale output int 1
connector.class Name of the connector class string com.datamountaineer.streamreactor.connect.bloomberg.BloombergSourceConnector

Connector Configurations

Config Description Type
connect.bloomberg.server.host The bloomberg endpoint host to connect to string
connect.bloomberg.server.port The bloomberg endpoint port to connect to string
connect.bloomberg.service.uri Which Bloomberg service to connect to. Can be //blp/mkdata or //blp/refdata string
connect.bloomberg.authentication.mode
The mode to authentication against the Bloomberg server.
Either APPLICATION_ONLY or USER_AND_APPLICATION
string
connect.bloomberg.subscriptions
Specifies which ticker subscription to make. The format is TICKER:FIELD,FIELD,..;
e.g. AAPL US Equity:LAST_PRICE;IBM US Equity:BID
string
connect.bloomberg.kafka.topic The The topic to write Bloomberg data to string
connect.bloomberg.payload.type
Specifies the way the information is serialized and sent over kafka
There are two modes supported: json(default) and avro
string

Optional Configurations

Config Description Type Default
connect.bloomberg.buffer.size
The buffer accumulating the data updates received from Bloomberg. If not provided
it will default to 2048. If the buffer is full and a new update will be received it
won’t be added to the buffer until it is first drained
int 2048
connect.progress.enabled Enables the output for how many records have been processed boolean false

TroubleShooting

Please review the FAQs and join our slack channel