Apache Pekko Connectors Kafka Documentation
Release Notes
Type to start searching
apache/pekko-connectors-kafka
Apache Pekko Connectors Kafka Documentation
apache/pekko-connectors-kafka
Java
Scala
Overview
Project Info
Matching Kafka Versions
Dependencies
Scala and Java APIs
Examples
Contributing
Release Notes
License Report
Producer
Choosing a producer
Settings
Producer as a Sink
Producing messages
Producer as a Flow
Connecting a Producer to a Consumer
Sharing the KafkaProducer instance
Accessing KafkaProducer metrics
Send Producer
Consumer
Choosing a consumer
Settings
Offset Storage external to Kafka
Offset Storage in Kafka - committing
Offset Storage in Kafka & external
Consume “at-most-once”
Consume “at-least-once”
Connecting Producer and Consumer
Source per partition
Sharing the KafkaConsumer instance
Accessing KafkaConsumer metrics
Accessing KafkaConsumer metadata
Controlled shutdown
Subscription
React on Partition Assignment
Consumer Metadata
Service discovery
Dependency
Configure consumer settings
Configure producer settings
Provide a service name via environment variables
Specify a different service discovery mechanism
Use Config (HOCON) to describe the bootstrap servers
Apache Pekko Cluster Sharding
Project Info
Dependency
Setup
Sharding Message Extractors
Rebalance Listener
Error handling
Failing consumer
Failing producer
Restarting the stream with a backoff stage
Unexpected consumer offset reset
At-Least-Once Delivery
Multiple Effects per Commit
Non-Sequential Processing
Conditional Message Processing
Transactions
Transactional Source
Transactional Sink and Flow
Consume-Transform-Produce Workflow
Caveats
Further Reading
Serialization
Protocol buffers
Jackson JSON
Spray JSON
Avro with Schema Registry
Debugging
Logging with SLF4J
Receive logging
Testing
Running Kafka with your tests
Alternative testing libraries
Mocking the Consumer or Producer
Testing with a Docker Kafka cluster
Production considerations
Apache Pekko Connectors Kafka API
Security setup
Snapshots
Configure repository
Documentation
Versions
link
Apache Software Foundation
link
License
link
Security
link
Privacy
link
Events
link
Donate
link
Thanks
label_outline
1.1.0
Release Notes
Release Notes (1.1.x)
Release Notes (1.0.x)
Edit this page
1.1.0