{{theTime}}

Search This Blog

Total Pageviews

Kafka Consumer Parallelism

Kafka Parallel Consumer Options:

Key-level parallelism:  Multiple threads process the messages from a single partition in parallel while maintaining the Kafka's key-based ordering.

Unordered Parallelism:  Multiple threads will process the messages from a single partition in an arbitrary order.

Partition-level parallelism:  Partition per topic provides the no of consumers that can be executed in parallel.


No comments:

Generate Insert Sql from Select Statement

SELECT 'INSERT INTO ReferenceTable (ID, Name) VALUES (' +        CAST(ID AS NVARCHAR) + ', ''' + Name + ''...