...
It is a common use case to capture changes as they are made to data entities in a RDBMS into Kafka topics using Change Data Capture platform. These data entities typically have multiple one-to-many relationships between parent and child database tables which allows for the easy data management of these entities using SQL statements with foreign key table join.
Gliffy Diagram | ||||||||
---|---|---|---|---|---|---|---|---|
|
Streams falls short here and the workaround (group by - join - lateral view) is not well supported as well and is not in line with the idea of record based processing.
...