[Romario77]

pull vs push. Plus if you start storing the last timestamp so you only select the delta and if you start sharding your db and dealing with complexities of having different time on different tables/replication issues it quickly becomes evident that Kafka is better in this regard.

But yeah, for a lot of implementations you don't need streaming. But for pull based apps you design your architecture differently, some things are a lot easier than it is with DB, some things are harder.

[ahoka]

Funny you mention that, because Kafka consumers actually pull messages.

[politelemon]

What is the reason for using Kafka then, sorry if I'm missing something fundamental.

[ycombinatrix]

Not by busy waiting in a loop on a database query though.