247. Warszawa JUG
- 18:15 - Konrad Szatan - Journey through real time data distribution with Kafka pipelines
Opis prelekcji:
In this new data intensive world
data distribution became one of main concerns in systems world wide. With message brokers like Kafka we have proper tooling to achieve desired goal, but are we doing it good enough?
In this session I want to tell you our story about using various databases changelogs as continuous source of data. I will describe how we have on-boarded Kafka Connect and Kafka Streams to stream real time changes wherever we needed them. What problems have we encountered during that journey? What have we learnt from building data distribution platform and what we would had changed as take away for you. All of that deployed to Kubernetes and strictly monitored to ensure our colleagues that their data are safe and up to date.
Serdecznie zapraszamy na 247. spotkanie Warszawa JUG, które odbędzie się 5. marca o godzinie 18:15 w sali 3180 (2. piętro) Wydziału Matematyki, Informatyki i Mechaniki Uniwersytetu Warszawskiego przy ulicy Banacha 2.