#1 Tech Bytes @ Ocado Technology
We have the pleasure to invite you to the #1 meet’up in the series of Tech Bytes @Ocado Technology, during which we will focus on delivering data products at scale - both in terms of petabytes and the number of engaged teams.
We will run a series of three 20-minute presentations, featuring data experts from Ocado Technology. We’ll start at 18:00 at our office, located in High5ive Building 4 (Pawia 21). We have a great event space on our 4th floor.
***Agenda***
18:00 - Grab a drink and take a seat
18:10 - 18:30 Tomasz Stradomski, Principal Data Engineer at Ocado Technology
Topic: From batch to stream - an evolution of data engineering @Ocado
About: Ocado is the world’s largest online supermarket and provider of cutting-edge technology for online retail. We build a modern Data Lake solution using multiple technologies on top of Google Cloud Platform. In this session I’ll briefly tell you what our Data Platform looks like and what the plans for the future are. You will have a chance to hear about the lessons we learned and why we believe the future is in nearly real time event processing - using lightweight, lambda-oriented architecture and self service toolkit for Data Producers.
18:30 - 18:50 Matusz Rataj, Software Engineer at Ocado Technology
Topic: How we get data from (almost) all apps in the company to a Data Lake
About: Ocado’s philosophy is to make decisions based on data. Every second, customers and tools in our warehouses generate tons of them. But how to guarantee that the decisions will be made based on the complete set of the data? In this session, I would like to describe our approach to event ingestion, and how we adopted Google Cloud Dataflow and Apache Beam to read and process more than 1 billion events per day.
18:50 - 19:10 Mateusz Radko, Senior Software/Cloud Engineer at Ocado Technology
Topic: Scalable cloud infrastructure management with Terraform
About: Maintaining cloud infrastructure in a consistent and efficient manner can be a difficult task. It becomes even harder if you have many customers for which you have to provide working instances. Terraform can be really helpful for achieving that goal. I will tell you about our use case and what we have learnt about adopting infrastructure as a code at scale over the last 3 years. I will also touch on how we use those learnings to minimise the amount of work needed to create a new Data Lake instance.
***Meet the speakers***
* Tomasz Stradomski - Principal Data Engineer at Ocado Technology
* Mateusz Rataj - Software Engineer at Ocado Technology
* Mateusz Radko - Senior Software/Cloud Engineer at Ocado Technology
