317. WJUG -A.Adamchik "Can we use big data techniques without big data infr"[EN]

[Event in English]

We are very happy to host a international guest this time for a one-time only event. Andrus Adamchik will talk about a data processing issue using the DataFrame tooling.

Let's meet in Paramount office:

ul. Mokotowska 19

October 1s 2024, 6:00 PM

Andrus Adamchik - "DataFrame - a Swiss Army Knife of Java Data Processing"

Abstract:

Can we use big data techniques without big data infrastructure? As Java developers, we deal with data processing all the time: analyzing app logs, extracting data from Excel, copying tables between databases, etc. Yet, the “standard” Java falls short in processing capabilities compared to more complex and heavy tools like Spark or Flink.

This talk is about “DataFrame” - a 2-dimensional in-memory table structure that provides filtering, column / row operations, joins, aggregations, window functions, etc. I will use an open source DFLib library (https://dflib.org) and a Jupyter notebook to demonstrate how to do data processing and visualization in a Java app with DataFrames without much fuss.

* Event for 18+ only