Welcome to GenAI Cracow #11 - first edition in 2025.

​It is time to start the year with a bang. For those who still believe 2025 will be a year of AI agents, we will have a take on the observability and a stream from a hackathon!

​​Agenda

• ​See through your AI: Enhancing LLM transparency with Datadog observability by Bartek
• ​AgentON winners live stream
• ​​Networking led by Urszula

​​Abstract

​See through your AI: Enhancing LLM transparency with DataDog observability

Do you have any AI solutions in production? If so, you must have heard about observability. If you did not, please do not say that out loud. DataDog platform offers end-to-end observability of applications, including visibility into LLM chains, enabling real-time monitoring of response quality, latency, and security threats. Learn how to detect hallucinations, optimize token usage, retrieve specific information from a database, and implement robust privacy safeguards while mitigating prompt hacking risks.

​AgentON Hackathon

Can you imagine a hackathon with a "No Human in the Loop" track, where agents compete autonomously? Top that with only 24h to deliver a public demo. This is the AgentON hackathon. Don't worry, they also have less hardcore tracks like "Needle in a Haystack". Teams are competing to be featured on 150k subscribers Youtube channel led by Matt Chrobok.

​​Speakers

​Bartek Staszkiewicz

Co-founder & CTO @ CIstarius, Data & AI Architect @ Crestt, and a Data Consultant @ Numlabs. He specializes in advanced big data solutions (i.e., Snowflake) and production data and AI/ML observability. Bartek orchestrates data-driven digital transformations across energy, adtech, and finance industries, including companies such as Bayer, Volkswagen, AerCap, Respect Energy, SwissRe, and Alior Bank.

​​Urszula Zemlińska-Sikora

With 7 years of experience in IT project management, Urszula leads several GenAI initiatives with a successful track record. Her teams integrate and develop GenAI products. She holds an MBA and is a PhD candidate, focusing on IT team communication. Since 2023, she organizes 'AGILE pod Wawelem' meetups and runs ITProjects4all, mentoring new IT talent.