Overview
Are you looking for a hybrid or remote work opportunity? Are you interested in a workplace that allows for flexibility in your day? Are you ready for a workplace that provides benefits that suit your needs?
Join our team as we innovate the future of data platform architecture, enabling massive scaling and data processing for ML and Gen AI projects. You'll be at the forefront of processing vast unstructured data, building high-throughput APIs, and supporting distributed compute frameworks for seamless model deployment. Ready to dive into the heart of cutting-edge tech?
Your role in action
- Build our next-generation data platform tooling and servicesto support the ingestion and processing of billions of documents at scale.
- Improve and extend our Spark based distributed data processing pipeline.
- Improve and extend our Rust based distributed query engine used to request large amounts of document data.
- Create tools to automate and optimize processes across disciplines
- Actively participate in the on-call schedule to investigate and fix production issues related to our data processing pipeline or query engine.
- Participate in code reviews for projects written by your team
- Focus on quality through comprehensive unit and integration testing
