Logo Crossweb

Logowanie

Nie masz konta? Zapomniałem hasła

Przypomnij hasło

close Wypełnij formularz.
Na Twój adres e-mail zostanie wysłane link umożliwiający zmianę hasła.
Wyślij
Niestety ta oferta pracy jest już nieaktualna. Sprawdź pozostałe oferty.

Big Data Developer

Dodano: Ponad miesiąc temu

Podstawowe informacje

Typ: Backend
Poziom: regular

formalności

Typ umowy: b2b, Umowa o pracę

projekty

Typ projektów:projekty dla klientów
Wykorzystywane technologie/narzędzia:
Główne: Big Data, Hadoop, Java, Python, Scala, Unix
Poboczne: NoSQL

praca

Metodyka pracy: Scrum

Wymagane technologie /narzędzia

Oczekiwane:
Big Data
Hadoop
Java
Python
Scala
Mile widziane:
NoSQL

inne wymagania

Wykształcenie: wyższe
Język obcy: angielski
Poziom:
Wykorzystanie w pracy:
BIG/DATA/DEV/1118/CJ Place of work: Lublin, Wroclaw, Szczecin You are a good match if you:
  • Have at least 2 years experience building Big Data solutions using the Hadoop ecosystem (Hadoop, HDFS,MR framework, YARN, Apache Spark, Hive QL, Sqoop etc.)
  • Have experience with Spark
  • Are proficient in a programming language like Java or Python or Scala
  • Have knowledge and experience in Unix environment & Shell scripting
  • Have RDMS DB background (SQL Server/Oracle and/or DB2) - at least 2 years
  • Have experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems and vice-versa.
  • Have knowledge of workflow/schedulers like Oozie or any other scheduling tool
You get extra points for:
  • Coordinating the movement of data from original data sources into noSQL data lakes and cloud environments
  • Hands-on experience with Talend used in conjunction of Hadoop MapReduce/Spark/Hive.
  • Solid understanding of different file formats and data serialization formats such as ProtoBuf, Avro or JSON.
  • Experience with Google cloud platform (Google BigQuery)
  • Experience in IDE framework like Hue, Jupyter , Zepplin
You will be responsible for:
  • Solving Data Engineering and Data Science problems
  • Development of data ingestion pipelines
  • Contribution to Big Data Team across Poland
You are kindly requested to include one of the following clauses in your application: 1.I hereby grant consent for the processing by intive Spółka Akcyjna of my Personal Data contained in the submitted documents for the purposes of present recruitment processes. Simultaneously, I acknowledge and declare that I have familiarized myself and understood the content of “Information in the scope of processing of Personal Data for recruitment purposes realized by intive Spółka Akcyjna” https://www.intive.com/en/administration-of-personal-data My declaration regarding granting consent has the character of voluntary, specific, conscious and explicit expression of will.   2.I hereby grant consent for the processing by intive Spółka Akcyjna of my Personal Data contained in the submitted documents for the purposes of present and future recruitment processes. Simultaneously, I acknowledge and declare that I have familiarized myself and understood the content of “Information in the scope of processing of Personal Data for recruitment purposes realized by intive Spółka Akcyjna” https://www.intive.com/en/administration-of-personal-data My declaration regarding granting consent has the character of voluntary, specific, conscious and explicit expression of will.
czytaj więcej»
#Java#Python#Scala#Big Data#Hadoop

Podobne oferty w Twojej okolicy