Logo Crossweb

Log in

No account yet? Forgot password

Przypomnij hasło

close Wypełnij formularz.
Na Twój adres e-mail zostanie wysłane link umożliwiający zmianę hasła.
Send
Niestety ta oferta pracy jest już nieaktualna. Sprawdź pozostałe oferty.

Big Data Developer

Added: Over a month ago

Key information

Type: Backend
Level: regular

formal aspects

Contract type: b2b, employment contract

projects

Type of projects:projects for clients
Used Technologies/Tools:
Key: Big Data, Hadoop, Java, Python, Scala, Unix
Auxiliary: NoSQL

work

Working method: Scrum

Required technologies /tools

Expected:
Big Data
Hadoop
Java
Python
Scala
Welcome:
NoSQL

other requirements

Education: university degree
Foreign language: English
Level:
Use in work:
BIG/DATA/DEV/1118/CJ Place of work: Lublin, Wroclaw, Szczecin You are a good match if you:
  • Have at least 2 years experience building Big Data solutions using the Hadoop ecosystem (Hadoop, HDFS,MR framework, YARN, Apache Spark, Hive QL, Sqoop etc.)
  • Have experience with Spark
  • Are proficient in a programming language like Java or Python or Scala
  • Have knowledge and experience in Unix environment & Shell scripting
  • Have RDMS DB background (SQL Server/Oracle and/or DB2) - at least 2 years
  • Have experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems and vice-versa.
  • Have knowledge of workflow/schedulers like Oozie or any other scheduling tool
You get extra points for:
  • Coordinating the movement of data from original data sources into noSQL data lakes and cloud environments
  • Hands-on experience with Talend used in conjunction of Hadoop MapReduce/Spark/Hive.
  • Solid understanding of different file formats and data serialization formats such as ProtoBuf, Avro or JSON.
  • Experience with Google cloud platform (Google BigQuery)
  • Experience in IDE framework like Hue, Jupyter , Zepplin
You will be responsible for:
  • Solving Data Engineering and Data Science problems
  • Development of data ingestion pipelines
  • Contribution to Big Data Team across Poland
You are kindly requested to include one of the following clauses in your application: 1.I hereby grant consent for the processing by intive Spółka Akcyjna of my Personal Data contained in the submitted documents for the purposes of present recruitment processes. Simultaneously, I acknowledge and declare that I have familiarized myself and understood the content of “Information in the scope of processing of Personal Data for recruitment purposes realized by intive Spółka Akcyjna” https://www.intive.com/en/administration-of-personal-data My declaration regarding granting consent has the character of voluntary, specific, conscious and explicit expression of will.   2.I hereby grant consent for the processing by intive Spółka Akcyjna of my Personal Data contained in the submitted documents for the purposes of present and future recruitment processes. Simultaneously, I acknowledge and declare that I have familiarized myself and understood the content of “Information in the scope of processing of Personal Data for recruitment purposes realized by intive Spółka Akcyjna” https://www.intive.com/en/administration-of-personal-data My declaration regarding granting consent has the character of voluntary, specific, conscious and explicit expression of will.
read more»
#Java#Python#Scala#Big Data#Hadoop

Similar offers in your area