Senior Data Platform Engineer

Senior Data Platform Engineer

 

Senior Software Engineer (Data Platform) to join our client’s Data Engineering team. In this role you will play key part in developing a next generation Data Platform to support all their operational processes, data sciences and business intelligence data processing.

Technologies

If you have a passion for writing data processing software, including acquisition, cleansing, correlation, organization, analysis and machine learning, and the challenge of building a new data infrastructure from the ground up excites you, we would love to hear from you. The team works with the following technologies:

 

  • The Hadoop ecosystem
  • Relational data modeling and batch processing on SQL databases
  • Distributed processing framework like Spark
  • Streaming data platforms like Kafka or AWS Kinesis
  • Realtime stream processing frameworks like Spark Streaming, Samza or Kafka Stream
  • Cloud computing systems like Amazon Web Services
  • Big Data analytics tools like Hive or Spark SQL

Responsibilities

  • 5+ years of experience working as a software developer in Data Engineering, Data Warehousing/BI team
  • 5+ years of experience in Java/Python development
  • 3+ years of experience in SQL and Relational Databases
  • Experience with unit testing frameworks like JUnit or TestNG
  • Extensive experience working with structured and unstructured data platforms, ELT/ETL, and Data Modeling
  • Experience with data warehousing and BI platforms
  • Knowledge and experience with big data systems such as Hadoop, Spark is a plus