Data Engineer (QR6016)

Data Engineer (QR6016)


Intern

19/09/2018


  • Omschrijving

    Functie: Data Engineer (QR6016)
    Start: 1-10-2018, 36 uur per week
    Periode: 3 mnd+
    Omgeving: Amsterdam

    Omschrijving:
    For our client in Amsterdam we are looking for a Data Engineer.

    As a Data Engineer you will further develop and maintain our data products and further develop the architecture of our platform and create new architectures for incoming projects.

    Your passion is to work with the latest and greatest technologies that make working with large amounts of data easy, you’re pro-active in keeping yourself up to date and are always searching for new ways to discover new technologies. You also enjoy laying the architectural foundations for the things you’re working on. You combine both thinking of the future and a hands on, right now attitude. You will work in a team with highly skilled people and enjoy a creative atmosphere where trying things out is encouraged.

    As a Data Engineer you are the single most important part of the team. You are able to combine Software Engineering with Machine Learning. Without your work, nothing moves, data sits idle and useless in a DB. You are the one combining these sources in real-time, distributed systems to handle large amounts of data loads in no-time. You work on the APIs that deliver personal and relevant insights to the customer. Data scientists, analysts, business users, CEO’s are continuously praising you, thanking you, worshipping you….

    Job description:
    Your passion is to work with the latest and greatest technologies in the field of Data Engineering. You will work as an engineer on different projects. With this team, you will be building new capabilities, help to launch new initiatives and support teams and their projects.

    Profile:
    - Knowledge of data manipulation and transformation, e.g. SQL
    - Hands-on experience building complex data pipelines e.g. ETL
    - Hands-on experience managing and further developing distributed systems and clusters for both batch as well as streaming data (Hadoop/Spark and/or Kafka/Flink)
    - Programming in scripting languages, e.g. Python
    - Programming in a statically typed language, e.g. Scala
    - Experience in setting up both SQL as well as noSQL databases
    - Deployment and provisioning automation tools e.g. Docker, Kubernetes, Openshift, CI/CD
    - Bash scripting and Linux systems administration
    - Security, authentication and authorization (LDAP / Kerberos / PAM)
    - Affinity with Predictive Analytics, Data Science

    Our stack:
    Docker / Kubernetes / Openshift
    Kafka
    Spark
    Flink
    REST Api
    Cassandra (and other noSQL DBs)
    Scala
    Python
    Polymer (nice to have)
    Airflow (nice to have)


    Extra informatie:
    Qualogy streeft ernaar om iedere kandidaat binnen 5 werkdagen een persoonlijke reactie te sturen.
    Indien de klant een security screening vereist zijn de (eenmalige) kosten hiervan voor eigen rekening.

  • Omschrijving Freelancer

  • Gebruikersnaam

    U dient in te loggen om gebruik te maken van Opdrachten.nl

  • Opdrachtrubriek

    ICT (applicaties en software)

  • Locatie Opdracht

    Amsterdam

  • Provincie

    Noord-Holland

  • Bijlagen

  • Gewenste Reacties

    Bedrag per uur

  • Verspreiden via social media