Data?1602756024
Data Engineer @ Integer Consulting

Description

Integer is a Portuguese consulting company specialized in Technology and Information Systems. Our core business is IT outsourcing services, software, nearshore projects, and tailor made solutions. We are partners with the main technology players worldwide and we work with national and multinational companies from several industries. Most of the projects we participate are in Portugal, Brazil, and throughout Europe. What set us apart is the experience of our team and our tech talent.

Are you looking for new opportunities in the IT field? We have news for you!

We’re looking for a Data Engineer with strong communication skills and a sense of responsibility and teamwork.

In this project, your main tasks are:

• Create and maintain optimal data pipeline architecture Assemble large, complex data sets that meet functional / non-functional business requirements Identify, design, and implement internal process improvements;

• Automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc;

• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics Work with data and analytics experts to strive for greater functionality on data systems;

Technical Requirements:

• Experience building and optimizing data pipelines, architectures, and data sets;

• Experience performing root cause analysis on data pipelines and identify opportunities for improvement;

• Experience with object-oriented/functional/scripting languages: Python, Java, Scala;

• Good knowledge of SQL; Experience with Apache Spark (EMR, Databricks, HDInsight);  

• Knowledge of Unix shell scripting (ex: Bash);

• Experience with Airflow (nice to have, not mandatory);

• Knowledge of Docker and Kubernetes (nice to have, not mandatory).

If you have the desired amazINg tech talent and want to be part of the INTEGER team, respond to this ad with your updated CV to [email protected]

To learn more about how we protect your privacy, please see our Policy at integerconsulting.pt