Description

Integer is a Portuguese consulting company specialized in Technology and Information Systems. Our core business is IT outsourcing services, software, nearshore projects, and tailor-made solutions. We are partners with the main technology players worldwide and we work with national and multinational companies from several industries. Most of the projects we participate are in Portugal, Brazil, and throughout Europe. What set us apart is the experience of our team and our tech talent.

We’re looking for Data Engineer.

This could be the perfect challenge if you have:

- Minimum 2 years’ experience

- Experience building and optimizing data pipelines, architectures, and data sets.

- Experience performing root cause analysis on data pipelines and identify opportunities for improvement.

- Experience with object-oriented/functional/scripting languages: Python, Java, Scala (master at least one).

- Good knowledge of SQL (mandatory).

- Experience with Apache Spark (EMR, Databricks, HDInsight) (mandatory).

- Knowledge of Unix shell scripting (ex: Bash).

- Experience with Airflow (nice to have, not mandatory).

- Knowledge in Azure Cloud Services, Azure Data Lake, Azure Databricks, Networking, Security (nice to have, not mandatory).

- Knowledge of Docker and Kubernetes (nice to have, not mandatory).

- Familiarity with stream-processing systems: Apache Kafka, Apache Spark-Streaming (nice to have, not mandatory).

- Experience with big data tools like Apache Sqoop, Apache NiFi, Apache Kafka (nice to have, not mandatory).

- Bachelor’s Degree in Engineering, Computer Science, or other related discipline.

Main responsibilities:

- Create and maintain optimal data pipeline architecture;

- Assemble large, complex data sets that meet functional / non-functional business requirements;

- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc;

- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources;

- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics;

- Work with data and analytics experts to strive for greater functionality in our data systems.

If you have the desired amazINg tech talent and want to be part of the INTEGER team, respond to this ad with your updated CV to [email protected]

To learn more about how we protect your privacy, please see our Policy at www.integerconsulting.pt