Description

INTEGER, a technology consulting company with over a decade of presence in the Portuguese market, is looking for a PySpark Engineer with strong communication skills and a sense of responsibility and teamwork.

Mandatory Skills:

Senior experience on ETL pipeline development, Python programming, scripting with PySpark/Scala,  + Senior experience on .NET Core ( > 3.1 ), C#, Docker, K8, GCP Cloud.

Role Description Skills:

Senior experience on ETL pipeline development, Python programming, scripting with PySpark/Scala, Docker etc.

•Strong analytical skills who can analyse the data inconsistencies and derive meaningful insights from the large data.

•Good knowledge on Hadoop Architecture and its ecosystem.

•Experience in optimizing Hive SQL queries and Spark Jobs.

•Problem-solving skills including knowledge of data structure and algorithms.

•Experience on agile software development process.

•Spark experience using python on Dataproc/Cloudera is desired.

•Like to collaborate within engineering and beyond.

If you have the amazINg talent and want to be part of the INTEGER team, answer this announcement with your updated CV to [email protected]  

Participating in this project means integration in a solid growing company and a young and dynamic team. #jumpIN

To know more about how we protect your privacy, check out our GDPR Policy at www.integerconsulting.pt