Description

Are you driven by Technology?

If so, it is at red.it that you should embrace your next challenge!

We took the first steps in Innovation and Technology in 2016 and the will to do more and better is always with us.

Join the Wolfpack as a Data Engineer (Full-Remote/Hybrid - Porto)!

What skills do you need to have:

• Degree in Computer Science, Information Technology, or a related field.
• 4+ years of proven experience as a Data Engineer with hands-on expertise in Cloudera, Hadoop, Hive, Impala, DataStage, Spark, Python, MicroStrategy, Power BI, SQL, and Oracle databases.
• Strong understanding of ETL processes, data modeling, and data warehousing concepts.
• Experience with designing and developing data visualizations and dashboards.
• Proficiency in performance tuning and optimization techniques for big data environments.
• Ability to collaborate effectively with cross-functional teams and communicate technical concepts to non-technical stakeholders.
• Problem-solving skills and an analytical mindset to address complex data challenges.
• Familiarity with agile development methodologies is a plus.
• Proficiency in English (technical).

Some of your responsibilities will be:

• Collaborate with cross-functional teams to understand data requirements and design scalable and efficient data pipelines.
• Develop and maintain ETL processes using tools like DataStage to extract, transform, and load data from various sources into our data lake.
• Utilize Cloudera and Hadoop ecosystem tools to manage and process large datasets efficiently.
• Design and implement data models for MicroStrategy and Power BI to create insightful and interactive dashboards.
• Develop and maintain data processing jobs using Apache Spark and Python to enable advanced analytics and machine learning.
• Optimize query performance for Hive and Impala to ensure efficient data retrieval and analysis.
• Work with SQL and Oracle databases to manage structured data and maintain data integrity.
• Collaborate with data scientists, analysts, and business stakeholders to ensure data quality and availability for analytics initiatives.
• Participate in data architecture design and contribute to data warehouse enhancements.
• Document technical specifications, processes, and best practices for data engineering and data modeling.
• Stay up-to-date with emerging trends and technologies in the data engineering and analytics space.

• A team focused on meeting goals, you won't be short of motivation! Red Team
• Red Training - We want to help you reach your potential.
• Ongoing follow-up and career counselling. Red Follow Up
• Red Change - Do you love what you do, but want to explore other areas? No problem Wolf!
• There's time for everything and fun is not left out.
• Red Hours
• Red Spirit - If you want to go fast, go alone, if you want to go far, GO TOGETHER!

Keywords: Data Warehousing, Data Modeling, ETL, Big Data, SQL, Cloudera, Python, R

WHAT DRIVES YOU?

Apply through [email protected] and find out what drives us at www.redit.pt