Description
Stefanini is hiring Lisbon-based Kafka Principal Engineers to join one of our clients.
This is a hybrid role requiring working from the office for one or two days per week.
Responsibilities:
- Provide expertise and hands on experience working on Kafka connect using schema registry in a very high-volume environment (~900 Million messages)
- Provide expertise and hands on experience working on Kafka connectors such as MQ connectors, Elastic Search connectors, JDBC connectors, File stream connector, JMS source connectors, Tasks, Workers, converters, Transforms.
- Provide expertise and hands on experience on custom connectors using the Kafka core concepts and API.
- Provide expertise and hands on experience working on AvroConverters, JsonConverters, and StringConverters and different data format like JSON, AVRO, Proto Buff.
- Create topics, setup redundancy cluster, deploy monitoring tools, alerts and has good knowledge of best practices and industry standards.
- Create stubs for producers, consumers and consumer groups for helping onboard applications from different languages/platforms. Leverage Hadoop ecosystem knowledge to design, and develop capabilities to deliver our solutions using Spark, Scala, Python, Hive, Kafka and other things in the Hadoop ecosystem.
- Provide expertise in Kafka brokers, zookeepers, KSQL, KStream, KTable and Kafka Control Centre.
- Use automation tools like provisioning using Jenkins and Azure DevOps.
Role requirements:
- Experience with messaging and stream processing on Kafka.
- Expertise on queue based and pub-sub messing process.
- Working knowledge on Kafka Rest proxy.
- Operational and deployment knowledge on different Kafka object.
- Good knowledge on writing KStream and KSQL involving complex schema.
- Good experience on error tracing and handling.
- Being a Confluent Certified Developer for Apache Kafka® is a major nice-to-have.
- Availability to travel to Holland for 1 or 2 weeks per year.
Nice-to-have factors:
- Ability to perform data related benchmarking, performance analysis and tuning.
- Strong skills in In-memory applications, Database Design, Data Integration
- Relational and/or NOSQL Databases
- Well versed with Java, Spring boot, REST APIs, micro-services and docker
- Ability to build libraries and utilities for Kafka
- Any knowledge on Kafka testing
- Retail Knowledge
- Having practitioner experience of reimagining legacy middleware stack and e-commerce decomposition with event streaming
What we offer:
- Health insurance
- Opportunities to learn and develop: training programs for hard and sofskills
- Referral bonuses
Diversity & Inclusion
Here at the Stefanini Group, we value plurality and equity, regardless of race, sexual orientation, disability, age, ancestry, religion, gender, and nationality. We understand and encourage the importance of being you!
What's next:
It's best to apply today, because job postings can be taken down and we wouldn't want you to miss this opportunity.
Please send us your updated CV to [email protected] using Kafka23 as subject.
About us
We are a Brazilian company with over 30 years of experience in delivering IT services worldwide, ranging from IT outsourcing to application development or IT staffing. We have a direct presence in 39 countries, through our 88 offices located throughout the world and we enjoy working for over 500 active clients. While more than 300 of them are multinational corporations, we have managed to become the preferred partner of many small-to-midsize local and regional companies as well. Most of our clients come from industries such as financial services, manufacturing, telecommunications, chemical, services, technology, public sector and utilities.
Stefanini has career opportunities locally and around the world for professionals interested in a vibrant, passionate, team-oriented workplace. If you are a customer-centric person with a "get it done" attitude, come over for coffee and a talk on your future career with us!
Learn more about us on www.stefanini.com and join us on LinkedIn, Facebook and Instagram where we regularly post insights from our colleagues.