Lead Data Engineer

We are looking for a Lead Data Engineer to join our growing team and take ownership of designing, building, and scaling modern data platforms. In this role, you’ll lead technical delivery on complex data projects, mentor other engineers, and collaborate closely with business stakeholders to ensure data becomes a true enabler of decision-making.

Who are you?

  • 6+ years of experience delivering data-related projects, from architecture to implementation.

  • Proven expertise in Databricks, Azure or Microsoft Fabric.

  • Strong programming skills in Python and SQL.

  • Solid experience in data architecture and modeling.

  • Excellent communication skills, with the ability to translate technical concepts into business value.

  • Consultancy mindset
  • A proactive, problem-solving mindset and the drive to push projects forward.

  • Nice to have: Experience with Power BI

What can we offer you?

You will work in a growing company with plenty of opportunities for self-growth and for learning new skills. You make up your career and we will guide you! Next to this, you will be able to work on very interesting projects for mainly enterprise companies.

You will be responsible for guiding a team of motivated and highly skilled data engineers, while maintaining flexibility in making architectural decisions for building future-proof data platforms.

To give you a better understanding on what type of profile we are looking for, we want you to meet one of your future colleagues.

Meet Vincent

I am an experienced Java developer and Data Engineer with a broad skillset that enables me to setup on-premise and cloud based scalable and performant data-driven applications, using technologies like Apache Spark and Kafka. I’m a certified AWS developer with relevant experience in both AWS (using EMR, Glue, Kinesis, SageMaker, Redshift and more) and Azure Cloud platform (Synapse, Fabric or Databricks).

My hands-on experience has lead me to a more architectural role, where I support organizations in making the right architectural decisions, aswell as with the implementation.

Oh yeah, and I also love gaming, Star Wars, Marvel, beer and pizza!

Years at the farm

I’ve been at the farm for 10 exciting years!

Favourite language

My absolute favourite is Java, followed by Scala

Education

I have a bachelor in Information Management

Made in

The beautiful city of Antwerp

Skills

Great minds come with great skills

Technical skills

Java77%
77%
Scala75%
75%
Python80%
80%
Apache Spark80%
80%
AWS (Amazon Web Services)70%
70%
Azure (Synapse, Fabric, Databricks, …)68%
68%
Apache Airflow65%
65%
TerraForm70%
70%
Apache Flink68%
68%
Kubernetes65%
65%

Personal skills

Communication77%
77%
Trustworthy90%
90%
Business minded75%
75%
Teamplayer82%
82%
Technical Coaching85%
85%

Projects

What kind of projects can you expect

Big Data Environment setup

Data Engineer

Set up of a new Big Data Cluster at VDAB for the standardization of the intake and processing of different data sources, and for the creation of a framework to aid the staff in the development and deployment of new data sources. We use Spark for disributed processing.

Apache Spark

Scala

Hadoop

Supply Chain Platform

Data Engineer

Maintaining a Spark architecture with Scala for mapping supply chain business processes an for batch tracing. We used Azure Databricks for the cluster management of spark jobs and the creation of Delta Lake layers enabling us to run Spark code on the datasets.

Apache Spark

Scala

Databricks

Streaming architecture

Data Tech Lead

Providing support to a data team in altering their current functions to a batch/streaming architecture. I’m using Apache Hadoop and Kafka to setup the Streaming architecture and I evaluated the capabilities of the application on Graph Databases.

Apache Spark

Scala

Hadoop

Are you looking for a job like Vincent?

Leave your contact details and we will be in touch with you shortly

How do we work

Upload your cv
Are you a good fit on paper? Let’s meet!

The Match
We look at your goals, what you are looking for in a job and if we find a good match for that within the farm

Let’s get technical!
We do a technical deep dive into the past projects you did so we learn what you can teach us

Meet the farmers
You talk to some of your future colleagues. The atmosphere in our team is most important to us, so we need to make sure you’re fun to work with

The decision.
We meet with all interviewers and see if we can’t find any reasons not to hire you. We are looking for the creme de la creme

The gates are open.
We make you an offer you can’t refuse and tell you all about your new role within the company