Data Engineer

MCS Group is seeking a number of Data Engineers as part of an exclusive project within one of Northern Ireland's most exciting technology companies. Off the back of recent business wins, our client is looking to grow their teams and seeking talented data professionals to join them. The ideal candidate will have a strong background in data engineering, with exposure to building and maintaining scalable data pipelines, including commercial expertise in Hadoop and PySpark. You will work closely with data scientists, analysts, and other software engineering teams in a high-growth business which is projecting huge growth in 2025 and beyond.

The Role

• The Data Engineer will design, develop, and maintain data pipelines using Hadoop and PySpark for large-scale data processing.
• You'll collaborate with cross-functional teams to understand data requirements and deliver data solutions that meet business needs.
• Ensure the quality, reliability, and efficiency of data processing workflows.
• Perform data transformation, integration, and aggregation tasks using PySpark.
• Troubleshoot and resolve data issues and performance bottlenecks in the pipeline.
• Implement data governance and security best practices across the data infrastructure.

The Person

• You'll have strong experience with Hadoop ecosystem tools (HDFS, Hive, Pig, etc.).
• Proficiency in PySpark for data processing and transformation.
• Solid understanding of distributed computing and data processing at scale.
• Experience with SQL and NoSQL databases.
• Knowledge of data warehousing and ETL concepts.
• Familiarity with cloud platforms (AWS or Azure) is a plus.
• Excellent problem-solving skills and ability to work in a collaborative team environment.

Salary

Up to £70,000 with package which includes bonus, private medical, opportunity for certifications and future share options.

To speak in absolute confidence about this opportunity, please send an up-to-date CV via the link provided or contact Chris Busby, Associate Director - IT Recruitment UK & Ireland, at MCS Group

Even if this position is not right for you, we may have others that are. Please visit MCS Group to view a wide selection of our current and exclusive roles www.mcsgroup.jobs

All conversations will be treated in the strictest of confidence.