Senior Data Engineer - Financial Markets (Contract)

Job Description

Work Location: Abu Dhabi, UAE

Mandatory Requirements:

• Candidate must have 8-9 years of experience from a leading stock exchange industry (e.g., Dubai, London, etc.).
• Candidate must be currently working for and available in the UAE.

Job Purpose:

The Data Engineer plays a crucial role in developing and optimizing our data architecture to support data-driven initiatives and enhance overall business intelligence.

Key Accountabilities:

• Design, implement, and maintain scalable and robust data architecture to support business needs.
• Collaborate with stakeholders to understand data requirements and ensure alignment with organizational goals.
• Develop and implement efficient Extract, Transform, Load (ETL) processes to integrate data from various sources.
• Ensure data integrity and quality throughout the ETL pipeline.
• Develop and implement event streaming framework and services (e.g., Kafka).
• Design and manage relational and non-relational databases, ensuring optimal performance and scalability.
• Implement database optimization strategies and conduct performance tuning.
• Utilize big data technologies (Hadoop, Spark, Kafka) to process and analyze large volumes of data.
• Implement solutions for real-time data streaming and processing.
• Develop and maintain data models for efficient storage and retrieval of information.
• Collaborate with data scientists and analysts on data requirements for analytical purposes.
• Create and maintain metadata repositories, documenting data lineage, definitions, and relationships.
• Implement and enforce metadata management best practices.
• Implement data quality checks and validation processes to ensure accuracy and reliability.
• Collaborate with cross-functional teams to address and resolve data-related issues.

Stakeholder Management:

• External: Manage all external entities with development scope under core functionality of Data and BI Engineering.

Qualification & Education:

• Bachelor&aposs degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer or in a similar role.
• Overall Experience: 89 years of experience

Technical Skills:

• Strong proficiency in SQL and database management systems (e.g., MySQL, PostgreSQL, MongoDB).
• Experience with big data technologies (Hadoop, Spark) and data processing frameworks.
• Knowledge of ETL tools and techniques.
• Knowledge of DevOps practices.
• Knowledge of event streaming frameworks (Kafka, Event Hub, Apache Storm, Stream Analytics, etc.).

Non-Technical Skills:

• Excellent problem-solving and analytical skills.