Senior Data Engineer (Data Platform Databricks)
Job Description
Project Description:
The Senior Engineer - Data Governance & Platform Lead (IB&M) is a hands-on senior technical role responsible for defining, implementing, and governing the IB&M Data Platform with a strong focus on data governance, quality, lineage, security, and platform standards.
The role will work closely with Global Markets, Investment Banking, Risk, Compliance, and Analytics teams to ensure data is trusted, compliant, and scalable across the enterprise. This is not a people management role but requires strong technical leadership and ownership across the data lifecycle.
Responsibilities:
Data Governance & Control- Define and implement data governance frameworks covering:
o Data ownership, stewardship, and accountability
o Data quality rules, controls, and monitoring
o Metadata management, data cataloging, and lineage- Ensure compliance with regulatory, risk, and internal governance requirements across IB&M data assets
- Partner with Risk, Compliance, and Audit teams to support regulatory use cases and thematic reviews
- Lead the design and evolution of the IB&M Data Platform, aligned with enterprise standards
- Drive governance capabilities across the Lakehouse architecture (ADLS, Databricks, Delta Lake)
- Define platform standards for:
o Data ingestion (batch / micro-batch / streaming)
o Schema enforcement and validation
o Data modeling and standardization
o Secure data access and entitlements
Architecture & Engineering- Act as a technical authority for data architecture decisions within IB&M
- Review and guide solution designs produced by internal teams and vendors
- Ensure scalability, performance, reliability, and cost efficiency of the platform
- Support hybrid architectures (Cloud + On Prem) where required by business or regulatory constraints
- Work closely with Data Engineering, Analytics, BI, AI/ML, and Business teams
- Enable self service analytics while maintaining strong governance controls
- Provide technical guidance, best practices, and design reviews across IB&M initiatives
- Support onboarding of new use cases onto the GM / IB&M Data Platform
Mandatory Skills Description:
- 10+ years of experience in Data Engineering, Data Platforms, or Data Architecture
- Proven experience leading data governance initiatives in large, regulated environments (Banking/Financial Services preferred)
- Strong background supporting Global Markets / Investment Banking data domains is highly desirable
Technical Skills:
- Strong hands-on experience with:
o Azure Data Lake (ADLS)
o Databricks / Delta Lake / Lakehouse architectures
o Data quality, schema enforcement, and validation frameworks- Experience with data cataloging and governance tools (e.g., Unity Catalog, Informatica Axon or similar)
Solid understanding of:
o Data modeling (analytical and canonical models)
o Metadata management and lineage
o Secure data access and entitlements- Good understanding of AI/ML and analytics enablement within governed data platforms
Nice-to-Have Skills Description:
- Strong ownership mindset with ability to work independently
- Excellent stakeholder management and communication skills
- Ability to translate regulatory and business requirements into technical solutions
- Comfortable working in complex, multi vendor, enterprise environments