Lead Data Engineer
Mastercard · Posted Oct 6
Global technology company connecting consumers, financial institutions, merchants, and businesses through secure payment processing and digital commerce solutions
Get a personal compatibility score
Add a resume for personal matches
About the role
Mastercard Services is a key differentiator delivering data-driven capabilities across consulting, analytics, experimentation, and risk management for some of the world's largest organizations, operating within a global payments technology company. The Data Platform & Orchestration team is seeking a Lead Data Engineer to design and build next-generation, cloud-native data platforms supporting Mastercard's global data ecosystem. The role leads development of scalable batch and real-time data pipelines across Data Lakes and Data Warehouses, working at the intersection of data engineering, cloud platforms, and distributed systems.
What you will do
- Design and build scalable batch and real-time data pipelines using Spark, Kafka, and (preferred) Apache Flink
- Develop robust ETL/ELT frameworks for structured and unstructured data
- Build and optimize data ingestion and transformation pipelines for Data Lakes and Data Warehouses
- Implement stream processing solutions for near real-time use cases
- Ensure data quality, lineage, observability, and governance across pipelines
- Optimize data jobs for performance, scalability, and cost efficiency
- Design and operate cloud-native data platforms on AWS, Azure, or GCP
- Leverage managed services such as S3/ADLS/GCS, EMR/Databricks, BigQuery/Redshift/Snowflake
- Implement Infrastructure as Code (Terraform, CloudFormation, or equivalent)
- Ensure high availability, fault tolerance, and disaster recovery
- Drive cost optimization strategies for large-scale data workloads
- Implement secure data access controls aligned with enterprise standards
- Build reusable data frameworks, libraries, and pipeline templates
- Drive adoption of CI/CD, automated testing, and observability
- Develop and enhance developer tooling and platform capabilities
- Contribute to cloud-agnostic platform architecture and automation
- Provide technical leadership, mentorship, and design guidance
- Conduct code reviews, architecture reviews, and best practice enforcement
- Collaborate with architects, product owners, and cross-functional teams
- Act as a Subject Matter Expert (SME) for data platform initiatives
- Promote engineering excellence through documentation, design standards, and innovation
- Work effectively across globally distributed teams
Skills used in this role
What the employer is looking for
- Strong proficiency in Object-Oriented Programming and Design (OOP/OOAD) Java (JDK 8+); Python and/or Go is a plus
- Experience building data services and distributed systems
- Strong understanding of multithreading, scalability, and performance tuning
- Strong hands-on experience with AWS, Azure, or GCP
- Experience with cloud-native data services (S3, ADLS, GCS, Databricks, EMR, BigQuery, Redshift)
- Strong experience with Apache Spark (Core, SQL, Structured Streaming)
- Hands-on experience with Kafka or equivalent messaging platforms
- Experience with real-time processing frameworks (Apache Flink preferred or Spark Streaming)
- Strong understanding of ETL/ELT design patterns and pipeline architectures
- Experience with data formats (Parquet, Avro, ORC)
- Knowledge of data modeling (dimensional modeling, star/snowflake schemas)
- Proficiency in Infrastructure as Code (Terraform, CloudFormation, ARM templates)
- Experience with Docker and Kubernetes
- Solid understanding of cloud networking, IAM, and security best practices
- Experience with workflow orchestration tools (Airflow or equivalent)
- Strong SQL skills and experience with Data Warehouse platforms
- Understanding of data governance, lineage, and observability frameworks
- Experience with CI/CD tools (Jenkins, GitHub Actions, etc.)
- Strong testing practices (JUnit or equivalent frameworks)
- Experience with monitoring & observability (Splunk, Dynatrace, Prometheus, etc.)
- Familiarity with performance testing tools (JMeter, Gatling)
- Understanding of secure development practices (PCI DSS, GDPR, etc.)
- Proven ability to lead and mentor engineering teams
- Strong problem-solving and system design skills
- Passion for innovation, automation, and continuous improvement
- Ability to operate effectively in a fast-paced, global environment
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field
Benefits and support
- Compensation and benefits are detailed in the job posting
About Mastercard
Mastercard is a global technology company in the payments industry that connects consumers, financial institutions, merchants, governments, and businesses worldwide. It operates a fast and secure payment processing network that spans more than 200 countries and territories. Through innovative products and solutions in credit, debit, digital assets, and security, Mastercard makes commerce safer, simpler, and more accessible.
- Industry
- Payments
- Company size
- 10001+ employees
- Founded
- 1966
- Location
- Purchase, New York, USA
- Funding stage
- Public Company
Funding
Public Company · $115M raised
Leadership
Chief Executive Officer
Chief Business Officer
President & Chief Technology Officer
Chief People Officer
Recent coverage
Mastercard Newsroom
Mastercard advances agentic commerce with new trust and intelligence servicesSeptember 30, 2026
Mastercard Newsroom
Mastercard launches AI-powered B2B analytics for supplier paymentsSeptember 30, 2026
Mastercard Newsroom
Mastercard completes acquisition of BVNK to advance global stablecoin capabilitiesAugust 3, 2026
Mastercard Newsroom
Mastercard launches Wallet Pay to scale digital wallets worldwideSeptember 10, 2026