Senior Data Engineer-1
Mastercard · Posted Oct 12
Global technology company connecting consumers, financial institutions, merchants, and businesses through secure payment processing and digital commerce solutions
Get a personal compatibility score
Add a resume for personal matches
About the role
Mastercard is a global technology company in the payments industry, connecting and powering an inclusive digital economy across more than 210 countries and territories, with teams focused on the high-growth fintech marketplace. This Senior Data Engineer role in Hyderabad owns end-to-end batch and real-time data pipeline delivery on cloud platforms, working with massive data volumes using Databricks, Spark, Python and PySpark. The role also involves driving dbt-based transformation architecture, CI/CD and DataOps practices, and mentoring junior and mid-level engineers.
What you will do
- Own the end-to-end design, development, and delivery of complex batch and real-time data pipelines using Databricks, Spark, Python, and PySpark.
- Drive dbt-based transformation architecture with rigorous Test-Driven Development (TDD) and modular design.
- Design and own CI/CD pipelines using GitLab and Jenkins, and champion DataOps practices across the team.
- Administer and optimize Databricks objects and the platform using Databricks Asset Bundles, managing performance, access, and cost.
- Establish data observability frameworks covering quality, freshness, lineage, and anomaly detection.
- Lead the design of real-time data streaming pipelines (e.g., using Kafka, Spark Structured Streaming).
- Mentor junior and mid-level engineers, and lead code and design reviews.
- Partner with stakeholders on requirements, delivery planning, and technical trade-offs.
- Plan and execute deployments, migrations, and upgrades with minimal disruption to operations.
Skills used in this role
What the employer is looking for
- Bachelor's degree in computer science or a related technical field (Master's a plus).
- 5+ years of data engineering experience.
- Deep hands-on experience with Databricks (including administration), Spark, and Python.
- Strong background in PySpark and distributed data processing.
- Proven track record using dbt for robust, testable transformation workflows following TDD.
- Familiarity with Databricks Asset Bundles for object deployment and version control.
- Strong CI/CD (GitLab, Jenkins) and DataOps expertise.
- Experience with real-time data processing and streaming pipelines.
- Expert SQL development and strong cloud infrastructure experience (AWS, Azure, or GCP).
- Demonstrated experience mentoring engineers and leading technical delivery.
- Ideally you have experience in banking, e-commerce, credit cards or payment processing and exposure to both SaaS and premises-based architectures. In addition, you have a post-secondary degree in computer science, mathematics, or quantitative science.
Benefits and support
- Compensation and benefits are detailed in the job posting
About Mastercard
Mastercard is a global technology company in the payments industry that connects consumers, financial institutions, merchants, governments, and businesses worldwide. It operates a fast and secure payment processing network that spans more than 200 countries and territories. Through innovative products and solutions in credit, debit, digital assets, and security, Mastercard makes commerce safer, simpler, and more accessible.
- Industry
- Payments
- Company size
- 10001+ employees
- Founded
- 1966
- Location
- Purchase, New York, USA
- Funding stage
- Public Company
Funding
Public Company · $115M raised
Leadership
Chief Executive Officer
Chief Business Officer
President & Chief Technology Officer
Chief People Officer
Recent coverage
Mastercard Newsroom
Mastercard advances agentic commerce with new trust and intelligence servicesSeptember 30, 2026
Mastercard Newsroom
Mastercard launches AI-powered B2B analytics for supplier paymentsSeptember 30, 2026
Mastercard Newsroom
Mastercard completes acquisition of BVNK to advance global stablecoin capabilitiesAugust 3, 2026
Mastercard Newsroom
Mastercard launches Wallet Pay to scale digital wallets worldwideSeptember 10, 2026