Lead Data Engineer
Chargebee · Posted Sep 28
Subscription management, recurring billing, and revenue growth infrastructure services
Get a personal compatibility score
Add a resume for personal matches
About the role
The Data Platform team at Chargebee builds and maintains scalable data systems that power internal analytics, business intelligence, and customer-facing data features. The role spans large-scale data ingestion and processing pipelines, streaming and event-driven architectures, distributed data processing frameworks, and cloud-based data infrastructure, including data lake and data warehouse architecture. As a Lead Data Engineer, you will lead the design and development of large-scale data systems, drive architectural decisions and platform evolution, and mentor engineers while working with product engineers, analysts, platform teams, and leadership.
What you will do
- Design and architect scalable, reliable data ingestion and processing pipelines across the data platform.
- Lead the development and optimization of ETL/ELT workflows to support high-volume and scalable data processing.
- Build and maintain distributed data processing systems using frameworks such as Apache Spark.
- Design and implement event-driven data architectures using streaming systems such as Kafka.
- Define data modeling standards and transformation strategies to support analytics and product use cases.
- Ensure high standards of data reliability, integrity, scalability, and performance across the data platform.
- Lead troubleshooting and debugging efforts for complex production data pipelines and distributed systems.
- Collaborate with data analysts, product teams, and engineering teams to design scalable data solutions.
- Mentor and guide data engineers, providing technical leadership and promoting engineering best practices.
- Lead design discussions, architecture reviews, and technical decision-making within the data platform team.
- Participate in and drive code reviews, technical design reviews, and agile development processes.
- Document architecture decisions, platform standards, and data engineering workflows.
Skills used in this role
What the employer is looking for
- Bachelor's degree in Computer Science, Mathematics, Engineering, or a related technical field, or equivalent practical experience.
- 8+ years of experience building and maintaining large-scale data processing systems and pipelines.
- Strong experience designing and operating production-grade distributed data systems.
- Hands-on experience with distributed computing frameworks such as Apache Spark.
- Strong proficiency in SQL and data modeling.
- Proficiency in at least one programming language such as Java, Python, or Scala.
- Strong understanding of data structures, distributed systems, and data platform architecture.
- Experience working with relational databases such as PostgreSQL, MySQL, or similar systems.
- Experience designing and building ETL/ELT data pipelines at scale.
- Experience working with Git workflows in collaborative development environments.
- Experience working in an Agile development environment.
Preferred qualifications
- Experience working within the AWS ecosystem.
- Experience building and operating large-scale Apache Spark-based data pipelines.
- Experience with streaming systems such as Kafka or similar event-driven platforms.
- Strong understanding of data lake and data warehouse architectures
- Experience designing scalable cloud-native data platforms.
- Knowledge or prior experience with open table formats such as Delta Lake, Apache Iceberg, or Apache Hudi.
- Strong technical leadership, communication, and problem-solving skills.
- Ability to investigate and debug issues across large-scale distributed systems.
Benefits and support
- Compensation and benefits are detailed in the job posting
About Chargebee
Chargebee is a subscription management and recurring billing platform that automates revenue operations, invoicing, payments, and compliance for high-growth businesses. Its platform helps enterprises manage complex subscription lifecycles, usage-based pricing, and global tax configurations. Trusted by thousands of global innovators, Chargebee streamlines financial workflows from early-stage operations to multi-year enterprise contracts.
- Industry
- SaaS
- Company size
- 1000-5000 employees
- Founded
- 2011
- Location
- San Francisco, California, USA
- Funding stage
- Series H
Funding
Series H · $475M raised
- 2024-03-08Series H$5M
- 2022-02-01Series H$250M
- 2021-04-01Series G$125M
- 2020-10-01Series F$55M
- 2019-08-01Series D$14M
- 2018-03-01Series C$18M
Leadership
CEO & Co-Founder
CPO & Co-Founder
CTO & Co-Founder
Chief Financial Officer
Recent coverage
GlobeNewswire
Chargebee Named a Leader in 2026 Gartner® Magic Quadrant™ for Recurring Billing Applications for the Third Consecutive Year2026-08-17
Chargebee News
Chargebee and Twikey Partner to Connect Billing Directly With Bank Payments2026-07-15
Chargebee News
Agicap Selects Chargebee to Power Its Next Phase of Global Growth2026-03-10
Chargebee News
Chargebee Acquires Inai to Supercharge AI-Powered Payments Intelligence2025-09-15