Senior Data Engineer II
American Express · Posted Oct 14
Banking, credit card, payment network, and travel services
Gurugram, HR, IndiaFull-timeHybridLead/Staff7+ years₹30.0L–₹48.0L yearly<25 applicants
BankingPaymentsCredit CardsFinancial ServicesPublic Company
Be an early applicantFull time
Get a personal compatibility score
Add a resume for personal matches
About the role
The role sits within American Express technology, overseeing all technical aspects of data architecture and database management while leading and mentoring teams of Data Engineers. The work spans Big Data, NoSQL and relational database ecosystems, ETL/ELT pipelines, performance tuning and high-availability design, with emerging Generative AI and LLM-based architectures. This Senior Data Engineer II collaborates with delivery architects, engineers and product teams to design and implement data tier solutions that align technology initiatives with business objectives.
What you will do
- Sr Data Engineer II oversees all technical aspects of data architecture and database management, ensuring optimal performance and security, while leading teams and collaborating with architects and product teams to design and implement effective data solutions, including advanced Big Data management strategies through partitioning and indexing.
- Supervises and mentors Data Engineers and cross-functional team of colleagues in specific tasks or projects, fostering their professional growth and ensuring adherence to best practices
- Collaborates with delivery architects and engineers to design optional data tier solutions to meet enterprise platform objectives and goals
- Collaborates with product teams to prioritize features for ongoing sprints, designs data tier solutions with architects and engineers, and contributes to decisions about tools and methods
- Mentors teams of junior and senior Data Engineers through ongoing development efforts
- Manages all technical aspects of data architecture and database management, including developing prototypes, new database structures, and application programming interfaces
- Transforms logical data architectures into physical designs, provides database administration services, and continuously improves database design and performance
- Debugs database components, fixes performance defects, and ensures optimal data replication, high availability, backup, and recovery processes
- Leads the development of plans, strategies, best practices, and standards for data management, security, and processes
- Oversees and develops Big Data management strategies by designing and implementing advanced partitioning and indexing solutions
- Collaborates and co-creates effectively with teams in product and the business to align technology initiatives with business objectives
Skills used in this role
SQLPythonJavaNoSQLHBaseHiveGCPBigTableBigQuerySpannerOracleMS SQL ServerPostgreSQLNetezzaMongoDBCouchbaseCassandraRedisErStudioErWinETLGitCI/CDLangChainLLM
What the employer is looking for
- Bachelor’s degree in Computer Science, Computer Engineering, and/or comparable experience; advanced degree preferred
- Knowledge of Big Data / NoSQL design and development with variety of data stores (document, column family, graph, etc.)
- Knowledge of database management system products and ecosystem – e.g., storage formats, access algorithms, data management processes, administration, data maintenance, replication, high availability, encryption, etc.”
- Knowledge of distributed (multi-tiered) systems, algorithms, and relational & non-relational databases
- Knowledge of XML/JSON and schema development/reuse, relational database management systems, Open Source
- Data engineering and development experience or a related job
- Experience in SQL and Python (or any other programming language like Java)
- Experience in design and development across one or more database management systems (e.g., HBase, Hive, GCP tools, NoSQL, BigTable, BigQuery, Spanner, IMS, DB2 zOS, Oracle, MS SQL Server, PostgreSQL, Netezza (PDA/DB2AA) as appropriate
- Experience in NoSQL databases (e.g., MongoDB, Couchbase, Cassandra, and Redis)
- Experience in data modeling tools (e.g., ErStudio, ErWin)
- Experience in performance tuning in the Big Data space
- Experience in distributed (multi-tiered) systems, algorithms, and application development
- Experience in database development and support of online transaction processing and/or online analytical processing systems
- Experience in software delivery methodology (Agile, Scrum, Agile XP, Test-Driven Development, Waterfall, etc.)
- Experience in infrastructure design for performance (e.g., network-attached or local-attached storage integration - such as Nutanix)
- Experience designing and implementing ETL/ELT pipelines and large-scale data-processing solutions.
- Experience with performance tuning, resiliency, high availability, data replication, and production troubleshooting.
- Experience with software-engineering practices including Git, automated testing, CI/CD, code reviews, and production support.
- Ability to collaborate effectively with architects, engineers, product teams, and business stakeholders.
- Experience mentoring engineers and providing technical leadership on complex initiatives.
Preferred qualifications
- Working knowledge of Generative AI and LLM-based application architectures.
- Exposure to RAG, embeddings, vector databases, semantic/hybrid search, and knowledge retrieval.
- Experience integrating LLM APIs or frameworks such as LangChain/LangGraph is advantageous.
- Basic Understanding of AI evaluation, grounding, guardrails, observability, security, and responsible AI concepts.
- Experience building data pipelines for unstructured/semi-structured content and preparing enterprise data for AI consumption.
- Ability to rapidly prototype AI/GenAI use cases using Python and transition viable POCs toward production.
Benefits and support
- Competitive base salaries
- Bonus incentives
- Support for financial-well-being and retirement
- Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location)
- Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
- Generous paid parental leave policies (depending on your location)
- Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
- Free and confidential counseling support through our Healthy Minds program
- Career development and training opportunities
About American Express
American Express Company is a globally recognized multinational financial services corporation specializing in payment cards, travel-related services, and network banking. Founded in 1850, the company provides charge and credit cards, expense management products, and merchant services to consumers, small businesses, and large corporations worldwide. It operates a proprietary payments network known for its premium customer engagement and lifestyle rewards programs.
- Industry
- Banking
- Company size
- 76800 employees
- Founded
- 1850-03-18
- Location
- New York City, New York, USA
- Funding stage
- Public Company
Leadership
SJ
Stephen J. Squeri
Chairman and Chief Executive Officer
CL
Christophe Le Caillec
Chief Financial Officer
RR
Ravi Radhakrishnan
Chief Information Officer and Executive Vice President
MR
Monique R. Herena
Chief Colleague Experience Officer
ER
Elizabeth Rutledge
Chief Marketing Officer
Recent coverage
Digital Transactions
AmEx's Next Step for Agentic Commerce Is a Framework; Forter's Agentic Verification Move2026-10-13
FinTech Global
American Express hit with $350m AML penalty2026-10-12
Banking Dive
AmEx dinged by Fed, OCC; must pay $350M for AML failures2026-10-08
American Express IR
American Express Declares Regular Quarterly Dividend on Common Shares2026-09-28