Data Engineer II
American Express · Posted Oct 28
Banking, credit card, payment network, and travel services
Get a personal compatibility score
Add a resume for personal matches
About the role
The Enterprise Marketing Technology team builds and optimizes scalable, reliable, high-quality data solutions that power customer targeting, eligibility, personalization, campaign execution and marketing analytics across American Express. The role sits in a cloud data engineering domain spanning GCP BigQuery, Python, SQL, Spark and Apache Airflow, with an emphasis on AI-assisted engineering. As a Data Engineer II, you will design and maintain large-scale data pipelines, ensure data quality and platform reliability, and build reusable customer, product and campaign data capabilities in an agile, collaborative environment.
What you will do
- Data Engineering & Development: Design, develop and maintain scalable data pipelines using GCP BigQuery, Python, SQL, Spark and Apache Airflow for large-scale data ingestion, transformation and processing.
- Data Analysis & Quality: Perform data discovery, profiling, complex SQL analysis, source-to-target reconciliation, data validation and root cause analysis to ensure trusted, high-quality data.
- AI-Assisted Engineering: Leverage approved Generative AI tools, GitHub Copilot and LLM-based solutions to accelerate code development, testing, troubleshooting, documentation and engineering automation.
- Performance & Reliability: Optimize data-processing performance, automate monitoring, troubleshoot production issues and implement preventive measures to improve platform stability.
- Data Product Enablement: Build reusable customer, product, campaign and engagement data capabilities supporting enterprise Marketing, targeting, personalization and analytics.
- Engineering Excellence: Follow software engineering best practices, including CI/CD, GitHub, code reviews, automated testing, data governance and production-readiness controls.
- Cross-Functional Collaboration: Partner with Product Owners, Business stakeholders, architects and upstream/downstream engineering teams to understand requirements, resolve dependencies and deliver business capabilities.
- Continuous Improvement: Proactively identify opportunities for automation, technical debt reduction, AI adoption and engineering productivity improvements.
Skills used in this role
What the employer is looking for
- Bachelor's or master's degree in computer science, Engineering or a related technical discipline, or equivalent work experience.
- 5+ years of hands-on experience in software development or data engineering, preferably with large-scale Big Data and cloud-based solutions.
- Strong hands-on expertise in SQL, Python, GCP Big Query and Apache Airflow, including developing and optimizing complex data pipelines.
- Experience with Spark, Scala, Hadoop/Hive or equivalent distributed data-processing technologies.
- Strong data analysis and problem-solving skills, including data profiling, complex SQL, source-to-target validation, data reconciliation and root cause analysis.
- Experience in ETL/ELT, data modeling, data transformation, workflow orchestration and performance optimization.
- Practical hands-on experience with Generative AI tools such as GitHub Copilot, ChatGPT Enterprise or equivalent AI coding assistants for development, debugging, testing or automation.
- Working knowledge of LLMs, prompt engineering and responsible AI practices, particularly secure handling of enterprise and sensitive data.
- Experience with Git/GitHub, CI/CD pipelines, automated testing and software development best practices.
- Understanding of data-quality controls, data governance, privacy and production support.
- Strong communication skills, ability to collaborate across teams and independently resolve complex technical problems.
Preferred qualifications
- Experience with GCP Bigtable, Pub/Sub, Dataflow, Kafka or real-time data-processing frameworks.
- Exposure to Adobe Experience Platform, Adobe Journey Optimizer or Customer Journey Analytics.
- Experience building or contributing to AI-enabled data engineering solutions, such as automated RCA, data-quality monitoring, intelligent data discovery, lineage or test-data generation.
- Familiarity with LLM APIs, Retrieval-Augmented Generation (RAG), agentic AI frameworks or AI workflow automation.
- Experience developing enterprise data products supporting Marketing, Banking, Lending or customer engagement.
- GCP Professional Data Engineer or equivalent cloud certification.
Benefits and support
- Competitive base salaries
- Bonus incentives
- Support for financial-well-being and retirement
- Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location)
- Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
- Generous paid parental leave policies (depending on your location)
- Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
- Free and confidential counseling support through our Healthy Minds program
- Career development and training opportunities
About American Express
American Express Company is a globally recognized multinational financial services corporation specializing in payment cards, travel-related services, and network banking. Founded in 1850, the company provides charge and credit cards, expense management products, and merchant services to consumers, small businesses, and large corporations worldwide. It operates a proprietary payments network known for its premium customer engagement and lifestyle rewards programs.
- Industry
- Banking
- Company size
- 76800 employees
- Founded
- 1850-03-18
- Location
- New York City, New York, USA
- Funding stage
- Public Company
Leadership
Chairman and Chief Executive Officer
Chief Financial Officer
Chief Information Officer and Executive Vice President
Chief Colleague Experience Officer
Chief Marketing Officer
Recent coverage
American Express Newsroom
American Express Continues to Expand the Centurion Lounge Network with Its Largest Lounge Yet2026-10-08
American Express Newsroom
American Express Delivers the Next Generation of Amex Corporate™2026-09-30
American Express Newsroom
American Express Reports Second-Quarter 2026 Financial Results2026-07-24
American Express Newsroom
American Express Releases 2026 Dodd-Frank Act Stress Test Results2026-06-25