Data Engineer III - Databricks, Pyspark, Python, AWS
JPMorgan Chase · Posted Oct 22
Global banking, investment, credit card, mortgage, and asset management services
Get a personal compatibility score
Add a resume for personal matches
About the role
The Commercial & Investment Bank at JPMorgan Chase delivers trusted data collection, storage, access, and analytics solutions in a secure, stable, and scalable way. The team builds and maintains critical big data pipelines and architectures across multiple technical areas and business functions. This Data Engineer III role designs and delivers batch and streaming data pipelines using PySpark, Spark, Databricks, and AWS, including data modelling, solution design, and performance optimization for high-volume datasets.
What you will do
- Design, develop, and maintain big data pipelines (batch and streaming) using PySpark/Spark and Databricks.
- Lead/own data modelling and solution design for data products, including defining target-state architecture, data flows, and transformation patterns.
- Build scalable ingestion and transformation workflows for high-volume datasets, ensuring reliability, quality, and performance.
- Develop and optimize complex SQL transformations, reconciliation queries, and analytical datasets; perform query tuning for large-scale workloads.
- Apply strong data warehousing concepts (dimensional modeling, SCDs, partitioning strategies, etc.) to build well-structured, analytics-ready data layers and Leverage common AWS services, with strong emphasis on S3 and AWS data processing capabilities, to support scalable storage and processing.
- Perform advanced debugging and troubleshooting across distributed Spark workloads (data skew, shuffle tuning, memory/compute optimization).
- Implement engineering best practices: modular design, efficient coding, code reviews, and CI-friendly development approaches.
- Use GitHub/Bitbucket and standard version control workflows to manage codebase, peer reviews, and releases.
- Partner with cross-functional stakeholders to convert requirements into robust big data solutions.
- Uses enterprise-authorized AI capabilities within the work environment to accelerate data pipeline/design analysis and documentation, validating outputs and handling data according to sensitivity and security requirements.
- Applies reuse-first, AI-assisted practices to strengthen SDLC-quality routines for data pipelines (e.g., test generation and control validation), ensuring traceability/auditability and alignment to resiliency and security expectations.
Skills used in this role
What the employer is looking for
- Formal training or certification on data engineering concepts and 3+ years applied experience
- Experience in data engineering / big data engineering, with strong hands-on delivery and Expert-level SQL skills (must be extremely strong): complex joins, window functions, CTEs, optimization, and analytical problem solving at scale.
- Strong hands-on coding experience with Python in production environments; demonstrated ability to write efficient, maintainable code.
- Deep expertise in Apache Spark (in depth) and PySpark, including performance tuning and distributed processing fundamentals.
- Strong experience with Databricks for large-scale data processing and pipeline development.
- Strong understanding of data warehousing concepts and best practices; proven capability in data modelling and solution design for scalable, maintainable data platforms/products.
- Experience implementing both batch and streaming data processing solutions.
- Familiarity with AWS S3 and common AWS services used in data platforms and processing
- Excellent debugging, troubleshooting, problem-solving skills and experience with GitHub, Bitbucket, and version control best practices.
- Demonstrated experience using enterprise-authorized AI capabilities within the work environment to support data engineering workflows with strong validation habits and awareness of data sensitivity.
- Ability to review and validate AI-assisted outputs (e.g., query suggestions, test ideas, or model change summaries) before use, escalating when uncertain and following data handling requirements.
Preferred qualifications
- Good to have: infrastructure provisioning in AWS using Infrastructure as Code (IaC) (e.g., Terraform, AWS CloudFormation).
Benefits and support
- Compensation and benefits are detailed in the job posting
About JPMorgan Chase
JPMorgan Chase & Co. is one of the oldest, largest, and most diversified financial services institutions in the world. Operating globally through the J.P. Morgan and Chase brands, the firm provides a comprehensive range of financial solutions including investment banking, consumer and commercial banking, transaction processing, and asset management. Serving millions of consumers and many of the world's most prominent corporate, institutional, and government clients, the company combines deep market expertise with extensive technological investments.
- Industry
- Banking
- Company size
- 320000+ employees
- Founded
- 1799
- Location
- New York, New York, USA
- Funding stage
- Public Company
Leadership
Chairman and Chief Executive Officer
Chief Financial Officer
Chief Operating Officer
Global Chief Information Officer
CEO, Asset & Wealth Management
Recent coverage
JPMorgan Chase & Co.
One year in, JPMorganChase's Security and Resiliency Initiative is helping to strengthen industries critical to long-term economic growthOctober 19, 2026
JPMorgan Chase & Co.
JPMorganChase announces $3.5 million to help more Boston residentsOctober 14, 2026
JPMorgan Chase & Co.
JPMorganChase expands at 2400 Market Street, bringing Philadelphia employees together, plans to add over 150 local jobsOctober 13, 2026