Senior Abinitio + Big data Dev
Barclays · Posted Oct 27
Banking, credit card, corporate, investment banking, and wealth management services
Get a personal compatibility score
Add a resume for personal matches
About the role
The role sits within Barclays' data engineering function, building and maintaining systems that collect, store, process, and analyse data, including data pipelines, data warehouses, and data lakes. The work focuses on large-scale enterprise data processing with PySpark, ETL/ELT, AWS, Databricks/Snowflake, and Ab Initio. The Senior Abinitio + Big Data Dev will design scalable pipelines, implement data quality and reconciliation controls, and collaborate with data scientists on machine learning deployment.
What you will do
- To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.
- Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data.
- Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures.
- Development of processing and analysis algorithms fit for the intended data complexity and volumes.
- Collaboration with data scientist to build and deploy machine learning models.
Skills used in this role
What the employer is looking for
- Design, develop and maintain scalable data pipelines using PySpark.
- Build and optimise ETL/ELT solutions supporting large-scale enterprise data processing requirements.
- Develop reusable frameworks, components and standards to accelerate data onboarding and analytics delivery.
- Implement data quality controls, validation frameworks and reconciliation processes.
- Deliver high-quality code following engineering best practices, coding standards and automated testing approaches.
- Proficiency in Linux/Unix and Shell scripting.
- You may be assessed on key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen, strategic thinking and digital and technology, as well as job-specific technical skills.
Preferred qualifications
- Excellent programming skills in Python/Pyspark.
- Hands-on experience with Databricks and/or Snowflake.
- Strong experience with AWS Cloud services including S3, Glue, EMR, Lambda, EC2, DynamoDB, IAM, CloudWatch and CloudTrail.
- Hands-on experience developing and optimising AWS Glue ETL jobs using PySpark.
- Experience with large-scale distributed data processing.
- Solid understanding of Data Lake, Lakehouse and Modern Data Platform architectures.
- Expertise with Git-based source control platforms.
- Experience in Airflow.
- Practical Ab Initio experience (GDE graphs, plans, psets, EME object/version management)
Benefits and support
- Compensation and benefits are detailed in the job posting
About Barclays
Barclays is a British multinational universal bank that provides consumer, corporate, and investment banking, as well as wealth management services. Tracing its origins back to 1690 in London, the institution operates globally to serve millions of retail and institutional clients. The bank leverages cutting-edge technology and digital platforms to drive operational efficiency across its international network.
- Industry
- Banking
- Company size
- 93000+ employees
- Founded
- 1690
- Location
- London, United Kingdom
- Funding stage
- Public Company
Leadership
Group Chief Executive
Group Finance Director
Group Chief Operating Officer
Recent coverage
The Guardian
Barclays to cut 5,000 jobs as AI replaces roles2026-10-22
Investing.com
Barclays Q3 2026 slides show mixed results, on track for targets2026-10-22
Euronews
Barclays cuts 5,000 jobs as net profit grows 13% in Q32026-10-22