Senior Data Engineer [T500-29990]
Stolt-Nielsen · Posted Oct 8
Global provider of integrated bulk-liquid logistics, chemical shipping, storage terminals, and sustainable aquaculture services
Get a personal compatibility score
Add a resume for personal matches
About the role
Stolt-Nielsen is a family-founded global leader in bulk-liquid and chemical logistics, transportation, and storage, and its Digital Innovation Centre in Hyderabad builds smarter systems and drives digital transformation for the logistics domain. The team is building and optimizing the data infrastructure that powers analytics and AI initiatives, including the move toward solutions such as Databricks Genie that rely on well-modelled and described data. This Senior Data Engineer role will design and maintain reliable data pipelines in Databricks using PySpark and Delta Lake, ensure data quality and performance, and work with analysts, data scientists, and business stakeholders to turn raw data into trusted, accessible, and actionable insights.
What you will do
- Design, develop, and maintain scalable data pipelines in Databricks using PySpark and Delta Lake.
- Build robust ETL/ELT processes to ingest data from multiple sources (APIs, databases, files, cloud systems).
- Optimize data models and storage for analytics, machine learning, and BI reporting.
- Write and maintain SQL queries, views, and stored procedures for data transformation and analysis.
- Collaborate with cross-functional teams to understand business needs and translate them into technical solutions.
- Implement and enforce data quality, governance, and security standards across pipelines and platforms.
- Monitor and troubleshoot data workflows for performance, reliability, and cost efficiency.
- Stay current with best practices in data engineering, Databricks, and cloud-native data architectures.
Skills used in this role
What the employer is looking for
- Bachelor’s or Master’s degree in Computer Science or a related field.
- 5+ years of hands-on experience as a Data Engineer, ETL Developer, or similar.
- Strong proficiency in Python (especially PySpark and pandas).
- Excellent command of SQL for data manipulation, performance tuning, and debugging.
- Hands-on experience with Databricks (workspace, notebooks, jobs, clusters, and Unity Catalog).
- Solid understanding of data warehousing concepts, data modeling, and distributed data processing, like dimensional modelling (Kimball) and medallion architectures.
- Experience with Azure PaaS ecosystem (data/storage).
- Strong analytical mindset and attention to detail.
- Effective communication skills and ability to work cross-functionally.
- Experience in CI/CD pipelines, automated testing, and Agile delivery.
- Databricks (PySpark, Delta Lake, Jobs, Workflows)
- Python (data processing and automation)
- SQL (advanced querying and performance tuning)
- Data pipeline orchestration (e.g., Databricks Workflows)
- Version control (Git) and CI/CD familiarity
- Data modeling and transformation design
Preferred qualifications
- Familiarity with dbt or modern data stack tools.
- Knowledge of data governance, cataloging, and access control (e.g., Unity Catalog, Purview).
- Exposure to machine learning workflows and ML model data preparation.
- Strong background in performance tuning and cost optimization on Databricks.
Benefits and support
- Training and mentoring investment
About Stolt-Nielsen
Stolt-Nielsen Limited is a long-term investor and manager of businesses focused on global bulk-liquid and chemical logistics, distribution, and aquaculture. Through its core operating divisions—Stolt Tankers, Stolthaven Terminals, and Stolt Tank Containers—the company provides integrated transportation and storage solutions. Additionally, Stolt Sea Farm operates as a producer of high-tech sustainable seafood.
- Industry
- Logistics
- Company size
- 5001-10000 employees
- Founded
- 1959
- Location
- London, United Kingdom
- Funding stage
- Public Company
Leadership
Chief Executive Officer
Jens F. Grüner-Hegge
Chief Financial Officer
Niels G. Stolt-Nielsen
Chairman of the Board
Peter Koenders
Chief Information Officer
Recent coverage
Investors Hangout
Leadership Changes at Stolt-Nielsen Limited2025-11-07
Stolt-Nielsen
Udo Lange appointed new CEO of Stolt-Nielsen Limited2023-08-09