Back
IBM logo

Data Engineer-Data Platforms-Azure

IBM · Posted Oct 23

Hybrid cloud, artificial intelligence, enterprise software, quantum computing, and IT consulting services

Bangalore, INFull-timeHybridMid Level2–5 years₹12.0L–₹20.0L yearly36 applicants
Information TechnologyCloud ComputingArtificial IntelligenceQuantum ComputingEnterprise SoftwareIT ConsultingPublic Company
Be an early applicantFull time

Get a personal compatibility score

Add a resume for personal matches

About the role

IBM Consulting works with leading companies across industries to shape their hybrid cloud and AI journeys, supported by IBM technology, Red Hat, and strategic partners. This role sits in Software Engineering within the Data Platforms space, focused on the Azure Cloud ecosystem. As a Data Engineer, you will design, build, and operate batch and real-time data pipelines and the data layer using Azure Synapse Analytics, Data Factory, Databricks, Event Hub, and related services, along with open source tools such as Apache Airflow and dbt.

What you will do

  • Design and Build Data Pipelines: Design, build, and operate batch and real-time data pipelines using Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub.
  • Develop Data Layer: Design, build, and operate the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.
  • Implement Azure Data Platform: Implement and maintain Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure functions with Python, Azure Purview, and Cosmos DB.
  • Utilize Open Source Technologies: Apply proficiency in open source technologies like Apache Airflow and dbt, Spark / Python, or Spark / Scala to support data engineering solutions.
  • Ensure Seamless Operations: Operate and maintain data engineering solutions to ensure seamless batch and real-time data processing.
  • Data Engineering on Azure: Experience working with Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure functions with Python, Azure Purview, and Cosmos DB.
  • Data Pipeline Development: Experience developing and maintaining data engineering solutions on the Azure Cloud ecosystem, including designing, building, and operating batch and real-time data pipelines.
  • Azure Data Layer Design: Experience designing, building, and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.

Skills used in this role

Azure Synapse AnalyticsAzure Data FactoryAzure DatabricksAzure Event HubsAzure Data Lake StorageAzure Blob StorageAzure SQL Data WarehouseAzure Cosmos DBAzure FunctionsAzure PurviewPythonApache AirflowdbtApache SparkScalaSQL

What the employer is looking for

  • Exposure to Azure Toolset: Proficiency in Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub to design, build, and operate batch and real-time data pipelines.
  • Open Source Technologies: Exposure to open source technologies like Apache Airflow and dbt, Spark / Python, or Spark / Scala to support data engineering solutions.
  • Proficiency in Azure Services: Exposure to Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub to design, build, and operate batch and real-time data pipelines.

Benefits and support

  • Compensation and benefits are detailed in the job posting

About IBM

International Business Machines Corporation (IBM) is a global technology and consulting company that provides hybrid cloud, artificial intelligence, and enterprise infrastructure solutions. Operating in over 175 countries, IBM helps businesses across industries modernize operations, secure data, and drive digital transformation through platforms like watsonx and Red Hat OpenShift. Founded over a century ago, the company remains a pioneer in high-performance computing, enterprise automation, and quantum technology.

Industry
Information Technology
Company size
260,000+ employees
Founded
June 16, 1911
Location
Armonk, New York, USA
Funding stage
Public Company

Funding

Public Company · $3.5B raised

Institutional Public ShareholdersVanguard GroupBlackRock
  • ·Post Ipo Debt$150M

Leadership

AK
Arvind Krishna

Chairman, President and Chief Executive Officer

JJ
James J. Kavanaugh

Senior Vice President and Chief Financial Officer

RT
Rob Thomas

Senior Vice President, Software and Chief Commercial Officer

MA
Mohamad Ali

Senior Vice President, IBM Consulting

JH
Jonathan H. Adashek

Senior Vice President, Marketing and Communications

Apply