Software Engineer, Infrastructure
Databricks · Posted Oct 7
Data, analytics, machine learning, and generative AI intelligence platform services
Get a personal compatibility score
Add a resume for personal matches
About the role
Databricks Information Technology is a product-led organisation transforming how the company works, from IT service usability to the internal applications that help it scale amid rapid growth. The IT CorpEng Infrastructure team owns the company's core infrastructure and observability platforms, focused on a cost-optimised, secure and highly available AWS environment. This role is a core technical contributor building resilient, automated infrastructure with Infrastructure as Code, Kubernetes and CI/CD, and driving "Observable by Default" standards for internal applications.
What you will do
- Automate: Develop and deploy production-grade infrastructure on cloud platforms (AWS preferred) using Infrastructure as Code tools like Terraform or Pulumi.
- Orchestration: Deploy, manage, and scale containerised workloads using Kubernetes (EKS/AKS), focusing on security, reliability, and resource efficiency.
- CI/CD Excellence: Build and maintain robust deployment pipelines using GitHub Actions, including both cloud-hosted and self-hosted runners for specialised build requirements.
- Drive "Observable by Default" Frameworks: Implement infrastructure standards to ensure new internal applications are secure, with logging, metrics, and tracing configured out of the box.
- Tooling, Scripting & AI: Build internal CLI tools, AI-assisted workflows, and automation scripts to streamline developer workflows and reduce manual toil.
- Partner Cross-Functionally: Collaborate with Security, Engineering, Infrastructure, and Support teams to execute technical projects aligned with business outcomes.
- Document & Knowledge Share: Participate in peer code reviews, maintain operational playbooks/failure triage guides, and help onboard team members onto platforms you maintain.
Skills used in this role
What the employer is looking for
- Software Engineering Expertise: 3–5 years of hands-on software engineering experience, with strong proficiency in Python for scripting, automation, and tooling (required).
- Infrastructure as Code (IaC): Solid working knowledge of Terraform (modules, state management) or Pulumi (preferred).
- Cloud & Containerization: Hands-on experience building and supporting production workloads in AWS (or Azure/GCP), along with Kubernetes and Docker fundamentals.
- CI/CD & Automation: Practical experience designing, maintaining, and troubleshooting pipelines using GitHub Actions or similar modern CI/CD tools.
- Observability Foundations: Practical understanding of observability pillars (logging, metrics, tracing) and hands-on experience integrating tools such as Datadog, Prometheus, or Grafana.
- Independent Execution: Proven ability to own end-to-end tasks with guidance from Tech Leads, breaking down broader technical goals into actionable technical solutions.
Benefits and support
- Compensation and benefits are detailed in the job posting
About Databricks
Databricks is a data and artificial intelligence company that provides a unified Data Intelligence Platform built on a lakehouse architecture. The platform combines data engineering, data warehousing, machine learning, and generative AI to help organizations manage and scale their data assets natively across major cloud providers. Founded by the original creators of Apache Spark, Databricks enables thousands of enterprises worldwide to power advanced analytics, business intelligence, and autonomous AI agents.
- Industry
- Data and AI Platform Software
- Company size
- 17300+ employees
- Founded
- 2013
- Location
- San Francisco, California, USA
- Funding stage
- Private Company
Funding
Private Company · $25.2B raised
- 2026-08-13Series L$5.0B
Leadership
Co-founder and Chief Executive Officer
Co-founder and Chief Technology Officer
Co-founder and Executive Chairman
Chief Financial Officer
Co-founder and Chief Architect
Recent coverage
Databricks Newsroom
Databricks Closes $5 Billion Strategic Funding at $190 Billion Valuation2026-08-13
Databricks Newsroom
Databricks Announces Strategic Funding at a $188 Billion Valuation2026-07-16
Databricks Newsroom
Databricks Accelerates Investments in Agent Bricks, Lakebase and Databricks Apps2025-12-16