Senior Software Engineer - Data + AI Observability
Databricks · Posted Oct 11
Data, analytics, machine learning, and generative AI intelligence platform services
Get a personal compatibility score
Add a resume for personal matches
About the role
Databricks builds and runs a data and AI infrastructure platform used by more than 20,000 organizations to build and scale data and AI apps, analytics and agents. The Customer Foresight Team builds products that let customers get insights into their AI and data workloads, optimize performance, and lower costs, processing billions of entries daily across more than 65 cloud regions. This senior engineering role leads development of observability data infrastructure and pipelines, driving roadmap milestones, scaling and cost optimization, and integration with the broader data warehousing ecosystem.
What you will do
- Develop systems that make it simple for customers to answer questions about their Databricks environment by providing a reliable and timely interface for observability
- Make it easy for frameworks teams across Databricks to publish their data to customers
- Effectively lead large milestones from the observability roadmap, contribute to the long-term vision and requirements development for Databricks products
- Mentor other engineers towards contributing to the product and their career growth
- Optimize the scalability and cost of large data pipelines towards reducing costs for customers and opening up new product opportunities
- Drive integration with popular tools and services in the broader data warehousing ecosystem
Skills used in this role
What the employer is looking for
- 6+ years of production level experience in one of: Java, Scala, Python, C++, or similar language
- Experience with cloud technologies, e.g. AWS, Azure, GCP, Docker, Kubernetes
- Proven track record in architecting, developing, deploying, and operating components of large scale distributed systems
- Strong software engineering maturity: security, correctness, engineering excellence, operational excellence
- Platform mindset: effective building platforms for other software teams, iterating quickly to reduce friction to adoption, advocating for platform use
- Cross-functional skills: we have platform customers internal at Databricks as well as external customers, which requires strong cross-functional skills
Benefits and support
- Compensation and benefits are detailed in the job posting
About Databricks
Databricks is a data and artificial intelligence company that provides a unified Data Intelligence Platform built on a lakehouse architecture. The platform combines data engineering, data warehousing, machine learning, and generative AI to help organizations manage and scale their data assets natively across major cloud providers. Founded by the original creators of Apache Spark, Databricks enables thousands of enterprises worldwide to power advanced analytics, business intelligence, and autonomous AI agents.
- Industry
- Data and AI Platform Software
- Company size
- 17300+ employees
- Founded
- 2013
- Location
- San Francisco, California, USA
- Funding stage
- Private Company
Funding
Private Company · $25.2B raised
- 2026-08-13Series L$5.0B
Leadership
Co-founder and Chief Executive Officer
Co-founder and Chief Technology Officer
Co-founder and Executive Chairman
Chief Financial Officer
Co-founder and Chief Architect
Recent coverage
Databricks Newsroom
Databricks Closes $5 Billion Strategic Funding at $190 Billion Valuation2026-08-13
Databricks Newsroom
Databricks Announces Strategic Funding at a $188 Billion Valuation2026-07-16
Databricks Newsroom
Databricks Accelerates Investments in Agent Bricks, Lakebase and Databricks Apps2025-12-16