Senior Software Engineer - Ingestion
Databricks · Posted Oct 17
Data, analytics, machine learning, and generative AI intelligence platform services
Get a personal compatibility score
Add a resume for personal matches
About the role
Databricks builds and runs a data and AI infrastructure platform, and ingestion into the Lakehouse is a strategic area of investment; Lakeflow Connect provides ready-to-use, point-and-click connectors for enterprise applications, databases, cloud storage, message queues, and local files. The team is building systems that extract data from OLTP systems while imposing minimal load on production systems, using techniques such as incremental data capture and log parsing. This role is for an engineer with core database internals experience to work hands-on on the Connect engine, influence the product roadmap, and embed ingestion capabilities across Databricks surfaces such as Dashboards, Notebooks, SQL, and AI.
What you will do
- Solve real business needs at large scale by applying your software engineering.
- Deliver a highly scalable, available, and fault-tolerant engine processing hundreds of TB of data daily across thousands of customers
- Low level systems debugging, performance measurement & optimization on large production clusters.
- Build architecture design, influence product roadmap, and take ownership and responsibility over new projects
- Use your deep experience to help prevent and investigate production issues.
- Plan and lead complicated technical projects that work with several teams within the company.
- Break down complex problems quickly into potential solutions, knowns, and unknowns, and de-risk (through prototyping/validation).
Skills used in this role
What the employer is looking for
- BS (or higher) in Computer Science, or a related field
- 5+ years of production level experience in one of: Python, Java, Scala, C++, or similar language.
- Experience developing large-scale distributed systems from scratch
- Experience in areas like Database replication, backup, transaction recovery at one of the major database vendors (Microsoft SQL Server , Oracle, IBM etc) is a plus to have.
- Hands-on experience in developing and operating backend systems.
- Ability to contribute effectively throughout all project phases, from initial design and development to implementation and ongoing operations, with guidance from senior team members.
Benefits and support
- Compensation and benefits are detailed in the job posting
About Databricks
Databricks is a data and artificial intelligence company that provides a unified Data Intelligence Platform built on a lakehouse architecture. The platform combines data engineering, data warehousing, machine learning, and generative AI to help organizations manage and scale their data assets natively across major cloud providers. Founded by the original creators of Apache Spark, Databricks enables thousands of enterprises worldwide to power advanced analytics, business intelligence, and autonomous AI agents.
- Industry
- Data and AI Platform Software
- Company size
- 17300+ employees
- Founded
- 2013
- Location
- San Francisco, California, USA
- Funding stage
- Private Company
Funding
Private Company · $25.2B raised
- 2026-08-13Series L$5.0B
Leadership
Co-founder and Chief Executive Officer
Co-founder and Chief Technology Officer
Co-founder and Executive Chairman
Chief Financial Officer
Co-founder and Chief Architect
Recent coverage
TipRanks
Databricks Looks to Boost Industrial Productivity in New AI Partnership2026-10-14
Databricks
Anthropic Claude Sonnet 5 now available as a Databricks-hosted model2026-10-07