Databricks—IT Software Engineer, Infrastructure

Job description

Description: GAQ327R265 About the Role At Databricks Information Technology, we are a product-led organisation transforming the way we work, from how easy it is to use our IT services to the applications we develop to help us scale seamlessly amid incredible growth. As an IT Software Engineer (Infrastructure), you will be a core technical contributor on the IT CorpEng Infrastructure team, owning and driving the evolution of our core infrastructure and observability platforms. This role requires a strong software engineering mindset, deep technical breadth across SRE and infrastructure worlds, and the ability to deliver high-quality, scalable solutions for currently "immature" system problems. You will be responsible for building resilient, scalable, and automated infrastructure that empowers our development teams. As a member of the team, you will bridge the gap between software engineering and systems architecture, ensuring our AWS environment is cost-optimised, secure, and highly available. The impact you will have: - Automate: Develop and deploy production-grade infrastructure on cloud platforms (AWS preferred) using Infrastructure as Code tools like Terraform or Pulumi. - Orchestration: Deploy, manage, and scale containerised workloads using Kubernetes (EKS/AKS), focusing on security, reliability, and resource efficiency. - CI/CD Excellence: Build and maintain robust deployment pipelines using GitHub Actions, including both cloud-hosted and self-hosted runners for specialised build requirements. - Drive "Observable by Default" Frameworks: Implement infrastructure standards to ensure new internal applications are secure, with logging, metrics, and tracing configured out of the box. - Tooling, Scripting & AI: Build internal CLI tools, AI-assisted workflows, and automation scripts to streamline developer workflows and reduce manual toil. - Partner Cross-Functionally: Collaborate with Security, Engineering, Infrastructure, and Support teams to execute technical projects aligned with business outcomes. - Document & Knowledge Share: Participate in peer code reviews, maintain operational playbooks/failure triage guides, and help onboard team members onto platforms you maintain. What we look for: - Software Engineering Expertise: 3–5 years of hands-on software engineering experience, with strong proficiency in Python for scripting, automation, and tooling (required). - Infrastructure as Code (IaC): Solid working knowledge of Terraform (modules, state management) or Pulumi (preferred). - Cloud & Containerization: Hands-on experience building and supporting production workloads in AWS (or Azure/GCP), along with Kubernetes and Docker fundamentals. - CI/CD & Automation: Practical experience designing, maintaining, and troubleshooting pipelines using GitHub Actions or similar modern CI/CD tools. - Observability Foundations: Practical understanding of observability pillars (logging, metrics, tracing) and hands-on experience integrating tools such as Datadog, Prometheus, or Grafana. - Independent Execution: Proven ability to own end-to-end tasks with guidance from Tech Leads, breaking down broader technical goals into actionable technical solutions. About Databricks Databricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and 70% of the Fortune 500 — rely on the Databricks Data + AI Platform to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified platform that includes Genie, Lakebase, Agent Bricks, Lakeflow, Lakehouse, and Unity Catalog. To learn more, follow Databricks on LinkedIn, X, YouTube, and Instagram. Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here. Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics. Compliance If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.