Apply

Senior Databricks Engineer

Data Engineering

Senior Databricks Engineer

Responsibilities:

  • Architecture, design, development and delivery of enterprise grade data solutions within Databricks (on AWS or Azure)
  • Work on high profile projects with well-known clients across various sectors
  • Help clients realise the potential of data science, machine learning, and scaled data processing within the Databricks and associated cloud ecosystem
  • Mentor junior team members and support their personal development
  • Take ownership for the delivery of core solution components
  • Constantly develop technical skills using the latest cloud technology - achieving & maintaining relevant certifications
  • Work directly with clients to understand requirements and present solutions to customer sponsors
  • Influence and support project delivery through involvement in project/sprint planning and QA.

Core Desired Skills & Experiences:

  • Strong communication skills
  • Strong background of enterprise data platform development, concepts and methods with the ability to adapt and tailor based on requirements
  • Deep understanding of software engineering tools and concepts

This is a role for ambitious technologists who wish to work with the latest cloud technology from Azure, GCP and AWS. Whilst we don’t expect everyone to have experience with all the technologies below, candidates will need to show their ability to rapidly learn new technologies.

  • Databricks
  • Cloud data platfrms on one or more of AWS, Azure, GCP
  • Expert Python and SQL skills
  • Expert Version Control skills and workflows (especially Gitflow)
  • Good Docker and Kubernetes skills (GKE, EKS, AKS)
  • Expert Knowledge of orchestration and data movement tools like DataFactory or Apache Airflow or Luigi
  • Good understanding of security concepts
  • Linux bash scripting
  • IoT and Event Streaming
  • Good knowledge of Terraform

Supporting desirable skills:

  • Kubeflow
  • Cloud AI tools like Azure ML
  • Azure Functions or Lambda Functions
  • Microservices Architecture
  • Experience with other MPP databases like Snowflake
  • Exposure to other public clouds like GCP, AWS
  • Consultancy experience

Apply Here

To apply for this role please tell us a little about yourself and if possible provide a link to your LinkedIn Profile and/or a CV, and we'll be in touch shortly.

by submitting this form you agree to the Datasparq
privacy policy
Submit