Senior Consultant - Databricks
John Keells IT Verified business
- Salary
- Not disclosed
- Location
- Colombo
- Job type
- Full-time
- Work mode
- On-site
Posted today Closes in 31 days 1 vacancy CV required From John Keells IT careers page ↗Job ID 9xv7ufs7ry
Originally posted on John Keells IT careers page ↗
About the job
Build data platforms on Databricks for customers, reporting to the Practice Manager.
What you will do:
- Build and support batch and streaming pipelines with Azure Databricks, Spark, PySpark, Python and SQL
- Implement Lakehouse solutions with Delta Lake, Unity Catalog, Databricks SQL and Workflows
- Develop ETL and ELT frameworks, and move customers off legacy platforms
- Apply good practice in modelling, Medallion Architecture, governance, security and data quality
- Tune Spark, SQL, clusters and storage for performance and cost
- Maintain CI/CD with Git or Azure DevOps, and work with customers, architects and junior engineers
What you need:
- Bachelor's degree in Computer Science, Data Science or similar
- 5+ years in data engineering, analytics, BI or software engineering, including 2+ years of enterprise Databricks
- Spark, PySpark, Python, SQL, Delta Lake, Data Factory, Data Lake Storage, Synapse, Microsoft Fabric and Power BI
- CI/CD, Git, automated testing and release management
- Databricks Professional certification is mandatory; Delivery or Project Expert is an advantage, and Azure or Fabric certifications are desirable
- Exposure to Asset Bundles, IaC, MLflow, MLOps, GenAI, Purview, presales and POCs
Requirements
- Education
- Degree
- Experience
- 5+ years
- CV
- Please send a CV