Senior Data Engineer - Databricks

We are looking for a skilled Databricks Developer to design, develop, and optimize big data solutions using ApacheSpark and Databricks on Azure cloud. The ideal candidate will have strong experience in data engineering, ETL pipelines, and performance optimization.

 Key Responsibilities:

Design, develop, and optimize ETL pipelines in Databricks.

Build data ingestion, transformation, and processing workflows using Apache Spark.

Work with structured and unstructured data from various sources.

Optimize Spark jobs for performance, cost efficiency, and scalability.

Implement CI/CD for Databricks workflows and manage version control.

Work closely with Data Engineers, DataScientists, and Business Analysts to support analytics and reporting.

Implement security best practices andmanage access controls in Databricks.

Troubleshoot performance and scalability issues in big data processing.