Responsibilities:

• Design, develop, and optimize scalable data solutions using Apache Spark and Scala on Azure Databricks.
• Write clean, modular, and production-grade Python and Scala code for data processing and transformation.
• Follow and implement best practices related to code quality, modular development, and performance tuning.
• Develop and maintain Databricks assets including notebooks, jobs, and workflows.
• Work extensively with Azure services such as ADLS and Key Vault.
• Collaborate with cross-functional Agile teams to deliver high-quality engineering solutions.
• Design, develop, and maintain PostgreSQL databases for applications and analytical workloads.
• Utilize Git and other configuration management tools effectively.