Azure Data Engineering Expert Needed

I'm seeking an experienced Azure Data Engineer to step in and effectively collaborate with my remote team. Given the lack of a specific task or main goal, your expertise, adaptiveness, and versatility will come in handy. Key responsibilities may likely include: - • Ideal candidates should have strong experience with Azure Databricks and Data factory. • Conducting data analysis - Data integration - Data processing - Possibly executing ETL processes - Maybe venturing into data modelling, optimization, and pipeline development. • Efficient communication and collaboration capabilities are needed for this remote role. • I look forward to working with an adaptable professional who can confidently handle diverse tasks in Azure data engineering. • Design, develop, and maintain data pipelines using Azure Data Factory to ingest, transform, and load data into data lakes. • Implement and optimize data processing workflows using Azure Databricks for efficient data manipulation and analysis. • Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs. • Ensure data quality and integrity by implementing data validation and cleansing processes. • Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner. • Develop and maintain documentation for data engineering processes, standards, and best practices. • Stay updated with the latest trends and advancements in Azure data technologies to continuously improve our data solutions Key Skills :- • Bachelor's degree in Computer Science, Information Technology, or related field. • 4-5 years of professional experience as a Data Engineer with a focus on Azure Databricks and Azure Data Factory. • Strong proficiency in SQL, Python, and/or Scala for data manipulation and scripting tasks. • Experience working with data lakes, data warehouses, and ETL processes. • Familiarity with cloud platforms (preferably Azure) and related services such as Azure Blob Storage, Azure SQL Database, etc. • Excellent problem-solving skills and attention to detail. • Effective communication and collaboration skills to work with cross-functional teams. • Azure certifications (e.g., Microsoft Certified: Azure Data Engineer Associate) are a plus. The scope of the data involved is also currently undefined, but I would prefer an individual who can manage large quantities of data comfortably. In terms of goals, they're not yet firmly set - but they could range from data analysis and reporting, data integration and consolidation, to data migration etc.