Azure Cloud & Data ETL Developer
- Posted
- Employment
- full time
- Work mode
- hybrid
Skills explicitly mentioned: Azure Data Factory, Azure Databricks, Azure Synapse Analytics, SQL, ETL, ELT, Python, PySpark, ADLS, Data modeling
Job Summary We are seeking a skilled and experienced Azure Cloud & Data ETL Developer to join our dynamic IT / Technology team. This is a hybrid role, offering a blend of remote work and in-office collaboration. The ideal candidate will possess a strong background in data engineering, cloud technologies, and ETL/ELT development, with a focus on the Azure ecosystem. Key Responsibilities The Azure Cloud & Data ETL Developer will be responsible for designing, developing, and maintaining robust and scalable data pipelines and solutions within the Azure cloud environment. This includes data ingestion, transformation, and loading processes, ensuring data quality, and adhering to data governance principles. The role also involves collaborating with cross-functional teams to understand data requirements and deliver effective solutions. Required Skills & Qualifications Azure Data Services: Demonstrated proficiency in utilizing various Azure data services, including Azure Data Factory (ADF) , Azure Databricks , and Azure Synapse Analytics , to build and manage data pipelines. ETL Development: Extensive experience in ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) development, including designing and implementing data integration solutions. Hybrid Data Architectures: A strong understanding of hybrid data architectures , enabling seamless data flow between on-premises and cloud environments. Cloud Migration: Experience in migrating data and applications to the Azure cloud platform. Data Engineering: Solid foundation in Data Engineering principles and practices. Data Modeling: Expertise in data modeling techniques, including the design and implementation of star schemas and snowflake schemas . Data Warehousing Concepts: A thorough understanding of data warehousing concepts and best practices. Programming Languages: Proficiency in Python and PySpark for data manipulation and processing. Data Ingestion & Integration: Experience with data ingestion and data integration processes, ensuring data accuracy and consistency. Data Quality & Governance: Knowledge of data quality and data governance principles and practices. DevOps & CI/CD: Experience with DevOps practices, including CI/CD (Continuous Integration/Continuous Delivery) pipelines, utilizing tools like Azure DevOps and GitHub Actions . Agile Methodology: Familiarity with Agile development methodologies. Performance Tuning & Indexing: Ability to perform performance tuning and indexing to optimize data query performance. Data Validation: Experience in implementing data validation processes to ensure data integrity. Azure Data Lake Storage (ADLS): Experience working with Azure Data Lake Storage (ADLS) . Communication Skills: Excellent communication skills , both written and verbal, to effectively collaborate with stakeholders. Problem-Solving Skills: Strong problem-solving skills to identify and resolve data-related issues. Gemini AI: Familiarity with Gemini AI and its applications in data processing. Experience Required: 6 - 10 years of relevant experience in data engineering and cloud development. This level of seniority requires a proven track record of designing and implementing complex data solutions, leading projects, and mentoring junior team members. What We Offer Salary: 18 LPA Required Skills Azure Data services ETL development Hybrid data architectures Cloud Migration Gemini AI Azure Data Factory (ADF) Azure Databricks Azure Synapse Analytics SQL Performance tuning Indexing Data ingestion Data quality Data governance Data validation DevOps CI/CD Agile Data Engineering ELT pipelines Data migration Data integration Azure Data Lake Storage (ADLS) Data warehousing concepts Data modeling Star schemas Snowflake schemas Python PySpark Azure DevOps GitHub Actions Communication Skills Problem-Solving Skills