Department/Group: Enterprise Data Services
We are looking for Senior Data Pipeline Engineers (multiple positions) for ongoing projects, within the Data Services and ML/AI Group
Senior Data Pipeline Engineers (Azure)
• 4+ years of experience in big data engineering, with a focus on Spark and SQL.
• 4+ Years Experience in developing Large-scale ETL Pipelines using Azure Data factory and Azure/SSIS tools.
• 2+ Years Experience in Azure Machine Learning Environments
• Design, construct, and manage Data Lake environments including Data ingestion, staging, Data quality monitoring, and business modeling, Data Schema Normalization, etc.
• Develop, construct, secure, test and maintain architectures (databases and large-scale processing systems)
• Design, develop and implement technical solutions in SQL environment (databases, SQL, data marts, integrations)
• Highly skilled in developing Visual Reports in Power BI. Knowledge of Power BI report visualizations, Data Analysis Expressions (DAX), Power Query (M), and Power BI data modeling
• Highly skilled in SQL programming in T-SQL building stored procedures and Data Pipeline jobs.
• Strong functional understanding of Azure Machine Learning
PREFERRED SKILLS
• Experience designing and building big data architectures using tools such as Hadoop, Hive, or Kafka.
Notice Period – Imm / 30 days.