Merck KGaA

Sr. Data Engineer

Posted On

Sept. 12, 2024

Location

Bangalore, Karnataka

Experience Level

D - Professional (4-9 years)

Job Type

full-time

Apply By

Feb. 4, 2025

Job Description

Job Summary:We are seeking a highly skilled AWS, Snowflake, and AI Engineer to join our dynamic team. In this role, you will be responsible for designing, implementing, and optimizing data solutions in the cloud using AWS and Snowflake. Additionally, you will develop and integrate AI models to drive innovation and efficiency across various business processes. The ideal candidate is a strategic thinker with hands-on experience in cloud platforms, data engineering, and AI technologies.Key Responsibilities:AWS Architecture & Management:Design, deploy, and manage cloud infrastructure on AWS.Implement best practices for security, scalability, and cost optimization.Monitor and troubleshoot AWS environments to ensure optimal performance.Data Engineering with Snowflake:Design and implement data pipelines using Snowflake.Develop and maintain ETL processes for data ingestion and transformation.Optimize Snowflake database performance for data analytics and reporting.Integrate Snowflake with other AWS services and third-party tools.AI Model Development & Integration:Design, develop, and deploy AI models to solve business problems.Integrate AI solutions into existing applications and workflows.Collaborate with data scientists and business stakeholders to ensure AI models align with business objectives.Continuously evaluate and improve AI model performance.Collaboration & Stakeholder Management:Work closely with cross-functional teams, including data scientists, analysts, and business units, to understand and address data and AI needs.Provide technical leadership and mentorship to junior engineers.Communicate complex technical concepts to non-technical stakeholders.Documentation & Compliance:Maintain comprehensive documentation of cloud architecture, data pipelines, and AI models.Ensure compliance with industry regulations and company policies related to data security and privacy.Qualifications:Experience:7+ years of experience in cloud engineering, with a focus on AWS.7+ years of experience working with Snowflake and data engineering.5+ Years of experience in AI/ML model development and deployment.5+ Years of experience in Python & PysparkExperience in managing Informatica Cloud (IICS) is a plus.Should have strong expertise in Writing complex SQL queries and ProceduresExperience in Coding, testing, implementing and maintaining medium to highly complex ETL code/solutions and scripts to build and maintain automated processesShould have good knowledge in Unix ScriptingShould have good understanding and experience of software development standard methodologiesExcellent Communication skillsTechnical Skills:Strong proficiency in AWS services (e.g., EC2, S3, Lambda, RDS, Redshift).Expertise in Snowflake data warehousing, including SnowSQL and SnowPipe.Proficiency in AI/ML frameworks.Strong programming skills in Python, PySpark, SQLExperience with CI/CD pipelines, containerization (Docker, Kubernetes), and version control (Git/Azure DevOps).Knowledge of data governance, security, and compliance best practices.Soft Skills:Excellent problem-solving and analytical skills.Strong communication and interpersonal skills.Ability to work independently and as part of a team.Strong organizational skills and attention to detail.

Jobs at Bangalore

Merck KGaA

Analyst

C - Professional (1-3 years)

Bangalore, Karnataka

Sr. Data Engineer Apply Now

Job Description

Jobs at Bangalore

More Jobs at Merck KGaA

Actively Recruiting Companies at Bangalore, Karnataka

Sr. Data Engineer