Virtusa
Airflow Developer
Job Description
We are seeking a skilled Data Engineer proficient in Airflow, with expertise in DBT (Data Build Tool). The ideal candidate will play a key role in designing, developing, and maintaining data pipelines, ensuring the reliability and efficiency of data workflows within our organization.
Responsibilities
Overall 4 yrs experience with various data platforms, data warehousing initiatives including at least 1 implementation experience in building data pipelines, Schedule, Orchestrate with Airflow and DBT is Mandatory.
Having Data Engineering, Orchestration experience using Apache Airflow and Python.
Proficient in SQL and Python is a Must.
Collaborating with the team for ensuring suitable translation of architectural solutions into robust and effective implementation.
Thorough understanding and application of AWS services related to Cloud data platform is mandatory AWS S3, AWS Glue, Amazon Redshift.
Stay current with industry trends and advancements in ETL technologies, incorporating new tools and techniques as appropriate like Airflow and DBT specific CICD, Version Control and Automated Testing.
Collaborate with infrastructure and DevOps teams to deploy and monitor data pipelines in production environments.
Work closely with DBT Engineers to understand the dbt models
Should have Ability to integrate logically different tasks into Data pipelines.
Must have good exposure to configure, schedule and orchestrate pipelines.
Qualifications
Bachelors or masters degree in computer science, engineering, or a related field.
Proven experience designing, implementing, and maintaining data pipelines using Airflow and DBT.
Experience with cloud platforms AWS and their data services.
Experience with version control systems (e.g., Git) and CI/CD pipelines.
Excellent problem-solving skills and attention to detail, with a commitment to delivering high-quality solutions in a fast-paced environment.
Strong communication and collaboration skills, with the ability to work effectively in cross-functional teams.
Prior experience working in an Agile or iterative development environment is a plus.
Jobs at Pune
Virtusa
Java Microservices Developer
Full Time
Pune, Maharashtra
Last Date: June 30, 2024
Virtusa
Dotnet Assocaite Architect (ATC)
Full Time
Pune, Maharashtra
Last Date: Dec. 31, 2024
Infosys
ACS Appian_Business Analyst
5 - 7 Years Exp.
Pune, Maharashtra
Last Date: July 17, 2024
Infosys
SAP ARIBA Consultant
5 - 7 Years Exp.
Pune, Maharashtra
Last Date: June 30, 2024
More Jobs at Virtusa
Virtusa
Oracle EBS Developer with Finance
Full Time
Hyderabad, Telangana
Last Date: June 30, 2024
Virtusa
L2 Production Support Engineer
Full Time
Chennai, Tamil Nadu
Last Date: Aug. 31, 2024
Virtusa
Java Developer with Angular/Oracle
Full Time
Hyderabad, Telangana
Last Date: Dec. 31, 2024
Virtusa
Automation Selenium expert
Full Time
Hyderabad, Telangana
Last Date: June 30, 2024
Actively Recruiting Companies at Pune, Maharashtra