Virtusa
Airflow Developer
Job Description
We are seeking a skilled Data Engineer proficient in Airflow, with expertise in DBT (Data Build Tool). The ideal candidate will play a key role in designing, developing, and maintaining data pipelines, ensuring the reliability and efficiency of data workflows within our organization.
Responsibilities
Overall 4 yrs experience with various data platforms, data warehousing initiatives including at least 1 implementation experience in building data pipelines, Schedule, Orchestrate with Airflow and DBT is Mandatory.
Having Data Engineering, Orchestration experience using Apache Airflow and Python.
Proficient in SQL and Python is a Must.
Collaborating with the team for ensuring suitable translation of architectural solutions into robust and effective implementation.
Thorough understanding and application of AWS services related to Cloud data platform is mandatory AWS S3, AWS Glue, Amazon Redshift.
Stay current with industry trends and advancements in ETL technologies, incorporating new tools and techniques as appropriate like Airflow and DBT specific CICD, Version Control and Automated Testing.
Collaborate with infrastructure and DevOps teams to deploy and monitor data pipelines in production environments.
Work closely with DBT Engineers to understand the dbt models
Should have Ability to integrate logically different tasks into Data pipelines.
Must have good exposure to configure, schedule and orchestrate pipelines.
Qualifications
Bachelors or masters degree in computer science, engineering, or a related field.
Proven experience designing, implementing, and maintaining data pipelines using Airflow and DBT.
Experience with cloud platforms AWS and their data services.
Experience with version control systems (e.g., Git) and CI/CD pipelines.
Excellent problem-solving skills and attention to detail, with a commitment to delivering high-quality solutions in a fast-paced environment.
Strong communication and collaboration skills, with the ability to work effectively in cross-functional teams.
Prior experience working in an Agile or iterative development environment is a plus.
Jobs at Pune
IBM
Package Consultant: SAP IS Utilities
Professional
Pune, Maharashtra
Last Date: Dec. 27, 2024
IBM
Application Developer: Microsoft .N…
Professional
Pune, Maharashtra
Last Date: Dec. 27, 2024
Virtusa
Java Micro Services (Backend )tech …
Full Time
Pune, Maharashtra
Last Date: Dec. 31, 2024
More Jobs at Virtusa
Virtusa
Java React JS Developer
Full Time
Hyderabad, Telangana
Last Date: March 31, 2025
Virtusa
Technical support lead
Full Time
Hyderabad, Telangana
Last Date: March 31, 2025
Virtusa
Machine Learning Engineer
Full Time
Chennai, Tamil Nadu
Last Date: Dec. 31, 2024
Actively Recruiting Companies at Pune, Maharashtra