Virtusa

Airflow

Posted On

Jan. 25, 2025

Location

Hyderabad, Telangana

Experience Level

Full Time

Job Type

Experienced

Apply By

Dec. 31, 2025

Job Description

Mandatory Skills: AWS Data Services, Python, SQL, Data Lake

Secondary Skills: DBT, Airflow, DevOps

JD: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team.

Key Responsibilities:

Design, develop, and maintain scalable data pipelines and systems on AWS.

Implement and manage ETL processes using Python and Apache Airflow.

Develop and execute comprehensive testing plan and test cases to ensure data quality and integrity.

Collaborate with cross-functional teams to understand data requirements and deliver solutions.

Optimize and troubleshoot data workflows and performance issues.

Document and maintain data architecture, processes, and systems.

Experience in operating Scrumban or POD delivery model.

Required Skills:

Proficiency in AWS services such as S3, Redshift, Lambda, and Glue.

Strong programming skills in Python for data manipulation and automation.

Experience with Apache Airflow for orchestrating complex workflows.

Solid understanding of testing methodologies and tools or python scripting for data validation.

Knowledge of data integration tools such as Talend, Nucleus, or similar.

Knowledge of data transformation tools such as Data Build Tool or Abinito will be an Advantage.

Preferred Qualifications:

Bachelors or Masters degree in Computer Science, Engineering, or a related field.

7+ years of experience in data engineering or a related role.

Experience with big data technologies such as Hadoop, Spark, or Kafka.

Strong problem-solving skills and attention to detail.

Excellent communication and collaboration skills.

AWS Certification

Jobs at Hyderabad

KPMG

Senior - GRC Packaged Product (Arch…

KI Professional

Hyderabad, Telangana

Airflow Apply Now

Job Description

Jobs at Hyderabad

More Jobs at Virtusa

Actively Recruiting Companies at Hyderabad, Telangana

Airflow