Virtusa
Senior Data Engineer
Job Description
Minimum of 7 years of experience in ETL development and data integration.
At least 3 years of Handson experience with Spark DPL framework and AWS managed Snowflake.
Proven experience in successfully migrating legacy ETL jobs to cloud environments
Convert and rewrite legacy Informatica ETL jobs into a Spark DPL framework
Migrate data pipelines to AWS-managed Snowflake environment.
Collaborate with data engineers, architects, and other stakeholders to ensure seamless migration and integration.
Ensure high-quality, scalable, and efficient ETL processes in the new environment.
Write and optimize Spark jobs to process large volumes of data.
Create and maintain the deployment pipelines and automation scripts.
Troubleshoot and resolve issues during migration and deployment.
Work with Snowflake to define and optimize data models and transformations.
Perform thorough testing and validation of the new ETL processes to ensure data integrity and accuracy.
Optimize performance, ensuring minimal latency and efficient resource utilization in AWS and Snowflake environments.
Document code, processes, and architecture for future reference and knowledge transfer.
Jobs at Hyderabad
KPMG
Risk Advisory Internal Audit Manager
KI Professional
Hyderabad, Telangana
Last Date: Jan. 15, 2025
KPMG
Risk Advisory Internal Audit Senior
KI Professional
Hyderabad, Telangana
Last Date: Jan. 15, 2025
Oracle
Oracle Field Service Cloud(TOA) Tec…
Professional
Hyderabad, Telangana
Last Date: April 5, 2025
Virtusa
Lead service Now developer
Full Time
Hyderabad, Telangana
Last Date: June 30, 2028
Virtusa
Java - Spark Senior Developer
Full Time
Hyderabad, Telangana
Last Date: March 31, 2025
Capgemini
Software Engineering Team Manager
Experienced Professionals
Hyderabad, Telangana
Last Date: Jan. 15, 2025
Virtusa
Java - Senior Developer
Full Time
Hyderabad, Telangana
Last Date: June 30, 2025
More Jobs at Virtusa
Virtusa
ServiceNow ITSM Developer
Full Time
Bangalore, Karnataka
Last Date: April 28, 2025
Actively Recruiting Companies at Hyderabad, Telangana