Virtusa
Senior Data Engineer
Job Description
Minimum of 7 years of experience in ETL development and data integration.
At least 3 years of Handson experience with Spark DPL framework and AWS managed Snowflake.
Proven experience in successfully migrating legacy ETL jobs to cloud environments
Convert and rewrite legacy Informatica ETL jobs into a Spark DPL framework
Migrate data pipelines to AWS-managed Snowflake environment.
Collaborate with data engineers, architects, and other stakeholders to ensure seamless migration and integration.
Ensure high-quality, scalable, and efficient ETL processes in the new environment.
Write and optimize Spark jobs to process large volumes of data.
Create and maintain the deployment pipelines and automation scripts.
Troubleshoot and resolve issues during migration and deployment.
Work with Snowflake to define and optimize data models and transformations.
Perform thorough testing and validation of the new ETL processes to ensure data integrity and accuracy.
Optimize performance, ensuring minimal latency and efficient resource utilization in AWS and Snowflake environments.
Document code, processes, and architecture for future reference and knowledge transfer.
Jobs at Hyderabad
Amazon
Financial Analyst I, Retail AP FinC…
Freshers/Experienced
Hyderabad, Telangana
Last Date: Jan. 14, 2025
Oracle
Oracle Cloud Functional Financials …
Professional
Hyderabad, Telangana
Last Date: April 6, 2025
Oracle
Software Developer 2
Professional
Hyderabad, Telangana
Last Date: April 19, 2025
Oracle
FrontEnd Senior Developer
Professional
Hyderabad, Telangana
Last Date: June 9, 2025
Oracle
Fusion ERP Functional Analyst 3-Sup…
Professional
Hyderabad, Telangana
Last Date: May 20, 2025
Oracle
QA Analyst 3-ProdDev
Professional
Hyderabad, Telangana
Last Date: March 30, 2025
Oracle
Software Developer 3
Professional
Hyderabad, Telangana
Last Date: April 28, 2025
Oracle
Senior Quality Assurance Engineer f…
Professional
Hyderabad, Telangana
Last Date: May 25, 2025
Virtusa
Java backend lead developer
Full Time
Hyderabad, Telangana
Last Date: March 31, 2025
IBM
Application Developer: SAP ABAP HANA
Professional
Hyderabad, Telangana
Last Date: Jan. 10, 2025
More Jobs at Virtusa
Virtusa
Service now lead developer
Full Time
Hyderabad, Telangana
Last Date: Jan. 31, 2025
Virtusa
UI Angular Developer (BAM)
Full Time
Chennai, Tamil Nadu
Last Date: June 30, 2025
Actively Recruiting Companies at Hyderabad, Telangana