Virtusa
AWS Data Engineer
Job Description
- Strong experience in data engineering, cloud technologies, and proficiency in Python programming to support data integration, transformation, and analytics processes.
- Migration Planning and Execution: Lead the planning, design, and execution of data migration from Azure to AWS, ensuring minimal downtime and data integrity.
- Data Architecture: Develop and implement scalable data architectures on AWS that align with business needs and best practices.
- ETL Development: Design, build, and maintain ETL processes to extract, transform, and load data efficiently using Python and AWS services.
- Data Integration: Integrate data from various sources, ensuring data quality, consistency, and security throughout the migration process. Utilize - - -- - Python for data processing and transformation tasks, including scripting, automation, and building custom data processing solutions.
- Python libraries: Have extensive experience in Python libraries such as pandas, NumPy, dbt, Airflow.
- Performance Optimization: Optimize data pipelines and architectures for performance, reliability, and scalability in the AWS environment.
- Collaboration: Work closely with cross-functional teams, including data scientists, analysts, and DevOps engineers, to understand data requirements and deliver robust solutions.
- Monitoring and Troubleshooting: Implement monitoring and logging solutions to track data pipeline performance and troubleshoot issues proactively.
- Documentation: Create and maintain comprehensive documentation of data workflows, migration plans, and infrastructure setups.
About Virtusa
Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 30,000+ people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us. Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence. Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.
Jobs at Pune
Virtusa
Java Microservices Developer
Full Time
Pune, Maharashtra
Last Date: Dec. 31, 2024
Infosys
Middleware Admin (MQ/WAS)
5 - 10 Years Exp.
Pune, Maharashtra
Last Date: Dec. 14, 2024
Capgemini
SRE Architect
Experienced Professionals
Pune, Maharashtra
Last Date: Oct. 2, 2024
Infosys
QA Automation Engineer
5 - 8 Years Exp.
Pune, Maharashtra
Last Date: Sept. 30, 2024
More Jobs at Virtusa
Virtusa
GCP BigQuery Developer
Full Time
Hyderabad, Telangana
Last Date: Sept. 30, 2024
Actively Recruiting Companies at Pune, Maharashtra