Virtusa
Data Engineer
Job Description
We are seeking a talented Developer with expertise in Python and AWS/Azure cloud
platforms with having at least minimum knowledge in Snowflake.
As a Data Engineer, you will be responsible for designing, implementing, and maintaining
data infrastructure and systems using Python, AWS, Azure.
Your primary focus will be on developing scalable and efficient data pipelines using
Python, optimizing data storage and processing, and ensuring the availability and
reliability of data for analysis and reporting.
Responsibilities:
1. Design, develop, and maintain data pipelines using python on AWS and Azure to ingest , process, and
transform data from various sources.
2. Optimize data storage and processing using cloud-native services and technologies
such as AWS S3, Azure Data Lake Storage etc.
3. Ensure data quality and integrity by implementing data validation, cleansing, and
transformation processes.
4. Develop and maintain ETL processes using for data integration and migration between
different data sources and platforms.
5. Monitor and troubleshoot data pipelines and systems to identify and resolve
performance issues or data inconsistencies.
6. Collaborate with cross-functional teams to understand data requirements and translate
them into scalable and efficient technical solutions.
skills
Python
Kafka
Snowflake
Azure
AWS S3
Jobs at Hyderabad
Capgemini
Cloud Architect
Experienced Professionals
Hyderabad, Telangana
Last Date: Oct. 2, 2024
Virtusa
Senior Java Full stack developer
Full Time
Hyderabad, Telangana
Last Date: Dec. 31, 2024
Amazon
L5 - SDE for AWS Bedrock team, Bedr…
Freshers/Experienced
Hyderabad, Telangana
Last Date: Sept. 24, 2024
Oracle
Customer Service Analyst 1-Support
Professional
Hyderabad, Telangana
Last Date: Oct. 16, 2024
Capgemini
Support | 4 to 6 Yrs | Hyderabad
Experienced Professionals
Hyderabad, Telangana
Last Date: Oct. 2, 2024
Oracle
Senior Software Developer
Professional
Hyderabad, Telangana
Last Date: Sept. 30, 2024
Product Manager, Google Technology
Freshers/Experienced
Hyderabad, Telangana
Last Date: Sept. 26, 2024
More Jobs at Virtusa
Virtusa
Performance Testing Specialist
Full Time
Hyderabad, Telangana
Last Date: Dec. 31, 2024
Virtusa
Java Microservices Developer
Full Time
Chennai, Tamil Nadu
Last Date: Sept. 30, 2024
Virtusa
Senior Abinitio Developer
Full Time
Hyderabad, Telangana
Last Date: Dec. 31, 2024
Actively Recruiting Companies at Hyderabad, Telangana