Virtusa
AWS Data Engineer
Job Description
Must have 7+ years of experience total IT experience in Data engineering / DW area
Must have 3+ yrs of exposure on AWS ecosystem, specifically Redshift, Lambda, Glue, Apache Airflow
Minimum 5 yrs of technical expertise with data models, data mining, and segmentation techniques
Expert on programming languages SQL Python Pyspark
Must be good at creating software and data pipelines that enable the ingestion, transformation and transfer of large quantities of structured and unstructured research data from filesystems sources
Must be able to design and build database logic to automatically fetch and store data in various forms
Must be good at building processes supporting data transformation, data structures, metadata dependency and workload management
Must be able to identify design and implement internal process improvements automating manual processes optimizing data delivery redesigning infrastructure for greater scalability etc
Expert on data manipulation, processing and extracting value from large disconnected datasets
Excellent handson experience on SQL database design
Expert on relational databases, API ingestions application ingestions using Appflow
Working knowledge of message queuing stream processing, and highly scalable big data data stores
Good to have Starbust, DataBricks, real time data ingestion experience eg - Kafka
Good communication skills to interact with clients playing an onshore lead role
Should be comfortable to work in Agile methodology
AWS Data & Analytics Certification will be added advantage.
Jobs at Chennai
Virtusa
L2 Production Support Engineer
Full Time
Chennai, Tamil Nadu
Last Date: Dec. 31, 2024
Infosys
Maximo Consultant
2 - 5 Years Exp.
Chennai, Tamil Nadu
Last Date: June 30, 2024
Paypal
Software Engineer
Freshers/Experienced
Chennai, Tamil Nadu
Last Date: June 30, 2024
Amazon
Software Development Engineer-II, E…
Freshers/Experienced
Chennai, Tamil Nadu
Last Date: July 2, 2024
Amazon
Associate, Quality Services, Amazon
Freshers/Experienced
Chennai, Tamil Nadu
Last Date: July 2, 2024
More Jobs at Virtusa
Virtusa
Process Re- Engineering Consultant
Full Time
Chennai, Tamil Nadu
Last Date: Dec. 31, 2024
Virtusa
Solution Architect Payments
Full Time
Pune, Maharashtra
Last Date: Dec. 31, 2024
Virtusa
Senior ReactJs Developer
Full Time
Bangalore, Karnataka
Last Date: Dec. 31, 2024
Actively Recruiting Companies at Chennai, Tamil Nadu