Accolite
AWS Data Engineer
Job Description
Job Summary:
We are seeking a skilled Data Engineer with strong hands-on experience in AWS Athena, AWS Glue, and data processing using Python / Scala / SQL.
The ideal candidate will design and develop data pipelines, build ETL workflows, manage large-scale datasets on AWS, and enable analytics and reporting across various platforms.
Key Responsibilities:
Design, build, and maintain scalable ETL/ELT pipelines using AWS Glue and Glue Jobs (Python/Scala).
Develop and optimize data queries using AWS Athena.
Work extensively with Python/Scala/SQL for data transformations and dataset enrichment.
Manage and maintain data stored in S3 and integrate with AWS services such as Lambda, Glue Catalog, and Lake Formation.
Implement data quality checks, schema validations, and metadata management.
Collaborate with analytics, data science, and engineering teams to deliver reliable datasets.
Optimize data workflows for performance, scalability, and cost efficiency.
Work with CI/CD pipelines for deploying data pipelines and scripts.
Ensure data governance, security policies, and best practices across AWS environments.
Required Qualifications:
5–7 years of experience in data engineering.
Strong hands-on experience with AWS Athena and AWS Glue.
Proficiency in Python, Scala, and SQL for data processing.
Experience working with large datasets stored on AWS S3.
Good understanding of distributed processing and data modeling concepts.
Experience with version control (Git) and CI/CD practices.
Strong analytical, debugging, and problem-solving skills.
Preferred Skills:
Experience with AWS Lambda, Glue Catalog, or Lake Formation.
Exposure to Spark, PySpark, or EMR.
Knowledge of orchestration tools (Airflow, Step Functions, etc.).
Understanding of data governance, metadata, and lineage management.
Jobs at Gurgaon
American Express
Senior Credit Risk Analyst – Automa…
Freshers/Experienced
Gurgaon, Haryana
Last Date: Dec. 7, 2025
American Express
Operations Support
Freshers/Experienced
Gurgaon, Haryana
Last Date: Dec. 7, 2025
Amazon
Team Lead , Team Lead
Freshers/Experienced
Gurgaon, Haryana
Last Date: Dec. 16, 2025
American Express
Lead Analyst
Freshers/Experienced
Gurgaon, Haryana
Last Date: Dec. 7, 2025
Amazon
Team Lead, Team lead
Freshers/Experienced
Gurgaon, Haryana
Last Date: Dec. 16, 2025
Amazon
Workforce Staffing Coordinator, Wor…
Freshers/Experienced
Gurgaon, Haryana
Last Date: Dec. 9, 2025
American Express
Manager-Controller
Freshers/Experienced
Gurgaon, Haryana
Last Date: Dec. 7, 2025
More Jobs at Accolite
Accolite
Murex Accounting
4 - 15 Years Exp.
Bangalore, Karnataka
Last Date: Dec. 6, 2025
Accolite
Broadridge Regulatory Reporting SME…
6 - 15 Years Exp.
Bangalore, Karnataka
Last Date: Dec. 6, 2025
Accolite
ServiceNow Developer
3 - 5 Years Exp.
Bangalore, Karnataka
Last Date: Dec. 6, 2025
Accolite
Senior Data Analyst – iSeries / RPG…
8 - 15 Years Exp.
Bangalore, Karnataka
Last Date: Dec. 6, 2025
Accolite
Python API Developer
5 - 10 Years Exp.
Bangalore, Karnataka
Last Date: Dec. 6, 2025
Accolite
Test Automation Engineer - Playwrig…
5 - 10 Years Exp.
Bangalore, Karnataka
Last Date: Dec. 6, 2025
Accolite
Calypso Risk Consultant
5 - 15 Years Exp.
Bangalore, Karnataka
Last Date: Dec. 6, 2025
Accolite
Data Engineer Lead
7 - 12 Years Exp.
Bangalore, Karnataka
Last Date: Dec. 6, 2025
Accolite
Murex Integration Specialist
5 - 15 Years Exp.
Bangalore, Karnataka
Last Date: Dec. 6, 2025
Accolite
Senior DevOps Engineer – Applicatio…
8 - 15 Years Exp.
Bangalore, Karnataka
Last Date: Dec. 6, 2025
Accolite
Senior Python Developer
8 - 12 Years Exp.
Bangalore, Karnataka
Last Date: Dec. 6, 2025
Actively Recruiting Companies at Gurgaon, Haryana