Accolite
Data Engineer
Job Description
Job Summary:
We are seeking a skilled and proactive Data Engineer with 3–8 years of hands-on experience in building and maintaining data pipelines. The ideal candidate will have strong expertise in Python, Apache Spark, and experience with Databricks or Snowflake. You will be a key contributor in transforming raw data into usable formats and enabling advanced analytics across the organization.
Key Responsibilities:
Design, develop, and maintain scalable and efficient data pipelines using Python and Spark.
Work on batch and real-time data processing solutions using Databricks or Snowflake.
Optimize data workflows for performance, reliability, and scalability.
Collaborate with data scientists, analysts, and stakeholders to understand data requirements.
Ensure data quality and integrity through validation, profiling, and monitoring.
Maintain documentation related to data pipelines, architecture, and infrastructure.
Troubleshoot and resolve issues in data pipelines and ETL processes.
Required Skills & Qualifications:
3–8 years of experience in Data Engineering or a related field.
Strong proficiency in Python for data engineering use cases.
Solid hands-on experience with Apache Spark (PySpark preferred).
Experience with Databricks or Snowflake (at least one is mandatory).
Strong understanding of data modeling, ETL/ELT concepts, and cloud data platforms.
Experience with version control (e.g., Git), CI/CD tools, and agile methodologies.
Familiarity with data security, privacy, and governance best practices.
Preferred Qualifications (Nice to Have):
Experience working with cloud platforms like AWS, Azure, or GCP.
Familiarity with Delta Lake, Airflow, or dbt.
Exposure to containerization tools (Docker/Kubernetes).
Jobs at Gurgaon
American Express
Analyst-Data Analytics
Freshers/Experienced
Gurgaon, Haryana
Last Date: May 25, 2025
Capgemini
Business Analyst (CPR) | 6 to 9 yea…
Experienced Professionals
Gurgaon, Haryana
Last Date: May 14, 2025
Capgemini
PHP Developer with UI(HTML,CSS,Java…
Experienced Professionals
Gurgaon, Haryana
Last Date: May 14, 2025
American Express
Engineer I
Freshers/Experienced
Gurgaon, Haryana
Last Date: May 18, 2025
Accolite
Software Engineer - Python/AI Agents
2 - 8 Years Exp.
Gurgaon, Haryana
Last Date: May 17, 2025
American Express
Analyst Operations Excellence
Freshers/Experienced
Gurgaon, Haryana
Last Date: May 25, 2025
Amazon
Senior Design Technologist, Visual …
Freshers/Experienced
Gurgaon, Haryana
Last Date: May 13, 2025
Amazon
Security and Loss Prevention Specia…
Freshers/Experienced
Gurgaon, Haryana
Last Date: May 20, 2025
Capgemini
Software Engineer
Experienced Professionals
Gurgaon, Haryana
Last Date: May 14, 2025
More Jobs at Accolite
Accolite
Lead DevOps Engineer
6 - 8 Years Exp.
Gurgaon, Haryana
Last Date: May 24, 2025
Accolite
Channel Health Engineer
4 - 7 Years Exp.
Gurgaon, Haryana
Last Date: May 24, 2025
Accolite
Database Engineer - Oracle
4 - 8 Years Exp.
Gurgaon, Haryana
Last Date: May 24, 2025
Accolite
Senior Product Manager, Data Platfo…
5 - 8 Years Exp.
Gurgaon, Haryana
Last Date: May 17, 2025
Accolite
Product Manager, Media Performance
5 - 8 Years Exp.
Gurgaon, Haryana
Last Date: May 17, 2025
Accolite
Product Manager - Analytics Platform
5 - 8 Years Exp.
Gurgaon, Haryana
Last Date: May 17, 2025
Actively Recruiting Companies at Gurgaon, Haryana