Virtusa

Data Engineer

Posted On

March 1, 2024

Location

Chennai, Tamil Nadu

Experience Level

Full Time

Job Type

Experienced

Apply By

July 31, 2024

Job Description

Responsibilities:
DataOps Technology Evaluation & POC
Support in the POC process for DataOps.live & similar technologies
Scripting and Coding:
Write efficient, reliable, and maintainable code using programming languages such as Python, SQL, and Snowflake-specific scripting languages.
Implement version control best practices and ensure code repositories are well-managed.
Snowflake CI/CD Development:
Design, develop, and maintain continuous integration and continuous deployment (CI/CD) pipelines for Snowflake data warehousing platform.
Collaborate with cross-functional teams to understand data engineering requirements and implement automated solutions.
Automated Testing:
Develop and execute automated testing strategies to ensure the reliability and accuracy of data pipelines and integration processes.
Collaborate with quality assurance teams to integrate testing processes into CI/CD pipelines.
Performance Optimization:
Identify and address performance bottlenecks in data processing and integration workflows.
Work closely with the data engineering team to optimize SQL queries and data transformation processes.
Documentation:
Document code, processes, and workflows to facilitate knowledge transfer and ensure maintainability.
Contribute to the development of best practices and coding standards for Snowflake CI/CD processes.
Qualifications:
Technical Skills:
Solid experience in Snowflake data warehousing platform.
Proficient in scripting languages such as Python and SQL.
Experience with version control systems (e.g., Git).
CI/CD Experience:
Proven experience designing and implementing CI/CD pipelines for data engineering projects.
Familiarity with CI/CD tools and platforms (e.g., Jenkins, GitLab CI/CD).
Data Engineering Knowledge:
Understanding of data modeling, ETL processes, and data integration.
Familiarity with cloud platforms (e.g., AWS, Azure, GCP).
Problem-solving Skills:
Ability to troubleshoot and resolve complex issues related to data processing and integration.
Communication and Collaboration:
Strong communication skills with the ability to collaborate effectively in a team environment.
Comfortable working in an agile development environment

Jobs at Chennai

Virtusa

Java Spark

Full Time

Chennai, Tamil Nadu

Data Engineer Apply Now

Job Description

Jobs at Chennai

More Jobs at Virtusa

Actively Recruiting Companies at Chennai, Tamil Nadu

Data Engineer