Virtusa

Spark ETL Developer

Job Description

  • Experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions using common programming language (Scala, Java, or Python) in a Big Data and Data Warehouse platform.  Preferably with at least 5+ years of hands-on experience in a Data Engineering role.
  • Experience in building data solution in Hadoop platform, using Spark, MapReduce, Sqoop, Kafka and various ETL frameworks for distributed data storage and processing.  Preferably with at least 5+ years of hands-on experience.
  • Strong Unix/Linux Shell scripting and programming skills in Scala, Java, or Python.
  • Proficient in SQL scripting, writing complex SQLs for building data pipelines.
  • Experience in leading and mentoring data engineers, including ownership of internal business stakeholder relationships and working with consultants.
  • Experience in working in Agile teams, including working closely with internal business stakeholders.
  • Familiarity with data warehousing and/or data mart build experience in Teradata, Oracle or RDBMS system is a plus.
  • Certification on Cloudera CDP, Hadoop, Spark, Teradata is a plus.
  • Experience in Ab Initio software products (GDE, Co>Operating System, Express>It, etc.), AWS products (S3, EMR, Redshift, etc.) is a plus.


Jobs at Bangalore

Infosys

Sitecore Architect

8 - 11 Years Exp.

Bangalore, Karnataka

View Details

Last Date: June 30, 2024

KPMG

Technology Consulting-DT Intelligen…

KI Professional

Bangalore, Karnataka

View Details

Last Date: June 19, 2024

TCS

functional safety

4 - 8 Years

Bangalore, Karnataka

View Details

Last Date: July 31, 2024

Virtusa

PM (ATC)

Full Time

Bangalore, Karnataka

View Details

Last Date: Sept. 30, 2024

Infosys

Oracle Fusion/EBS Financials Consul…

2 - 5 Years Exp.

Bangalore, Karnataka

View Details

Last Date: June 30, 2024

Amazon

Support Ops Specialist, Support Ope…

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: June 25, 2024

Virtusa

Pega CSSA

Full Time

Bangalore, Karnataka

View Details

Last Date: Dec. 31, 2024

Infosys

Technical Trainer

6 - 12 Years Exp.

Bangalore, Karnataka

View Details

Last Date: Aug. 23, 2024

Infosys

ESEM Architect

8 - 11 Years Exp.

Bangalore, Karnataka

View Details

Last Date: June 30, 2024

Capgemini

Senior Infrastructure Consultant - …

Experienced

Bangalore, Karnataka

View Details

Last Date: June 19, 2024

Infosys

IT Consulting

2 - 13 Years Exp.

Bangalore, Karnataka

View Details

Last Date: June 30, 2024

Infosys

AWS ARCHITECT

8 - 11 Years Exp.

Bangalore, Karnataka

View Details

Last Date: June 30, 2024




More Jobs at Virtusa

Virtusa

Senior Mainframe Developer

Full Time

Bangalore, Karnataka

View Details

Last Date: June 30, 2024

Virtusa

DevOps - Oracle Cloud

Full Time

Hyderabad, Telangana

View Details

Last Date: June 30, 2024

Virtusa

Salesforce Lead

Full Time

Hyderabad, Telangana

View Details

Last Date: Dec. 31, 2024

Virtusa

SFDC QA

Full Time

Hyderabad, Telangana

View Details

Last Date: June 30, 2024

Virtusa

Node JS

Full Time

Hyderabad, Telangana

View Details

Last Date: June 30, 2024

Virtusa

Senior Consultant

Full Time

Chennai, Tamil Nadu

View Details

Last Date: Dec. 31, 2024

Virtusa

Senior Scrum Master

Full Time

Pune, Maharashtra

View Details

Last Date: Dec. 31, 2024

Virtusa

Junior Software Engineer-Java Job i…

Full Time

Chennai, Tamil Nadu

View Details

Last Date: June 26, 2024

Virtusa

Oracle EBS Tech Lead

Full Time

Hyderabad, Telangana

View Details

Last Date: Sept. 30, 2024

Virtusa

Data Engineer

Full Time

Hyderabad, Telangana

View Details

Last Date: June 28, 2024

Virtusa

Senior Consultant

Full Time

Hyderabad, Telangana

View Details

Last Date: Dec. 31, 2024

Virtusa

Salesforce Developer

Full Time

Hyderabad, Telangana

View Details

Last Date: May 14, 2025