Virtusa

Spark ETL Developer

Job Description

  • Experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions using common programming language (Scala, Java, or Python) in a Big Data and Data Warehouse platform.  Preferably with at least 5+ years of hands-on experience in a Data Engineering role.
  • Experience in building data solution in Hadoop platform, using Spark, MapReduce, Sqoop, Kafka and various ETL frameworks for distributed data storage and processing.  Preferably with at least 5+ years of hands-on experience.
  • Strong Unix/Linux Shell scripting and programming skills in Scala, Java, or Python.
  • Proficient in SQL scripting, writing complex SQLs for building data pipelines.
  • Experience in leading and mentoring data engineers, including ownership of internal business stakeholder relationships and working with consultants.
  • Experience in working in Agile teams, including working closely with internal business stakeholders.
  • Familiarity with data warehousing and/or data mart build experience in Teradata, Oracle or RDBMS system is a plus.
  • Certification on Cloudera CDP, Hadoop, Spark, Teradata is a plus.
  • Experience in Ab Initio software products (GDE, Co>Operating System, Express>It, etc.), AWS products (S3, EMR, Redshift, etc.) is a plus.


Jobs at Bangalore

Amazon

Sr Technical Program Manager, Tax E…

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: July 9, 2024

Amazon

Demand Generation Representative

Freshers/Experienced

Bangalore, Karnataka

View Details

Last Date: July 2, 2024

Infosys

Senior Java Developer

3 - 5 Years Exp.

Bangalore, Karnataka

View Details

Last Date: June 30, 2024

KPMG

Digital Trust Cyber Transformation …

KI Professional

Bangalore, Karnataka

View Details

Last Date: July 3, 2024

Virtusa

.Net core+ Angular

Full Time

Bangalore, Karnataka

View Details

Last Date: Dec. 31, 2024

Infosys

SAP Native HANA

7 - 9 Years Exp.

Bangalore, Karnataka

View Details

Last Date: June 30, 2024

KPMG

Technology Consulting-TE SAP-SF-EC …

KI Professional

Bangalore, Karnataka

View Details

Last Date: July 3, 2024

Virtusa

Pega SSA Developer

Full Time

Bangalore, Karnataka

View Details

Last Date: Dec. 31, 2024

Infosys

IT Delivery

8 - 18 Years Exp.

Bangalore, Karnataka

View Details

Last Date: July 14, 2024

Infosys

Consultant - Infrastructure Managem…

5 - 7 Years Exp.

Bangalore, Karnataka

View Details

Last Date: July 1, 2024

Virtusa

React Developer

Full Time

Bangalore, Karnataka

View Details

Last Date: July 31, 2024

KPMG

Digital Trust IT Audit Assistant Ma…

KI Professional

Bangalore, Karnataka

View Details

Last Date: July 3, 2024




More Jobs at Virtusa

Virtusa

Java Fullstack Developer

Full Time

Pune, Maharashtra

View Details

Last Date: Dec. 31, 2024

Virtusa

Architect (ATC)

Full Time

Hyderabad, Telangana

View Details

Last Date: Dec. 31, 2024

Virtusa

Angular Developer

Full Time

Pune, Maharashtra

View Details

Last Date: Dec. 15, 2024

Virtusa

Big Data - Informatica Developer

Full Time

Gurgaon, Haryana

View Details

Last Date: Dec. 20, 2024

Virtusa

AWS devops lead

Full Time

Pune, Maharashtra

View Details

Last Date: Dec. 31, 2024

Virtusa

Java AWS Architect (ATC)

Full Time

Bangalore, Karnataka

View Details

Last Date: Dec. 31, 2024

Virtusa

Consultant

Full Time

Bangalore, Karnataka

View Details

Last Date: Dec. 31, 2024

Virtusa

Java backend developer

Full Time

Hyderabad, Telangana

View Details

Last Date: July 31, 2024

Virtusa

Cypress QA Tester

Full Time

Hyderabad, Telangana

View Details

Last Date: June 30, 2024

Virtusa

Java Full Stack - Tech Lead

Full Time

Hyderabad, Telangana

View Details

Last Date: Dec. 31, 2024

Virtusa

GCP GKE

Full Time

Hyderabad, Telangana

View Details

Last Date: Dec. 31, 2024

Virtusa

Architect (ATC)

Full Time

Pune, Maharashtra

View Details

Last Date: Dec. 31, 2024