Virtusa
Spark ETL Developer
Job Description
- Experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions using common programming language (Scala, Java, or Python) in a Big Data and Data Warehouse platform. Preferably with at least 5+ years of hands-on experience in a Data Engineering role.
- Experience in building data solution in Hadoop platform, using Spark, MapReduce, Sqoop, Kafka and various ETL frameworks for distributed data storage and processing. Preferably with at least 5+ years of hands-on experience.
- Strong Unix/Linux Shell scripting and programming skills in Scala, Java, or Python.
- Proficient in SQL scripting, writing complex SQLs for building data pipelines.
- Experience in leading and mentoring data engineers, including ownership of internal business stakeholder relationships and working with consultants.
- Experience in working in Agile teams, including working closely with internal business stakeholders.
- Familiarity with data warehousing and/or data mart build experience in Teradata, Oracle or RDBMS system is a plus.
- Certification on Cloudera CDP, Hadoop, Spark, Teradata is a plus.
- Experience in Ab Initio software products (GDE, Co>Operating System, Express>It, etc.), AWS products (S3, EMR, Redshift, etc.) is a plus.
Jobs at Bangalore
Amazon
Sr Technical Program Manager, Tax E…
Freshers/Experienced
Bangalore, Karnataka
Last Date: July 9, 2024
Amazon
Demand Generation Representative
Freshers/Experienced
Bangalore, Karnataka
Last Date: July 2, 2024
Infosys
Senior Java Developer
3 - 5 Years Exp.
Bangalore, Karnataka
Last Date: June 30, 2024
KPMG
Digital Trust Cyber Transformation …
KI Professional
Bangalore, Karnataka
Last Date: July 3, 2024
KPMG
Technology Consulting-TE SAP-SF-EC …
KI Professional
Bangalore, Karnataka
Last Date: July 3, 2024
Infosys
Consultant - Infrastructure Managem…
5 - 7 Years Exp.
Bangalore, Karnataka
Last Date: July 1, 2024
KPMG
Digital Trust IT Audit Assistant Ma…
KI Professional
Bangalore, Karnataka
Last Date: July 3, 2024
More Jobs at Virtusa
Virtusa
Big Data - Informatica Developer
Full Time
Gurgaon, Haryana
Last Date: Dec. 20, 2024
Virtusa
Java AWS Architect (ATC)
Full Time
Bangalore, Karnataka
Last Date: Dec. 31, 2024
Virtusa
Java Full Stack - Tech Lead
Full Time
Hyderabad, Telangana
Last Date: Dec. 31, 2024
Actively Recruiting Companies at Bangalore, Karnataka