Virtusa
Spark ETL Developer
Job Description
- Experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions using common programming language (Scala, Java, or Python) in a Big Data and Data Warehouse platform. Preferably with at least 5+ years of hands-on experience in a Data Engineering role.
- Experience in building data solution in Hadoop platform, using Spark, MapReduce, Sqoop, Kafka and various ETL frameworks for distributed data storage and processing. Preferably with at least 5+ years of hands-on experience.
- Strong Unix/Linux Shell scripting and programming skills in Scala, Java, or Python.
- Proficient in SQL scripting, writing complex SQLs for building data pipelines.
- Experience in leading and mentoring data engineers, including ownership of internal business stakeholder relationships and working with consultants.
- Experience in working in Agile teams, including working closely with internal business stakeholders.
- Familiarity with data warehousing and/or data mart build experience in Teradata, Oracle or RDBMS system is a plus.
- Certification on Cloudera CDP, Hadoop, Spark, Teradata is a plus.
- Experience in Ab Initio software products (GDE, Co>Operating System, Express>It, etc.), AWS products (S3, EMR, Redshift, etc.) is a plus.
Jobs at Bangalore
Infosys
Sitecore Architect
8 - 11 Years Exp.
Bangalore, Karnataka
Last Date: June 30, 2024
KPMG
Technology Consulting-DT Intelligen…
KI Professional
Bangalore, Karnataka
Last Date: June 19, 2024
Infosys
Oracle Fusion/EBS Financials Consul…
2 - 5 Years Exp.
Bangalore, Karnataka
Last Date: June 30, 2024
Amazon
Support Ops Specialist, Support Ope…
Freshers/Experienced
Bangalore, Karnataka
Last Date: June 25, 2024
Infosys
Technical Trainer
6 - 12 Years Exp.
Bangalore, Karnataka
Last Date: Aug. 23, 2024
Capgemini
Senior Infrastructure Consultant - …
Experienced
Bangalore, Karnataka
Last Date: June 19, 2024
More Jobs at Virtusa
Virtusa
Senior Mainframe Developer
Full Time
Bangalore, Karnataka
Last Date: June 30, 2024
Virtusa
Junior Software Engineer-Java Job i…
Full Time
Chennai, Tamil Nadu
Last Date: June 26, 2024
Actively Recruiting Companies at Bangalore, Karnataka