Virtusa
Senior Data Engineer
Job Description
8+ years of experience in implementing functionalities using Pyspark , Python and AWS services(Glue, Athena, Lambda).
Strong hands-on experience in AWS Glue, Athena, S3, Glacier, EC2
Experience in writing Spark scripts for loading and transforming the data in Qubole
Experience in AWS Athena for creating tables, DDLs and End to End testing
Experience in SQL and NOSQL needed for writing queries, procedures etc.
Experience in AWS Glue for creating Crawlers, classifiers and tables in AWS GLUE catalog on top of the AWS S3 data.
Experience in PySpark and SparkScala script
Experience in Building data pipeline design using Lambda
Experience in customized dashboards using spark, Hive, Elastic search and D3
Experience in Spark streaming application code development (Writing spart streaming jobs) with Kafka
Experience working in an Agile/DevOps environment and Well versed with DevOps CI/CD concepts and implementation
Good knowledge in Java, JSP, Structs, Spring, Hibernate, REST APIs, JUNITs
Good knowledge on Event based frameworks, Spring Boot, Apache camel
Jobs at Bangalore
Infosys
Technology Lead
5 - 10 Years Exp.
Bangalore, Karnataka
Last Date: June 30, 2024
Virtusa
Abinitio - Associate Architect
Full Time
Bangalore, Karnataka
Last Date: Dec. 31, 2024
Virtusa
Senior ReactJs Developer
Full Time
Bangalore, Karnataka
Last Date: Feb. 28, 2025
Infosys
Java + .Net Developer
3 - 5 Years Exp.
Bangalore, Karnataka
Last Date: June 30, 2024
Infosys
Oracle SOA Developer
2 - 5 Years Exp.
Bangalore, Karnataka
Last Date: June 30, 2024
Virtusa
Senior Java AWS Developer
Full Time
Bangalore, Karnataka
Last Date: Dec. 31, 2024
KPMG
AEM Developer – Senior Consultant- …
KI Professional
Bangalore, Karnataka
Last Date: July 3, 2024
KPMG
Technology Consulting-DT Intelligen…
KI Professional
Bangalore, Karnataka
Last Date: July 3, 2024
More Jobs at Virtusa
Virtusa
Dot Net React JS Developer
Full Time
Chennai, Tamil Nadu
Last Date: Dec. 31, 2024
Virtusa
Senior Mainframe Developer
Full Time
Bangalore, Karnataka
Last Date: June 30, 2024
Virtusa
Senior Software Engineer
Full Time
Hyderabad, Telangana
Last Date: Dec. 31, 2024
Virtusa
Business Analyst - Cards & Payments
Full Time
Thane, Maharashtra
Last Date: Dec. 31, 2024
Actively Recruiting Companies at Bangalore, Karnataka