Virtusa
Big data architect
Job Description
- Position: Big data architect
- Location: BLR
- Primary skills: Big data hadoop spark & aws
- Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive and Impala. Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing configuring and supporting Hadoop Perform analysis of vast data stores. Good understanding of cloud technology. Must have strong technical experience in Design Mapping specifications HLD LLD. Must have the ability to relate to both business and technical members of the team and possess excellent communication skills. Leverage internal tools and SDKs, utilize AWS services such as S3, Athena, and Glue, and integrate with our internal Archival Service Platform for efficient data purging. Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management. Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs.
Performed database health checks and tuned the databases using Teradata Manager.
Develop and maintain data platforms using Python
Work with AWS and Big Data, design and implement data pipelines, and ensure data quality and integrity
Collaborate with crossfunctional teams to understand data requirements and design solutions that meet business needs
Implement and manage agents for monitoring, logging, and automation within AWS environments
Handling migration from PySpark to AWS
Jobs at Bangalore
Virtusa
Senior Full Stack Developer
Full Time
Bangalore, Karnataka
Last Date: Dec. 31, 2024
Merck KGaA
Senior Specialist - Manufacturing C…
D - Professional (4-9 years)
Bangalore, Karnataka
Last Date: July 2, 2024
Infosys
SAP FICO Consultant
9 - 11 Years Exp.
Bangalore, Karnataka
Last Date: June 30, 2024
TCS
TCS Hiring for SAP Fiori/UI5 Consul…
5 - 12 Years
Bangalore, Karnataka
Last Date: Aug. 31, 2024
Amazon
Senior Applied Scientist , Books Co…
Freshers/Experienced
Bangalore, Karnataka
Last Date: July 9, 2024
Infosys
Cyber Security Consulting and Advis…
11 - 20 Years Exp.
Bangalore, Karnataka
Last Date: June 30, 2024
Infosys
.net and JM - GDLYOH
3 - 10 Years Exp.
Bangalore, Karnataka
Last Date: June 30, 2024
Razorpay
Senior Manager - Domestic Payments
Freshers/Experienced
Bangalore, Karnataka
Last Date: July 6, 2024
Infosys
Power Programmer - Senior Technolog…
8 - 15 Years Exp.
Bangalore, Karnataka
Last Date: June 30, 2024
KPMG
Digital Trust IT Audit Assistant Ma…
KI Professional
Bangalore, Karnataka
Last Date: July 3, 2024
More Jobs at Virtusa
Virtusa
Senior Pega SSA Developer
Full Time
Hyderabad, Telangana
Last Date: Dec. 31, 2024
Virtusa
QA Automation Tester (Data Tester)
Full Time
Bangalore, Karnataka
Last Date: Dec. 31, 2024
Virtusa
Infor Functional Architect
Full Time
Bangalore, Karnataka
Last Date: Oct. 31, 2024
Actively Recruiting Companies at Bangalore, Karnataka