IBM

Data Engineer

Posted On

Nov. 8, 2024

Location

Bangalore, Karnataka

Experience Level

Professional

Job Type

Permanent

Apply By

Nov. 29, 2024

Job Description

Introduction
At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so, lets talk.

Your Role and Responsibilities

We are seeking an experienced data engineer to join our team. As a data engineer, you will be responsible for designing, implementing, and maintaining data structures and pipelines for efficient data processing and analysis. Your role will involve working with various databases, including DB2, Cloudant, PostgreSQL, and REDIS. You will collaborate with cross-functional teams to understand data requirements, optimise data flow, and ensure data integrity. Your expertise in data modelling, ETL processes, and database technologies will be instrumental in building robust and scalable data solutions.
Responsibilities:
Design and implement data models and database structures to meet business requirements.
Develop and maintain ETL processes to extract, transform, and load data from various sources.
Optimise data pipelines and workflows for efficient data processing and analysis.
Collaborate with data scientists and analysts to define data requirements and deliver actionable insights
Ensure data quality, integrity, and security throughout the data lifecycle.
Monitor and troubleshoot data pipelines, resolving issues and performance bottlenecks.
Implement data governance and data management best practices.
Stay updated with emerging trends and technologies in data engineering and database management.
Collaborate with cross-functional teams to define data integration strategies and implement data-driven solutions.
Implement data security measures and ensure compliance with relevant regulations and standards.
Document data structures, processes, and workflows for knowledge sharing and future reference.
Mentor junior data engineers and provide technical guidance and support.
Tasks:
Design and implement data models for DB2, Cloudant, PostgreSQL, and REDIS databases.
Develop ETL processes using tools and frameworks such as Apache Spark, Apache Kafka, or Talend.
Optimise data pipelines for performance, scalability, and reliability.
Collaborate with data scientists and analysts to understand data requirements and develop data solutions.
Implement data governance practices, including data quality monitoring and metadata management.
Monitor and analyse data pipelines, identifying and resolving issues or bottlenecks.
Implement data security measures, including access controls and encryption.
Collaborate with database administrators to ensure optimal database performance and availability.
Conduct data profiling and analysis to identify data quality issues and propose solutions.
Implement and automate data validation and testing processes.
Explore and evaluate new tools and technologies for data engineering and database management.

Required Technical and Professional Expertise

Proven experience as a data engineer or similar role
Strong expertise in designing data structures and database modelling
Experience with DB2 and Cloudant databases is required.
Knowledge of PostgreSQL and REDIS databases is a plus.
Proficiency in ETL processes, Pentaho/DataStage, and tools such as Apache Spark, Apache Kafka, or Talend
Familiarity with data warehousing concepts and technologies
Strong SQL skills for data manipulation and querying
Understanding of data governance and data management principles
Knowledge of data security and compliance standards
Experience with data integration and data pipeline optimisation
Familiarity with cloud-based data platforms such as AWS or Azure
Experience with data visualisation tools and techniques is a plus.
Strong analytical and problem-solving skills
Excellent communication and collaboration abilities
Ability to work in a fast-paced and dynamic environment
Continuous learning mindset to stay updated with industry trends and advancements

Preferred Technical and Professional Expertise

none

About Business Unit

The IBM Finance organization is responsible for driving enterprise performance and transformation. We are the financial stewards of IBM, delivering IBM’s financial strategy, developing new business models, and mitigating enterprise risk. Do you have a passion for creating business value? Join our team in accounting, financial planning, pricing, business controls, tax, treasury, business development (acquisitions & divestitures), and global financing.

Your Life @ IBM

In a world where technology never stands still, we understand that, dedication to our clients success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.

Being an IBMer means you’ll be able to learn and develop yourself and your career, you’ll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background.

Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do.

Are you ready to be an IBMer?

About IBM

IBM's greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.

Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we’re also one of the biggest technology and consulting employers, with many of the Fortune 50 companies relying on the IBM Cloud to run their business.

At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it’s time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.

Location Statement

When applying to jobs of your interest, we recommend that you do so for those that match your experience and expertise. Our recruiters advise that you apply to not more than 3 roles in a year for the best candidate experience.

For additional information about location requirements, please discuss with the recruiter following submission of your application.

Being You @ IBM

IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

Jobs at Bangalore

IBM

Data Engineer: Master Data Manageme…

Professional

Bangalore, Karnataka

Data Engineer Apply Now

Job Description

Jobs at Bangalore

More Jobs at IBM

Actively Recruiting Companies at Bangalore, Karnataka

Data Engineer