Google

Staff Software Engineer, Machine Learning Infrastructure, Google Cloud

Job Description

  • Design, implement and advance the telemetry capabilities needed for monitoring and evaluating the fleet-wide efficiency of ML resources (TPUs and GPUs). This includes identifying the right underlying signals, devising the right high-level metrics of interest, and creating common dashboards for highlighting fleet-wide performance and efficiency.
  • Identify opportunities to improve the efficiency of the ML fleet and build solutions and capabilities to improve ML fleet efficiency.
  • Build reporting and analytic solutions with key partners,  and provide in-depth analysis of the metrics to improve the operation and utilization of ML resources. 
  • Drive collaboration with various teams (across different PAs) as needed to accomplish the efficiency improvement goals.
  • Lead junior SWEs towards delivering project goals.

Minimum qualifications:

  • Bachelor's degree in Computer Science or a related technical field or equivalent practical experience.
  • 8 years of experience with software development in one or more programming languages, and with data structures/algorithms.
  • 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
  • 5 years of experience with machine learning algorithms and tools (e.g., TensorFlow), artificial intelligence, deep learning or natural language processing.

Preferred qualifications:

  • Experience with Kubernetes, Google Kubernetes Engine, GPU Programming, TensorFlow, and Cloud.
  • Experience analyzing ML models performance or working on LLM prompting, training or developing LLMs.
  • Experience and knowledge of CPU/GPU architecture or HW accelerators
  • Ability to quickly adapt to new tools, frameworks, and languages.
  • Bachelor's degree in Computer Science or a related technical field or equivalent practical experience.
  • 8 years of experience with software development in one or more programming languages, and with data structures/algorithms.
  • 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
  • 5 years of experience with machine learning algorithms and tools (e.g., TensorFlow), artificial intelligence, deep learning or natural language processing.

Google Cloud's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google Cloud's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. You will anticipate our customer needs and be empowered to act like an owner, take action and innovate. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

In this role, you will join a team that's part of Google's Core ML organization, focused on optimizing Google's Machine Learning resources. You will help develop monitoring tools and dashboards to track the performance and efficiency of TPUs and GPUs, which are used across all Google products. This data helps to improve resource allocation, identify areas for improvement, and drive efficiency gains across Google's products.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.


Jobs at Bengaluru

Oracle

Senior Consultant - Java React JS

Professional

Bengaluru, Karnataka

View Details

Last Date: June 1, 2025

Oracle

Technical Writer 3-ProdDev

Professional

Bengaluru, Karnataka

View Details

Last Date: March 24, 2025

Oracle

Senior Software Developer

Professional

Bengaluru, Karnataka

View Details

Last Date: Feb. 3, 2025

Amazon

SDE II, Amazon India Ads

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 4, 2025

Oracle

Software Development Director

Professional

Bengaluru, Karnataka

View Details

Last Date: March 19, 2025

Oracle

Customer Success - Oracle Financia…

Professional

Bengaluru, Karnataka

View Details

Last Date: March 18, 2025

Oracle

Corporate Banking Business Analyst

Professional

Bengaluru, Karnataka

View Details

Last Date: Feb. 27, 2025

Oracle

Consulting OFSAA Technical Manager

Professional

Bengaluru, Karnataka

View Details

Last Date: Feb. 22, 2025

Oracle

Senior Site Reliability Engineer

Professional

Bengaluru, Karnataka

View Details

Last Date: Feb. 23, 2025

Oracle

Software Developer 3

Professional

Bengaluru, Karnataka

View Details

Last Date: May 28, 2025

Oracle

QA Analyst 3-ProdDev

Professional

Bengaluru, Karnataka

View Details

Last Date: June 17, 2025

Oracle

Payroll Analyst 1-Fin

Professional

Bengaluru, Karnataka

View Details

Last Date: May 31, 2025




More Jobs at Google

Google

Software Engineer, Machine Learning…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 6, 2025

Google

Senior Software Engineer, Android, …

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 13, 2025

Google

Strategy and Operations Manager II,…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 13, 2025

Google

Product Manager, Application Integr…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 6, 2025

Google

Senior Software Engineer, Infrastru…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 13, 2025

Google

Senior Software Engineer, Android, …

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 6, 2025

Google

Strategic Cloud Engineer, Looker BI

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 13, 2025

Google

Software Engineering Manager II, Pa…

Freshers/Experienced

Hyderabad, Telangana

View Details

Last Date: Feb. 6, 2025

Google

Business Analyst, Go-to-Market, Goo…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 13, 2025

Google

Data Scientist, Product, Advertiser…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 13, 2025

Google

Software Engineer III, Android, Wat…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 6, 2025

Google

Technical Solutions Engineer, Infra…

Freshers/Experienced

Bengaluru, Karnataka

View Details

Last Date: Feb. 13, 2025




Actively Recruiting Companies at Bengaluru, Karnataka