💼

Senior AI Engineer at Flipkart

NEW
Location
Bengaluru, Karnataka, India
Job type
Full time
Posted 1 day ago
Description

About the job


About the Team & MissionThe ML Platform team maximizes the speed, throughput, and hardware efficiency of our production Large Language Model (LLM) inference stack. As models scale and real-time demand grows, post-training optimization and aggressive server-level utilization are our primary levers for delivering low-latency AI at sustainable infrastructure economics.We operate at the intersection of LLM serving engines, post-training compression, and bare-metal accelerator architecture. Our mission is to squeeze maximum compute and memory bandwidth out of every server node—turning heavy foundation models into ultra-fast, cost-efficient endpoints.


Role Overview


We are hiring a deeply technical Senior / Staff Software Engineer (Individual Contributor) with 8+ years of experience to partner directly with the Leadership in architecting and scaling our LLM inference platform.In this high-leverage IC role, you will serve as our primary technical anchor for inference performance. You will own end-to-end serving architecture, drive post-training optimization pipelines, eliminate hardware bottlenecks, and guide engineers through complex systems challenges.


Key Responsibilities

  • Post-Training Optimization: Architect and productionize model compression and acceleration pipelines—including quantization (FP8/INT8/INT4), distillation, and speculative decoding—to slash latency (TTFT/ITL) while preserving model quality.
  • Hardware & Server Maximization: Drive bare-metal utilization across multi-GPU and multi-node topologies by optimizing memory bandwidth, tensor core occupancy, interconnects, and parallelism strategies (tensor, pipeline, expert, and disaggregated serving).
  • Inference Engine & Kernel Engineering: Extend modern inference frameworks (such as vLLM or SGLang) and build custom fused kernels and batching schedulers to eliminate compute, memory, and CPU host bottlenecks.
  • Profiling & Automated Diagnostics: Build deep telemetry, roofline modeling, and automated bottleneck-detection workflows to pinpoint hardware stalls and prevent performance regressions in production.
  • Technical Leadership: Partner with Leadership to shape our multi-quarter inference roadmap, author high-clarity RFCs and influence hardware capacity decisions.
  • Mentor Junior Engineers: Level up junior and mid-level engineers through code reviews, pair programming, and hands-on systems coaching.


Minimum Qualifications

  • Education: Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical systems experience.
  • Experience: 8+ years of hands-on software engineering experience in high-performance computing (HPC), ML inference systems, GPU programming, or low-latency distributed infrastructure.
  • LLM Inference Mastery: Proven track record optimizing large-scale LLM serving in production, with a deep understanding of transformer memory footprints, KV-cache mechanics, continuous batching, and latency/throughput trade-offs.
  • Hardware & Systems Depth: Strong grasp of accelerator microarchitecture (compute vs. memory-bound workloads, roofline analysis, memory hierarchies) and multi-GPU server interconnects.
  • Programming Proficiency: Expert-level coding skills in C++ and Python, with experience building low-overhead, production-critical systems software.


Preferred QualificationsGPU & Compiler Internals:


  • Practical experience writing or profiling custom accelerator kernels and working close to ML compilers or runtime execution graphs.
  • Production Compression & Decoding: Track record deploying quantized models or speculative decoding techniques in high-throughput production environments.
  • Open-Source Inference Familiarity: Experience working inside or contributing to modern open-source LLM serving engines and attention libraries.
  • Complex Workload Scaling: Background optimizing Mixture-of-Experts (MoE) routing overhead or ultra-long-context inference workloads.
  • Automated Performance Tooling: Experience building automated benchmarking harnesses, hardware utilization models, or AI-assisted trace debugging tools.


Why Flipkart?

Flipkart is India’s leading e-commerce platform, where innovation meets impact at scale. As part of the AI Solutions team, you will shape the foundational AI infrastructure powering experiences for 500M+ users, millions of sellers, and complex supply chains. Flipkart is part of the Walmart-owned Flipkart Group, which includes Flipkart Wholesale, Flipkart Health+, Cleartrip, Shopsy, Flipkart Travels, and Myntra. Join us to build the platforms that make AI at Flipkart possible.

500+

‘Apply now’ takes you to the job application page after a quick sign-in

Master Backend Engineering
AI-First Software Engineering
Next batch starts on 28 Nov
Always stay in the know!
Join our community and stay notified of latest job opportunities.
500+

‘Apply now’ takes you to the job application page after a quick sign-in

Tap to Apply

Frequently Asked Questions

What is the Senior AI Engineer at Flipkart role?
Chevron down
Where is the Senior AI Engineer at Flipkart job located?
Chevron down
Is the Senior AI Engineer at Flipkart position full-time?
Chevron down
What experience is required for the Senior AI Engineer at Flipkart?
Chevron down
What is the salary for the Senior AI Engineer at Flipkart?
Chevron down
How can I apply for the Senior AI Engineer at Flipkart job?
Chevron down

Why work at Flipkart

A Senior AI Engineer at Flipkart can work on artificial intelligence problems in a large-scale commerce environment. Flipkart’s marketplace connects customers, sellers, and products, creating opportunities for engineering teams to use data and intelligent systems to improve digital experiences and business operations. The precise projects for this position are not specified in the listing, so candidates should confirm the team’s focus and current priorities during the hiring process.

The role is listed as a full-time engineering position in Bengaluru, Karnataka, at the mid-senior level. For an experienced AI professional, that setting may offer the chance to contribute both technical depth and engineering judgment: evaluating approaches, building reliable solutions, and helping a team make sound implementation decisions. The work may involve balancing model quality with practical considerations such as latency, cost, maintainability, and performance at scale, depending on the project.

A position at a large technology company can also expose engineers to collaboration across disciplines. AI systems often depend on more than model development alone. Data availability, infrastructure, product requirements, privacy, monitoring, and user experience can all shape what a successful solution looks like. A senior engineer may need to communicate across these areas and explain how technical choices affect the product or operation.

The job details identify Bengaluru as the location but do not specify compensation, benefits, reporting structure, or team arrangements. Candidates should avoid relying on assumptions about these details and ask the recruiter for current information. The same applies to the team’s tools, model stack, and working practices: these can vary by project and should be confirmed directly.

What’s it like to work at Flipkart?

Working at Flipkart may mean contributing to products and systems that support online shopping and related operations. In a commerce setting, engineering decisions can affect multiple parts of an experience, from how information is organized to how efficiently an internal process runs. Teams may need to consider reliability, scale, and changing customer or business requirements alongside technical quality.

The day-to-day experience depends heavily on the particular team. Some AI engineering projects may emphasize experimentation and model development; others may focus more on production deployment, data pipelines, evaluation, or integration with existing services. A candidate interviewing for the Senior AI Engineer at Flipkart position should ask what the team spends most of its time building, how success is measured, and how responsibilities are divided between research, engineering, and product work.

Collaboration is likely to be an important part of work in a role of this scope. AI engineers commonly work with software engineers, data specialists, product managers, and business stakeholders. The challenge is not simply to build a model, but to understand the underlying problem, choose an appropriate method, and deliver something that can be evaluated and maintained. Senior-level contributors may also be expected to review designs, share technical context, and help resolve trade-offs, though the exact expectations for this opening are not stated in the listing.

When evaluating the workplace, ask practical questions rather than relying on general descriptions of company culture. Useful topics include how teams plan work, how technical decisions are documented, what support is available for professional development, and how production incidents or model regressions are handled. These questions can help you understand whether the team’s environment suits your working style.

What’s it like to work as a Senior AI Engineer at Flipkart?

The Senior AI Engineer at Flipkart role is listed in the Engineering department as a full-time, mid-senior-level position in Bengaluru. The listing does not provide a detailed responsibility list or minimum experience requirement. Therefore, the exact scope should be confirmed with the hiring team rather than inferred from the title alone.

In many senior AI engineering roles, the work spans the lifecycle of an intelligent system. This can include clarifying the problem, identifying suitable data, developing a baseline, comparing modeling approaches, and evaluating results against meaningful criteria. If a solution is intended for production, the engineer may also need to consider deployment, monitoring, reproducibility, and how the system behaves when data or operating conditions change. These are common considerations for the discipline, not confirmed duties for this particular opening.

A senior role can also involve making decisions under constraints. A model with strong offline performance may not be the right choice if it is too costly, slow, difficult to maintain, or unsuitable for the intended users. Engineers may need to weigh predictive performance against interpretability, operational complexity, and the consequences of errors. Clear reasoning about these trade-offs is often as important as technical implementation.

Candidates can prepare to discuss examples that show end-to-end ownership. Select projects where you can explain the original problem, your individual contribution, the data and methods involved, how you evaluated the outcome, and what you learned after deployment or testing. Be ready to describe setbacks and changes in direction as well as successful results. If your experience is relevant to commerce, recommendations, search, forecasting, personalization, or automation, explain the connection clearly without assuming that the Flipkart team works on any one of these areas.

Senior AI Engineer interview questions at Flipkart

The exact interview format and questions for this vacancy are not provided. The following examples are practice questions, not confirmed questions from Flipkart. They can help you prepare for discussions relevant to a senior AI engineering position:

  1. How would you take an AI solution from an initial business problem to a production-ready system?
    Structure your answer around problem definition, data assessment, baseline, evaluation, deployment considerations, and ongoing monitoring.

  2. How do you decide whether a machine-learning approach is appropriate for a problem?
    Discuss simpler alternatives, available data, expected impact, operational constraints, and how you would test the hypothesis.

  3. Describe a model or AI system you have built. What was your contribution?
    Distinguish your own work from the team’s work and explain the reasoning behind key technical choices.

  4. How would you investigate a model whose performance has declined after deployment?
    Consider data quality, distribution changes, instrumentation, recent code or configuration changes, and the choice of evaluation metrics.

  5. What evaluation methods would you use when a single accuracy measure is not enough?
    Explain why metric selection depends on the problem, the cost of different errors, and the needs of the people using the system.

  6. How do you balance model quality with inference latency and infrastructure cost?
    Describe how you would measure trade-offs and compare options such as model size, caching, batching, or alternative architectures where appropriate.

  7. Tell us about a technical disagreement you handled.
    Show how you gathered evidence, communicated trade-offs, listened to other perspectives, and reached a decision.

  8. How do you make AI systems understandable and maintainable for other engineers?
    Discuss documentation, code quality, experiment tracking, reproducibility, testing, and clear operational ownership.

  9. How would you handle missing, noisy, or biased data?
    Explain how you would investigate the issue, assess its impact, document limitations, and determine whether the system is safe and useful for its intended purpose.

  10. How do you guide less-experienced engineers through a complex AI project?
    Share examples of mentoring, review practices, breaking work into manageable stages, and helping others build independent judgment.

For behavioral questions, use a concise structure such as context, responsibility, actions, and outcome. Include concrete evidence where possible, but avoid sharing confidential information from previous employers.

Senior AI Engineer interview preparation at Flipkart

Start by reviewing the job listing and noting what it confirms: the role is Senior AI Engineer, the department is Engineering, the position is full-time, and the location is Bengaluru. The listing identifies the level as mid-senior but does not specify a minimum number of years, required tools, or a detailed project scope. Use the interview process to learn those details.

Refresh the fundamentals that apply to your experience. Depending on your background, this may include machine-learning concepts, statistical reasoning, model evaluation, data preparation, software engineering, and production system design. Be prepared to explain not only what a method does, but why it suits a particular problem and what its limitations are. For AI projects, practice describing the relationship between offline evaluation and real-world performance.

Prepare two or three detailed project stories. For each, be ready to cover:

  • The problem and why it mattered.
  • The data and assumptions you worked with.
  • The methods or architecture you considered.
  • How you evaluated alternatives.
  • Your specific contribution and collaboration with others.
  • Deployment, monitoring, or operational considerations, if applicable.
  • The result, limitations, and lessons learned.

Also review system design topics relevant to AI products. Think about how data enters a system, how predictions or generated outputs are served, how failures are detected, and how updates are introduced safely. If you have worked with large-scale systems, explain the scale in terms you can substantiate, such as traffic patterns, data volume, or latency requirements. Do not claim experience with tools or platforms you have not used.

Finally, prepare questions for the interviewer. Ask what problem the team is hiring this engineer to solve, which parts of the AI lifecycle the role owns, how the team measures success, and what technical challenges are most pressing. These questions help you tailor your answers while assessing whether the role aligns with your strengths and interests.

Senior AI Engineer interview tips at Flipkart

Be precise about your impact. Senior interviews often explore how candidates make decisions and influence outcomes. Explain what you personally delivered, where teammates contributed, and how you know the work made a difference.

Show sound engineering judgment. A strong answer does not assume that the most complex model is always best. Explain how you compare alternatives and account for quality, reliability, cost, latency, and maintainability.

Connect technical choices to the problem. Define the goal before discussing algorithms or infrastructure. A clear link between the user or business need, the design choice, and the evaluation approach makes your reasoning easier to follow.

Communicate uncertainty honestly. If you do not know a particular detail, explain how you would investigate it. For a role whose public listing provides limited technical requirements, thoughtful questions are more useful than guessing about the team’s tools or projects.

Use examples with a clear structure. Keep answers focused, then add technical depth when asked. If you describe a challenge, make sure you explain the action you took and the result or lesson that followed.

Confirm the role’s specifics. Ask about the team, responsibilities, interview stages, compensation, and working arrangements directly with the recruiter. The available job details do not state these items, and they may vary by team or over time.

A thoughtful preparation plan can help you present yourself effectively for the Senior AI Engineer at Flipkart opportunity: demonstrate strong AI and engineering fundamentals, explain your decisions clearly, and show how you approach building systems that are useful, dependable, and practical to operate.