Lead Software Engineer- AI Agent Developer
An AI agent that applies to roles like this on employers' own sites. 25 applications free, no card needed.
Job Description
Join us to advance your software engineering career while building impactful technology solutions. Grow your skills and make a difference with a collaborative team.
Were seeking a Lead Software Engineer (AI/ML) to build and operate scalable, low-latency autonomous agent systems in production. Youll lead the design and delivery of agentic platforms that reliably serve 100K+ customers, combining strong software engineering fundamentals with deep hands-on expertise in foundation models and LLM-powered architectures.
Job responsibilities
- Architect and ship autonomous agent systems that are scalable, resilient, and production-grade (latency, reliability, security, and uptime).
- Design agentic architectures (planner/executor patterns, multi-agent orchestration, tool use, retrieval, and workflow execution).
- Build robust tool interfaces and tool ecosystems (APIs, function calling patterns, permissions, and safe execution).
- Engineer context, memory, and state management strategies (short/long-term memory, summarization, retrieval, grounding, and caching).
- Own model evaluation and quality measurement (offline/online evals, regression testing, and failure-mode analysis).
- Implement end-to-end observability for LLM systems (tracing, metrics, logging, prompt/tool telemetry, incident response).
- Drive cost and performance optimization across models and infrastructure (throughput, batching, caching, routing, quantization, and inference efficiency).
- Mentor engineers and set engineering standards for production AI systems (code quality, design reviews, and operational excellence).
Required qualifications, capabilities and skills
- 8+ years of software engineering experience, including leading design and delivery of large-scale production systems.
- Demonstrated experience building and operating LLM/agentic systems in production with strict latency and reliability requirements.
- Strong understanding of foundation models, LLM behavior, prompting strategies, and tool-augmented generation patterns.
- Strong understanding of Knowledge graph (Neo4J preferred), Open Knowledge formats (OKFs)
- Proven expertise in context and memory engineering, model evaluation methodologies, and quality measurement.
- Experience implementing observability for distributed systems and AI applications (tracing/metrics/logs, dashboards, alerting, on-call readiness).
- Strong programming skills in one or more of: Python, Java, Go, or TypeScript plus strong API and distributed-systems fundamentals.
- Familiarity with retrieval systems, vector databases, and hybrid search patterns.
Preferred qualifications, capabilities and skills
- Agentic AI architecture: planner/executor patterns, multi-agent orchestration, tool-use design, retrieval workflows
- LLM/foundation model expertise: prompting strategies, tool-augmented generation, model behavior understanding
- Context & memory engineering: short/long-term memory, summarization, retrieval grounding, caching strategies
- Knowledge graphs: Neo4J (preferred), Open Knowledge Formats (OKFs)
- Retrieval systems: vector databases, hybrid search patterns
Skills
PythonDistributed SystemsJavaTestingApiSoftware EngineerDeveloperIf a job posting appears fraudulent, asks for payment, contains misleading information, or violates our guidelines, please report it immediately. Our team will review it promptly, Jobaaj does not charge any fee from the applicants.
About Company
JPMorgan Chase & Co. is the largest bank in the United States and a leading global financial services firm, with assets of over US $4 trillion and operations in 100+ countries. Headquartered in New York City, the firm serves millions of consumers, small businesses, corporations, governments, and institutions under its J.P. Morgan and Chase brands.
Its business segments include Consumer & Community Banking, Corporate & Investment Bank, Commercial Banking, and Asset & Wealth Management. Known for its fortress balance sheet, innovation in digital banking, and commitment to sustainability, JPMorgan Chase invests heavily in technology, AI, and cybersecurity to deliver secure, customer‑centric solutions.
In India, JPMorgan Chase operates across Mumbai, Bengaluru, and Hyderabad, with large Global Service Centers supporting technology, operations, finance, and risk functions. The firm is recognized for its diverse talent base, employee development programs, and community impact initiatives.
Similar Jobs
View allLooking for something similar?
New IT / Software Development & Related roles in Bengaluru / Bangalore.
One email a day. Unsubscribe any time.

