Databricks Consultant (AI)

Company Description

Yoda Tech Pte. Ltd., headquartered in Singapore, specializes in breaking down digital transformation into manageable micro-initiatives using ready-to-deploy Micro-bots. By focusing on Automate + Robotize, Power Application Development, and streamlined Infrastructure, Maintenance, and Support services, Yoda Tech helps businesses lower their IT operations expenses. With a commitment to innovation, the company delivers efficient and sustainable technological solutions tailored to meet modern business needs.

Job Summary

We are seeking a skilled Databricks Consultant with 4+ years of experience to design, develop, and deploy scalable AI and data solutions on the Databricks platform. The ideal candidate will have hands-on experience in AI agent development using Agent Bricks, machine learning workflows, and advanced analytics leveraging the Databricks ecosystem. This role involves building intelligent data pipelines, developing AI-powered agents, and optimizing data platforms for enterprise use cases.

Key Responsibilities

• Design and implement AI-driven solutions on the Databricks platform.
• Develop and deploy AI agents using Agent Bricks and Databricks AI capabilities.
• Build and maintain data pipelines using Databricks, Spark, and Delta Lake.
• Develop and operationalize machine learning models using Databricks ML and MLflow.
• Integrate LLM-based AI agents with enterprise data sources and applications.
• Optimize data workflows and performance within Databricks environments.
  
• Collaborate with data engineers, data scientists, and business stakeholders to translate requirements into scalable AI solutions.
• Implement best practices for data governance, security, and model lifecycle management.
• Monitor and maintain AI models and agent-based workflows in production environments.
• Provide technical guidance and support for Databricks-based AI implementations.

Required Skills & Qualifications

• 4+ years of experience in Data Engineering, Data Science, or AI development.
• Strong hands-on experience with Databricks platform.
• Proficiency in Python, PySpark, and SQL.
• Experience building AI agents using Agent Bricks or similar agent frameworks.
• Experience with Apache Spark and distributed data processing.
• Hands-on experience with Delta Lake, Databricks Workflows, and Unity Catalog.
• Experience with ML lifecycle management using MLflow.

• Looking to get Placed? Try our Placement Guarantee Plan

  Get Hired
  Familiarity with LLMs, Generative AI, and AI orchestration frameworks.
• Strong understanding of data architecture and cloud data platforms.

Preferred Qualifications

• Experience with Databricks Mosaic AI / AI Functions / Vector Search.
• Experience with LLM integration, RAG architectures, or conversational AI.
• Hands-on experience with Azure Databricks, AWS Databricks, or GCP Databricks.
• Knowledge of LangChain, LlamaIndex, or agent-based AI architectures.
• Databricks certifications such as Databricks Data Engineer Associate/Professional.

Nice to Have

• Experience building enterprise AI copilots or automation agents.
• Exposure to MLOps, CI/CD pipelines, and model monitoring.
• Knowledge of data governance and compliance frameworks.