AI Engineer (LLM)

Remote · Full-time · Senior

Why does MWDN rock?

MWDN connects exceptional tech talent with leading companies across Israel, the USA, Great Britain, and Western Europe. We aim to ensure our employees enjoy a rewarding and secure experience while collaborating with prestigious international clients.

Here’s what you can expect when you get employed by MWDN:

  • Security first. We vet our clients to eliminate risks, ensuring reliability and timely payments for your hard work—no fraud or unforeseen events here!
  • Career support. If a match isn't right, we're here for you. We actively assist our employees in finding new opportunities that fit their skills and aspirations.
  • Legal assistance. We provide guidance on legal matters (e.g., opening and administering your private entrepreneur account, taxes, etc.).
  • Professional development. We offer English courses and other engaging activities, including team-building events.

Why choose us? MWDN is ranked among the top 5 IT employers in our region by DOU, and we pride ourselves on our transparency and commitment to our team. Curious to learn more? Discover what our employees say about us in their DOU reviews: MWDN reviews.

What is your new project?

  • Domain: AI-powered sales co-pilot 
  • Location: Israel, USA
  • Company size: up to 10 employees
  • Founded in: 2025

What makes you a great fit

  • 5+ years in ML/AI engineering, NLP, or applied research roles with hands-on work on LLMs and conversational AI.
  • Proven experience fine-tuning and evaluating large language models for conversation understanding, persona alignment, and domain-specific reasoning.
  • Experience building evaluation pipelines measuring model grounding, coherence, latency, and conversation-quality metrics.
  • Strong background designing and maintaining multi-agent orchestration layers.
  • Proficiency with LangChain, LlamaIndex, or equivalent frameworks to build structured reasoning chains (prompt routing, tool selection, memory caching).
  • Strong background in building distributed, real-time architectures using FastAPI, Redis, Pub/Sub, Cloud Run (or equivalents).
  • Knowledge of observability for LLM systems: latency tracing, token-level monitoring, agent-level analytics.
  • Ability to prototype and optimize prompting strategies, RAG pipelines, and multimodal (speech/text/metadata) integrations.
  • Upper-intermediate+ level of English.

Your day-to-day in this position

  • Fine-tune and evaluate models for sales-conversation understanding, persona alignment, and domain-specific reasoning.
  • Implement and benchmark instruction-tuned and adapter-based methods for context-efficient deployment.
  • Build evaluation pipelines for model grounding, coherence, latency, and coaching-quality metrics.
  • Design and maintain the multi-agent orchestration layer for pre-call, in-call, and post-call workflows.
  • Build structured reasoning chains (prompt routing, tool selection, memory caching) using LangChain, LlamaIndex, or custom frameworks.
  • Integrate streaming transcription, context compression, and stateful session memory for sub-second feedback loops.
  • Lead the design of a low-latency distributed architecture (FastAPI, Redis, Pub/Sub, Cloud Run) to support concurrent real-time coaching sessions.
  • Implement full observability for model behavior: latency tracing, token-level monitoring, and response analytics across agents.
  • Establish model-versioning, evaluation dashboards, and automated rollback protocols.
  • Prototype and test new prompting strategies, retrieval-augmented generation (RAG) configurations, and multi-modal fusion (speech, text, metadata).
  • Collaborate with the data engineering team to design and manage conversational datasets for continual fine-tuning.
  • Stay current with frontier research in LLM systems, reasoning agents, and real-time inference optimization.

Why work with us?

  • People-oriented management without bureaucracy
  • The friendly climate inside the company is confirmed by the frequent comeback of previous employees
  • Flexible working schedule
  • Full financial and legal support for private entrepreneurs
  • Free English classes with native speakers or with Ukrainian teachers (for your choice)
  • Dedicated HR

Our next steps

✅ Intro call with a Recruiter — ✅ Client intro interview — ✅ System design interview — ✅ Livecoding interview — ✅ Offer