Senior AI Developer (Generative AI, Python, FastAPI)

Top 3 reasons to join us

• A 13-month salary bonus.
• High-quality health insurance
• WFH as needed.

Job description

Senior AI Developer (Generative AI)

Coder Trove is seeking a Senior AI Engineer to lead the design and development of scalable AI systems for our FinTech platform. This role requires strong hands-on expertise and architectural thinking — especially in Agentic AI and large-scale LLM platforms.

You will help shape our AI strategy, design production-grade systems, and deliver intelligent automation for invoice financing and business workflows.

What you’ll own

• Design and build end-to-end RAG & Agentic RAG pipelines for real-world financial use cases
• Develop multi-agent systems (Planner–Executor, Router, Verifier, Reflection patterns)
• Build and orchestrate agent workflows with strong reliability guarantees
• Implement MCP servers & tool-calling layers for structured, controllable AI execution
• Optimize LLM inference pipelines (latency, throughput, cost) using tools like vLLM, batching, caching
• Set up evaluation frameworks & experiments (A/B testing, offline + online eval) to measure real impact
• Ensure observability & production reliability (tracing, logging, metrics, debugging agent failures)

Your skills and experience

Core Responsibilities

Experience

• 6+ years of professional software engineering experience.
• 5+ years of hands-on Python development.
• Strong experience designing and developing backend systems and distributed applications.
• Experience working with production-grade AI/LLM systems.

Backend & Systems

• Strong Python programming skills.
• Strong understanding of async programming, concurrency, distributed systems, APIs, queueing, retries, and fault tolerance.
• Hands-on experience with SSE and/or WebSockets.
• Experience designing scalable, high-performance backend services.

Agentic AI / LLM

• Hands-on experience building Agentic AI / LLM applications.
• Experience with LangChain and/or LangGraph.
• Experience implementing RAG / Agentic RAG.
• Practical experience with tool calling/function calling/structured outputs.
• Understanding of prompt engineering + AI system architecture.

Data & Retrieval

• Experience building data pipelines or data platforms.
• Practical experience with vector search and/or hybrid search.
• Experience with at least one vector/search technology such as Pinecone, Weaviate, Milvus, FAISS, or Elasticsearch.
• Good understanding of data retrieval, indexing, and query-performance optimization.

Cloud

• Strong hands-on experience with AWS.
• Experience with cloud-native/serverless architectures.
• Familiarity with services such as Lambda, ECS/EKS, S3, SQS, EventBridge, or Step Functions.

AI Evaluation & Optimization

• Experience evaluating AI/LLM systems using measurable metrics such as quality, precision, recall, latency, and cost.
• Experience with at least one AI evaluation/observability tool such as LangSmith, Langfuse, Ragas, or DeepEval.
• Understanding of model benchmarking and practical fine-tuning/model adaptation concepts.

Nice-to-Have

• Experience with MCP (Model Context Protocol).
• Experience with Apache Iceberg / Parquet.
• Experience with Lakehouse / Data Warehouse / OLAP technologies such as ClickHouse, BigQuery, Snowflake, or DuckDB.
• Experience with Kafka / Airflow / streaming data pipelines.
• Experience with vLLM.
• Hands-on experience with LoRA / model fine-tuning.
• Experience with Redis caching.
• Experience with OpenTelemetry.
• Experience with A/B testing frameworks.
• Basic experience with React or other frontend frameworks.
• Azure experience.
• Experience working with production-scale AI systems and optimizing latency, throughput, and cloud cost.

Why you'll love working here

• A 13-month salary bonus.
• 13 days of paid leave and 10 days of sick leave.
• WFH as needed.
• High-quality health insurance and health check-ups.
• Company trips.
• Regular team events with office food delivered twice a week; extra drinks and snacks are always available.
• Support for training and certifications to improve your skills.
• A friendly management team, a flexible working environment, and opportunities for career growth.