Li Jiayin

Senior Software Engineer

Email | Phone

jiayinli55@gmail.com

81070-8581-3174

Osaka, JP

About

Highly experienced AI/ML Engineer with over a decade of expertise in backend systems and applied AI, specializing in transformer-based NLP and end-to-end GenAI pipelines. Proven track record in deploying Large Language Models (LLMs) to production, building scalable APIs, and delivering intelligent automation tools. Adept at optimizing data pipelines and integrating GenAI into real-time applications, leveraging deep understanding of cloud-native tools and human-in-the-loop ML workflows to drive significant impact.

Work Experience

Senior Machine Learning Engineer – GenAI/NLP

Scale AI

Jan 2022 - Jan 2025

Led the development and deployment of advanced GenAI and NLP solutions, focusing on transformer-based models and scalable microservices for production environments.

  • Led development of multilingual NLP pipelines using HuggingFace Transformers for complex NER, classification, and summarization tasks.
  • Engineered scalable FastAPI microservices, deploying them efficiently via Docker and AWS ECS to support high-performance AI applications.
  • Integrated Large Language Models (LLMs) into QA workflows with human-in-the-loop tools, boosting annotation accuracy by 30%.
  • Optimized model serving by deploying transformer models via Triton Inference Server with ONNX, significantly improving inference performance.
  • Orchestrated high-volume asynchronous workloads using Celery and Redis, successfully supporting over 1 million monthly API requests.

Software Engineer – Applied AI & Backend Systems

NTT Data Japan

Jan 2020 - Jan 2022

Designed and implemented robust backend services and AI applications, focusing on data pipelines, real-time monitoring, and production model integration for enterprise clients.

  • Designed robust backend services for enterprise AI applications, leveraging Python and FastAPI for high-performance and scalability.
  • Developed critical predictive maintenance tools and document understanding pipelines, delivering specialized solutions for government and finance clients.
  • Deployed real-time monitoring dashboards and data APIs using PostgreSQL and Redis, enhancing operational visibility and data accessibility.
  • Integrated Scikit-learn and XGBoost models into production-grade services, ensuring reliable performance via REST and gRPC APIs.
  • Led the successful rollout of containerization and CI/CD pipelines using GitHub Actions and Docker on AWS, significantly streamlining deployment processes.

Systems Developer & CS Lecturer

Osaka University of Economics

Jan 2016 - Jan 2020

Developed educational backend systems and introduced modern software development practices while instructing undergraduate students in computer science.

  • Developed Flask-based backend systems to automate student progress tracking and grading, improving administrative efficiency for faculty.
  • Introduced Git-based project workflows and DevOps practices into the Computer Science curriculum, enhancing student development methodologies.
  • Engineered Firebase Auth-based portals with role-based multilingual content delivery, expanding access and usability for diverse student populations.
  • Delivered comprehensive instruction in data science, algorithms, and practical Python programming to undergraduate students, fostering foundational skills.

EdTech Engineer & Math Instructor

Osaka Institute of Technology

Jan 2012 - Jan 2016

Engineered educational technology tools and digitized administrative processes while teaching mathematics and leading curriculum modernization initiatives.

  • Developed educational tools using C++ and Python to facilitate computational math and problem-solving skills for students.
  • Digitized key administrative workflows through custom SQL-backed internal tools, enhancing operational efficiency and data management.
  • Designed assistive learning modules and UI components tailored for special education use cases, improving accessibility and engagement.
  • Led a successful university-wide initiative to integrate Python, Git, and data science into engineering programs, modernizing the curriculum.

Education

Applied Mathematics & Computer Science

Osaka Institute of Technology

Jan 2007 - Jan 2011

Projects

LLM-Augmented Crypto Trading Bot

A GenAI-powered trading bot designed to generate strategies and execute trades in the cryptocurrency market.

Academic Timetable Conflict Resolver

A web application developed to automate conflict-free scheduling for academic timetables.

Panoramic Image Preprocessing Pipeline

An automated pipeline for preprocessing large datasets of panoramic images for machine learning applications.

Skills

Cloud & Backend

  • AWS (Lambda, ECS, API Gateway, S3)
  • Firebase
  • PostgreSQL
  • Firestore

DevOps & Tools

  • Docker
  • GitHub Actions
  • Celery
  • Redis
  • WebSockets
  • Git
  • Postman
  • Figma
  • JIRA

Languages

  • Python
  • JavaScript (TypeScript)
  • Dart
  • SQL
  • C++

AI/NLP & GenAI

  • HuggingFace Transformers
  • OpenAI API
  • LangChain
  • spaCy
  • Triton Inference Server
  • ONNX

Frameworks

  • FastAPI
  • Flask
  • Node.js
  • React
  • Next.js
  • Flutter

Protocols & APIs

  • REST
  • GraphQL
  • OAuth2
  • JWT
  • Microservices
  • CI/CD