Finetuning LLMs

Prof. Dr. Mirco Schoenfeld

Motivation

Most likely, your company is very much interested in setting up a chatbot, knowledge base, or the like which uses a fine-tuned LLM.

Motivation

But what is actually needed to set up such a pipeline “in production”?

It’s your turn

What is needed to fine-tune your an LLM?

  • What base model to use?
  • What requirements exist?
  • What size of training data do you need?
  • What overall performance can you expect?
Back to Lecture Website