IOAI Philippines 2026 NLP Lecture

IOAI Philippines 2026 NLP Lecture

Prepared by: Lj V. Miranda

NLP training materials for the Philippine Team for the International Olympiad for AI.

Read the problem

Make sure to read the problem twice!

What is the key evaluation metric? What are the restrictions?

Implement a baseline

What is the simplest solution I can write right now?

Your goal is to establish the evaluation loop, an easy way to iterate over solutions.

Check for errors

Have I implemented the baseline correctly?

Learn how to spot silent errors: no error message, but they show up in your eval signal.

Enhance the solution

There are many ways to enhance a solution:

  • Ensembling
  • Scaling
  • ...and more

Problems

  1. SkyAssist Intent classification and slot filling for an airline voice assistant.
  2. Corrupted Transformers Repairing damaged transformer checkpoints: a zeroed embedding table, then shuffled and zeroed layers.
  3. The Stripped Transformer Reading multiple-choice answers out of a stripped causal language model with a small probe.