Infatoshi/kernrl-training

kernrl Training Materials

Training resources for the kernrl GPU kernel optimization environment.

Overview

This repository contains:

• GRPO training notebook for training LLMs to write optimized GPU kernels
• Example scripts and configurations

Quick Start

from trl import GRPOConfig, GRPOTrainer
from kernrl import kernrl_env, KernelAction

# Connect to kernrl environment
env = kernrl_env(base_url="http://localhost:8000")

# Train with GRPO
trainer = GRPOTrainer(
    model="Qwen/Qwen2.5-Coder-1.5B-Instruct",
    reward_funcs=[reward_compilation, reward_correctness, reward_speedup],
    train_dataset=dataset,
    rollout_func=rollout_func,
    args=GRPOConfig(use_vllm=True, vllm_mode="colocate"),
)
trainer.train()

Files

• kernrl_grpo_training.ipynb - Complete GRPO training notebook
• train_kernrl.py - Standalone training script

Links

• kernrl Environment
• OpenEnv Repository
• TRL Documentation