PredictaBoard is a novel benchmark for measuring the predictability of Large Language Models.