Critical illness is any immediately life-threatening disease or trauma and results in several million deaths globally every year. Responsive hospital systems for managing critical illness include quick and accurate identification of the critically ill patients. Prognostic prediction models are widely used for this aim. To be clinically useful, a model should have good predictive performance, often measured using discrimination and calibration. This is not sufficient though: a model also needs to be tested in the setting where it will be used, it should be user-friendly and should guide decision making and actions.