Deciding on a Sorting Hat