You sort by points? Not by polygons? Usually, people will take a central, average points of a polygon and sort by that.