Part of the issue is the weird way airlines label the groups. If you're not familiar with Delta's process and have "boarding group 1" printed on your boarding pass, why wouldn't you go up first? (I think boarding group 1 boards seventh, after people needing extra time, active duty military, first/Diamond, business, Comfort+, Sky Priority. It's possible that some of those are combined; I'm not entirely sure.)