I think it'd be an improvement:

Up/Down [ Agreement; no real filtering mechanic ]

Tag -> Reason [ Other filtering / reactions ]

Flag -> spam filter signal

However, I think a real universal solution is unfortunately just non-obvious and likely not anything we've tried so far.