Leveling the Playing Field for All Factor Sizes