Starter works fine is not an accurate diagnosis...
The starter relies on 100% power to engage the starter bendix and have enough torque to turn the motor over. A 4 brush motor will still work on 2 brushes but won't have the speed or power to start the engine.
Check your battery under load as well. You might have a cell dead. It should hold 10v with the starter engaged.