??? You may be thinking of Kuro5hin.org, which was started for that reason.

Slashdot has never, ever, allowed user reputation to influence the front page. It’s always been top-down, absolute editorial control - in fact, to the extent that some editors were infamous for being abusive or playing favorites with their friends.

The comment-pit is as you say, and that was indeed innovative - though note some editors have also been known to abuse power there too (though I’d grant the accusation is certainly made more often that warranted - but the problem is you can’t tell!).

I think you’re right about the challenge. It’s the old popular vs. accurate problem, and editorial fiat thrown in for good measure.