What keeps the big miners from just getting together and agreeing on a high minimum fee, refusing to include any transactions a fee below that threshold?

Normally governments have laws to avoid illegal price fixing but we certainly don't want governments interfering with bitcoin.

So are we basically dependent on the benevolence of miners?