Essentially all suppliers (publishers) agreed to set a price on their goods, that's a cartel.
We like to think of books such as Harry Potter when considering publishing, but Harry Potter is a unique item because it has more or less unparalleled popularity. Other fiction books aren't really in competition with Harry Potter, people don't normally say "I am going to either purchase Harry Potter or Hunger Games". They generally purchase both if interested.
Now consider something that is much more of a commodity: Cookbooks. It's quite easy to find a couple of cookbooks from competing publishers, and if one new type of cookbook proves popular (Gluten-free Cooking!), most other publishers will come out with a competing cookbook. Great you say, sounds like competition! Except they have agreed to sell all their cookbooks at $10, so we, the consumers, now have a plethora of books to choose from, but only at one price. That is very, very illegal.
If the different companies had independently decided to change how they charge for books, ok, but their meetings and apparent coordination not just of the agency model, but the actual price makes this a cartel.
The anti-competitive piece is more about Apple making sure Amazon could not undercut the price for competition. Apple wanted 30% profits, no matter the price, and couldn't do that with Amazon in the mix. Apple could have just signed an exclusivity deal for certain books or something, but instead it wanted all books this way, which made it get involved with the publisher's coordinating. Conspiring with the publishers to specifically target a single player (Amazon) is apparently illegal, although I don't know much about that part so much.
If you usually filled up your car at the local station and suddenly an App Station opened across the street and all gas everywhere was suddenly 30% more expensive, the anti-competitive nature would be readily apparent.