With the caveat that my only familiarity with the interface is reading the manual page, it seems like only some modes of perf_event_open are privileged.
this is due to timing attacks you can do with detailed perf info, but also due to the constant stream of bugs found by the perf_fuzzer that took years to fix and it was easier to just lock down by default