I hadn't heard about YaCy even though I'm in their game. I too run a search engine that doesn't use a link graph for scoring relevance. My bet is on semantic relevance over PageRank, because I think our understanding of language models have become so sophisticated we can start relying on them solely.
Also, it's harder I think to game a language model when compared to a page rank model.
What do you think is lacking from non-link graph search engines?
EDIT: maybe I misunderstood b/c it says here YaCy _has_ a link graph: https://yacy.net/en/API.html