Doesn't sound like you're out of your depth. It's been done with a worse receiver - https://www.rtl-sdr.com/detecting-pulsars-rotating-neutron-s...
Thanks for the link btw!
From the linked article: "... With their system [...] they were able to estimate that the minimum dish aperture required to observe the Vela pulsar would be 6m, noting that the Vela pulsar is probably the strongest pulsar ever detected"
As a kid, I built a crystal radio. There it was the same: with a very long wire, even such a simple radio could receive far-away stations