Unless you're confused about the term backpackers itself, in which I mean a hostel.
I've never seen the plural word backpackers used as a singular synonym for hostel.
It appears to be a Australian/New Zealand English term, I guess it's abbreviated from backpackers' hostel. Somewhere along the line the apostrophe was lost, so now it's backpackers.