There's much more public info out there now, and machining has improved significantly in the past 50 years, so the main barrier to building a crude bomb is material rather than the expertise or machining.
However, building something which squibs, i.e. undergoes a partial criticality and goes bang in a reasonably large but not city-killing way, and spreading a bunch of radioactive material about, is probably much easier. (This is the 'dirty bomb' thing that was getting the press excited a couple of years back.)
(Fun fact: if you're locked in a room with a nuke on a timer, your best option is probably to beat the shit out of it with an axe. Provided you can physically damage it enough to upset the implosion geometry, it won't go off properly. Of course, you'll still die, but...)
My understanding is that dirty bombs don't even necessarily undergo any nuclear reaction. You don't even need the right kind of material for them. It's just a traditional bomb with radioactive material strapped to it.
Maybe we're better off forgetting about a bomb completely. Grind it up fine, watch while it spontaneously catches fire (plutonium chemistry is weird!), dissolve the plutonium oxide in nitric acid, water down and then drive around the city spraying it into the air in a fine mist...
If ISIS starts turning out their own rifles, ammo, truck repair parts, maybe some drones or something, or otherwise demonstrates dedication at a societal level to designing and building things, then I'd start to worry. As it is now, it's pretty hard to buy.
And speaking of potential damage, a nuclear blast is just the start of the potential issues. The real question, if somebody managed to pull that off, is how would the target of such an attack reply? How would the allies of that target think and expect, and how would any countries that are rivals to the target and/or allied/sympathetic to the suspected attackers react to the response?