There's a library called "unsafe" explicitely for this. I think it's reasonable to expect people to generally not use it, though.
// p points to address 1000
p := (*int)(unsafe.Pointer(uintptr(1000)))
Of course, this is why use of the unsafe package is heavily discouraged.