What a neurologist will do, at best, is give you an fMRI to pinpoint what part of you brain has "abormal activity". (I also have deja vous seizures, and in my case it was my right temporal lobe.) Which, as cool as that may be, is completely useless as far as fixing the problem. If your seizures aren't causing distress in your life, the neurologist will essentially just tell you to never drive or operate heavy machinery, and send you home.
If you do feel that your seizures are causing distress in your life, or might be putting you at risk of harm, then yes, you should definitely talk to a neurologist, because there are medications that may be able to help.