Though some saying having to use a passport to travel within your own country defeats the purpose of the country.
There are some border controls between Ireland including Northern Ireland and the UK now. If you look out of place, you should be prepared to be challenged.