readdir() is implemented in libc, not the kernel. The kernel interface is getdents() and that has a configurable buffer size.