There was a firmware update[1] to fix various issues with the trackpad – are the annoyances you describe there even after applying the update?

[1] https://forum.pine64.org/announcements.php?aid=23