Remove diseased, damaged, congested or crossing shoots. Shoots that are growing in unwanted directions can also be pruned out.
I love these trees and like you would be happy to enjoy it while it grows slowly. I was told too that it could be kept to a size you wanted by trimming it. Not exactly sure if that's true but I'd hedge my bets and buy one myself! They are so pretty and great for wildlife and birds.