I have a 15 year old apple tree in the garden which only produces apples the size of marbles, I thinned the apples out this year but have still the same size help.
Maybe that's how they are. Maybe it's a crab apple.
Do you have multiple fruiting spurs on the tree? If so it is these you need to thin out. You can see them more clearly when the leaves drop