Ah that is Alkanet.
It has a very pretty blue flower that the bees love, BUT it will set seed everywhere if you do not control it.
It has quite a deep tap root so dig deep and remove the plant. Just make sure that you remove the seed heads before they scatter as well.
I have it in my garden and am on top of it now.