Yes if you're careful - as far as I'm aware the biggest danger would be the physical one of snapping the flowering stem. Otherwise just dig a hole and pop them in.
That's how i deal with most of my bulbs. I always buy from taylors/walkers half price charity sale in the autumn so they're planted late, in pots, then placed where I think they'd look good in Spring. I don't break many.