Could I have an Atom feed for each category (tag) please?

Of course! Just go to any tag page, like this one, and add /feed/ to the end of it. To get an Atom feed just add /feed/atom/ to the end of it.