Display Show All Link should expand that category

Surely if you have a Latest Blogs module which can filter by category or tag etc. The show All Link should show all of whichever category or tag you have chosen, not every blog from all categories?? If this can't be done, then it should be an extra option to expand the chosen filter selected.