Drill some holes in the stump then using a cheap paintbrush, paint brush killer over the entire surface of the stump. You can also paint the leaves of any shoots. The brush killer will kill all of the roots preventing the stump from resprouting and seems to be harmless to surrounding plants. I have used this technique many times and it works very well, even on tough stumps like privet.
You can buy brush killer at pretty much any home center or garden center. I use the Bayer brand.
http://www.homedepot.com/p/Bayer-Advanced-32-oz-Brush-Killer-Plus-Quart-Concentrate-704640B/203124091