You could safely wash it in either group so long as you are using non-chlorine bleach (like Clorox 2). But, if you use chlorine bleach with your whites, then I would not wash this sweater with the whites.
I think it'll be safe to wash it with your whites but really you can wash it with your colors to. i don't think the colors will run. i wash my whites and colors together all the time