Kitten should take kitten food, because kitten food has high protein and fat which fit for the development in kitten stage. If adult cats have the kitten food, they might be over weight if having too much calories.
You can separate them into different rooms when feeding them the cat food.