The Periodic Table doesn't actually give any information about how the elements were formed.
It's probable that some helium (atomic number 2), and maybe a bit of lithium (number 3), were formed in the Big Bang along with the hydrogen (atomic number 1), according to one cosmologist I've read. And you're correct that helium is also a main product of hydrogen fusion in stars.
For the most part, the elements above helium are formed in novas, the explosive events which end the lives of some stars. Of course, we also know that the really heavy elements, such as uranium and radium, are subject to nuclear decay, which splits their nuclei and forms lighter elements.
Anyway, here's a table:
https://www.ptable.com