By that logic, all of the Earth and the moon were once parts of stars, so tidal and geothermal are also solar.

When people say "solar energy", they are usually referring to first order solar energy, directly from photons, not second or third order solar energy after it has been trapped into other sources of potential energy.