I’m not seeing how that’s inconsistent with it being culturally derived?

Your brain is still just pattern matching “minor = sad” based on thousands of hours of examples from the western canon consumed throughout your life regardless of how you dress it up with rhythmic variations.