Don’t worry, my new M4 doesn’t feel much faster either due to all the corporate crapware. Since Windows Defender got ported to Mac it’s become terrible in I/O and overall responsiveness. Any file operations will consume an entire core or two on Defender processes.
My personal M1 feels just as fast as the work M4 due to this.