If you have a furnace or air handler, it should already be sized to change the air inside a building multiple times per hour which should keep the air nice and clean assuming you change the filters when needed. ‘Change the air’ in this case means the entire air volume of the building passes through the filter, not a total exchange of indoor and outdoor air.

If you want a quiet but expensive solution that doesn’t involve a properly sized air handler, read on.

The solution here is to put the fan outside the building mounted on ductwork that goes inside the building with a damper you can open and close. “Powered roof ventilator” is what you should google.

Then add in a makeup air fan that is interlocked with the exhaust fan (and the dampers on both the exhaust fan and makeup air unit) outside and mounted on ductwork so your house isn’t negatively pressurized which would have the opposite effect, dirt and dust would enter the house. “Makeup air fan” is what you should google.

If you’ve ever been in a commercial kitchen, the vent hood is connected to ductwork that goes outside the building where the exhaust fan in mounted, and there’s always a makeup air unit mounted outside sized roughly the same (cfm) as the exhaust fan to push air into the kitchen to maintain the air pressure and prevent negative pressurization. A (typical modern) large building has multiple intake and exhaust fans that work in concert with a building automation system to maintain air pressure. The idea is to maintain slight positive pressure with respect to the outside air pressure to prevent dust and dirt from being sucked into the building.