Mac notebooks based on plain M1 and M2 chips are limited to one display, period.
Mac notebooks based on plain M3 chips can drive two external displays, but only when their lids are closed, and only with a 5K limit on the "lid closed" display that translates into fewer Retina options for a second 4K one.
A 14" MacBook Pro with a plain M4 chip can drive up to two external displays with the lid open: a first for any Mac notebook with a plain M-series chip.
----------
The M3 MacBook Airs have two multi-purpose USB-C (USB, USB4, DisplayPort, Thunderbolt, Charging) ports, and a MagSafe 3 charging port, that you must use for pretty much everything. Without a Thunderbolt hub or dock, you will not be able to plug two regular (non-Thunderbolt) displays into the same USB-C port. Both ports will be in use, so you will be forced to rely on a plain USB-C hub/dock, or on hub ports on USB-C monitors themselves.
14" MacBook Pros with plain M4 chips have three multi-purpose USB-C ports, a HDMI port, a SDXC card slot, and a MagSafe 3 charging port. (The third Thunderbolt port is a first for any Mac with a plain M-series chip.). So there are four places that you can use to plug in the two displays, and even if you use USB-C for both displays, you would still have one of the multi-purpose USB-C ports open for other stuff. If you connected one display via HDMI, you would have two of the three USB-C ports open.