I've had allergy/asthma-ish symptoms for years now---I went in for testing (finally) and turns out I'm mildly allergic to cats! But I've lived with two out of the three powder down birds (including Sully, my tiel who was so dusty he'd leave a dust-print on your shirt if you hugged him!) and yeah occasionally if I get a big dose of birdie dust I'll sneeze, and yeah if the room is particularly dusty from birdie stuff that it gets a little tough to breathe. But i don't think that necessarily means oh god I'm going to get bird keeper's lung.
The only cases i've seen where people developed bird keeper's lung were people with many, many birds, especially those who weren't kept clean and the air wasn't filtered---or if you had a lung disease already/were immunodeficient/sensitive.
I come from an allergy/ezcema/asthma prone family, I don't take nearly the precautions you do (and admittedly, I have mental health issues so there was one summer when I was fifteen where the mirrors were fuzzy with bird dust), and I haven't always lived in the cleanest house and yet, here I am six...seven years down the road and not a hint of bird allergies or bird keepers lung.
So I'd say, if you can, keep up your cleaning routine, but don't stress over birdie dust




