I used this acne medication, and it seriously dryed out my skin. Then to get rid of the flakes i used moisturizer which is making me break out again. Does anyone know of an acne cleanser that DOESNT dry your skin out and a moisturizer that isnt gonna make me break out?

Back in December I had some zits on my chin. I used an all natural acne stick and it just really dried my skin out in that spot. All winter long my chin was dry and peely. No matter how much I moisturized it. I thought maybe I just over used the acne stick. Then I noticed I would get these little red bumps on my cheeks or even neck. They are really tiny and unlike anything I have ever had. Almost like a rash maybe.
Now I had pretty clear skin in my teens, but early 20′s used Proactiv because I broke out a lot. After my son was born 10 years ago, I stopped using any acne stuff and I had great skin. I use all natural cleansers and moisturizers. My makeup consists of foundation, blush and mascara. I have not used any new products lately either.
My dry patch is gone. Perhaps because of the season and the warmer weather. However, the red bumps come and go. But are never completely gone. My skin has just not been the same. I went on vacation for a week where the climate was hot and when I got home, my husband thought my skin looked better. But now it’s been a few weeks and I can see that it isn’t gone. I have googled this and think it may be adult acne. But I am not certain. I know going to a dermatologist will answer this for me, but I would hate to go and have to take stupid pills or use stupid stuff that makes my skin worse. Because there probably isn’t some instant treatment and it will all go away.
Anyone experience this before? Any ideas on what to use? I would hate to go away from my all natural stuff but it must not be all that great if my skin still looks like crap.