Tips to make eating organic affordable? Pretty please?

Sometimes I break out in hives for no reason. No doctor I have been to has been able to diagnose me with anything. They just tell me to keep a food diary and cut out the trigger foods. They don't listen to me when I tell them it isn't triggered by any food. I switched to dye and fragrance free EVERYTHING. I used vinegar and water as a cleaner instead of chemicals... I kept the damn food journal anyway... but there was no correlation between any food and my breakouts. For example: I eat bananas often, several times a week usually. ONE time I ate a banana for breakfast and my lips were significantly swollen and itchy shortly thereafter. I didn't eat or drink anything else, I hadn't applied lip balm or makeup of any sort... JUST ate a banana. This crap happens all the time!! I take loratadine (claritin) daily and it helps for the most part but sometimes I get so itchy and become dermatographic (not sure if that word can be used that way but I'm able to draw and write on my skin). I did a lot of research on my own and it seems like it could be an auto-immune issue or an allergy to some kind of pesticide/fungicide/whatever...

TL;DR: In case allergy symptoms are chemical related, I would like to eat organic to see if it helps me at all. My boyfriend and I spend about $150-$200 a month on food and I REALLY don't want to spend much more if possible. Are there any chain stores that specialize in organic food in Pennsylvania?