Pain on the outside of my foot during/after running! Help!?

Hi!

I recently started the NHS couch to five k podcast thing and after my first jog/ brisk walk I noticed that all along the outside bottom of my feet was really, really sore.

I put it down to the fact my trainers were really cheap and old and shoddy so I bought a new pair of running shoes and they're way comfier and stuff but I just went to do my second day of the podcast and I got about five minutes into it then the outsides of my feet were unbearably sore again! I managed to complete the podcast but it was agony!

It's really frustrating me because I want to get fit and do this and I have no problem with the jogging apart from this weird pain in my feet! I was wondering if anyone has any ideas what it could be!!?? And more importantly how to stop it hurting so I can do this!

I found a picture of sort of where it hurts but can't find answers : http://i.imgur.com/cwP0i.png

Thanks so much guys!