Not sure if I want "skinny" or "fit"

I could never get muscles. After 1 year of hard training every day (when I was like 17) I could never get muscles or anything. It would be easier to just become skinny, but to me skinny isn't really attractive, fit is. So what to do? Trying to become fit seems like a waste of time, I already have enough stamina for martial arts though.