Selfish

As I was telling someone important to me about it they said that I was being selfish because it was just something that I wanted to do....But really is it selfish by setting goals and trying to accomplish them???