Well, if it is brand new, you have to give it some time to get used to you. What I do, is putt it in a room with food and water and litter and such, and stay in the room with it. Let it get used to you. Don't worry, I know how you feel.
Give it time. She/He will grow to like you. I have had experience with new kittens, and it hid under everything and jumped onto tall things. You should give it places to hide, and soon it will grow to love you. Never get frustrated, and remember: You are huge compared to it! Imagine what you would think. Good luck!
