If you are a disciplined spender and have the will power not to spend on impulse, then you need not worry much about keeping a credit card. It will give a self confidence while going out on travel or purchase. But you have to be very careful in spending and not to spend on unnecessary things.
Keeping a credit does not mean you are borrowing right now. Credit card will be a convenience in many situations especially when you make your utility payments online.
However if you do not intend to spend with credit card and the card has some fixed charges even if you do not use it, better not to take it. You can go through al details about the card, especially the charges- expressed and hidden, their billing cycle, and the interest per month and per annum rates etc. If those charges are not high, and some small amount only, then just take a credit card with very minimum credit limit. Otherwise if you feel it may turn problematic later then don't take the credit card, but just have a debit card which will also help you at times.