How can I market my business when I start up without breaking the bank?
Your target market must find out about you, and the quality of your communications must represent the quality of your business offer.
I would suggest developing a marketing plan. If this is done properly then you do make the right decisions, and this can save you money (or make you money) in the long run.
A completed marketing plan will suggest approaches to communicating with the market. Your research will find out how other companies do this in your market. Even if this is expensive, do not ignore the sound reasons that they will have had to follow that course of action. For instance "why do plumbers advertise in the yellow pages?"
A low cost route is to do all of your communications yourself (or have friends that can do them for you). Do remember that poor communications wont give you business. Some of the skills needed do take a long time to develop.