Borrowing at a low interest rate might look attractive but, in the long term, the government - and its citizens - pay through higher cost of finance.