Assett Lender Fees

I built a house a couple of years ago funded by a commercial loan from an assett lender. I paid a £4000 arrangement fee, £2400 commission to the broker who introduced me to the lender and when the house was finished I remortgaged and paid the assett lender an exit fee of £6250. All these fees were included in the original loan offer - so they were not unexpected - but with all this talk about refunding bank charges based on the charge representing the true cost of the action, I wondered if I could have a punt with this situation? Any ideas, comments or suggestions welcome. P