Taking an interest bearing loan to start a business

I live in a country where all systems of the government are un-islamic. Most of the time our non-Muslim counterparts enjoy all the benefits from certain policies of the government. For instance, the government set aside a multi-billion amount of money to help small, medium and large scale entrepreneurs with a single-digit interest loan, having a single-digit interest loan by a good entrepreneur is viable but for the Muslim, even less then 1% interest is haram.

Consider myself as a case study, I have a viable business idea and I spent almost a year finding a way and manner to finance it, by either interest-free loan, partnership or any Islamic accepted way but I couldn't get it. As a professional accountant I have a "masters degree in accounting and financial management". I know how to secure and manage the government loan but I doubt whether or not it is permissible in Islam when considering the above situation.