For both loans AND grants, you will be expected to put up a significant chunk of the money from your own pocket. When I wanted to start up a used book store, just BUYING the store was gonna cost me a quarter of a million bucks...and that was for the inventory and furnishings, not the physical store. I had to show that I had $200K in collateral in order to get a loan which would allow me to buy the inventory, pay for the first couple of years' salary and other expenses, and generally keep the shop open for a couple of years until it started earning money again. And I had to come up with $100K to invest in the business. So I put up our house and the farm (two separate properties) and then cashed in most of my other assets. Starting a new business is not cheap.
You won't get a loan or a grant unless you can come up with a lot of the cash yourself. Really. There are a few exceptions, but you usually have to be a minority or disabled to get those exceptions. You'll have better luck getting your friends and relatives to invest in your new business.
Most new businesses fail because they are undercapitalized. Very, very few businesses will make money at first, you will have a few years when you lose horrendous amounts of money, then you start breaking even, and after five or ten years you will start seeing a profit.
Go to SCORE (Service Corps of Retired Executives) in your area and ask for a mentor. It's free.
I have to warn you, though, that most governments, both state and city, are having to tighten their belts. They might not even have many grants available.