First off, check the zoning to make sure you can build what you want on this property.
Taxes should not be insignificant for undeveloped land.
Permits won't be a factor until you want to build. Permits have an expiration date, so you aren't going to want to apply to build until you are ready.
Most areas will require you to maintain the land, at least keep the weeds and such down until you are building.
You will absolutely want to check how much it will cost to bring utilities to the land. Even if there is a power pole at the property and water lines running in front of the property, it can be tens of thousands of dollars to run utilities.
You don't need a builder unless you want to assess the land from a builder's perspective. Some parcels are easier to develop than others, and if you are considering a couple different parcels, cost of utilities and cost to develop (due to soil, rocks, leveling, etc.) may make this an easy decision.