ignore if you wish but my advice would be no. i have a variety of pole buildings and wind breaks on the place. we have access to utility poles on occasion and i have a whole pile of them in inventory. that said, while tempted to save a few bucks an put up a building after using them for an addition to one building we have never been tempted to use them again.
why you say? every one is different. the taper, the diameter, the uniformity is just off on every one. trying to make anything straight when one pole is 8 inches round top to bottom. the next is 14 inches at the bottom 12 inches in the middle and 13 at the top. the next is 15 inches at the bottom and 8 inches at the top. now throw in that some are round, some are oval, some are egg shape and everything in between. nothing is straight. everything is crooked, nothing lines up and that is only if you want to finish the exterior. any finish work on the inside is a like a horror.
if you want to build a wind break and only need to line up one side they work ok. if you want to build a decent building you need a good foundation and a pole buildings foundation is the poles.
trying to fit 4 walls, a roof, and doors to a bunch of random poles and then trying to fasten tin or siding to that crooked mess as a surefire way to create a building that looks like ass.
like a said, i have seen it done and tried to do it, the results are usually not favorable.