Sure you can, but after a while you'll find it annoying to have to spend twice the time (pump time plus feed time) and also take care of the washing of pump apparatus and bottles. As well, your milk supply regulation will be difficult. If baby increases his intake, you'd be getting behind on pumping, and if you try to anticipate that you could end up too engorged. So it's not a long term thing.
My son came early and started out with breathing and feeding tubes, so I had to pump at first. And since he was tiny and I was emotionally too much of a wreck to attempt breastfeeding him in front of nurses, I just pumped the milk for him during the whole time he was in the NICU. (They can't make you try to nurse, but you might get out of the hospital sooner if you do - especially if you are a first time mom) And we had a hard time with him latching at first, so the pump was a blessing - I could pump the bulk of his needs and then take my time with the learning to nurse, without any pressure to see that he got enough.
If you end up having trouble breastfeeding (you probably won't!) you can likely pump for a few months with no problem, although it wouldn't be ideal it's supposed to be better than formula. I agree that it's good for dad to get the chance to do some feeding! I just don't think it's practical for the long term. If you end up using formula it's nothing to feel bad about. Just don't take ANY of this stuff personally or stress about it - have faith that you'll nurse fine (it's weird at first but you get used to it rapidly!) and that if for some reason it doesn't work out, that'll be fine too.
Oh, and by the way, pumping can be at least as much of a pressure on you emotionally at first. Letting down the milk took a LONG time for me with my first child, and I couldn't pump anything. Also, the first time you nurse or pump you get only like a teaspoonful... it gradually increases, but the first couple days it won't seem like hardly anything, and nurses might push you to supplement with formula... Don't. Babies are designed to live on very little colostrum for the first few days and weight loss is normal in the first week. Stick with it!