There is nowhere in the bible where it says "the sun goes around the Earth," but the Bible definitively states that the Earth is at rest and unmoving.
Psalm 93:1 The LORD reigneth, he is clothed with majesty; the LORD is clothed with strength, wherewith he hath girded himself: the world also is established, that it cannot be moved.
Psalm 104:5 Who laid the foundations of the earth, that it should not be removed for ever.
1 Chronicles 16:30 Fear before him, all the earth: the world also shall be stable, that it be not moved.
Job 9:6 Which shaketh the earth out of her place, and the pillars thereof tremble.
There are many, many further verses that discuss the "foundations" and "pillars" of the Earth, as if the Earth needed to be fixed in place with them.
Thus church doctrine declared, with biblical support, that the Earth was fixed and unmoving.
This is why, when forced by the church under threat of torture to recant his Sun-centered philosophy, as he signed the confession, Galileo is said to have muttered, "And yet it moves."
In addition to stating that the Earth is stationary, the bible claims the Sun moves:
Psalm 19:4 Their line is gone out through all the earth, and their words to the end of the world. In them hath he set a tabernacle for the sun, 5 Which is as a bridegroom coming out of his chamber, and rejoiceth as a strong man to run a race. 6 His going forth is from the end of the heaven, and his circuit unto the ends of it: and there is nothing hid from the heat thereof.
When Joshua commands the Sun to stand still, it's the sun that has to stop, not the Earth:
Joshua 10:12 Then spake Joshua to the LORD in the day when the LORD delivered up the Amorites before the children of Israel, and he said in the sight of Israel, Sun, stand thou still upon Gibeon; and thou, Moon, in the valley of Ajalon.13 And the sun stood still, and the moon stayed, until the people had avenged themselves upon their enemies. Is not this written in the book of Jasher? So the sun stood still in the midst of heaven, and hasted not to go down about a whole day.
In the following verse, God commands the Sun to stop (not the Earth) in order to prevent a sunrise:
Job 9:6 Which shaketh the earth out of her place, and the pillars thereof tremble. 7 Which commandeth the sun, and it riseth not; and sealeth up the stars.
Reading the other answers here, It's lovely to see how Christians don't actually know what's in their own bible, and can so easily cast off "wrong ideas" as ideas only of the established church, and not ideas that are actually in their own holy book. Interesting psychological phenomenon.