There were many such camps and all were terrible. Elmira is the one you are thinking of as it was consider similar to Andersonville. Following is a list of such camps and prisons for both sides.
Belle Isle Prison (CSA)
Beautiful Belle Isle, in the James River at Richmond, became a Confederate prison after 1st Bull Run, confining Union noncommissioned officers and enlisted men.
Blackshear Prison (CSA)
Read about how 5000 Union prisoners were placed in facility intented to house only a few hundred men.
Camp Chase (USA)
Camp Chase Confederate Cemetery, located at 2900 Sullivant Avenue, Columbus, Ohio, encloses within its less than two acres the mortal remains of 2,087 Confederate soldiers.
Camp Douglas (USA)
Originally designed as a training station, this facility was converted to a POW camp in 1862. It was designed with a capacity for 6000 men, but during its most crowded they managed to cram in over 12,000.
Camp Ford (CSA)
Camp Ford was the largest Confederate Prisoner of War Camp west of the Mississippi River during the American Civil War. Established in August of 1863, the camp was not closed until May 19, 1865. At its peak in July 1864, over 5,300 prisoners were detained there.
Castle Pinckney (CSA)
This page provides information on Castle Pinckney, a secondary defensive Fort in Charleston Harbor used as a fort, prison and artillery position during the American Civil War.
Danville Prison (CSA)
Designed for 3700, at its most crowded, they put 4000 men in here. Used from '63-'65; just under 1300 men died here.
Elmira Prison Camp (USA)
This camp was considered by many to be the "Andersonville of the North" because although its capacity was designed for 5000, just under 3,000 people died here.
Florence Military Stockade (CSA)
The Florence Prison Stockade was in operation for approximately 5 months during the time period of Sept 1864 through Feb 1865. During this time, as many as 15 - 18,000 Union soldiers were held captive.
Fort Delaware (USA)
Now known as Fort Delaware State Park, the fort not only still exists, it is very much as it was when it held over 40,000 Confederate, Federal and civilian political prisoners.
Fort Jefferson (USA)
Learn why this was one of the worst Union prisons in the Civil War -- and why the fort had a well deserved reputation as America's Devil's Island.
Fort McHenry (USA)
Learn why this camp was nicknamed "The Baltimore Bastille".
Johnson's Island (USA)
Johnson's Island served as a Prisoner of War depot for Confederate Officers from April, 1862 through September, 1865. During that time, over 10,000 Southern officers found themselves confined on the island.
Libby Prison (CSA)
More than 50,000 men passed thru this prison while it was used by the Confederacy.
Ohio State Penitentiary (USA)
The Ohio State Penitentiary in Columbus was a three-story stone structure with heavy iron bars on the windows and doors of cell blocks. It was used to house hardened convicts until July 30, 1863.
Old Capitol Prison (USA)
The Old Capitol Prison was located on the present site of the U.S. Supreme Court building, First Street and ‘A’ Street NE in Washington DC.
Lacking a means for dealing with large numbers of captured troops early in the war, the U.S. and Confederate governments relied on the traditional European system of parole and exchange of prisoners.
Point Lookout (USA)
Constructed on the tip of the peninsula where the Potomac River joins Chesapeake Bay. In the two years during which the camp was in operation, August, 1863, to June, 1865, Point Lookout overflowed with inmates, surpassing its intended capacity of 10,000 to a population numbering between 12,500 and 20,000. In all, over 50,000 men, both military and civilian, were held prisoner there.
Learn about some of the activities which prisoners used to take their minds off of their severe conditions.
Richmond's Castle Thunder (CSA)
Mainly used for civilian prisoners, it was generally packed with murderers and thieves. Males suspected of being disloyal, spies, and Union sympathizers were also incarcerated here.
Rock Island Prison (USA)
One of the westernmost federal prisons for confederate POWs was located on Rock Island, a government owned island in the Mississippi River between Davenport, Iowa and Rock Island and Moline, Illinois.