The incident occurred on Saturday and there was outcry on social media after the photo was shared with many people comparing it to the slavery era.
"All I know is that these are two white police officers on horseback with a black man walking him down the street with a rope tied to the handcuffs, and that's doesn't make sense, period".
Galveston police are apologizing after a dramatic photo circulated online showing horse-mounted officers leading a handcuffed man of color by what appears to be a rope.
The division added: "We realize the destructive thought of this action and have confidence it is most acceptable to end the use of this arrangement".
He was "handcuffed and a line was clipped to the handcuffs", the police department said.
The post went on to claim the two officers - identified as Officer P. Brosch and Officer A. Smith - didn't have any "malicious intent" and simply wanted to escort the suspect back to where they were stationed without dismounting their horses.
We have verified with law enforcement officials in Galveston, that the photograph taken in Galveston is real.
Addressing the bubbling outrage, the department's Chief Vernon L. Hale III apologized to Neely in a statement, saying that the "trained technique" caused an "unnecessary embarrassment" for the 43-year-old detainee.
Terrie Cotton, the mother of Neely's child, wrote on Facebook: "I may not speak to him daily.Hell its been years since I have".
He includes a formal apology to Neely and his family, all of whom are up in arms and planning to sue the PD for what they call a humiliating, heart-breaking experience.
The police confirmed that the officers involved with the arrest were using body cameras at the time.
Mr Neely is free on bond but would possibly possibly not be reached for observation, the Houston Story reported.
Leon Phillips, the president of the Galveston Coalition for Justice, told The New York Times that Neely's treatment was a reminder of the oppression still faced by African Americans in the U.S.
He had walked along because he did not want to be kicked or dragged by the horse, she said.
I would say "We need answers", but nothing you can say would ever justify what you did to this man.
- Defoe strengthens Euros case
- Top smartphones for gaming
- China reiterates support for Hong Kong's embattled leader
- Tottenham Agree $78m Dybala Fee With Juventus
- Disney sets $12.99 price for streaming bundle
- Author Toni Morrison Has Died
- Iran's president warns war with Tehran would be 'mother of all wars'
- Trump in OH to begin day of mass shooting site visits
- Meghan gets 38th birthday tributes from Harry, William and Kate Middleton
- British Airways cabin 'filled with smoke'