CASSELBERRY, Fla. (CBS Tampa) — A Florida couple spent their honeymoon behind bars after police say they left their young children at home alone to get married.

According to the Orlando Sentinel, Kymberely Frederick, 30, and Daniel Richards, 34, were arrested Tuesday by Seminole County authorities for allegedly leaving their 1, 2, and 3-year-old children home alone so they could get married at the county’s courthouse.

WFTV reports that a neighbor – whose car the couple borrowed to get to the courthouse – called police after said over the phone that the toddlers were by themselves.

Frederick and Richards wrote a note to their 7 and 8-year-old kids to watch their siblings when they got back home from school, according to the Sentinel.

Police say two of the children were found in their cribs while the other one was found in bed.

The couple allegedly left their five kids home alone constantly.

“It’s a sad story,” neighbor Sylvia Galvez told WFTV. “The kids are very sweet.”

Frederick and Richards have each been charged with child neglect. The five children have been taken into foster care.