Police said Robert Lyzenga allegedly placed a video camera in the women’s bathroom at Sunrise Christian Reform Church in Tippecanoe County.

According to a probable cause affidavit, a woman at the church called police after noticing a suspicious device in a bathroom.

Sheriff Tracy Brown said an investigation led deputies to a small hidden camera in a bathroom stall.

Lyzenga was taken into custody but later released on $5,000 bond, officials said.

Neighbor Brooke Linn said she was alarmed when she learned of the allegations, RTV6's Eboné Monet reported.

"I don't think you ever want to hear about something like that. Coming from a parent's perspective, you don't want to hear about children being taken advantage of," Linn said.

Lyzenga was arrested on probable cause and authorities said they were trying to determine the age of the victims before filing formal charges.