A man followed the mother of his children to her church despite being warned not to go near her.
And a court heard there were fears he may abduct the youngsters.
Llucky Aghayere, 42, pleaded guilty to using threatening words or behaviour likely to cause harassment, alarm or distress.
Kirklees Magistrates’ Court was told that police had issued him with a harassment warning after he threatened to take his children away from their mother.
But on October 11 he travelled “some distance” from his Maidenhead home in Kent to Cathedral House in St Thomas’ Road, Huddersfield.
Prosecutor Shamaila Qureshi said: “He knew the mother and the children would be at her church.
“He claimed it was a prior arrangement but there’s a statement from the pastor which says it’s not.
“Someone has seen him there holding the children’s hands.”
The court was told that there had been fears over Aghayere abducting the children.
He was also issued with the harassment warning after previously following his ex.
Police were called and the mother said she was fearful that he was trying to take the children away from her.
Mrs Qureshi said: “He’s violated a place of her safety, a church environment.
“He has caused her alarm or distress - she just wants to be left alone.”
Deputy District Judge James Hatton made a two-year restraining order banning Aghayere from contacting his ex.
Aghayere, of Laggan Road in Maidenhead, also has to pay £55 fine, £150 court charge, £85 costs and £20 victim surcharge.
