Secretly.

Now the birth of Jesus Christ was on this wise: when as his mother Mary was espoused to Joseph, before they came together, she was found with child of the Holy Ghost. Then Joseph her husband, being a just man, and not willing to make her a public example, was minded to put her away PRIVILY. ( Matthew 1 )

Dictionary of Words from the King James Bible. Public Domain. Copy freely.