... and giving heartfelt thanks
You are interested in giving thanks for your newborn child, asking for a blessing and having the baby baptised.
In the Christian context, this is generally done in a church service, as it also means that the child is accepted into the Christian community and faith. (Possible dates can be found under the heading “Church Services”.)
A baptism or “blessing” can also be held in a different place or on an occasion that is special to you. This requires particularly careful discussion and preparation.