AceShowbiz -

Kelsey Grammer is a proud father to a baby girl. His wife Kayte gave birth to their first daughter at 1 A.M. Friday, July 13 in Los Angeles. The newborn was named Faith Evangeline Elisa Grammer and weighed in at 6 lbs., 2 oz. at time of birth.

"We are thrilled," the couple told PEOPLE in a joint statement. "Mother and child are in excellent health." The happy news, however, was laced with sad announcement that little Evangeline's twin brother died early in Kayte's pregnancy.

"We were ecstatic earlier this year, when we announced that Kayte was carrying twins. Tragically we lost the little boy shortly thereafter," the new parents explained. "This was not something we cared to make known publicly at the time."

They furthermore opened up their feelings about the miscarriage, "It was unspeakably painful and we know that people will understand our desire to keep the news private then, as we know they will respect our privacy in this matter now."

"A glorious birth with a lingering sadness is ours today. We choose to celebrate the life that has been given us. We proudly introduce our Faith to the world today looking forward to the days ahead and the children yet to come."

Grammer, 57, and Kayte, 31, got married in February 2011. He announced that they were expecting twins backstage at the Golden Globe Awards in January. The couple who renewed their vows in June also lost an unborn baby in October 2010.

"We would like to thank all of those who expressed kindness and concern," they said back then, "But we needed a little time to heal, time to find some solace before publicly acknowledged our loss."