Technically, the donor has to pay tax after the $12000 gift exemption of each donor. However, I don't think the IRS or FTB can catch you.

The way I understand how IRS deal with tax issues are by checking with 1099 misc. Since there are no 1099 misc, they have to no way to track your records. So, you and your family are doing fine even with more than $12000 donation.