Virgin birth.

Does it really matter if Mary was a virgin? Jews in those times always thought God had something to do with a new life...it was His will. Why should Jesus have ancestors (Matthew Ch 1 v 1) if He wasn'y really part of the family? Why did Mary refer to Joseph as Jesus' father (Luke 2 v 48). Would it really mean anything if the virgin birth was not exactly as we thought it was?