His father was Juan de Olivares, and his mother was Angela de Treviño.
He married Juana Maria de Montemayor.
In 1731, he requested a dispensation to marry Juana Maria Teresa de Arredondo. It was his second marriage. Dispensation source: Guerra, et. al., Index to the Marriage Investigations of the Diocese of Guadalajara, p.176.