Midaidokoro

The midaidokoro (御台所) was the official wife of the Shogun. During the Edo period, she resided in the Ōoku of Edo Castle and sometimes wielded considerable political power behind the scenes.

The first Midaidokoro is wife of the second shogun, Tokugawa Hidetada, because when the Tokugawa Ieyasu became shogun his wives had already died so there was no Midaidokoro at that time. When Tokugawa Yoshimune's time came he didn't have Midaidokoro either because his wife had died before he became shogun. Also when Tokugawa Ieshige's time, his wife already died. At Tokugawa Yoshinobu's time he and his wife doesn't enter Edo castle but they entered Nijo castle so his wife was called "Gorenju".

...
Wikipedia