In "Larry's Wife", Gloria calls over the priest believing that there is evil in Joe. The priest does a blessing on Joe but leaves when Joe pick-pocketed the priest's wallet. Gloria returns the wallet and apologizes.
In "Spring-a-Ding-Fling", he begins to walk. Lily blames breaking Gloria's phone on him by saying he can walk for her. She luckily got away with it until Joe's shoes magically got on the wrong feet.
In "And One to Grow On", it's Joe's birthday and Jay wants to reuse birthday decorations from Manny's birthday party the day before but Gloria refuses.
In "Queer Eyes, Full Hearts", Manny's Spanish teacher teaches Joe to swim.
In "The Big Guns", Jay tries to potty train Joe despite Gloria's warnings that Joe has to be ready on his own and Jay has to not put stress on him. The real reason Jay wants to train Joe is because every time he goes to the store to buy diapers, people think that he asks diapers for himself. After a long time and the moment Jay is ready to give up, Joe manages to use the potty, but Jay picks him up before he's finished which results in Joe peeing on Jay.
In "Rash Decisions", Joe has a problem going on with him. Gloria starts thinking he's allergic to Stella, but it turns out to be Gloria's face balm.