Of course you are confused! And, don't worry, we already figured out that you are really tryng super hard. And Wolf is 100% right, you need to think about the different approaches that have been recommended and see which one strikes a chord with you and your husband.
I know a lot of people say that putting a bird that bit you in the cage for a time-out is the wrong thing to do but the problem I have with this position is that they argue that a bird should not see its cage as a place for 'punishment', that it should be its 'home'. Well, birds don't have 'homes', they live out in the sky, the trees and going from one place to another so I fail to see how any bird would regard a cage as a 'home' when the concept of home is not even hard-wired into them by nature. You also have to take into consideration that I personally hate cages, crates and anything that resembles a jail or restricts an animal natural need to roam, fly, run, walk, slither or whatever the specific animal's main mode of transportation is. It has been proven over and over that confinement creates stress, even in zoos where the animals are in large areas they have issues from them so it seems that, to them, cages are already 'punishment' no matter how large or comfortable they are. The only birds that like cages are the ones that have serious psychological issues and/or a broken spirit, otherwise, they are all more than happy to spend their entire life out.
The advice I give you is what I would do, and, if I was in your shoes, I would leave him out all the time that I was around for the simple reason that I feel terrible about birds been kept in a cage for years (I always try to see things from their point of view and try to imagine how they would feel about things by comparing to nature's ways) and, if he follows me around the house, I would just keep one step ahead of him so he cannot 'climb' on me. I would put a little ladder or a rope with knots going from the floor to his cage so he could climb up on his own and a nice branch (a semi-thick one with little branches coming off it) tied to the side of his cage so he could climb up and around (you can hang a toy or stick a piece of fruit in it, too). And, if and when he gets real insistent and a pain in the neck about following me, I would use the Tstick and put him back on his cage while I repeat 'Go home' all the way back (this is what I use with my mean birds, the ones I cannot really handle with my hands, to make them go to their 'place' in the birdroom but you can use whatever phrase you want to use, the idea is for him to understand a command that means he needs to go back to a specific place) and once he is on his cage or the branch, I would praise praise praise and give him a treat. If this works with wild-caught ex-breeder male amazons, it has to work with a little handfed bird.
But, again, just do what you feel is the right approach because it is a fact that what works for most birds will fail miserably with a few.





