He's the sort of person taken in by Tony Stark. Just like everyone else. Almost everyone else at least.

It's not the the Wolverine is impossible to deal with, it's just that Tony can't really do much to help. He's not good with sitting around and being bored. That's where the fighting with Logan would undoubtedly occur. Boredom. And jealousy.

What made Tony special, in his own eyes, had been the suits. The suits now are gone.

He doesn't like to be reminded of it.