So I was bored today while I was in the school library, so I opened Tuck Everlasting to a random page and read it.  I read this book a few months ago.  I happened upon this page and was shocked.

Anna was Miles' daughter in the book. And this means that Miles' wife knew the man in the yellow suit. There you have it folks! The canon answer!