How do I know when a contact responds to me?

When a contact responds to you, the conversation will move under the To Answer category. You will see a count badge for this category, that lets you know the number of contacts who have responded to you.