This is usually caused by duplicate accounts. You may have followups scheduled under one email address, and logging in under another.

Fortunately, the solution is quite easy: link your accounts. This will allow you to view all followups for all linked emails under the same iCal feed.