Assume Foo Bah distributes a software which uses (plugin) API from a GPL'ed software. However this work is not distributed or packaged with the GPL'ed software. It is independently downloaded by the users of GPL'ed software to add functionality to their GPL'ed software. Is Foo Bah's software required to be under GPL?

GPL license states that - "You are not required to accept this License, since you have not signed it. However, nothing else grants you permission to modify or distribute the Program or its derivative works."
Which is perfectly fine for Foo Bah as his software doesn't need to distribute or modify the GPL'ed Program or derivative works (in this context).

Let the wisdom of the internet pour on this simple question to enlighten all of us. Please answer with explanations for your decision.