Hey,
I think I answered this previously as well...
You need to seperately add users to the Project Portal. It does not automatically takes the User Settings from the TFS Project.
You can do so from the Project Portal, Site Settings, Users and Groups Permissions.
Hope this solves your issue.