And it looks like the fix to that is to logout and sign back in through the bbPress site (instead of your wordpress site). Once you do that, wordpress recognizes you are logged in and you can access the Admin section of both sites.
Might have spoken too soon. That at least fixes the login integration and being able to login to my wordpress site, but now, while I show as logged into my bbPress site, I cannot access the Admin section.