Yeah and although BB is WG sterotype of pirate he does have a bit of respect or rather sees some of him in Luffy plus just like Shiki he invites people he sees as enemies to be his partners in crime.

And also in first starter comment it says the relationship that they have with Luffy not the actual person