It depends on why you got refused access. Since I'm pretty sure you weren't refused because of a criminal record, but likely because you lack the proper documentation proving that you are allowed to work and reside in Canada, it shouldn't count against you in the future.

If you want to know for sure, I would suggest calling one of the numbers here and asking about it. :)