Not at all - in feudal society, rights didn't exist as we know them now.

This is a completely different issue. Your argument can still justify feudal relation since the feudal monopoly was the only means of access to production, and so serfs should have been grateful to their lords for providing them with jobs &c.