There are no manor managers in either the Orc or Dwarf starting villages. It appears there will be in C5.
This means you cannot use the manor system while in those villages, but it also means there is no Lord to raise your taxes. This means you can buy supplies at a price usually much lower than you will be able to on the mainland or on Talking Island.