The manor system goes down every day at 8pm CST for maintance. At 8:05pm CST the maintance is done and you can turn in your fruit.
Depending on what fruit your trying to turn in there could be a large number of others trying to turn in the same fruit, so if your not fast and within a sec or 2 you won't get to turn them in. Remember, even if you don't see others around trying to turn in, they could be in a different town.
well I hit sale at betwen 5 to 7 after and all the chill doda was sold to the manor.
Vendored the fruit, and made a slight profit. but i'll stick to things that aren't gettign hit as hard now. since they seem to be camped at the end of maintance.