“even the best of them.” That is, even the best of them all, not just the olive groves.
“his servants.” This refers to the officers and officials of the king, not his household servants/slaves.
[For more on “servants” being used for people of high position in the kingdom, see commentary on 2 Sam. 11:1.]