He absolutely is pushing back. True, he doesn't know the first thing about Kylo's established norms, but he can't say that he's in the least bit impressed by what Kylo has been willing to show him so far.

"Then I would advise you to not blindly assume. There are no native residents of this village."

There might, possibly, be some to the system the word they're on is located in, especially considering the Observers themselves have to have come from somewhere. But given that there isn't any real way to check just at the moment he can't say for certain - and isn't going to mention, given that admitting to being uncertain could very well jeopardize the position he's currently taking.