Like any human philosopher, the AI+ would be capable of entertaining the possibility of systematic deception that follows from this distinction. This would inevitably lead it to confront certain questions for which human philosophers have struggled to find satisfactory answers. But a non-biological artefact does not have to be burdened by the overly metaphysical conceptions of subjectivity and selfhood that prevent human philosophers from seeing past such questions, and which seem to fundamentally limit our cognitive constitution.
The AI+ is supposed to be a progression beyond the human in some sense or other. But, without prejudicing or delimiting the concept of progress, there is surely an important sense in which “merely” human progress over the past several thousand years has been significant.
There is a specific limitation to human cognition (and by extension to any form of artificial cognition based on its blueprint), and this limitation could, in principle, be transcended by an AI+.
The rational creature knows that it can be in error, that it can be deceived. It is thanks to this knowledge that it is capable of becoming reflective. The rational animal is pre-reflective because it has the necessary cognitive endowment to entertain the possibility of its being systematically in error.
Can we imagine what it might be like to be a reflective creature who has advanced beyond metaphysical thinking, who has become post-reflective?