The
paper about the model notes that it was trained with 50% AI generated content and 50% human content. That means that the model expects the prior probability to be 50/50. On SO, human content is
much more common, so the probability put out by the model isn't directly a probability of AI content. Thus, in my opinion, the detector should be used with caution and as supporting evidence.