Sentiment mining reports are useless when their external validity cannot be assessed. Demographics, events, manipulation are main threats of sentiment mining external validity. This article gives meta‐requirements and meta‐designs of an external validity identifier. Automatic demographic, event and manipulation detection in sentiment reports is feasible. Sentiment mining services need to be complimented by external validity reports.