Content Moderator / Trust & Safety Analyst
UnexpectedThe pull to shield from harm
The shape of the work
- A hard push you keep up for a long stretch
- Short, intense, and the stakes are right now
Behaviours this work is made of
- Holding people and institutions accountable.
The pull to right what's wrong in how people are treated
Justice · Unjust → Just
- Determining the quality, value, or merit of something through informed assessment.
The pull to discern what's good from what isn't
Judgement · Undifferentiated → Distinguished
- Watching for danger, maintaining vigilance.
The pull to shield from harm
Protection · Vulnerable → Safe
- Committing to a course of action when the right answer is uncertain and delay has a cost.
The pull to make things work
Resolution · Broken → Functional
- Noticing what others miss. Perceptual acuity.
The pull to bring what's hidden to light
Revelation · Hidden → Revealed
- Creating the record that allows others to understand later.
The pull to make things make sense
Explanation · Confused → Understood
The pull to make things last
Preservation · Ephemeral → Enduring
- Establishing protections, guardrails.
The pull to shield from harm
Protection · Vulnerable → Safe
In words
A content moderator reviews posts, images, videos, comments and accounts on online platforms, and decides whether they break the platform's rules. A trust and safety analyst works at a broader level: they study patterns of abuse, fraud, harassment, scams and misinformation, write or improve the rules, and help design the systems that detect harm. The main pull is Protection, because the work keeps people, and especially children and vulnerable users, safer online. Judgement comes second, since each decision means applying written rules to messy real examples.
Moderators work from a policy and a queue. Automated systems flag or hide items, and reviewers check the cases that need a person: borderline content, appeals, reports and new kinds of abuse. A reviewer picks a label or action, such as leave up, remove, restrict or escalate, and explains the decision in a form others can audit. Analysts and senior staff handle harder cases, such as organised abuse, threats and child safety reports that must go to specialist teams, and they investigate how bad actors get around the rules. Platforms of every size need this work, including social networks, games, dating apps, marketplaces and online communities.
The role is called content moderator, trust and safety analyst, community safety specialist or content reviewer, and it exists in every country with a large online platform. Moderation by volunteers on community forums or streams is a related, unpaid activity and is not the same as this job.
Kitsune can talk through anything on this page — whether it might suit you, what to do next, questions this page doesn't answer. Everything here is yours to read either way.
The work can be hard on the people doing it. Reviewers see violence, abuse and other disturbing content, and studies and legal cases have documented anxiety, trauma-related symptoms and burnout among moderators, especially in outsourced roles with strict quotas and limited support [reported by people in the field, moderator research and legal filings, 2020-2025]. Good employers rotate reviewers, limit exposure, provide counselling and let people leave the hardest queues. Before accepting a role, it is reasonable to ask what the support, shift limits and rules on viewing graphic content are.
The job is also changing. AI classifiers now find and remove much of the clearest harmful content before a person sees it, which leaves humans with the hardest, most context-dependent cases and with checking the machine's mistakes [our read of how the field works, 2026]. Rules are also tightening: the EU Digital Services Act and similar laws in other countries require large platforms to run reporting systems, explain decisions and carry out risk assessments, which has created more analyst, policy and compliance roles alongside reviewing.
There is no required qualification, and entry-level reviewer jobs often ask for a school diploma or equivalent, strong written language skills, resilience and good judgement. Many are offered through outsourcing companies that work for platforms, and some come with a probation period and a wellbeing assessment. Analyst roles usually want a degree or experience in a subject such as law, politics, psychology, criminology, communications, data analysis or cybersecurity, plus time as a moderator or in customer support. With experience, people move to team lead, quality reviewer, policy specialist, investigator, child safety specialist, trust and safety manager, or into related careers in compliance, online safety research, cybersecurity or law enforcement liaison.
Before you go
Where the tension is
Automated systems now handle the large majority of first-pass violation detection on major platforms, and that shift has already cost jobs at scale. What is left for a human reviewer is the smaller set of borderline, contested or genuinely new cases classifiers cannot resolve with confidence, plus the growing analyst and governance layer that regulation such as the EU Digital Services Act itself creates.
Where it is heading
Entry-level, high-volume queue reviewing keeps shrinking and is the layer most exposed to further automation and offshoring pressure. Demand is shifting toward a smaller number of senior analyst, policy and AI-governance roles that test and oversee the automated systems rather than compete with them.
People drawn to Content Moderator / Trust & Safety Analyst are often drawn to these, in the order they are closest. The ones marked sit in a different field entirely.