This process, known as reinforcement learning from human feedback, is crucial because topics can be ambiguous, disputed, or hard to define cleanly in code. The directives for what counts as sensitive or neutral are decided by the tech companies making the chatbots.