Is anyone else fresked out by the high possibility of error with AI health analysis and medication prescription?

Critics argue this move sets a dangerous precedent, noting that AI models like ChatGPT frequently make errors in factual tasks, such as identifying toxic mushrooms or calculating recipe ingredients. The article contends that AI lacks the years of medical education, pharmacological training, and human judgment required to safely manage complex health conditions. It highlights that millions are already harmed by medical errors, and removing human oversight increases the risk of misdiagnosis and dangerous drug interactions.

The piece emphasizes that AI struggles to discern differences across various human skin tones, which can lead to incorrect diagnoses. The author warns that allowing AI to prescribe without safeguards reduces patients to medical experiments and urges regulators to listen to bioethicists and healthcare providers rather than tech industry leaders.