What unsettling result did Weizenbaum observe regarding users' interaction with ELIZA?

Answer

Users attributed genuine feeling and understanding to the machine

The outcome was profoundly unsettling because many users, including Weizenbaum's own secretary who asked him to leave so she could speak privately with the 'doctor,' attributed deep feeling and comprehension to the program. This reaction highlighted a deep-seated human tendency to anthropomorphize entities that successfully mimic human communication patterns, irrespective of the underlying technological simplicity, revealing a significant finding in early conversational AI research.

What unsettling result did Weizenbaum observe regarding users' interaction with ELIZA?
Artificial IntelligenceinventorchatbotConversational system