Vechev and his team found that the large language models that power advanced chatbots can accurately infer an alarming amount of personal information about users—including their race, location, occupation, and more—from conversations that appear innocuous.
I mean, can be used that way, can also be used to predict the stock market, or future climate. Just depends on the intent.