NYS Department of State’s Division of Consumer Protection Cautions Against Sharing Personal Information with AI Chatbots
NYS Department of State’s Division of Consumer Protection Cautions Against Sharing Personal Information with AI Chatbots
Users Can Help Manage Identity Theft Risks by Excluding Sensitive Personal Information from AI Chatbots
Secretary Mosley said, “AI chatbots are helpful, but sharing sensitive information can increase risk of identity theft and other financial harms for users. As such, the NYS Division of Consumer Protection will continue to remain hard at work safeguarding New Yorkers by offering tips on how to protect their personal information when using AI.”
The New York Department of State’s Division of Consumer Protection today offered New Yorkers tips to protect personal information while using AI chatbots. According to a June 2026 Pew Research Survey, AI chatbot usage is on the rise and about half of U.S. adults (51%) now report using AI chatbots, with a quarter (25%) of those surveyed using AI tools daily. This raises concerns since some users are turning to AI chatbots for health advice, emotional support, and companionship, and may share personal information.
“As we use AI chatbots more frequently, it’s important to remember that information oversharing with these novel programs may lead to the inadvertent or unintended release of private information if we do not use caution,” said Secretary of State Walter T. Mosley. “AI chatbots are helpful, but sharing sensitive information can increase risk of identity theft and other financial harms for users. As such, the NYS Division of Consumer Protection will continue to remain hard at work safeguarding New Yorkers by offering tips on how to protect their personal information when using AI.”
Acting ITS Chief Information Officer Jenson Jacob said, “With the growing integration of AI chatbots into everyday life, proactively managing identity theft risks is more critical than ever. While using these tools responsibly can help you access important information, using them in the wrong way could pose a significant risk of exposing private data. The most effective safeguard to secure your data is to never share Social Security numbers, driver’s licenses, passport numbers, account passwords, PINs, credit card details, health information, or other personal, sensitive information when utilizing these platforms.”
WHAT YOU NEED TO KNOW ABOUT AI CHATBOTS:
Like other technology, AI chatbots can be helpful, but, as noted by a recent Stanford University study, it is important to assume that any information given to an AI chatbot will be collected and used for training and could be viewed by a human reviewer or hacked.
- Public AI chatbots can collect user prompts to train future versions of AI models, which means your private words may not remain private.
- AI chatbots may retain user information.
- If any personal information, account numbers, or credentials are entered, they could potentially be shared or exposed in a data breach.
TIPS WHEN USING AN AI CHATBOT:
Avoid posting or disclosing personal information.
What Not to Share:
- Personal identifying information (SSN, Name, Address, Birth Dates, etc.)
- Financial information (account numbers, etc.)
- Health information (medical diagnosis, lab results, etc.)
- Legal documents
- Usernames or passwords
Opt-out of having your future data saved:
Many AI chatbots may save chats and data for AI training by default. You can take steps to stop future chats from being saved and used for training. If the platform permits you to change the default settings, opt-out of an AI chatbot storing your personal information or using it for training purposes by adjusting the privacy and training settings directly within each platform. For general internet searches, switching to “private” or “incognito” modes can help minimize the amount of information or data retained on your device, but information may still be transmitted to external parties, including AI platforms.
About the New York State Division of Consumer Protection
Follow the New York Department of State on Facebook, X, and Instagram and check in every Tuesday for more practical tips that educate and empower New York consumers on a variety of topics. Sign up to receive consumer alerts directly to your e-mail or phone here. The New York State Division of Consumer Protection provides voluntary mediation between a consumer and a business when a consumer has been unsuccessful at reaching a resolution on their own. The Consumer Assistance Helpline 1-800-697-1220 is available Monday to Friday from 8:30am to 4:30pm, excluding State Holidays, and consumer complaints can be filed at any time at: www.dos.ny.gov/consumer-protection. The Division can also be reached via X at @NYSConsumer or Facebook.