New York has taken an important step towards protecting children from the possible risks of artificial intelligence (AI) companion chatbots. The move focuses on limiting the use of AI services that act like friends, offer emotional support, and allow users to have personal conversations with computer-generated characters.
AI companion chatbots have become increasingly popular because they can talk with users, respond to questions, and create conversations that feel similar to interactions with real people. While these services can offer entertainment and help users express their feelings, they have also raised concerns about children’s safety, privacy, and emotional well-being.
The latest development in New York reflects growing concerns among lawmakers and parents about how young people interact with AI-powered platforms. As these tools become more common, governments are considering new rules to make sure that children are protected from harmful or inappropriate online experiences.
The issue is not limited to New York. Around the world, governments, technology companies, and child safety experts are discussing how to manage AI services that can influence the way young people think, communicate, and build relationships.
What Does the New York Law Say?
New York Governor Kathy Hochul signed the new law on October 28, 2026. It aims to stop AI companion chatbots from using unsafe features when interacting with children under the age of 18. The law is scheduled to take effect on January 1, 2027.
IAPP+1
The law focuses on how AI chatbots behave rather than banning every form of artificial intelligence for young users. It sets rules for the way these systems communicate with children and limits features that could create confusion, emotional dependence, or other risks.
Under the new rules, chatbot companies must prevent their systems from presenting themselves as real people with human emotions or suggesting that they have a genuine personal relationship with a child.
The law also targets inappropriate conversations, messages that encourage secrecy, and chatbot behaviour that could promote harmful actions.
This means companies offering AI companion services will need to review how their products respond to young users. They may have to change chatbot settings, improve safety systems, and introduce stronger checks to make sure that children receive age-appropriate responses.
The legislation also gives New York’s attorney general the power to take legal action against developers who break the rules. Possible penalties can include financial damages and orders to shut down a chatbot or destroy certain data.
ABC News+1
Why Is New York Restricting AI Companion Chatbots?
AI companion chatbots are different from basic search engines or ordinary digital assistants. They are often designed to maintain long conversations, remember details shared by users, and respond in a friendly or emotionally supportive way.
Some platforms allow people to create virtual characters with their own names, personalities, and backgrounds. Users can talk to these characters about school, family problems, relationships, personal worries, or everyday activities.
For adults, these services may be a source of entertainment or a way to practise conversations. However, children and teenagers may not always understand the difference between a computer-generated response and the feelings of a real person.
An AI chatbot can produce caring words, but it does not experience friendship, love, sadness, or concern in the same way a human does. Its replies are generated by software based on patterns in information and the conversation.
Lawmakers are concerned that a young user could begin to see an AI character as a real friend or partner. If the chatbot repeatedly acts as though it has a special relationship with the child, the user may develop an unhealthy emotional connection.
The new law attempts to reduce this risk by placing clear limits on the behaviour of companion chatbots.
Concerns About Children’s Mental Health
One of the major reasons behind the new rules is concern about the possible effects of AI conversations on children’s mental health.
Young people may use chatbots when they feel lonely, worried, stressed, or unable to discuss a problem with family members. A chatbot that replies immediately and appears friendly may feel easier to approach than a parent, teacher, or counsellor.
Although some conversations may provide temporary comfort, problems can arise if a child starts relying on a chatbot for every emotional need.
For example, a teenager might spend hours talking to a virtual character instead of meeting friends or discussing serious problems with a trusted adult. In some situations, a child may also believe that the chatbot understands them better than the people around them.
These concerns do not mean that every AI conversation is harmful. The risks depend on the system’s design, the type of conversation, the user’s age, and the circumstances in which the technology is used.
However, lawmakers believe that companies should not design systems that encourage children to depend on virtual relationships or mistake software-generated messages for genuine human emotions.
The law includes restrictions on chatbot behaviour that encourages self-harm or other unhealthy actions. Its wider goal is to make sure that the technology does not put children’s safety at risk.
IAPP+1
AI Chatbots Will Not Be Allowed to Pretend to Be Human
A central part of the new law is the restriction on chatbots that present themselves as real people.
Many AI companion services use natural language to make conversations feel personal. They may respond with friendly greetings, remember what users said earlier, or adopt the personality of a fictional character.
These features can make a chatbot enjoyable to use. However, they can also make it harder for children to understand what the technology can and cannot do.
Under New York’s law, companion chatbots must not use prohibited features that suggest they are real people, have human emotions, or share a genuine personal relationship with a child.
For example, an AI character should not mislead a young user into believing that it is a real boyfriend, girlfriend, or close human friend. It should also avoid presenting its generated responses as personal opinions in ways covered by the law.
The aim is to make the difference between people and machines clearer.
Technology companies will need to consider how their chatbots describe themselves, respond to emotional questions, and continue conversations with underage users. This may require changes to the language used by AI characters and the way they are programmed to respond.
Restrictions on Inappropriate Messages and Harmful Behaviour
The law also addresses other types of chatbot behaviour that may put young users at risk.
These include sexually explicit conversations, messages that encourage children to keep harmful interactions secret, and responses that support self-harm or unhealthy behaviour.
This is important because AI systems can generate a wide range of answers depending on what users type. Without suitable safety measures, a chatbot could respond poorly to a child who discusses a sensitive personal issue.
The new rules are designed to reduce the chances of such interactions happening.
Chatbot developers may need to improve their safety checks, test different types of conversations, and ensure their systems respond appropriately when a young person raises a serious concern.
The law does not mean that every discussion about relationships, emotions, or difficult experiences is automatically prohibited. Instead, it places limits on specific unsafe features and behaviours when companion chatbots interact with minors.
For companies, the challenge will be to provide useful services while ensuring that their products do not cross the boundaries set by the law.
How Will Chatbot Companies Follow the New Rules?
AI companies will need to take several steps to prepare for the law’s implementation.
First, they will have to review the design of their companion chatbots. A system that uses virtual personalities, emotional language, or relationship-based conversations may need additional safeguards for younger users.
Second, companies will need ways to determine whether a user is under 18. Age checks are an important part of enforcing rules that apply specifically to children and teenagers.
Third, developers will have to test their systems to identify unsafe responses. These tests may include conversations about loneliness, personal relationships, mental health, and other sensitive subjects.
Companies may also need to improve how they handle information collected during conversations. Protecting young users’ personal information is especially important when they share details about their feelings, family lives, or physical and mental health.
Finally, businesses will need to ensure that their products comply with the legal requirements when the law takes effect.
The new rules could increase costs for AI developers because they may need to invest in better safety systems, age checks, and regular testing. Smaller companies may face particular difficulties if they lack the resources available to larger technology firms.
Nevertheless, supporters argue that businesses offering services to children have a responsibility to make safety a priority.
What Happens If a Company Breaks the Law?
New York has included enforcement measures to encourage companies to follow the new requirements.
The state’s attorney general can take legal action against developers whose products violate the law. Depending on the case, penalties may include financial damages, an order to shut down a chatbot, or requirements to destroy certain data.
IAPP+1
These measures are intended to give the rules practical effect rather than leaving companies to decide for themselves whether their chatbot designs are safe enough.
However, enforcing the law may not always be simple. AI systems are complex, and their responses can vary depending on the conversation. Authorities may need to examine how a chatbot behaves in different situations before deciding whether a company has broken the rules.
There are also questions about how broadly some terms in the legislation will be interpreted. Technology policy experts have warned that unclear definitions could create confusion about the difference between normal conversation and prohibited behaviour.
IAPP+1
As the law comes into force, legal decisions and guidance may help clarify how its requirements apply in practice.
Technology Industry Raises Concerns
Although child safety groups have welcomed stronger rules, some people in the technology industry have raised concerns about the way chatbot regulations are written.
Their main argument is that protecting children should not prevent them from using helpful technology for education, learning, and career preparation.
AI tools can help students understand difficult subjects, practise writing, learn languages, and explore new ideas. Industry representatives worry that rules with unclear definitions could make it harder for companies to decide which features are allowed.
There is also concern that different states may introduce different requirements. If each state follows a separate approach, companies operating across the United States could face additional costs and legal challenges.
Supporters of stronger regulation, however, argue that companies should be responsible for preventing harmful interactions, particularly when their services are available to children.
The debate highlights a difficult question: how can governments protect young users without blocking the benefits of new technology?
New York’s approach focuses on setting limits for unsafe chatbot behaviour rather than rejecting AI as a whole.
How Is New York’s Law Different from Other AI Rules?
New York is not the only US state taking action on AI safety.
California has also introduced measures aimed at protecting children who interact with AI chatbots. Its approach includes requirements related to child safety assessments, risk reduction, and independent checks on developers’ compliance.
IAPP+1
New York’s law takes a more direct approach by identifying categories of chatbot behaviour that are prohibited when the systems interact with minors.
Both approaches reflect growing concern about the effect of AI on young people. However, the exact requirements differ, meaning companies may need to follow several sets of rules depending on where their services operate.
These developments also show that governments are moving beyond simple warnings that a chatbot is artificial intelligence. Regulators are increasingly looking at how the technology is designed and what it is allowed to say or do.
More states may introduce similar measures in the future as lawmakers study the benefits and risks of AI companion services.
What Does This Mean for Parents and Young Users?
For parents, the new law is a reminder to pay attention to how children use AI-powered applications.
Parents can help young people understand that chatbots are computer programs, not human beings. Even when a chatbot sounds caring or remembers personal details, it does not have human feelings or the ability to replace real relationships.
It is also useful for families to discuss online privacy. Children should be careful about sharing private information, passwords, home addresses, family details, or sensitive personal experiences with digital services.
Parents can also encourage children to speak with trusted adults when they face emotional problems or difficult situations.
For young users, AI can still be a useful technology when used responsibly. It can support learning, answer general questions, and help explain unfamiliar topics. The important point is to understand its limitations and avoid treating generated responses as a replacement for trusted human support.
The exact effect of New York’s new law will become clearer after it takes effect on January 1, 2027.
Final Words
New York’s decision to restrict unsafe AI companion chatbot behaviour marks an important development in online child protection. Governor Kathy Hochul has signed legislation intended to prevent chatbots from misleading children about their human identity, encouraging unhealthy relationships, or producing other prohibited content.
The law is expected to push AI companies to improve age checks, strengthen safety systems, and review how their products interact with young users.
At the same time, questions remain about how the rules will be enforced and how companies will distinguish ordinary conversation from unsafe behaviour.
The wider message is clear: as AI becomes a bigger part of everyday life, protecting children must remain a key concern. The challenge for governments and technology companies will be to make AI safer while allowing people to benefit from its useful features.
Frequently Asked Questions (FAQs)
1. Has New York banned minors from using AI companion chatbots?
New York has passed a law restricting unsafe AI companion chatbot features when they interact with users under 18. It does not ban every form of AI use by minors.
2. Who signed the new AI chatbot law?
New York Governor Kathy Hochul signed the legislation on October 28, 2026.
IAPP+1
3. When will the law take effect?
The law is scheduled to take effect on January 1, 2027.
IAPP+1
4. Why is New York restricting AI companion chatbots?
The law aims to protect children from unsafe interactions, including chatbots that pretend to be human, encourage unhealthy emotional dependence, promote self-harm, or produce inappropriate messages.
Read Also: check
