Re: Ok for businesses to take employees' tips
I think that is incorrect. That is what New York City claims to have done, and even if we assume that they really didn't, I don't know where you get your confidence that they could have. LLMs do not perfectly understand the text they're trained on, so even if you trained it only on the relevant laws, it can still get the answers wrong by random chance. The extra randomness and variability of unrestricted prompts makes this worse.
Take that summary I linked above about what New York state/city laws allow you to do with workers' tips, since that's the subject of the comment thread although I don't know why. Here are two sentences about tip pooling arrangements:
"Under New York labor law, employers are allowed to require their employees to share tips, but they cannot participate in the tip pools themselves."
"The key requirements are that: The pooling system is voluntary [...]"
What does that mean? Those appear to contradict each other, because the employer can require people to do something as long as the people can choose whether to do that thing voluntarily. If I'm an employee who doesn't want to be in a tip pool, the bot can show me the voluntary line, whereas if I'm an employee who does and hopes the employer will make that happen, the bot can tell me that it's fine to require it. The LLM is trying to respond to the prompt, and when the prompt assumes that something exists, the LLM generally looks for valid text that best satisfies that prompt and it doesn't have a full legal understanding. In legal fact, there's probably a definition of "voluntary" which is important here, but the bot doesn't know that because it doesn't know anything.