When what's inside your head and what's outside are not compatible.
There are gray areas.
Someone could believe that Little People live in her garden, and live a perfectly normal life except for the bowls of milk she leaves on the porch. The incompatibility is minor, and harmless.
When it interferes with normal functions, or other people's lives, it starts to become a problem.