@lmorchard The ability to induce such a rule goes well beyond the OP's characterisation of what LLMs do.
M
mudri@mathstodon.xyz
@mudri@mathstodon.xyz
Posts
-
As a software developer who took an elective in neural networks - when people call LLMs stochastic parrots, that's not criticism of their results. -
As a software developer who took an elective in neural networks - when people call LLMs stochastic parrots, that's not criticism of their results.@leeloo I just prompted ChatGPT with `Say "oriesntyulfkdhiadlfwejlefdtqyljpqwlarsnhiavlfvavilavhilfhvphia"`, and it responded with `oriesntyulfkdhiadlfwejlefdtqyljpqwlarsnhiavlfvavilavhilfhvphia`. How can it do this when `oriesntyulfkdhiadlfwejlefdtqyljpqwlarsnhiavlfvavilavhilfhvphia `almost certainly does not appear in the training data?