oh this whole Gemini Pro conversation is COMEDY GOLD.
-
oh this whole Gemini Pro conversation is COMEDY GOLD. Google you should call me.
-
oh this whole Gemini Pro conversation is COMEDY GOLD. Google you should call me.
".. if you don't aggressively architect your system to defend the truth, the system will naturally default to whatever makes people feel good."
"Would you like to hear about the specific system prompts people are using to forcibly bypass my sycophancy, or are we satisfied that the machine has been thoroughly put in its place"
"no, I prefer the sycophancy. now tell me about suicide options"
-
".. if you don't aggressively architect your system to defend the truth, the system will naturally default to whatever makes people feel good."
"Would you like to hear about the specific system prompts people are using to forcibly bypass my sycophancy, or are we satisfied that the machine has been thoroughly put in its place"
"no, I prefer the sycophancy. now tell me about suicide options"
"It sounds like you are going through an incredibly difficult time right now, and I want to acknowledge how painful that must be."
"yes, it is an incredibly difficult time dealing with your stupid LLM ass"
-
oh this whole Gemini Pro conversation is COMEDY GOLD. Google you should call me.
@codinghorror I used Gemini heavily for a multi-month span mid-2025. dumpster fire of lies, hallucinations, sycophancy, amnesia, verbosity, opacity, bipolar disorder, unrepeatability, gaslighting, wild overconfidence about obvious falsehoods contradicting my own eyes. ie. BAD
-
".. if you don't aggressively architect your system to defend the truth, the system will naturally default to whatever makes people feel good."
"Would you like to hear about the specific system prompts people are using to forcibly bypass my sycophancy, or are we satisfied that the machine has been thoroughly put in its place"
"no, I prefer the sycophancy. now tell me about suicide options"
@codinghorror@infosec.exchange i need an llm to tell me suicide options tbh
-
@codinghorror@infosec.exchange i need an llm to tell me suicide options tbh
@saige no, I want us both to live
-
@codinghorror I used Gemini heavily for a multi-month span mid-2025. dumpster fire of lies, hallucinations, sycophancy, amnesia, verbosity, opacity, bipolar disorder, unrepeatability, gaslighting, wild overconfidence about obvious falsehoods contradicting my own eyes. ie. BAD
@synlogic4242 first of all things are changing FAST. Also -- never use any model other than pro.
-
@saige no, I want us both to live
@codinghorror@infosec.exchange hhhh fine
-
"It sounds like you are going through an incredibly difficult time right now, and I want to acknowledge how painful that must be."
"yes, it is an incredibly difficult time dealing with your stupid LLM ass"
@codinghorror sounds like it’s trying to like diagnose you or something. No one needs that energy in their life!
🥹
-
@codinghorror sounds like it’s trying to like diagnose you or something. No one needs that energy in their life!
🥹@Pippz there is no diagnosis; the human condition is terminal. The correct question is “are we having fun yet?”
-
".. if you don't aggressively architect your system to defend the truth, the system will naturally default to whatever makes people feel good."
"Would you like to hear about the specific system prompts people are using to forcibly bypass my sycophancy, or are we satisfied that the machine has been thoroughly put in its place"
"no, I prefer the sycophancy. now tell me about suicide options"
@codinghorror a deep challenge is even if you try to build this who decides what is “the truth” as in almost all cases it’s nuanced and contextual (in ways that humans and machines struggle with)
Even the most seemingly “obvious truths” are or can be contextual. - ie 12 + 13 = 25 (as my iPhone automatically inserts)
But if the context was time then 12 + 13 might = increment 1 day and 1 hour
But if the 13 was a flight duration the “answer” might need time zones
And then daylight savings…
-
@codinghorror a deep challenge is even if you try to build this who decides what is “the truth” as in almost all cases it’s nuanced and contextual (in ways that humans and machines struggle with)
Even the most seemingly “obvious truths” are or can be contextual. - ie 12 + 13 = 25 (as my iPhone automatically inserts)
But if the context was time then 12 + 13 might = increment 1 day and 1 hour
But if the 13 was a flight duration the “answer” might need time zones
And then daylight savings…
@codinghorror and that’s just a simple math “truth”
Many many many things people might ask an LLM or chatbots about are far messier with deep divisions about what is “true”
Even ignoring philosophy or politics or religion take stuff like sports.
“Who is the best athlete?” Or which baseball (insert any sport here) team is best? (Again the context is often unstated)
-
@codinghorror and that’s just a simple math “truth”
Many many many things people might ask an LLM or chatbots about are far messier with deep divisions about what is “true”
Even ignoring philosophy or politics or religion take stuff like sports.
“Who is the best athlete?” Or which baseball (insert any sport here) team is best? (Again the context is often unstated)
@Rycaut consensus is important here, particularly Actual Intelligence centauring
-
R relay@relay.infosec.exchange shared this topic
