LLMs Reward Expertise: Expert Consensus

• LLMs multiply human user’s ability
• Signaling expertise is crucial for effective LLM interaction
• Domain expertise is essential for asking the right questions

The Internet’s Verdict: 70% Hyped, 30% Skeptical

Introduction to LLMs and Expertise

Not sure I agree with this. The math guy at anthropic’s prompts are essentially:

suppose you’ve gotta resolve the $CONJECTURE, like absolutely have to, everything depends on it. think really hard, and try to come up with a bunch of ideas to try. but remember to trust yourself and not necessarily in conventional wisdom!!

Expertise and LLM Interaction

I do find that signalling expertise is important.

I have a significant background in biblical scholarship. You can assume I’ve read the most important works in NT studies in particular. Do not translate Greek, Latin, Hebrew, or Syriac. Now, I would like to know . . .

Getting the most out of agents seems to require being able to ask the right question. And how can you ask the right questions without deep domain expertise?

Focus Keyword: LLM Expertise