filwd.substack.com/p/can-llms-detect-reasoning-errors/comment/105014360

Preview meta tags from the filwd.substack.com website.

Linked Hostnames

2

Thumbnail

Search Engine Appearance

Google

https://filwd.substack.com/p/can-llms-detect-reasoning-errors/comment/105014360

Jo on FILWD

Interesting. I wonder if 'educating' the LLM first through a persona might help here. For example you could prime it to consider a number of categories of interpretation error: "You are an informed analyst capable of critical thinking and aware of common problems in map and chart interpretation. This includes, but is not limited to, 'regression to the mean', 'epistemic error', 'absolute numbers vs rates', 'the ecological fallacy', 'the modifiable areal unit problem (MAUP)', 'saliency bias' etc. You should also be aware of other common forms of bias in interpretation including those around data sources and who created the chart/map being evaluated." It would be interesting after specifying such a persona, whether you get similar results with your examples. Jo Wood



Bing

Jo on FILWD

https://filwd.substack.com/p/can-llms-detect-reasoning-errors/comment/105014360

Interesting. I wonder if 'educating' the LLM first through a persona might help here. For example you could prime it to consider a number of categories of interpretation error: "You are an informed analyst capable of critical thinking and aware of common problems in map and chart interpretation. This includes, but is not limited to, 'regression to the mean', 'epistemic error', 'absolute numbers vs rates', 'the ecological fallacy', 'the modifiable areal unit problem (MAUP)', 'saliency bias' etc. You should also be aware of other common forms of bias in interpretation including those around data sources and who created the chart/map being evaluated." It would be interesting after specifying such a persona, whether you get similar results with your examples. Jo Wood



DuckDuckGo

https://filwd.substack.com/p/can-llms-detect-reasoning-errors/comment/105014360

Jo on FILWD

Interesting. I wonder if 'educating' the LLM first through a persona might help here. For example you could prime it to consider a number of categories of interpretation error: "You are an informed analyst capable of critical thinking and aware of common problems in map and chart interpretation. This includes, but is not limited to, 'regression to the mean', 'epistemic error', 'absolute numbers vs rates', 'the ecological fallacy', 'the modifiable areal unit problem (MAUP)', 'saliency bias' etc. You should also be aware of other common forms of bias in interpretation including those around data sources and who created the chart/map being evaluated." It would be interesting after specifying such a persona, whether you get similar results with your examples. Jo Wood

  • General Meta Tags

    18
    • title
      Comments - Can LLMs Detect Reasoning Errors with Charts?
    • title
    • title
    • title
    • title
  • Open Graph Meta Tags

    7
    • og:url
      https://filwd.substack.com/p/can-llms-detect-reasoning-errors/comment/105014360
    • og:image
      https://substackcdn.com/image/fetch/$s_!rJ7c!,f_auto,q_auto:best,fl_progressive:steep/https%3A%2F%2Ffilwd.substack.com%2Ftwitter%2Fsubscribe-card.jpg%3Fv%3D1521470701%26version%3D9
    • og:type
      article
    • og:title
      Jo on FILWD
    • og:description
      Interesting. I wonder if 'educating' the LLM first through a persona might help here. For example you could prime it to consider a number of categories of interpretation error: "You are an informed analyst capable of critical thinking and aware of common problems in map and chart interpretation. This includes, but is not limited to, 'regression to the mean', 'epistemic error', 'absolute numbers vs rates', 'the ecological fallacy', 'the modifiable areal unit problem (MAUP)', 'saliency bias' etc. You should also be aware of other common forms of bias in interpretation including those around data sources and who created the chart/map being evaluated." It would be interesting after specifying such a persona, whether you get similar results with your examples. Jo Wood
  • Twitter Meta Tags

    8
    • twitter:image
      https://substackcdn.com/image/fetch/$s_!rJ7c!,f_auto,q_auto:best,fl_progressive:steep/https%3A%2F%2Ffilwd.substack.com%2Ftwitter%2Fsubscribe-card.jpg%3Fv%3D1521470701%26version%3D9
    • twitter:card
      summary_large_image
    • twitter:label1
      Likes
    • twitter:data1
      1
    • twitter:label2
      Replies
  • Link Tags

    49
    • alternate
      /feed
    • apple-touch-icon
      https://substackcdn.com/image/fetch/$s_!GsVl!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa1770f1-21f8-4f33-9264-21d994411efd%2Fapple-touch-icon-57x57.png
    • apple-touch-icon
      https://substackcdn.com/image/fetch/$s_!bxhE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa1770f1-21f8-4f33-9264-21d994411efd%2Fapple-touch-icon-60x60.png
    • apple-touch-icon
      https://substackcdn.com/image/fetch/$s_!MLff!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa1770f1-21f8-4f33-9264-21d994411efd%2Fapple-touch-icon-72x72.png
    • apple-touch-icon
      https://substackcdn.com/image/fetch/$s_!PbOM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa1770f1-21f8-4f33-9264-21d994411efd%2Fapple-touch-icon-76x76.png

Links

16