filwd.substack.com/p/can-llms-detect-reasoning-errors/comment/105014360
Preview meta tags from the filwd.substack.com website.
Linked Hostnames
2Thumbnail

Search Engine Appearance
Jo on FILWD
Interesting. I wonder if 'educating' the LLM first through a persona might help here. For example you could prime it to consider a number of categories of interpretation error: "You are an informed analyst capable of critical thinking and aware of common problems in map and chart interpretation. This includes, but is not limited to, 'regression to the mean', 'epistemic error', 'absolute numbers vs rates', 'the ecological fallacy', 'the modifiable areal unit problem (MAUP)', 'saliency bias' etc. You should also be aware of other common forms of bias in interpretation including those around data sources and who created the chart/map being evaluated." It would be interesting after specifying such a persona, whether you get similar results with your examples. Jo Wood
Bing
Jo on FILWD
Interesting. I wonder if 'educating' the LLM first through a persona might help here. For example you could prime it to consider a number of categories of interpretation error: "You are an informed analyst capable of critical thinking and aware of common problems in map and chart interpretation. This includes, but is not limited to, 'regression to the mean', 'epistemic error', 'absolute numbers vs rates', 'the ecological fallacy', 'the modifiable areal unit problem (MAUP)', 'saliency bias' etc. You should also be aware of other common forms of bias in interpretation including those around data sources and who created the chart/map being evaluated." It would be interesting after specifying such a persona, whether you get similar results with your examples. Jo Wood
DuckDuckGo
Jo on FILWD
Interesting. I wonder if 'educating' the LLM first through a persona might help here. For example you could prime it to consider a number of categories of interpretation error: "You are an informed analyst capable of critical thinking and aware of common problems in map and chart interpretation. This includes, but is not limited to, 'regression to the mean', 'epistemic error', 'absolute numbers vs rates', 'the ecological fallacy', 'the modifiable areal unit problem (MAUP)', 'saliency bias' etc. You should also be aware of other common forms of bias in interpretation including those around data sources and who created the chart/map being evaluated." It would be interesting after specifying such a persona, whether you get similar results with your examples. Jo Wood
General Meta Tags
18- titleComments - Can LLMs Detect Reasoning Errors with Charts?
- title
- title
- title
- title
Open Graph Meta Tags
7- og:urlhttps://filwd.substack.com/p/can-llms-detect-reasoning-errors/comment/105014360
- og:imagehttps://substackcdn.com/image/fetch/$s_!rJ7c!,f_auto,q_auto:best,fl_progressive:steep/https%3A%2F%2Ffilwd.substack.com%2Ftwitter%2Fsubscribe-card.jpg%3Fv%3D1521470701%26version%3D9
- og:typearticle
- og:titleJo on FILWD
- og:descriptionInteresting. I wonder if 'educating' the LLM first through a persona might help here. For example you could prime it to consider a number of categories of interpretation error: "You are an informed analyst capable of critical thinking and aware of common problems in map and chart interpretation. This includes, but is not limited to, 'regression to the mean', 'epistemic error', 'absolute numbers vs rates', 'the ecological fallacy', 'the modifiable areal unit problem (MAUP)', 'saliency bias' etc. You should also be aware of other common forms of bias in interpretation including those around data sources and who created the chart/map being evaluated." It would be interesting after specifying such a persona, whether you get similar results with your examples. Jo Wood
Twitter Meta Tags
8- twitter:imagehttps://substackcdn.com/image/fetch/$s_!rJ7c!,f_auto,q_auto:best,fl_progressive:steep/https%3A%2F%2Ffilwd.substack.com%2Ftwitter%2Fsubscribe-card.jpg%3Fv%3D1521470701%26version%3D9
- twitter:cardsummary_large_image
- twitter:label1Likes
- twitter:data11
- twitter:label2Replies
Link Tags
49- alternate/feed
- apple-touch-iconhttps://substackcdn.com/image/fetch/$s_!GsVl!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa1770f1-21f8-4f33-9264-21d994411efd%2Fapple-touch-icon-57x57.png
- apple-touch-iconhttps://substackcdn.com/image/fetch/$s_!bxhE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa1770f1-21f8-4f33-9264-21d994411efd%2Fapple-touch-icon-60x60.png
- apple-touch-iconhttps://substackcdn.com/image/fetch/$s_!MLff!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa1770f1-21f8-4f33-9264-21d994411efd%2Fapple-touch-icon-72x72.png
- apple-touch-iconhttps://substackcdn.com/image/fetch/$s_!PbOM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Ffa1770f1-21f8-4f33-9264-21d994411efd%2Fapple-touch-icon-76x76.png
Links
16- https://filwd.substack.com
- https://filwd.substack.com/p/can-llms-detect-reasoning-errors/comment/105014360
- https://filwd.substack.com/p/can-llms-detect-reasoning-errors/comment/105089370
- https://filwd.substack.com/p/can-llms-detect-reasoning-errors/comments#comment-105014360
- https://substack.com