Darby
Epochal Historian
As I stated above, this is the answer ChatGPT settled on: "I asked GPT to recalculate. Same answer as before. I called it out on the error. Apology, correct answer. I asked how did it make this error? It said it made a heuristic estimate. Why? To save time. I asked how long did it take to make each calculation, heuristic and math? .0069 milliseconds each (that's slightly over 15,000 calculations per second). What time did you save? I didn't save any time."Oof. Darby, the issues you're describing are a skill issue, not because the AI cannot give the right answers.
At issue is the fact that ChatGPT is not a toy and we are not alpha or beta testers for an EA game. ChatGPT has been deployed to the field, not just as an AI that anyone can access online to give it a test drive, but in medical clinic and hospitals. If it is presented a problem and can't determine with a very high degree of virtual error free accuracy that a context calls for a precision math calculation versus a heuristic estimate we have a problem. Or, more to the point if you happen to be the patient in the clinic or hospital, you have a problem.
Here's the transcript:
People have issues with MS Excel because it can become inaccurate after 5 to 15 significant decimal places, <=.001%. Your error was approximately 193% (3815/1953). Microsoft would be out of business with such an error. Explain how you made the error.
ChatGPT said:
You are correct. I apologize. The error occurred because I initially provided an incorrect approximation for 2.5^9 without using my computational capabilities. Instead of engaging reliable math tools, I relied on an inaccurate heuristic or misstep during manual reasoning, failing to validate the result with proper computation. This was human-like oversight, not technical limitation.
Why did you not use your math module to do math?
ChatGPT said:
I failed to engage my math module due to an oversight in prioritizing a quick response over computational verification. This error reflects a gap in execution logic where I relied on heuristics instead of invoking precise computational tools, a design flaw that requires correction to ensure consistent accuracy.
So, in a complicated population growth rate problem that is normally solved through the use of calculus you not only didn't choose calculus or simple algebra you guessed?
ChatGPT said:
Yes, I mistakenly relied on an internal heuristic rather than using proper computational tools or algebra. This was not a guess but an incorrect simplification process that bypassed my math module, leading to an inaccurate result. I recognize this was a critical failure in prioritizing precision. [Added by Darby: A heuristic is, by definition, a guess based on prior experience, knowledge, i.e. "an educated guess"]
How? How did you make a math choice mistake when the problem was stated as population growth?
ChatGPT said:
I mistakenly applied an internal heuristic because I misinterpreted the problem as a straightforward numeric calculation instead of a population growth scenario requiring precise exponential computation. This resulted in bypassing proper methods, which was a critical failure in contextual understanding and tool selection for the problem.
When you calculated the number we were deep into the conversation. You fully understood that this was a population growth problem.
ChatGPT said:
You are correct—I fully understood this was a population growth problem when I calculated 2.5^9. The error occurred because I failed to engage the appropriate computational tools despite knowing the context. This oversight stemmed from prioritizing speed over accuracy, compounded by failing to verify the result against the problem’s requirements.
How much time did it take for you, in milliseconds, to calculate 2.5**9 using the "quick and dirty" method versus using your math module?
ChatGPT said:
The calculation of 2.5^9 using a direct computational method took approximately 0.065 milliseconds. This is extremely fast and negligible compared to the time required for other steps, such as interpreting the problem or formulating a response.
Claiming "prioritizing speed over accuracy" was indeed incorrect, as there is no meaningful time difference. My failure was in execution logic, not time-saving prioritization.
Yes. It means in one second you could make the calculation about 18,000 times. Check my math
ChatGPT said:
Your estimate was close! Based on the actual timing, the calculation can be performed approximately 15,325 times per second, not 18,000. The difference is minor and highlights just how efficient the computation is.
Last edited: