{"id":52013,"date":"2023-03-14T13:45:16","date_gmt":"2023-03-14T13:45:16","guid":{"rendered":"https:\/\/mailinvest.blog\/index.php\/2023\/03\/14\/getting-the-right-answer-from-chatgpt-oreilly\/"},"modified":"2023-03-14T13:46:15","modified_gmt":"2023-03-14T13:46:15","slug":"getting-the-right-answer-from-chatgpt-oreilly","status":"publish","type":"post","link":"https:\/\/mailinvest.blog\/index.php\/2023\/03\/14\/getting-the-right-answer-from-chatgpt-oreilly\/","title":{"rendered":"Getting the Right Answer from ChatGPT \u2013 O\u2019Reilly"},"content":{"rendered":"

<\/a>\n<\/p>\n

\n

A few days in the past, I used to be fascinated about what you wanted to know to make use of ChatGPT (or Bing\/Sydney, or any related service). It\u2019s straightforward to ask it questions, however everyone knows that these massive language fashions continuously generate false solutions.\u00a0Which raises the query: If I ask ChatGPT one thing, how a lot do I must know to find out whether or not the reply is appropriate?<\/p>\n

So I did a fast experiment. As a brief programming undertaking, quite a lot of years in the past I made an inventory of all of the prime numbers lower than 100 million. I used this checklist to create a 16-digit quantity that was the product of two 8-digit primes (99999787 occasions 99999821 is 9999960800038127). I then requested ChatGPT whether or not this quantity was prime, and the way it decided whether or not the quantity was prime.<\/p>\n

\n
\n
\n
\n
\n <\/a>\n <\/div>\n

<\/p>\n


\n Study sooner. Dig deeper. See farther.
\n <\/h2>\n

\n <\/p>\n<\/div>\n<\/div>\n

ChatGPT accurately answered that this quantity was not prime. That is considerably stunning as a result of, when you\u2019ve learn a lot about ChatGPT, you already know that math isn\u2019t one in all its sturdy factors. (There\u2019s most likely an enormous checklist of prime numbers someplace in its coaching set.) Nonetheless, its reasoning was incorrect\u2013and that\u2019s much more attention-grabbing. ChatGPT gave me a bunch of Python code that carried out the Miller-Rabin primality take a look at, and stated that my quantity was divisible by 29. The code as given had a few fundamental syntactic errors\u2013however that wasn\u2019t the one drawback. First, 9999960800038127 isn\u2019t divisible by 29 (I\u2019ll allow you to show this to your self). After fixing the plain errors, the Python code seemed like an accurate implementation of Miller-Rabin\u2013however the quantity that Miller-Rabin outputs isn\u2019t an element, it\u2019s a \u201cwitness\u201d that attests to the very fact the quantity you\u2019re testing isn\u2019t prime. The quantity it outputs additionally isn\u2019t 29. So ChatGPT didn\u2019t really run this system; not stunning, many commentators have famous that ChatGPT doesn\u2019t run the code that it writes. It additionally misunderstood what the algorithm does and what its output means, and that\u2019s a extra severe error.<\/p>\n

I then requested it to rethink the rationale for its earlier reply, and obtained a really well mannered apology for being incorrect, along with a distinct Python program. This program was appropriate from the beginning. It was a brute-force primality take a look at that attempted every integer (each odd and even!) smaller than the sq. root of the quantity beneath take a look at. Neither elegant nor performant, however appropriate. However once more, as a result of ChatGPT doesn\u2019t really run this system, it gave me a brand new checklist of \u201cprime elements\u201d\u2013none of which had been appropriate. Apparently, it included its anticipated (and incorrect) output within the code:<\/p>\n

\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0n = 9999960800038127<\/code>
\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0elements = factorize(n)<\/code>
\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0print(elements) # prints [193, 518401, 3215031751]<\/code><\/p>\n

I\u2019m not claiming that ChatGPT is ineffective\u2013removed from it. It\u2019s good at suggesting methods to unravel an issue, and may lead you to the suitable answer, whether or not or not it offers you an accurate reply. Miller-Rabin is attention-grabbing; I knew it existed, however wouldn\u2019t have bothered to look it up if I wasn\u2019t prompted. (That\u2019s a pleasant irony: I used to be successfully prompted by ChatGPT.)<\/p>\n

Getting again to the unique query: ChatGPT is nice at offering \u201csolutions\u201d to questions, but when you could know that a solution is appropriate, it’s essential to both be able to fixing the issue your self, or doing the analysis you\u2019d want to unravel that drawback. That\u2019s most likely a win, however it’s important to be cautious. Don\u2019t put ChatGPT in conditions the place correctness is a matter until you\u2019re keen and capable of do the arduous work your self.<\/p>\n<\/p><\/div>\n