#28 – The Art of Prompt Design, OpenAI Codex, Fine Tuning and More with David Shapiro
Bakz T. Future
Welcome back to Multimodal! Today’s very special guest is David Shapiro (daveshapautomator). He’s an author, IT professional, and frequent OpenAI community forums contributor.
In this wide ranging discussion, we discuss the art of prompt design, his thoughts on InstructGPT, OpenAI codex, his new book, the OpenAI community at large, and share thoughts on fine tuning and so much more.
Podcast Discussion Timestamps:
00:00 – Intro
02:48 – How David heard about OpenAI’s GPT-3
05:57 – David’s first time trying GPT-3/his favourite use cases
10:38 – Did GPT-3 feel advanced to you?
15:00 – What are the keys to great GPT-3 prompt design?
18:34 – How do you become a better writer?
25:43 – GPT-3: The end of the socially awkward developer (?)
30:16 – Is GPT-3 Prompt Design Over? (Chatting About InstructGPT)
34:21 – Open Fine Tuning Lessons Learned
42:00 – OpenAI Codex / David’s Billion Dollar Use Case Idea
50:00 – Which AI Models David is using currently
53:15 – David’s Book – Natural Language Cognitive Architecture
1:01:25 – What is the pathway from now to true AGI?
1:08:41 – Thoughts/feedback about the OpenAI Community Forums
1:18:40 – My Feedback on OpenAI’s Community Forums
1:22:00 – My Feedback on OpenAI’s Community Forums II #hottake
1:24:46 – Multimodal AI technology
1:27:43 – What would you do with Multimodal AI?
1:32:38 – Where do you see all of this stuff going? 5-10 years
1:35:24 – Closing thoughts
Show Notes/Links
OpenAI:
https://openai.com/blog/instruction-following/
https://openai.com/blog/openai-codex/
https://beta.openai.com/docs/guides/fine-tuning
Fine tuning notes:
https://bakztfuture.substack.com/p/openai-fine-tuning-feedbacknotes
GPT-3 navigates the New York subway:
https://www.youtube.com/watch?v=Xzb1Vc8dYAY
The Language Instinct: How the Mind Creates Language by Steven Pinker
https://www.amazon.ca/Language-Instinct-How-Mind-Creates/dp/1491514981
My Biggest 2022 Prediction: GPT-3 will take over schools and college campuses
https://bakztfuture.substack.com/p/my-biggest-2022-prediction-gpt-3
GPT-3 – The End of the Socially Awkward Developer (?)
https://bakztfuture.substack.com/p/gpt-3-the-end-of-the-socially-awkward
GPT-3 Twitter Spaces Event:
https://twitter.com/bakztfuture/status/1491260407579054087?cxt=HHwWjsDU1ZHcgrIpAAAA
Follow David Shapiro (daveshapautomator):
https://www.davidkshapiro.com/home
https://www.linkedin.com/in/dshap-automator/
https://github.com/daveshap
https://community.openai.com/u/daveshapautomator/summary
Natural Language Cognitive Architecture GitHub repo, links:
https://github.com/daveshap/NLCA_Question_Generator
https://youtu.be/FXURKmtjXI0
https://youtu.be/WG1Dk8yYiZs
Subscribe to the Multimodal Podcast!
Spotify – https://open.spotify.com/show/7qrWSE7ZxFXYe8uoH8NIFV
Apple Podcasts – https://podcasts.apple.com/us/podcast/multimodal-by-bakz-t-future/id1564576820
Google Podcasts – https://podcasts.google.com/feed/aHR0cHM6Ly9mZWVkLnBvZGJlYW4uY29tL2Jha3p0ZnV0dXJlL2ZlZWQueG1s
Stitcher – https://www.stitcher.com/show/multimodal-by-bakz-t-future
Other Podcast Apps (RSS Link) – https://feed.podbean.com/bakztfuture/feed.xml
Connect with me:
YouTube – https://www.youtube.com/bakztfuture
Substack Newsletter – https://bakztfuture.substack.com
Twitter – https://www.twitter.com/bakztfuture
Instagram – https://www.instagram.com/bakztfuture
Github – https://www.github.com/bakztfuture