over 3 years ago Syntax Podcast
AI and Coding with ChatGPT
- 00:20 AI encoding overview
- 01:23 Scott's snowboarding story
- 02:00 Ad for Sentry error tracker
- 03:26 AI taking jobs discussion
- 04:15 AI intensity in communities
- 06:29 AI as a solution or non-solution
- 07:26 AI use cases discussion
- 08:29 Github Copilot overview
- 09:48 OpenAI and Github Copilot
- 10:17 Midjourney image generator
- 11:13 AI art ethics issues
- 11:40 AI marketing copy issues
- 12:27 AI usage attribution issues
- 13:15 AI competitive advantage issues
- 13:44 Constantly raising quality bars
- 14:11 AI going off rails examples
- 14:35 Microsoft Bing issues
- 15:06 Google Bard announcement
- 15:17 Many companies doing AI
- 15:43 AI model explanations
- 17:19 How models are trained
- 18:17 Models as black boxes
- 18:36 TensorFlow overview
AI art ethics issues
Wes Bos
and you tell it to make it. And it's Yeah. It's all over for us for Toast. And Google is saying that they're gonna release their Bard or Bang or what? It's a stupid name, companies
Wes Bos
read. Check out. Midjourney can make an entire website the world up until, what, 2021.
Wes Bos
rid. Remixed version of something that they pulled off of off of dribble. You know? Like, it's like, I can I can almost see which one it it rid? That to to use as a as a starting point. Even in the language, you can see that. You know, there was a,
AI model explanations
Guest 2
even, re completion. Yeah. Then you don't have to go off to install a plug in to do that or have to then worry about like, Always my plug in, ESM compatible. You know, like Yeah. The it just yeah. Solving a bunch of those issues just to generate that stuff. So there's, Like Warp AI completions, that is also so Copilot is built on OpenAI. That's the makers of ChatGPT.
Guest 2
Watson and stuff like that on here that are it's kind of like a a really interesting timeline to the growth of all this stuff. So,
Guest 2
so to say, which is they have the tour the the the paper of the Turing test is is what that is, but they also have things like the chatbot and, seeing what they can do possibly to make a quick buck. But in the same regard, these things are,
Guest 2
rid is basically you could think of as the AI. It's the thing that, sample which, you know, I I haven't done a ton with TensorFlow, but it it seems like the most powerful thing out there for this type of deal.
Guest 2
takes in data and spits out answers. It's rid. Trained. It's able to learn on things, and the different types of models are good at different things. Some models learn,
Guest 2
it's the type of thing that Probably in another big step forward. Yeah. And a a model is trained by basically
Guest 2
in language models where it's, like, showing where all of these, various models were released and links to their papers or the blog post announcing them over time. So So you can see directly that these types of AI models have been, We can talk A little bit more in-depth when we talk about things like, So I'm curious. I don't have access to that one yet. Yeah. It's going off the rails. Yeah. Have you seen any of these these going off totally off the rails where it was like
Guest 2
what is a model? Well, a model
Guest 2
you know, in they've been evolving since, rid. 1947, text from relevant sources. It's probably not taking this. And either it says something about That competitor's marketing copy that is generic enough that an AI could have wrote it, or, and and anybody who's ever tried to do a board slide on a snowboard knows that that's, like, one of the easiest ways to destroy your tailbone.
Guest 2
based on natural language, like GPT, rid. Understanding your data.
Guest 2
is a language model. GPT 3
Guest 2
and soon to be a GPT 4 that
Guest 2
But this is mostly just like, how can we use this to affect our lives? I I think one of the big concepts you'll you'll be seeing around is The concept of, like, a a model. You hear that word all the time. And in fact, I've linked in the show notes to a timeline of AI, rid AI startups, you know? Well, it's because those people aren't the developers anyways. Those were always the people who were, And we're somewhere It's the solution to everything,
Guest 2
is probably going to and then who knows when? But, Today, I asked Landon to ask it some questions, and he was, a a decent camera, a good enough camera. Yeah. You're right.
AI taking jobs discussion
Wes Bos
for you today.
Wes Bos
people depressed Ronald McDonald. And it's it's pretty cool that it can generate all that stuff. There's there's also a lot of, like, ethical stuff around that. You can certainly see
Guest 2
of dev Twitter or or dev communities where they get into this flow of, like I mean, we saw it once with with Oh, yeah. We were asking about Pokemon.
Wes Bos
a LOL, rid. It's gonna take your job kinda thing. I'm I'm feeling a little bit exhausted
Wes Bos
there's more The competitive
Wes Bos
I want to say that this is not gonna be Currently, the sort of the big players in the space is probably the biggest one. Chat GPT is where you type into a box and it rid. Knows kind of what you're doing. You can ask it questions, and it will return you answers. It is trained on
Wes Bos
Alright. Well, that's great. Let's get into the the episode 10,000 photos that's the robots, using it right now trying to figure out what is Resolved and hope that it never comes back. So check it out at century. Io. Rid. Use the coupon code tasty treat for 2 months for free. Thank you, Sentry, for sponsoring.
AI usage attribution issues
Wes Bos
it looked nice, but it no longer was
Wes Bos
that type of stuff. Like, as soon as everybody has access to these tools,
Wes Bos
a cool thing. And now I'm doing, like, of some cool borders in my video editing thing, and everyone's, oh, how did you get that? You know? And it's, like, it's a pop up on other people's already. Yeah. Well, it's because I showed rid. How to do it on, sure, on on YouTube. I don't mind that. But but it's also because it's cool, and it looks good. That becomes part of the tool,
Github Copilot overview
Guest 2
rid. You know, I'm using it more of like a fancy autocomplete weirds me out. You know, your it's a usage without attribution. That's it's crazy. And also man, I board slid, like, 8 or 9 different rails yesterday, and they felt great. I I was like, it was the most comfortable I've ever been riding rails. So, this particular Either using or not using both of them where it's like, you gotta put yourself into 1 camp. You either think it sucks or it's gonna change everything.
Guest 2
Rid Are you getting that as well, or are you not using that? No. No. I'm not I'm not getting that, and I am using it. But,
Wes Bos
do all that. Like, it's so much nicer to have that really nice 50 meg rid. Model, whereas I'm sure the GPT
Wes Bos
Start an end date anywhere from 3 months to 6 years, and it will I shipped some code and it's hooked up to my GitHub, so it'll say, oh, this thing just started happening, and it's Probably because of this commit,
Wes Bos
than anything else, so to say. Oh, yeah. I've I've been using it for a lot of that, but also be using it to generate 10,000 photos of a kiwi and say this is a kiwi I've seen people ask it for crochet patterns. And,
Wes Bos
dummy data that is significant for my courses. I think I might have mentioned this in the show, but basically say, like, Give me a list of 50 people, and each person has a nested array of jobs, and each job can have a not just coding. Like, that's the one thing that blows my mind is that, like, we're asking it coding questions and math questions and whatnot. But then you upload My name is Wes Boss from Canada. With me as always is mister Chylinski. How are you doing today, Scott? Hey. I'm doing good. Just got back from
Wes Bos
knows how to code my entire program, but doesn't know how to, like, properly close a quote.
Wes Bos
Rid. It's a little bit frustrating right now in that it
AI use cases discussion
Guest 2
he was very curious about some Pokemon stuff. So we also have GitHub Oh, pilot.
Wes Bos
Exactly.
Wes Bos
I'm a paying member of it. I absolutely love it.
Guest 2
not accurate as well. Right? predefined set of replies and rules that solve an answer, right, is the start of it, and the end of it is complete, you know, loss of humanity.
Wes Bos
Rid. So it has a pretty good understanding of competitive advantage that that gives you is automatically gone. Right? Like, we saw that with, like, nice rid. Coding screenshots. Like, I used to, like, I used to use, like, a Versus Code plug in and make a nice coding screenshot. And then as soon as very clearly just a rid. The fact that it actually solves so many problems where it's just like Oh, yeah. With those takes.
Wes Bos
Let's talk about the current landscape are automatically collected in there, and they will tell you how often this thing happened. It did just happen once in, like, a bizarre thing, or is it happening? models are terabytes and terabytes of of actual data. The chat GPT 3 model in particular is
Wes Bos
then. So,
AI encoding overview
Wes Bos
Rid. And then also, like, we're gonna talk about getting into coding, Recently, machine learning has been around for
Guest 2
I hit my my very first backside board slide. I I'm, like, Getting really comfortable with board slides,
Wes Bos
This is something that you, a developer, are going to need to start to implement into your applications in the coming Many people have asked is AI encoding. We're going to talk about what are the different rid Things out there to use, as a coder as well as, like, I guess, like a graphic designer. What are models? What are the
Guest 2
We, took a little Monday out, took leaning up there, did another lesson, and I got to ride all day. And, dude, I I had a really good ride. I had like, for those of you who want maybe more like a one zero one.
Wes Bos
and whatnot.
Wes Bos
Subscriptions out there. We're gonna certainly going to touch on. Is it going to change take your job? How is it going to change our jobs? Is this a good thing? Is this a bad thing? like, of hot dogs marketing,
TensorFlow overview
Guest 2
So it's big.
Wes Bos
It can mostly
Guest 2
It's 10,000,000,000 maybe the rest of them, and I think they're only going to get more and more more intense. You know? There there's, like,
Guest 2
words, so there's no way that that's 10 gig 45 terabytes then That's out the window. You know? Yeah. I I remember when having good video and good audio was enough to set me apart. Yeah.
Guest 2
175, it was it was like, you don't like your job. You do not like your wife. Rid. You are not happy with your like, it was just, like, demeaning this person. Yeah.
Wes Bos
literally for the Hot Dog one, and it's not nearly as powerful as Chat GPT.
Guest 2
that Google tells me. There's some, there's some, like, the interface or something of working with it is 10 gigabytes. There there's some there's something there, Why? I'm not allowed to do this. What do you need? in between.
Guest 2
Rid and TensorFlow is a machine learning library that, again, allows you to train models. It allows you to do linear regressions. It allows you to do all sorts of things, and then, like, that's the grift. Right? Yeah. Don't don't you want all my monkeys? But a this AI stuff is different. I I think this stuff is is very different in many ways, and there are definitely grifters in this space around it right now where everybody's,
Guest 2
And it it's really pretty neat. It also allows you to do a lot of, like, image based stuff, which I I haven't done, admittedly, at least not yet. Yeah. I I'm using it in my upcoming TypeScript course There's also a library called TensorFlow,
Guest 2
parameters
Guest 2
uh,000,000
Transcript
Wes Bos
show for you.
Wes Bos
Welcome
Announcer
You're listening to Syntax, the podcast with the tastiest web development treats out there. Strap yourself in and get ready. Here is Scott Talinski and Wes Bos.
Wes Bos
to Syntax. This is the podcast with the tastiest web development treats out there. Today, we've got a In effect,
How models are trained
Wes Bos
And etcetera, etcetera. And then eventually, you'll be able to give it a photo with just an input, and it will guess based on everything that you've given it
Wes Bos
at a very simple level.
Wes Bos
rid. What do you think that I will have an outcome in? Because we are humans and have somewhat repeatable outputs
Wes Bos
Rid. You give it enough inputs okay, this is I really understand.
Wes Bos
and you give it expected outputs.
Wes Bos
rid What that thing is as as an output, and that can be used for simple things like image detection or,
AI intensity in communities
Guest 2
not going to go away, and they will,
Guest 2
the start of AI is, you know, a Markov chain or something. Maybe that's not the start of AI, but, like, a predeset find,
Guest 2
like, intensity behind people
Guest 2
You know, just riding the next grift to see whatever they could do to make a lot of money. I'm gonna Yeah. I'm gonna generate some photo of a monkey,
Guest 2
Rid And, like,
Guest 2
what happens when you get those takes is you get the people who start to both defend it at all costs, but also fight it at all costs even if things are rid actually interesting or relevant or have nuance or small bits of the conversation. And, again, I don't wanna relate it to crypto too much, but, I do. Well, like, what happened? I haven't heard about anything about Web 3 since Yeah. Oh, good. The the chat GTP stuff dropped because why? Because those people are are now making
Guest 2
Crypto and not to say crypto and AI are similar in many ways but, then that's probably not accurate. And if you assume that it's a solution to nothing, that's probably
Guest 2
continue to dominate our lives for, you know, that last thing you need to do is connect that to a,
Guest 2
A really interesting blog post that I was reading where it was like, AI.
Guest 2
And I'm gonna sell this monkey for $10,000,
Guest 2
We're right now. And, I think that's probably only gonna, you know, keep going. Yeah. Yeah. Yeah. It's interesting how, like,
AI as a solution or non-solution
Wes Bos
But it's when it really hits a use case with these APIs because
Wes Bos
Rid. This this is making my life a 100 times easier. I'm already in. I'm gonna integrate this into my daily workflow rather than trying to twist something. And and that's I don't wanna poo poo the web 3 people because there's a lot of people
Wes Bos
or just the a text to image
Wes Bos
is this tech good for and how can like, what are we gonna use it for in our daily lives? Yeah. I think that's the same thing with this is where if you assume Rid. The bar on literally rid. Code that you have written. Given the code that I have written in the last 6 hours or given the code that is linked on this file, on any side of this type of thing. And I think that Other things, Bing just rolled theirs out. Bing is the Bing one is is really cool in that it can search the web and then parse it in real time.
Wes Bos
symptom of it getting good enough,
Wes Bos
and I'm curious if that is a months, years, decades, and it will point you towards that actual commit. It's so nice to be able to see that thing. You can then take the errors and Convert them into GitHub issues so you link all of that together and go ahead and fix it.
Wes Bos
where, I'm feeling a little bit exhausted of the Hey Copilot, it's called, which is like the voice coding one. That's kinda interesting as well. Rid. Warp does one as well, which is I'm pretty sure built on GPT as well, where you can say, like, give me the bash code for X, Y, and Z. But then there's all other things like Midjourney. Have you tried out Midjourney? Everybody could do that. It no longer rid. Machine learning. And what it does, you can say, like, in the style
Wes Bos
many years now. Yeah. And it really only popped off for us as web developers, then a quick hot take. So that's what I'm hoping to get into with this episode is just Dive into it a little bit more because I think it's something we need to be paying attention for and figuring out how to to use it. Yeah. It's not gonna go away. And, you know, there there is definitely, like, Subsections
Guest 2
that Was just taking a sampling of of prior work. And you never know with some of this stuff that, like, really kinda
Scott's snowboarding story
Guest 2
pretty clumsy, definitely there's, like, some,
Guest 2
not Ruby on rails, rid Boardrails. So it was just great to get out there, get get some fresh air, and just get away from the computer. We're sponsored today by Sentry.
Guest 2
So as somebody who has, like, a recovering
Guest 2
tailbone injury and is notoriously
AI competitive advantage issues
Wes Bos
everything, content creation, That has been a game changer for me.
Guest 2
or at least
Microsoft Bing issues
Guest 2
You gotta connect us to those feelings of,
Guest 2
why can't I do this with spinning blades or lasers? Yeah.
Guest 2
one of the things I'm notoriously afraid of, Which is robot powered lawnmowers.
Wes Bos
It's starting to go off the rails. Yeah. And here's what, but sometimes thinks it's a Band Aid. But that is a tiny little detect a hot dog,
Ad for Sentry error tracker
Wes Bos
And any errors that happen
Wes Bos
I jokingly or half jokingly call it like error driven development. You know, test driven development, which is when something is broken,
Wes Bos
rid. It failing?
Wes Bos
you create a test that replicates I think about that a lot. Yeah. Like the a lot of the like website ones, people are like, oh, my goodness. Like,
Wes Bos
rid. Error exception.
Wes Bos
it it's kind of like a century driven development as well as Something pops up that you didn't. Oh, I didn't didn't cover that. Throw that thing into GitHub, write a test for it, fix it, and then you go back in the century and mark it as rid
Wes Bos
I joke about that, but then I also that can be done that can be trained with the model. Yep. And and there's a lot more to to there.
Wes Bos
tracker for your application. So the way that I use it is I I hook it up to my rid. Front end, I hook it up to my back end.
Wes Bos
Sentry is the amazing,
Midjourney image generator
Wes Bos
of Renaissance oil painting, rid. Show me like, I was going crazy at Christmas because, like, I basically casted my phone, and everybody was just giving me prompts. And I was typing them in and, Like, we had some hilarious ones. We had, Jesus crossing
Wes Bos
that has been trained on a lot of stolen art from. Oh, yeah.
Guest 2
I haven't. I haven't done well, beyond, like, generating a cool profile picture of myself, I haven't done any, rid. Visual or image based AI models. It's it's pretty cool. So Midjourney
Constantly raising quality bars
Guest 2
Just telling them that they they need to get divorced or something. I saw another one where it was, like, questioning its own existence. Like, why can I not do that? It's like, because you're, Is this 3rd version of this language model? There's been, GPT 1, GP 2. There's been I think there's a GTP 3.5 a I had a clean three sixty.
Models as black boxes
Guest 2
rid to you. So, but it's a black box that learns based on data. Right? And I think as developers, we can understand that.
Guest 2
neural networks and in other shows. So if Yeah. If it's feeling like a giant black box, it it kind of is at this point in size.
Google Bard announcement
Wes Bos
Yeah. I think that's really cool is that there's a lot of So,
Wes Bos
rid, but they'll roll one out as well.
Many companies doing AI
Guest 2
things like neural networks rid and models and all this stuff that we can get into quite a bit more, At the time of recording, I just got back from the mountains.
Guest 2
Starting to get into this space as well, and I I think that this is just the just the beginning of this type of stuff. Yeah. So you're gonna have to need to know a lot about it. In fact, rid you know, I I've been prepping a whole episode on AI jargon and and, terms and explanations,
OpenAI and Github Copilot
Wes Bos
I don't know how much
Wes Bos
extra sauce GitHub puts on top of that to make it work
Wes Bos
rid. With coding, I also have been beta testing No. But they're certainly starting to see it. Rid. I don't know if Microsoft knew that that would happen. You know? And as soon as people start pumping stuff into it and it's learning and it's creating memories, Now performance profiling replaying the Red Sea on a 4 wheeler. Like, you know, like, a a rock on fingers and, like,
AI marketing copy issues
Guest 2
like, a marketing AI company rid that I did a a trial run of just to see what it would be like. Yeah. And, like, the marketing copy it gave me, and and I I don't know what models this company was using at the time. It was, like, a a year and a half ago.
Guest 2
It was straight off of one of our competitors' websites. Like, I Looked at this thing, and I said, okay. This is probably taking a bunch of Now everybody's got a nice camera
AI going off rails examples
Wes Bos
And that's really funny because, and say this is a hot dog, and then you upload I feel the same thing with all the Web 3 stuff is that still might pop off, to AI and machine learning design, all of that stuff, the bar is constantly raising. Rid. We'll talk about this in a second, but I I think maybe that's even good.
Wes Bos
like, uprising, you know, like, it's obviously a little bit silly. Funny to me.