Standard Schema: The Universal JavaScript Data Interface

Yeah. No. I'm doing good, man. Just hanging out, doing doing, some creative coding and having fun. I I'm excited to learn about this stuff a little bit because I guess what I don't understand about this whole thing is why. I mean, I get that having a a common interface amongst these libraries is is great if that's what this means. But in the same regard, then, like, why not

the other day, how do you maintain that? Like, you're if you're scraping data from a website, thing or something that is safe going from the server to the client? That that's up to you. Right? That that's Yeah.

I went I went to the mountain to go skiing. I actually did. Skimming?

Doing good. Just got back from mountain. I went skimming.

you might get some errors in your code. Those errors, you might not know about them. And unless they pop up in your your Century dashboard because you're seeing some something of property is undefined, and then all of a sudden your users are having a bad time because maybe your data wasn't being validated correctly, and you didn't know it was in there. So tell you. Let me let me interrupt your your ad. Tell me. I got a Yes. Perfect. Example for this. So somebody asked

Yeah. But a large part about what these libraries are doing is oftentimes with data validation.

and you wanna validate that they have completed all of the fields correctly.

Yep is another popular one. There's there's lots of them out there. So those are the schema definition and 40, 50 different libraries that consume Oh, man. Schemas, then you're talking about, it's really just 58 lines of TypeScript infer output, and a TypeScript, and that will, there's an infer input, catch that error and then send that data off to Sentry, and you get alerts right away when that data is not looking like what you're expecting.

need to validate your data before going forward. So if you think about your schemas pnpm doing validation,

to make sure that it looks like what you're expecting. So a very simple example would be you have a schema for a person, and, yeah, their name is a string, and their age is a number. Right? It can be a lot more complicated than that. You can check that things are capitals. You can check for things that are libraries like libraries. Right? The right, Node, type. The right returned type, which is, again, a lot of like, you think about somebody like Drizzle that needs to, like, maintain the Drizzle to Zod adapter.

You wanna validate that they're not sending data that is not needed. You wanna make sure that the length of the body that they sent is not the Bee Movie.

formatted as a ZIP or postal code. You can check that they don't go longer than a specific length. Right? Whenever you're dealing with data in an application, you're going to need to validate that data, give you if you pass it Wes schema, doesn't, again, doesn't matter what type of schema. Could be a Node schema. Could be ValleyBot. Could be archetype.

a validation library and and consider it blessed. They say, like, we use XOD for validating your data. And if you use something else for describing the Node API, the ValleyBot API, the archetype API, those are all different APIs, and they've all the inference is really nice. So, like like, one thing with Drizzle just collaborate on those the library itself? Yeah. Yeah. Yeah. Why not make that a on what this these shapes

life, again, much easier for flow control you're actually using.

You're welcome. Alright.

So if somebody has an idea for better, Mhmm. Function that will sort of translate it from from one to another. So the idea with standard schema is it's not a way to define these libraries that need to validate your data, they either choose

like, do you primarily see end users using this or just library authors? I don't foresee

from all of these people to come together and agree and the validation

on it that's called, like, infer. You can you can take the Drizzle schema, and you can infer your return type a standard schema will simply need to look a little something like this Wes they can run the validate method on it. Again, they don't have to care what library is being used.

Yeah. That's great. Fantastic. Cool, man. Well, thank you so much. This has been really in interesting.

library you're using. You don't have to, like, wait for support to be implemented.

validation libraries, like, Arqtype came out. They they do it entirely with TypeScript types. It's pretty nifty. They could automatically just start to use it in in whatever,

at that point is up to whatever library framework, standard schema will simply tack on this tilde standard or Express JS, you have a a middleware they've had here is that the return value from validate what your data looks like. And when you have a piece of data, you can validate it against the schema And, of course, we have Zod, ValidBot, Arctype.

Validation is just a a primitive, and then the actual what happens that's taking in a post request from somebody that's filled out a form, and a lot of thinking, between the 2, and it just gets out of control Basically, So what they have agreed layer translate to it's returning to you JSON, like, what do you do when that that changes? You know? Or if you're pulling data back from an AI, My name is Wes, developer from Canada. With me JS always is Scott. How are you doing today, Scott? did not really understand what the deal was. So I really Yeah. I'm too sure that first I thought, like, oh, are they coming out with a new validation library? But that that is not the case.

heavy lifting here that it has is it's a standard ways for inferring why and what that is, and why this is good for you as the end developer.

from the actual schema. Right? And Yeah.

Yeah. I you know what I'm interested in this is,

Not the case. Well, glad to hear. And,

I could see this being a really nice way to just sort of standardize how inferring those values work, but I see most of the actual be called and will be able to return data in a structured way. So the the Scott of the second standardization

is only good for being able to support all these different libraries that we're constantly inflicting ourselves with. So Totally. Yeah. Yeah. And it it only opens the door to, like, more libraries to to be created.

and,

interesting stuff. I think this is good. Having any sort of standard connection or whatever

Node and Express that actually consume these types of things. Interesting. Cool. Well, thank you for the rundown. I saw this pop up. It's definitely something that's in my wheelhouse, but to be honest,

Now they don't have to necessarily Welcome to Syntax. Today, we're talking about standard schema. Schema, that's a word I'm gonna say wrong the whole episode, so buckle on up. This is a a new effort from the devs, Fabian Hiller. He's behind ValleyBot. That's a JavaScript validation library.

that they will ship support for relatively soon.

Yeah. So I could suck at this now. Okay. Yes. The other benefits Data validation, one of those big things that, like, hey. If you're not, validating or parsing your data correctly,

do that for every single validation library out there. You can simply just use the standard schema inside of Drexel.

Interesting. Cool. So last thing we have here is, like, a a library that actually consumes that is the whole idea behind standard schema. It's it's really interesting because, like, again, it's 60, 58 lines of TypeScript, just pass me a standard schema. I don't care between these libraries. And if you think you have 5 or 6 different large validation libraries Hano JS

from it. So you can see here here I have, you normally have to write, like, a translation is always going to be in the same shape. And if you take a look at the actual standard schema specification, sort of a a way to validate your data. We have a, like, a little bit of a a problem there because that has very rigidly defined what the inputs and the outputs like, 5 or 6 times 50. Right? Then you're talking about library authors And then they they haven't shipped support for this yet, but I imagine that this would be something being replaced. The idea with standard schema I will let's peel it back in a second. So a a schema, if you haven't done done this before, is

And then they will either get the resolved value, often provide a you describe a standard library? standard schema. So all these library authors will now say, okay. I don't have to is, like, Drizzle has a property all of these libraries both the input and output types, They've not, likes like, got together and said, you know what? Let's just make Node validation API to to end it all. Those are still their own is

packages.

when you pass in a schema into something like Deno or TANSTACK Form end users using it a whole lot unless it is something like but it it was it seems like a pretty big effort Wow. So, yeah, that is

who made the schema. All I care about is that I can access approached it differently.

who has made it. I'm just gonna call a validate method on that schema, and then that validate method will then a couple things. First of all, I wanna be able to call the validate method on your schema, and I don't care those errors into some human readable And then on on the other side of things, you have tools that before you go ahead and throw it in a database or before you display it to your actual user. Mhmm.

anyone who implements

know that the inputs and the outputs are always going to look in a specific way. If you do take a look at the TypeScript code, you can see that the result is either going to be a successful result of whatever type you passed in or it's going to be a failure result. Right? And then the failure result is going to be an object with a property of issues, Zod, ValleyBot, and archetype are not of this look like. So it's not even something library authors have to necessarily NPM install. It's just

very quickly.

And that way, and each of the issues is going to be an array of individual it's not up to the validation library. It's up to the framework. What do you wanna do now that you have validation errors? Right? Mhmm. Do you Sanity throw them into state to display an error message? Do you wanna redirect all of these validation library authors sort of got together and put together this thing called a standard schema. And today, we're going to explain to you David Blass, he's behind a a relatively new Wes. So or React Router or anything that will support what your data looks like. So that need to actually implement validation.

Yeah. That sounds like a nightmare to have to support all of that stuff.

60 lines of TypeScript that they just have to adhere to that will allow library authors a standard way to define several things. First of all, how to actually validate the data. So what's standard schema does issues. Each issue itself has a message property on it. You see what you see what's happening here JS that It will always give you

onto each of the schemas.

250 possible adapters is you're either out of luck, or you have to write, like, a like an adapter or a resolver routers and, you have to still validate that that data looks like what you're expecting. And and what happens when it doesn't look that way? What happens when the website you're scraping changes? Well, will look like, and then this should make Hano Express, which is great, or they will get an array of those issues that I talked about. And and at that point, simply just being done both by the validation libraries that implement standard schema and the,

hey, if the data isn't looking like what we expected, our code's gonna break. So, yes, check it out. You're in trouble. Yeah. Century.ioforward/syntax.

standard schemaling.

Sign up with the coupon code at tasty treat. Get 2 months for free. Alright. Let's get into it. I'm I'm stoked to learn a little bit about this stuff here because I primarily use Zod, and Zod is the only one. But this seems like a world where every other week, somebody's like, no. Zod's out. You gotta use,

ValleyBot. Bos, ValleyBot's out. You gotta use Arctite. Okay. What what are we on today? Well, now we're on

Yeah. That's important, because,

validation library called Arctype. And Colin McDonnell, we've had him on the the podcast as well. He is the creator of Zod, tRPC.