NHacker Next
  • new
  • past
  • show
  • ask
  • show
  • jobs
  • submit
SpacetimeDB: a short technical review (strn.cat)
LarsDu88 12 hours ago [-]
I remember a friend showing me some stuff about this when they were still trying to pursue the MMORPG route and I am surprised this company is still alive given the amount of unnecessary overengineering that went into that effort.

The model of putting ECS like logic as code and putting all that code as stored procs solves a handful of db transaction issues that none of the major mmorpgs really had issues with 20 years ago when mmorpgs were all the rage and when computers were 100x-1000x slower than today. A lot of engineering is going to solving and cutting out these database round trips that were not even an issue 20 years ago and even less of an issue today.

On the other hand the actual hard parts about building a multiplayer game, such as roll back, physics, collisions, all of that sort of stuff, well this actually doesn't really help with any of that. If anything it makes all of those things even more difficult. I imagine that the developers of this game probably had to come up with some pretty interesting hacks that probably didn't benefit from their DB to get anything resembling physics to work.

Layered on top of that are the known anti-patterns around using stored procs within databases, which spacetimedb does't address at all. You can't really run your tests just on your client because the application logic is split between client and db-server leading to spaghetti code and poor iteration cycles for game design. The database itself also doesn't horizontally scale beyond a single node.

Just take a peek at the steam reviews for BitCraft. The recent ones are actually pretty scathing and it seems like, despite all this engineering, the developers haven't really listened to their playerbase. With all of this effort centered around building a custom database, users still can't, say, build homes for themselves in this game, something that you can certainly do in probably most all other MMORPGs.

I think this will go down as a cautionary example of not listening to your users and spending engineering effort on the wrong types of problems. I think one of the most important skills for an engineer is actually not just having good technical ideas but knowing the right types of problems to solve and, most importantly, listening to your audience, your users, and your stakeholders. I wish the developers the best of luck and hope they can pivot successfully.

cloutiertyler 1 hours ago [-]
On the contrary, even the writer of this blog post told me that BitCraft is "a very enjoyable game"!
LarsDu88 36 minutes ago [-]
Oh I'm sure it very enjoyable. This is more on the question of "could it have been a better game with better reviews" if more time had been spent on gamedev versus spacetimedb?

I suspect the answer to that is probably nuanced. Spacetime probably gets more VC funding based on the DB rather than being a game. Trying to make a successful indie MMORPG without pre-existing IP is going to be an uphill battle in 2026 with or without fancy backend innovations.

cloutiertyler 3 hours ago [-]
I'm a SpacetimeDB developer and this post has many inaccuracies. I have actually asked Vicent to fix them and he's agreed to address them.

Please read our reply to this and other criticism here: https://spacetimedb.com/blog/benchmarking

nemothekid 21 hours ago [-]
The SpacetimeDB launch video came up on my YouTube feed - and I was surprised the video didn't go at all into how it was implemented. I assumed it was proprietary magic, but then I was surprised to find it was opensource. That confused me more - to get the kind of semantics they were talking about I had assumed that it was pretty novel and if it was open source they should be leading with that.

Kind of bummed to see its essentially 2015-era React Flux in Rust around a mutex.

cloutiertyler 2 hours ago [-]
Notably, single threaded execution is optimal for performance here. If you don't believe us, maybe you'd believe TigerBeetle which is also single threaded by design.

If you're interested more in our benchmarking methodology, you can read our technical blog post on the topic: https://spacetimedb.com/blog/benchmarking

42 minutes ago [-]
Escapado 7 hours ago [-]
I appreciate the article from a technical perspective. Is there anyone here who has used it in production regardless of the criticism and has some perspective to share on where it actually falls flat or situations where performance degrades massively? Them having built an MMO around it makes it look like the technical limitations around this pattern might(!) only matter for very specific workloads or for poorly implemented reducers - and my gut feeling is that you can also reach for postgres or sqlite and write very inefficient queries that quickly bog your system down as well. Just curious how it stacked up in the real world.
cloutiertyler 2 hours ago [-]
I am the SpacetimeDB developer. Several assertions in this article are simply wrong. You can read our response here: https://spacetimedb.com/blog/benchmarking
Groxx 16 hours ago [-]
Broadly enjoyed my read, though I do have a nitpick here:

>The absence of side effects or stalls cannot be enforced by the type system ...

Side effects is probably correct, but stalls would imply wasm code that calls out to a long-time blocking function - that's generally quite easy to type-system-ify, and wasm stuff often does so with promise-like constructs. So there would be a need for spacetimedb-side markers for "this func might do HTTP", but that kind of marker for WASM-contact-able code is very much a normal expectation.

If they don't have that kind of marker, and do allow blocking calls in their beta API, then yeah - huge problem with that kind of internal structure (shared global lock), completely agreed.

cloutiertyler 2 hours ago [-]
I would encourage you to read our technical write up in reply to this article: https://spacetimedb.com/blog/benchmarking
Groxx 46 minutes ago [-]
Doesn't really cover the types used in the beta APIs. Nor would I expect it to though.

Is there a more technical explanation post somewhere? I'm definitely curious how it works, and I like the core idea quite a bit - I'm fairly convinced that WASM uses like this are going to grow immensely, and "it's just a global mutex/single thread" reduces complexity so much that it's always interesting to see where it's possible to use.

The latency+throughout brings many questions though, like "are you holding responding to writes and any reads that occur after until changes are written to disk" and "if so I kinda assume that change log is constantly streamed to disk with a moving high water mark for responses". I can generally see how that'd hit such benchmarks, especially with non-dirty reads being near instant, but details are always interesting.

cloutiertyler 36 minutes ago [-]
I don't really have a deep technical explanation blog post out, but we should definitely publish one.

I can say that your last paragraph is essentially correct though. It works exactly that way.

Groxx 22 minutes ago [-]
Is there anything on how a multi-node cluster works? Application-level sharding is always an option (and multiple things I've worked on have used it to great effect), but anything automatic seems likely gnarly and fun to learn about, if it recovers some of the naive perf loss of "just hold the lock while doing rpc to other nodes".
arn3n 21 hours ago [-]
Always a fun time to bring up my favorite writeups in database benchmarking: https://questdb.com/blog/lies-damn-lies-and-database-benchma...

There’s also an excellent paper called “Fair Benchmarking Considered Difficult: Common Pitfalls In Database Performance Testing”.

Benchmarks are genuinely hard. Modern systems and hardware are notoriously complex and have different behaviors across runs and with minor tweaks to performance settings.

cloutiertyler 2 hours ago [-]
I am a creator of SpacetimeDB. Several assertions in this article are simply wrong. You can read our response here: https://spacetimedb.com/blog/benchmarking
cmrdporcupine 21 hours ago [-]
Yep, absolutely... and in the end benchmarks aren't going to sell a database anyways. Reliability and provable correctness and ease of integration are probably going to win in the end. It's a dubious marketing edge to lead with.

PostgreSQL itself is remarkably slow in many configurations and leaves a lot of performance on the table due to its architecture and assumptions. But it works and people trust it. So they use it.

cloutiertyler 2 hours ago [-]
As a SpacetimeDB dev, I absolutely agree. Reliability, provable correctness, and ease of integration are higher priority than performance. That doesn't mean we need to accept garbage performance though.

You may be interested in our technical blog post on benchmarking methodology for this benchmark: https://spacetimedb.com/blog/benchmarking

nazgulsenpai 21 hours ago [-]
Or if you're in enterprise, whichever company's sales rep some executive has locked you into while 10 drinks in at a fancy dinner.
sabot90260 9 hours ago [-]
Leading with unfair benchmarks is the fastest way to lose credibility in the database space. The companies that last are the ones doing honest technical work.
cloutiertyler 2 hours ago [-]
As a SpacetimeDB dev, I absolutely agree. However, these benchmarks are more than fair. Please read our full technical writeup on the benchmarks: https://spacetimedb.com/blog/benchmarking
thrance 9 hours ago [-]
> The companies that last are the ones doing honest technical work.

If only that were true...

JSR_FDED 15 hours ago [-]
I appreciate the very even-handed way this was written, not fanning flames but bringing it back to a choice between trade-offs that all DB developers can/should make.
cloutiertyler 2 hours ago [-]
I am a creator of SpacetimeDB. Several assertions in this article are simply wrong. You can read our response here: https://spacetimedb.com/blog/benchmarking
moribvndvs 19 hours ago [-]
Very cool watching late stage software shops undiscover n tier architecture. Of course, breaking from hard learned wisdom for niche use cases is fine… until you bury the reality in a misleading and edge lord-ish PR sweep.
cloutiertyler 2 hours ago [-]
I would encourage you to read our technical blog post in reply to this article: https://spacetimedb.com/blog/benchmarking
danr4 3 hours ago [-]
based design
7 hours ago [-]
vvern 15 hours ago [-]
Do SurrealDB next
alex7o 13 hours ago [-]
I think surrealdb is actually nice, just a bit missmanaged
Tostino 21 hours ago [-]
I watched a few of their talks, and while I'm somewhat impressed by the results, it's not exactly surprising to me that you can get those numbers when you make the trade-offs they're making. Most applications cannot make those trade-offs and, thus, cannot ever hope to see those numbers. The lack of rigor in database benchmarking in any of the videos I saw was an obvious indicator of something to be wary of.
cloutiertyler 2 hours ago [-]
I am a creator of SpacetimeDB. Several assertions in this article are simply wrong. You can read our response here: https://spacetimedb.com/blog/benchmarking

In particular, we are not making trade-offs. The assertions SpacetimeDB provides anything less than full durability guarantees is just wrong.

toolslive 20 hours ago [-]
One of the problems with running the application code inside the database server is that you need to make application developers use the programming language(s) you prepared for them. The other is that you need to trust them to not do crash out, or do infinite loops. Good luck moving application developers from their choice into the right choice.
JSR_FDED 15 hours ago [-]
This is easy to fix. The SpacetimeDB folks could just add a phase to analyze the application developer’s code before running it to prove that it will definitely halt.
toolslive 9 hours ago [-]
the halting problem?
cmrdporcupine 6 hours ago [-]
i think that's the joke, my friend
cloutiertyler 2 hours ago [-]
I'm a SpacetimeDB dev. We do not need to trust them, we employ a system like Ethereum's gas limits to prevent infinite loops.
wizzledonker 19 hours ago [-]
This is why you need to compile your code for spacetimedb to WebAssembly and it runs inside a VM. Use the language of your choice, and assume the code is only semi-trusted with the ability to have a watchdog. That part makes sense.
cmrdporcupine 21 hours ago [-]
"Because the system is, well, a hash table with a lock in front of it."

This actually surprises me? I was a very early employee/contractor working on this product but left after 3 months. But this wasn't the shape it had when I was there. It would have been better described as a CoW tree of various sorts, which lets reads and writes advance on separate transactions and reconciles at commit with what I recall was fairly minimal lock-holding time.

When I was there there was no global lock being held while a WASM "reducers" was executing. They operated on their own separate transaction in their own thread.

I haven't looked at their source since -- and I really don't want to because I work on similar things I don't want IP contamination as last I looked they had some sort of weird license -- but there's been .. 3 years? of development on it since and I know Tyler well enough and he hired smart-ish people.

I had a lot of criticisms of what he was making and the way it was being made... but ehh....I would want to confirm in source that this claim is accurate, it makes me a bit suspicious of the accuracy and fairness of the rest of TFA.

cmrdporcupine 18 hours ago [-]
Ok, so I had a clanker go look. It actually sounds as bad as the article says. For some reason they apparently lock things while "reducer"s are running.

Robot brain summarized:

"Your historical description may be completely accurate. Your request that the author substantiate the claim was warranted. But the source substantiates it extremely clearly. The blog’s concurrency conclusion is right. Its “hash table,” fairness, “cannot sync WAL,” and “questionable to call it a database” language is deliberately contemptuous and sometimes technically sloppy."

touche

cloutiertyler 2 hours ago [-]
I think you mean it sounds as good as the article says it is. SpacetimeDB is single threaded by design, just like TigerBeetle by the way. The reason we changed from MVCC to single threaded design is that it's simply faster for almost all workloads. Measurably so! With MVCC we were doing more bookkeeping than actual work and perpetually causing cache coherency issues.

"Technically sloppy" is an understatement. The article just gets several things plan incorrect about the durability guarantees, etc.

cloutiertyler 2 hours ago [-]
Since we're asking clankers:

https://chatgpt.com/c/6a886e34-c784-83ea-8298-2d8215f5994a

https://claude.ai/share/658d00e4-550a-470e-b4a3-7a71a06222cb

> In particular, these statements should not be relied on:

> readers wait “up to 0.5 ms” because of parking_lot;

> all reducers/views are Wasmtime/WASM;

> reads normally happen through Views;

> external side effects are merely something reducer authors must avoid;

> durable/confirmed reads are an unusual opt-in intended only > for non-ephemeral data;

> 50 ms is the normal/current durability delay;

> SpacetimeDB has no meaningful replication;

> the benchmark numbers themselves are simply “not true.”

cmrdporcupine 2 hours ago [-]
hey tyler, ltns

yeah my bot also flagged the parking_lot thing :-)

it was a hit piece with an unprofessional tone. but extraordinary claims get extraordinary responses

i do think dropping mvcc is an odd choice. do you at least let pure reads proceed while a single writer is active?

cloutiertyler 1 hours ago [-]
Extraordinary claims perhaps, but correct ones nevertheless: https://spacetimedb.com/blog/benchmarking.

The article says that we don't provide strong durability guarantees. Pure ipse dixit. And IIRC he's already cleaned it up a little.

The shamelessness with which people published bogus claims about SpacetimeDB after this was really really astonishing. And so many were quick to dismiss the overall results based on some handwaving arguments. I wasn't prepared for it.

We should have held off on publishing until we had a deep technical blog on the subject.

If you haven't read https://spacetimedb.com/blog/benchmarking you should give it a read.

It seems like an odd choice perhaps, but I had the numbers to prove that it was simply measurably worse overall performance for most OLTP workloads.

IIRC, we don't let pure reads read the committed state while a transaction is underway. We can certainly do that in the future, but we're so far out ahead of typical database performance for most OLTP workloads we haven't even bothered.

slopinthebag 17 hours ago [-]
They're calling a hashmap behind a RwLock a "database"? Damnit I wish I had the capacity for grifting, I could be rich by now.
cloutiertyler 2 hours ago [-]
If you don't believe me, perhaps you'd believe the TigerBeetle team who also made their database single threaded by design.

Perhaps you'd be interested in reading our technical response: https://spacetimedb.com/blog/benchmarking

slopinthebag 39 minutes ago [-]
My comment was unrelated to benchmarking and I don’t see anything in that blogpost addressing my comment.

Also you’re spamming the same comment up and down this thread. Did this post upset you?

cloutiertyler 34 minutes ago [-]
Yes, of course it did. This article makes factually wrong claims about the database I've spent 6+ years building.

Your comment was about whether SpacetimeDB was "just a hashmap behind a RwLock" and the blog post I linked addresses that question. Namely, it does have a RwLock, but that is by design and produces better results than the alternative.

myshapeprotocol 18 hours ago [-]
[dead]
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact
Rendered at 17:33:40 GMT+0000 (Coordinated Universal Time) with Vercel.