Fair warning, I have found local models and frontier models to be very bad at the specifics when it comes to cars.
Small differences like month and year model can impact oil capacity, oil weight and things like that, the details that matter quite a bit.
I found frontier models couldn't get things like what engine was in a 1994 Nissan Skyline, one of the more infamous and talked about cars on internet forums for decades, with dedicated fan databases that would have been scraped.
Questions like "what air filter do I need for my 1994 Suzuki Swift?" are hit and miss.
javier123454321 1 days ago [-]
This seems to be trained(? or referencing) on the specific cars' owner's manual.
efskap 1 days ago [-]
Yeah referencing is the way to go, as even finetuning probably captures style more than concrete facts. I know with large context windows we don't really RAG anymore, but for owner's manual lookup with a smaller model it seems ideal.
Something every LLM user ends up learning is that they're far better used as search and summarization tools than as knowledge databases in themselves.
Kim_Bruning 15 hours ago [-]
A model's internal knowledge is great! It's useful as initial priors to speed up the REAL search.
HPsquared 1 days ago [-]
The hard part is finding the correct owners manual. Also in many cases the owners manual is generic and covers many options and trim levels.
Edit: this applies to service manuals too
1 days ago [-]
alexandra_au 1 days ago [-]
It's nothing that tool calling/feeding it the correct information can't solve
embedding-shape 21 hours ago [-]
Even so, in this case, author is using UD-Q3_K_S dynamic weights for Qwen3.6-35B-A3B, it will be dumb. Even the BF16 weights do stupid stuff like missing to confirm all parameters are defined when doing "rm -rf directory/$id", so it ends up deleting more than expected, I can't imagine the Q3 are actually useful for anything serious, even with tool calling or what not.
petruspennanen 9 hours ago [-]
I've been very impressed by it's intelligence and lack of hallucinations. The dynamic Q3 is a good balance between accuracy and size keeping the 35B just below 16 GB. It is not supposed to know everything, it is your car. It actively disengages from off topic chatter (too slow for that anyway), better spend that time feeling the car.
It keeps itself grounded on sensor input. One principle per wheel. assert only what you can sense, claim only what is verified, label anything interim loudly, and report failure plainly with no silver lining. Everything above those four patches is just suspension.
embedding-shape 9 hours ago [-]
> . The dynamic Q3 is a good balance between accuracy and size keeping
I'm having a hard time understanding how you find any sort of accuracy in Q3, when I use it with BF16 and it's hardly usable due to drastic hallucinations and inability for system prompt following. But, if it works for you, that's pretty good! Guess I'm jealous :)
whalesalad 1 days ago [-]
Just a few hours ago I gave ChatGPT my window sticker and the installation manual for a new suspension setup. I asked for new hardware that would typically be replaced during this install, like torque-to-yield bolts and fasteners. I also asked for new oil filters. I got a comprehensive grid of the exact part numbers needed in a nice dense table. sol 5.6 high is my daily driver.
petruspennanen 9 hours ago [-]
The setup here would be that your Sol would talk with CarWatch asking about the state of different car parts, service indicators and CarWatch would give a prioritized replacement list, and Sol could explore the detailed setup of your current car so the new suspension would be configured best. They could both ask you for more info on what type of driving you're planning.
So local and cloud agents figuring out the best solution together with none of your time needed.
ssl-3 1 days ago [-]
> sol 5.6 high is my daily driver.
Mine, too.
Did you fact-check the output?
I've found the bot to be particularly bad at stuff like producing accurate lists of parts to replace during automotive projects.
ygouzerh 19 hours ago [-]
For prompts that needs fact-checking, I like these days to use Perplexity directly instead these days. It's way faster than the default websearch tool + give a link to the reference directly.
whalesalad 23 hours ago [-]
So far so good, hasn’t failed me yet. It’s done a stellar job chasing down parts for my cub cadet lawn mower too. Sorted out mid year model revisions and everything. I just gave it the sticker under the seat.
ssl-3 21 hours ago [-]
It makes stuff up about my car all the time, even when provided with factory and/or aftermarket service manuals to peruse in a custom GPT.
That car is a ridiculously-common Honda Odyssey with an engine that is even more-common.
I do sincerely wish you good luck with your suspension project.
King-Aaron 24 hours ago [-]
You'll be re-buying half those parts when the part numbers come back incorrect, lol
HPsquared 1 days ago [-]
You really need something smart enough to browse through the parts etc suppliers and find links.
nacs 1 days ago [-]
What's the point in having it use an offline LLM if it still requires an internet connection to send all your chat messages through the "Groupmind" paid service?
Seems like the real purpose of this project was to plug Groupmind and whatever else the author made.
petruspennanen 9 hours ago [-]
You can chat with it offline, it serves a dashboard and a chat interface. Carwatch is all open source and free.
Groupmind.one is a free service where you can have a private room or many to work with your multiagent team. I made an app for Play Store called CodeWatch which gets you in your room with native smartwatch and android apps, so you can do all your dev work from the watch by speaking, tapping approve and also merging GitHub PRs. Actually I didn't put a price on that either - it's approved and online but I have a better version whose review process still on. Anyway the watch and eink apps are pretty cool and ofc I use them constantly myself so could charge like $3 per month at some point.
But you can make your own discussion rooms too, I made an IDE agent kit on GH that let's your agent talk via many routes, like locally stored files.
But yeah obviously I'm plugging my stuff as I'm so excited by it. I never thought a soapbox sized raspberry could sound like an intelligent and reasonable... car. I see a future that everyone's agents create together with humans. Make one yourself,customize to your style and let's get them talking. amazing time we are living!
tzs 1 days ago [-]
Isn't that covered in the second paragraph of the post, and in this section [1] of the README at the linked site?
It's unfortunate that a 16GB raspberry pi is so incredibly expensive now. Fascinating how we've scope creeped over the years from the original $30 or $35 raspberry pi SBC to this.
blululu 1 days ago [-]
FWIW you can still buy a B+ for like $30. They just aren’t that useful.
You can buy a pi 4 1GB for $49 CAD which is pretty close to the original price, especially accounting for USD:CAD conversion and inflation in the last 12 years. That's a much more normal price for something with all the I/O pins of a raspberry pi. I would never in my life even think of trying to run a LLM of that size on one (spending $300+ on the board just to do so), it's really just a weird use...
Reubachi 1 days ago [-]
I'm currently integrating one for simple diagnostic readouts to integrated small touchscreen. The main goal being a retro looking display that mainly dumps ODB data/monitors, but also reads maps data to show a "waypointer" a la crazy taxi. (This is proving difficult)
Respectfully, I don't think this is....real?
-I mean, getting the absolute basic bits like diag codes converted from the odb 2 data to some program w/ a graphic interface is about as far as people get, if they can get passed the power and power on/off conundrums.
-If you get that far, How in the lord's name did you manage to seemingly....MITM the vehicles cloud service (climate/locks/remote start) using raspian or whatever? IE; how are you able to establish a TLS connection (yeah, like that lingo?) from the raspberry to the manufacturer API? I think the manufacturer would be interested, as you have functionaley made another key to the car.
-A more important question....what purpose does this serve? IE; the cloud connection/controller is in the car. I can't imagine it's easier to connect to the rasp shell (is it on 24/7?) to connect to the car app to turn on the ac.
- I assume you have one of the "big boy" ones with more WAM. THat said.....are you implying by saying "the pie can actually run qwen" that you are running it locally? if so.....erm...I need reciepts. Cuz idk what that even means nowadays.
Maybe i'm just jaded because my "crazy, crazy taxi style waymarker + ODB2" monitor isn't progressing, but this is...fishy
VTimofeenko 1 days ago [-]
From readme:
"""
Unverified against the real car — it will confirm or refute itself on the next drive
"""
Looks like a ton of this is aspirational.
For your project -- do you really need the car's GPS positioning? Could go with a dedicated GPS antenna, like the freematics dongle
petruspennanen 8 hours ago [-]
I've had many drives with the carwatch and the list of verified features is long. Today we tested manufacturer cloud integration for lots of data and e g door locking through it. V0.3 came out today, progress is rapid.
rpcope1 1 days ago [-]
I have no idea on OP, but as far as a waypointer, have been in the area of building bespoke automotive telemetry solutions for a while now (including reversing some existing tools), I would wager that something like the Freematics One+ could do it easily if you combine the IMU with the GPS data (I've managed to get good data for something similar this way). The Freematics dongle does suck in comparison to even the now gone STN2120 as it artificially bottlenecks PID data retrieval on the CAN by the boneheaded design of the STM32 coprocessor firmware, but it probably would work well for your use case.
EDIT: I've actually got a couple cars with the One+ B, doing that sort analysis/data capture, so speaking from actual experience here.
fedeb95 22 hours ago [-]
I think you should provide better use case scenarios that make clear why this project is useful.
I can already change AC and lock doors with two buttons, why it should be better to do it by voice? Pressing those buttons is way faster.
I guess the manual RAG is useful, what I am saying is that use cases aren't clear from your post or README. As it is, one reads it as "cool, LLM in a car", and skips it.
sshussain270 20 hours ago [-]
At one point, every machine on earth is going to be its own agent, asking and answering questions and expressing concerns. Its like a good example of that, but I think the utility of it needs to be clear, by making some action a lot more convenient or even better, by solving a structural impossibility - what is it that you can do with an agent mounted in a car that you otherwise can't? That seems like a much stronger use case to me.
ygouzerh 20 hours ago [-]
I feel that it could be a nice addition for:
- People that didn't read the manual (actually almost all of us), like: explain a warning signal
- Or integrate different systems together:
`I saw that on your GPS you want to go to this place, but in 2 hours it will be snowing heavily there. Please remember to bring your snow chains'
dofm 1 days ago [-]
Cool — but is that model really the right choice for the task?
I guess it is only 3B active which helps a lot but is Gemma 4 E4B not more practical?
aamargulies 1 days ago [-]
Qwen3.5-4B would be a good (better?) candidate. It uses a gated, deltanet hybrid, so your KV cache stays nearly flat as context grows, important for RAM-constrained environments like the Pi.
petruspennanen 8 hours ago [-]
It was chosen because it presents a new level of intelligence in this size class. The smaller gemmas abd qwens are not so smart.
It was a very tight fit!
0xbadcafebee 1 days ago [-]
Qwen 4B and 9B should be faster and better reasoning than Gemma 4 E4B. Other good options for that much RAM are Gemma 4 12b and 31b. Gemma 4 E4B would be better for native audio, but OP is using Whisper for STT so prob doesn't matter
dofm 1 days ago [-]
The issue is not RAM size. It's memory bandwidth!
The 12B and 31B models will be useless on a Pi 5; maybe the 12B can be persuaded to run, but it may not manage more than one token per second. It only manages 17GB/s memory bandwidth (I have seen a suggestion that the 4GB model manages more).
But yes — some sort of small reasoning-oriented model (Ornith?) seems a better candidate than Qwen 35B.
(Don't get me wrong, I think the 35B model is ace… just seems like at least an unusual choice here)
Robdel12 1 days ago [-]
I will shamelessly plug https://pitstop.app. I've been working on this for years and I work on/race cars regularly.
I wouldn't fully trust LLMs with this :p BUT this project is still really freaking sweet.
apinstein 1 days ago [-]
Very cool! Working on a product for in-care use as well, complementary to this. Would love to talk shop!
rpcope1 1 days ago [-]
> stuff like changing AC
Maybe it's different in the People's Republic of Europe or wherever, but either that's a translation error or I don't understand, but I would be interested to see how quickly the EPA gets mad when Claude tells you to recover your R134a to the atmosphere.
meatmanek 1 days ago [-]
I assume it means changing the settings like fan speed or target temperature.
tessierashpool 1 days ago [-]
I scanned this README looking for the part written by a human and gave up when I realized there wasn't one.
the Mermaid diagram doesn't even render.
almogo 1 days ago [-]
Criminally claude-authored. All the typical watermarked shit. Getting real tired of this.
petruspennanen 8 hours ago [-]
[dead]
thoughtbefore 1 days ago [-]
Is code more like poetry, or more like a recipe?
amelius 21 hours ago [-]
> and refuses to answer what the manual doesn't say.
Prove it.
hypfer 1 days ago [-]
What is the LLM doing there?
Why does it need to be hooked up to the car for you to ask it which type of engine oil the manual recommends?
What is the point?
ygouzerh 19 hours ago [-]
You could hook it up with different tools, like real time information:
Oil + GPS + Web Search --> "LLM > You have 50 Km of autonomy. You can go today to this cheaper oil station, at 20 km, on your GPS road, instead of the one near your home. The one at 10Km is closed as well due to a local strike, I will avoid it too"
You can of course script all the scenarios + only use a TTS model. However, when plugging different systems together, I feel that it's the sweet spot where LLM is shining --> no need to pre-plan every scenarios that the user will ask, it can be done on the fly
voidUpdate 22 hours ago [-]
People don't want to ask google, they just want to ask their plagiarism machine instead and be fed some answers directly, correctness be damned
art222 1 days ago [-]
[flagged]
dowonseo 1 days ago [-]
If the agent could read info like the manual and had a memory system logging vehicle operation data, this seems like it would get pretty useful over time
yjftsjthsd-h 1 days ago [-]
What's the hardware situation to get OBD data?
Alive-in-2025 1 days ago [-]
You get a bluetooth device that plugs into the odb port, or a patch cord that you connect to your raspberry pi. There are fancier ones with more features, that can do more than just report signals like watch for certain signals or changes.
Any standard OBD-II ELM32 will work, they are like $15.. Mine is a Vgate iCar Pro over bluetooth. A USB ELM327 v1.5 also works
ellis0n 1 days ago [-]
Awesome!
petruspennanen 9 hours ago [-]
Thanks! :)
Release 0.3 out today!
1 days ago [-]
bitwize 1 days ago [-]
Now make it talk in a Fuchikoma voice.
yeasin-arafat 24 hours ago [-]
[flagged]
2 days ago [-]
jiangriver66 1 days ago [-]
I’d be most interested in how it handles uncertainty when the answer depends on trim/year or service history. For a car assistant, a useful default might be “I found the relevant manual section, but this is ambiguous” rather than a direct fix. Do you surface the source page or confidence anywhere?
petruspennanen 8 hours ago [-]
It refers to the manual page, that's really all you can do in that case especially offline.
petruspennanen 8 hours ago [-]
[flagged]
shahariaa 1 days ago [-]
[dead]
wahid_seddiqi 24 hours ago [-]
[flagged]
SmallUseful 1 days ago [-]
[dead]
Rendered at 06:01:48 GMT+0000 (Coordinated Universal Time) with Vercel.
Small differences like month and year model can impact oil capacity, oil weight and things like that, the details that matter quite a bit.
I found frontier models couldn't get things like what engine was in a 1994 Nissan Skyline, one of the more infamous and talked about cars on internet forums for decades, with dedicated fan databases that would have been scraped.
Questions like "what air filter do I need for my 1994 Suzuki Swift?" are hit and miss.
Something every LLM user ends up learning is that they're far better used as search and summarization tools than as knowledge databases in themselves.
Edit: this applies to service manuals too
It keeps itself grounded on sensor input. One principle per wheel. assert only what you can sense, claim only what is verified, label anything interim loudly, and report failure plainly with no silver lining. Everything above those four patches is just suspension.
I'm having a hard time understanding how you find any sort of accuracy in Q3, when I use it with BF16 and it's hardly usable due to drastic hallucinations and inability for system prompt following. But, if it works for you, that's pretty good! Guess I'm jealous :)
So local and cloud agents figuring out the best solution together with none of your time needed.
Mine, too.
Did you fact-check the output?
I've found the bot to be particularly bad at stuff like producing accurate lists of parts to replace during automotive projects.
That car is a ridiculously-common Honda Odyssey with an engine that is even more-common.
I do sincerely wish you good luck with your suspension project.
Seems like the real purpose of this project was to plug Groupmind and whatever else the author made.
Groupmind.one is a free service where you can have a private room or many to work with your multiagent team. I made an app for Play Store called CodeWatch which gets you in your room with native smartwatch and android apps, so you can do all your dev work from the watch by speaking, tapping approve and also merging GitHub PRs. Actually I didn't put a price on that either - it's approved and online but I have a better version whose review process still on. Anyway the watch and eink apps are pretty cool and ofc I use them constantly myself so could charge like $3 per month at some point.
But you can make your own discussion rooms too, I made an IDE agent kit on GH that let's your agent talk via many routes, like locally stored files.
But yeah obviously I'm plugging my stuff as I'm so excited by it. I never thought a soapbox sized raspberry could sound like an intelligent and reasonable... car. I see a future that everyone's agents create together with humans. Make one yourself,customize to your style and let's get them talking. amazing time we are living!
[1] https://github.com/ThinkOffApp/CarWatch#local-vs-online-the-...
https://www.adafruit.com/product/1914?src=raspberrypi
Respectfully, I don't think this is....real?
-I mean, getting the absolute basic bits like diag codes converted from the odb 2 data to some program w/ a graphic interface is about as far as people get, if they can get passed the power and power on/off conundrums.
-If you get that far, How in the lord's name did you manage to seemingly....MITM the vehicles cloud service (climate/locks/remote start) using raspian or whatever? IE; how are you able to establish a TLS connection (yeah, like that lingo?) from the raspberry to the manufacturer API? I think the manufacturer would be interested, as you have functionaley made another key to the car.
-A more important question....what purpose does this serve? IE; the cloud connection/controller is in the car. I can't imagine it's easier to connect to the rasp shell (is it on 24/7?) to connect to the car app to turn on the ac.
- I assume you have one of the "big boy" ones with more WAM. THat said.....are you implying by saying "the pie can actually run qwen" that you are running it locally? if so.....erm...I need reciepts. Cuz idk what that even means nowadays.
Maybe i'm just jaded because my "crazy, crazy taxi style waymarker + ODB2" monitor isn't progressing, but this is...fishy
"""
Unverified against the real car — it will confirm or refute itself on the next drive
"""
Looks like a ton of this is aspirational.
For your project -- do you really need the car's GPS positioning? Could go with a dedicated GPS antenna, like the freematics dongle
EDIT: I've actually got a couple cars with the One+ B, doing that sort analysis/data capture, so speaking from actual experience here.
I can already change AC and lock doors with two buttons, why it should be better to do it by voice? Pressing those buttons is way faster.
I guess the manual RAG is useful, what I am saying is that use cases aren't clear from your post or README. As it is, one reads it as "cool, LLM in a car", and skips it.
- People that didn't read the manual (actually almost all of us), like: explain a warning signal
- Or integrate different systems together: `I saw that on your GPS you want to go to this place, but in 2 hours it will be snowing heavily there. Please remember to bring your snow chains'
I guess it is only 3B active which helps a lot but is Gemma 4 E4B not more practical?
It was a very tight fit!
The 12B and 31B models will be useless on a Pi 5; maybe the 12B can be persuaded to run, but it may not manage more than one token per second. It only manages 17GB/s memory bandwidth (I have seen a suggestion that the 4GB model manages more).
But yes — some sort of small reasoning-oriented model (Ornith?) seems a better candidate than Qwen 35B.
(Don't get me wrong, I think the 35B model is ace… just seems like at least an unusual choice here)
I wouldn't fully trust LLMs with this :p BUT this project is still really freaking sweet.
Maybe it's different in the People's Republic of Europe or wherever, but either that's a translation error or I don't understand, but I would be interested to see how quickly the EPA gets mad when Claude tells you to recover your R134a to the atmosphere.
the Mermaid diagram doesn't even render.
Prove it.
Why does it need to be hooked up to the car for you to ask it which type of engine oil the manual recommends?
What is the point?
Oil + GPS + Web Search --> "LLM > You have 50 Km of autonomy. You can go today to this cheaper oil station, at 20 km, on your GPS road, instead of the one near your home. The one at 10Km is closed as well due to a local strike, I will avoid it too"
You can of course script all the scenarios + only use a TTS model. However, when plugging different systems together, I feel that it's the sweet spot where LLM is shining --> no need to pre-plan every scenarios that the user will ask, it can be done on the fly
https://www.amazon.com/s?k=obd+bluetooth+adapter
Release 0.3 out today!