NHacker Next
  • new
  • past
  • show
  • ask
  • show
  • jobs
  • submit
▲Huawei releases MACaQ, its internal quantizer for local inference (github.com)
lukasc-ch 1 days ago [-]
People are reproducing it and creating GGUFs https://www.reddit.com/r/LocalLLaMA/s/36atJ2nNjh
adrian_b 15 hours ago [-]
The results shown there are very good, much better than for the previously widely used quantizers.

Nice for Huawei to share it.

alfiedotwtf 14 hours ago [-]
Sorry, I've deleted my Reddit account since they locked out users. Could you please post links to the GGUFs here :)
Rabbit504030201 1 days ago [-]
https://huawei-csl.com/blog/macaq/

Why does some HN users seem to prefer GitHub page whenever available at expense of official site? I mean, Huawei is still sanctioned, anything they host third party outside China can disappear at any hour.

nout 1 days ago [-]
I prefer GitHub, because I can see the code and immediately know where to click. Product pages are always full of various marketing shots, videos, etc that just takes more time to parse through.
gt0 1 days ago [-]
This is pretty much the reason that if I read about a new product, I generally just go to the Wikipedia page. I just want the no-bullshit version, no "Say hello to blah" video or marketing word salad.
andsoitis 1 days ago [-]
In this particular case I think you'd be pleased with it https://huawei-csl.com/blog/macaq/

It is from their lab in Switzerland, after all.

lukasc-ch 1 days ago [-]
Looks like many of their repos there have been around for a while. Also not sure why we would sanction free stuff from them
skinfaxi 1 days ago [-]
Well I'm not a lawyer but are you allowed to provide material support to sanctioned entities?
sroussey 1 days ago [-]
It’s a commerce department sanction not a treasury department sanction (which would be far more serious).
xpil11 1 days ago [-]
[dead]
Schlagbohrer 17 hours ago [-]
The top 3 repos sorted by stars on Huawei's github page are all for quantization. I am not an LLM scientist so I can't tell what the difference is between them, or why they need three different pipelines for model quantization.
xpil11 15 hours ago [-]
SINQ was created last year. It was for weights only and it was calibration-free quantization. Then KVarN is for KV-cache quantization to get longer context. MACaQ is multimodal, activation and weights calibrated quantization. 3 different projects
mocchibird 1 days ago [-]
Did they release any model? Seems good for Strata
minraws 1 days ago [-]
Qwen 3.8 27B has a macaq quant available
utternerd 1 days ago [-]
What a project name.
QuantumNomad_ 1 days ago [-]
Probably intended to reference macaque monkeys.
keyle 1 days ago [-]
I forgot my French, but isn't it incredibly rude?
PorciiVorbesc 1 days ago [-]
Why?
dmonitor 1 days ago [-]
I think the immature commenters are referring to the pronunciation being similar to "my cock"
PorciiVorbesc 1 days ago [-]
Aaa, thanks I didn't think of that.
arcanemachiner 1 days ago [-]
Congratulations on not being a total degenerate.
stdbrouw 1 days ago [-]
It's also a racial slur in certain languages.
yonatan8070 19 hours ago [-]
It's also "Roach" in Hebrew (מקק)
onemoresoop 20 hours ago [-]
What are those?
15 hours ago [-]
keyle 1 days ago [-]
No, no, not that.
IsTom 1 days ago [-]
I'd assume the French know something about naming projects in the vein of Coq.
xpil11 1 days ago [-]
[dead]
1 days ago [-]
0xb0565e486 1 days ago [-]
xD
wolrah 15 hours ago [-]
First thing my mind went to.

"Huawei releases MACaQ"

"Just like Jensen released his..."

adrian_b 1 days ago [-]
I do not think that macaques would mind.
ebx 1 days ago [-]
Just enough plausible deniability :P
1 days ago [-]
speedupagi 19 hours ago [-]
[flagged]
p-s- 1 days ago [-]
[dead]
1 days ago [-]
thefox96 1 days ago [-]
[dead]
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact
Rendered at 04:22:24 GMT+0000 (Coordinated Universal Time) with Vercel.