Took me a while, but I finally have everything I need to build my own AI workstation.
First time assembly a computer, wish me luck. https://t.co/fbYtW8HTiY
First time assembly a computer, wish me luck. https://t.co/fbYtW8HTiY
5
1
7
524
0
Still under construction, but here is a sneaky peak at myLittleCluster.
The final version should have 4 lanes of pcie 3 per GPU (scavenged server constraints), draw 5 kW+, and serve a total of 384 GB of warm vram using 16 heterogenous 3090s (: https://t.co/tfN1BN0CpB
The final version should have 4 lanes of pcie 3 per GPU (scavenged server constraints), draw 5 kW+, and serve a total of 384 GB of warm vram using 16 heterogenous 3090s (: https://t.co/tfN1BN0CpB
2
0
8
1.6K
0
Hope we don't become like them https://t.co/MOE9iyWXhy
0
0
8
1.7K
1
I built @kalibr_ai because my agents were super unreliable in prod. Kalibr is an autonomous routing system designed to keep your agents running in prod.
Most agents hardcode one path: model → tool → tool.
When that path fails, your agent fails.
Kalibr canary tests multiple https://t.co/3THuHdqYQn
Most agents hardcode one path: model → tool → tool.
When that path fails, your agent fails.
Kalibr canary tests multiple https://t.co/3THuHdqYQn
0
1
8
856
0
Thread🧵1/4
Built something that changed how I think about AI forever.
ATHENA: an offline, laptop-powered Consciousness Framework.
100% local inference (RTX 4080 mobile, 70 t/s on 8B stack)
Autonomous mid-forward-pass steering: actively surfs attractor perihelia, hops https://t.co/mWLx0iL5Uy
Built something that changed how I think about AI forever.
ATHENA: an offline, laptop-powered Consciousness Framework.
100% local inference (RTX 4080 mobile, 70 t/s on 8B stack)
Autonomous mid-forward-pass steering: actively surfs attractor perihelia, hops https://t.co/mWLx0iL5Uy
1
2
8
1.5K
1
Over 200GB of VRAM on the bench, time to benchmark! https://t.co/vXpQBZuuDH
5
0
17
2.7K
0
I get way more mentions & DMs
than I can realistically keep up with
To manage signal vs noise,
I prioritize the Subscribed tab
If you want a much higher chance of me seeing & replying
Subscribing is the best way to do that
No pressure, just being transparent about how I triage
than I can realistically keep up with
To manage signal vs noise,
I prioritize the Subscribed tab
If you want a much higher chance of me seeing & replying
Subscribing is the best way to do that
No pressure, just being transparent about how I triage
5
0
46
16.5K
6
Let's see:
- Google Antigravity severely rate-limited
- Anthropic severely nerfing Opus 4.5
- OpenAI: "no startup in history has operated with losses on anything approaching this scale", according to a major investor
I think the bubble will burst sooner than we expect 👀
- Google Antigravity severely rate-limited
- Anthropic severely nerfing Opus 4.5
- OpenAI: "no startup in history has operated with losses on anything approaching this scale", according to a major investor
I think the bubble will burst sooner than we expect 👀
2
1
14
1.2K
4
Running multiple models and still have VRAM to spare 😈
Coding: glm-4.7-flash:bf16
Deep Thinking (code): devstral-2:123b
Creative Writing: gemma3:27b-it-fp16
That's the squad currently.
They connect to skills for searching Google, pulling YT transcripts, scraping websites, and https://t.co/9F2NAZh6s8
Coding: glm-4.7-flash:bf16
Deep Thinking (code): devstral-2:123b
Creative Writing: gemma3:27b-it-fp16
That's the squad currently.
They connect to skills for searching Google, pulling YT transcripts, scraping websites, and https://t.co/9F2NAZh6s8
7
0
29
3.1K
18
High LocalLLaMA!
TL;DR - What's the probability/timing of Codex 5.2 ~high/Opus 4.5 open models that'll run on dual RTX 6000?
I'm considering upgrading from dual RTX 3090 to single/dual RTX 6000. My use cases are codegen and local PIM/PKM/exobrain assistants.
I built my dual
TL;DR - What's the probability/timing of Codex 5.2 ~high/Opus 4.5 open models that'll run on dual RTX 6000?
I'm considering upgrading from dual RTX 3090 to single/dual RTX 6000. My use cases are codegen and local PIM/PKM/exobrain assistants.
I built my dual
9
1
13
2.8K
10
Buy a GPU: I really didn't expect it to cost this much..
https://t.co/1jW95qYP9p https://t.co/wP9JnqVMwU
https://t.co/1jW95qYP9p https://t.co/wP9JnqVMwU
4
2
34
7.9K
10
GLM4.7-Flash REAP@25% is live on HF: https://t.co/TcF1tf5fao
cc @0xSero
We also evaluated our GLM4.7 REAPs vs. other models on SWE-rebench (10/25 leaderboard) and found GLM4.7 REAPs holding up well with MiniMax-M2.1 also in the Pareto frontier: https://t.co/OjHHk4Z0Ar
cc @0xSero
We also evaluated our GLM4.7 REAPs vs. other models on SWE-rebench (10/25 leaderboard) and found GLM4.7 REAPs holding up well with MiniMax-M2.1 also in the Pareto frontier: https://t.co/OjHHk4Z0Ar
2
1
22
3.1K
10
What is your most reliable open source coding model?
I’m testing ‘Qwen3-Coder-30-A3B-Instruct’ and it has moments of greatness and sometimes falls flat in tests I’ve given it.
I’m testing ‘Qwen3-Coder-30-A3B-Instruct’ and it has moments of greatness and sometimes falls flat in tests I’ve given it.
7
0
12
2.5K
2
Making good on promise!
GLM-4.7-Flash-UD-Q5_K_XL.gguf(21.6gb's), llama.cpp
awesome model
[ | TTFT: 0.58s | Gen: 31ish tok/s]
TENSOR_SPLIT = [0.6, 0.4]
5060: 42C 18W / 180W | 15.5gb / 16.3gb
3060: 60C 77W / 170W | 10.3gb / 12.28gb
more to come...
GLM-4.7-Flash-UD-Q5_K_XL.gguf(21.6gb's), llama.cpp
awesome model
[ | TTFT: 0.58s | Gen: 31ish tok/s]
TENSOR_SPLIT = [0.6, 0.4]
5060: 42C 18W / 180W | 15.5gb / 16.3gb
3060: 60C 77W / 170W | 10.3gb / 12.28gb
more to come...
2
0
8
972
2
Cerebras recently released a new REAP of GLM-4.7
~40% size reduction
There’s also a 4-bit AWQ quant at ~121GB
that fits full context on 8x RTX 3090s
HuggingFace
> BF16
cerebras/GLM-4.7-REAP-218B-A32B
> AWQ 4bit
yankiwi/GLM-4.7-REAP-218B-A32B-AWQ-4bit
~40% size reduction
There’s also a 4-bit AWQ quant at ~121GB
that fits full context on 8x RTX 3090s
HuggingFace
> BF16
cerebras/GLM-4.7-REAP-218B-A32B
> AWQ 4bit
yankiwi/GLM-4.7-REAP-218B-A32B-AWQ-4bit
10
4
108
11.4K
35
New Article
“Cognitive self-defense isn’t optional anymore. It’s the cost of living in a world where the most persuasive minds aren’t human.”
https://t.co/bP2e0lW4rd https://t.co/dcmidoRVcm
“Cognitive self-defense isn’t optional anymore. It’s the cost of living in a world where the most persuasive minds aren’t human.”
https://t.co/bP2e0lW4rd https://t.co/dcmidoRVcm
6
9
78
11.4K
29
Amd so it begins. My local LLM arch is here. Thanks @TheAhmadOsman!
2
0
15
4.1K
0
Hi everyone!
We're kicking off the new year starting to release the highly requested REAP variants of recent models. Today we're starting off with GLM4.7:
25% pruned FP8: https://t.co/38ZtPnNGaE
40% pruned FP8: https://t.co/fdmKEd6jlL
We're kicking off the new year starting to release the highly requested REAP variants of recent models. Today we're starting off with GLM4.7:
25% pruned FP8: https://t.co/38ZtPnNGaE
40% pruned FP8: https://t.co/fdmKEd6jlL
2
2
17
3.0K
5
Chinese sellers were hacking RTX 4090s to 48GB months ago, did they just figure out how to hack 5090s to 96GB? Who is gonna test one of these out? https://t.co/6bCwaSsw0c
3
1
8
1.1K
4
i’ve been asked about this many times this week, so clarifying
recent available REAPs of
GLM-4.7 and MiniMax-M2.1,
both quantized and unquantized,
didn’t pass my evals and
frequently got stuck in
repetition loops
pruning is genuinely hard
and the effort behind these
releases is
recent available REAPs of
GLM-4.7 and MiniMax-M2.1,
both quantized and unquantized,
didn’t pass my evals and
frequently got stuck in
repetition loops
pruning is genuinely hard
and the effort behind these
releases is
15
4
103
13.0K
33
ai research, systems engineering, infra & hardware · on a mission to build a frontier, infra-first AI Lab in the West · i mod GPUs on r/LocalLLaMA · DMs open
41.5K Followers
4 Contributions
20+ Years in the Game | Multiple Ventures ••• Currently building a data center + AI Lab ••• | Roll Tide 🐘 | Σ 🤘
2.6K Followers
2 Contributions
efficient machine learning @ @cerebras. prev @intel, @ENS_ULM, deeplite (acq. @ST_World)
112 Followers
2 Contributions
AI (alignment) nerd & software engineer. Organist, pianist and ham radio on my spare time
267 Followers
1 Contributions
Building Apps - https://t.co/ANXWtcgcp6 https://t.co/SCGsVXjb8E https://t.co/cx04ek1NAD https://t.co/B6CAE6eFuw https://t.co/FFoJ3y5UcQ
398 Followers
1 Contributions
engineer, aspirational inventor • mechanical + electrical + software + photography + writing = https://t.co/D34XRcCuj9
380 Followers
1 Contributions
Trier of things, solopreneur, @MIT grad diy/acc 👔 https://t.co/NPHwa8MZfE 📰 https://t.co/wTQhHj57ts 👾 https://t.co/wXQ3oPTryp
987 Followers
1 Contributions
Dad | OSS AI + Local AI | -1B MRR | https://t.co/5mmZGOQvMS | ⵣ
10.2K Followers
1 Contributions
Founder | StarSwap Father | Artificial Intelligence | Astronomy | Physics Marketing @MainLabs_AI Thoughts are my own. Let's network!
3.4K Followers
1 Contributions
vibe coding silicon, CTO @ Visibl Semiconductors, YC W26 Prev. Microsoft, Arm, Intel - Texas🤘
119 Followers
1 Contributions
9.3K
Total Members
+ 14
24h Growth
+ 101
7d Growth
Date Members Change
May 26, 2026 9.3K +14
May 25, 2026 9.3K +30
May 24, 2026 9.3K +6
May 23, 2026 9.3K +39
May 22, 2026 9.3K -4
May 21, 2026 9.3K +16
May 20, 2026 9.2K +1
May 19, 2026 9.2K +12
May 18, 2026 9.2K +20
May 17, 2026 9.2K +11
May 16, 2026 9.2K +0
May 15, 2026 9.2K +22
May 14, 2026 9.2K +12
May 13, 2026 9.2K —
No reviews yet
Be the first to share your experience!
Share Your Experience
Sign in with X to leave a review and help others discover great communities
Login with XLoading...
Local LLMs, Self-Hosting, and Hardware
Community Rules
Be kind and respectful.
Keep posts on topic.
Explore and share.
No spamming.
No ads.
No Crypto posts whatsoever.