Pinchflat

Are Local Models Finally Good Enough?

Media Tasks
Actions

Raw Attributes

Source: Techno Tim
  • original_url: https://www.youtube.com/watch?v=K2IGHj7KQoM
  • uploaded_at: 2026-05-18T00:00:00Z
  • last_error:
  • inserted_at: 2026-05-19T02:21:53Z
  • source_id: 4
  • media_size_bytes: 233080826
  • description: I have been covering local and self-hosted AI for a few years now - from running models privately at home to what is still running in my homelab today. But to run the larger, more capable models, you need something more specialized than a general-purpose home server with a video card. I wanted to see how good local self-hosted AI has actually gotten, so I built a mini AI cluster on my desk and tested it with a real coding workflow. Can a local AI coding agent actually build and improve a real app? And does adding a second machine make the workflow better, or just add more complexity? This is a practical test of the ASUS Ascent GX10, vLLM, OpenCode, power draw, Open Weight Models, and what local AI feels like to actually use. Thank you to ASUS for sending these 2 GX10s to test. ASUS Ascent GX10: https://amzn.to/3PxWqjl (Amazon affiliate link) Video Notes: https://technotim.com/posts/local-ai-... 00:00 Local AI is starting to change 01:19 ASUS Ascent GX10 hardware 03:21 Remote access and workflow 04:19 NAS storage and vLLM 05:49 OpenCode agent stack 06:57 The Homelab app test 08:06 One GX10 coding test 11:48 One-GX10 power draw and idle cost 12:34 What does a second GX10 change? 13:00 NCCL and the two-node Ray cluster 14:09 MiniMax, KV cache, and model loading 16:09 Two GX10 coding test 17:44 Two-GX10 power draw 18:45 One GX10 vs two GX10s 19:12 UI and Windows XP stress tests 20:59 This is not plug and play 22:15 Final thoughts Merch Shop 🛍️: https://l.technotim.com/shop Support me on Patreon:   / technotim   Sponsor me on GitHub: https://github.com/sponsors/timothyst... Subscribe on Twitch:   / technotim   Become a YouTube member:    / @technotim   Gear Recommendations: https://l.technotim.com/gear Get Help in Our Discord Community: https://l.technotim.com/discord 2nd channel:    / @technotimtinkers   (Affiliate links may be included in this description. I may receive a small commission at no cost to you.) 00:00 - Intro Thank you for watching!
  • title: Are Local Models Finally Good Enough?
  • id: 7793846
  • livestream: false
  • metadata_filepath: /downloads/Techno Tim/2026-05-18 Are Local Models Finally Good Enough？/Are Local Models Finally Good Enough？.info.json
  • updated_at: 2026-05-19T02:23:14Z
  • prevent_download: false
  • short_form_content: false
  • culled_at:
  • media_downloaded_at: 2026-05-19T02:23:10Z
  • media_filepath: /downloads/Techno Tim/2026-05-18 Are Local Models Finally Good Enough？/Are Local Models Finally Good Enough？.mp4
  • prevent_culling: false
  • playlist_index: 1
  • subtitle_filepaths:
  • duration_seconds:
  • nfo_filepath:
  • media_id: K2IGHj7KQoM
  • predicted_media_filepath: /downloads/Techno Tim/2026-05-18 Are Local Models Finally Good Enough？/Are Local Models Finally Good Enough？.NA
  • uuid: 59573373-7d93-4d39-9b1a-2299789a1504
  • thumbnail_filepath: /downloads/Techno Tim/2026-05-18 Are Local Models Finally Good Enough？/Are Local Models Finally Good Enough？-thumb.jpg
  • media_redownloaded_at:
  • upload_date_index: 99
  • matching_search_term:
Worker
State
Scheduled At
Pinchflat.Downloading.MediaDownloadWorker completed