george hotz/tinybox

thoughts on george hotz's $15k machine for local AI computing?

A Conspiracy Theorist Is Talking Shirt $21.68

Nothing Ever Happens Shirt $21.68

A Conspiracy Theorist Is Talking Shirt $21.68

  1. 1 month ago
    Anonymous

    I'm still waiting for him to develop something usable and relevant.

    • 1 month ago
      Anonymous

      openpilot is a product used by many people. plenty of reviews online.

      • 1 month ago
        Anonymous

        At least the first video does not paint openpilot in a very good light.

        • 1 month ago
          Anonymous

          wtf are you talking about? guy seems to love it. and its performance seems okay

  2. 1 month ago
    Anonymous

    I'm guessing tinygrad still doesn't work? Also I'm guessing his AMD memebox gets outperformed by a Mac pro that still manages to cost less.

    • 1 month ago
      Anonymous

      >Mac pro
      What Mac Pro can fit 70B fp16 exactly?

      • 1 month ago
        Anonymous

        128 GB might be a bit close unless you were to install a minimal Linux distro on it. 192 GB would be plenty. Even a 192 GB Mac with 8 TB of storage costs $4000 less than a tinybox.

  3. 1 month ago
    Anonymous

    Why would someone use a 32 core epic or a 30gb/s storage for AI?

    • 1 month ago
      Anonymous

      >Why would someone use a 32 core epic or a 30gb/s storage for AI?
      Genoa has the best bang for buck for a system with lots of PCIe and memory channels. Could have used 16 cores, but it won't save a massive amount of money.

      Fast SSDs could be important for developing LLM in a Flash type stuff, the whole thing is going to be expensive to begin with so why not?

  4. 1 month ago
    Anonymous

    >two 120v outlets
    So who the hell is this aimed at?
    Anyone willing to pay 15k for an AI computer isn't gonna plug it into a consumer outlet in their home, enterprise shit already runs at higher voltages for efficiency gains

    • 1 month ago
      Anonymous

      It's for WFH professionals and small offices.

  5. 1 month ago
    Anonymous

    this guy is still milking his iphone script kiddy fame?

  6. 1 month ago
    Anonymous

    He has stopped complaining and just started to code to make shit work again? Amazing.

    If tinygrad can get decent utilization with tensor parallelism across 6 GPUs for batch 1 inference I'll be surprised though.

    • 1 month ago
      Anonymous

      >just started to code to make shit work again
      Anon he's schlepping PC builds

      • 1 month ago
        Anonymous

        >Anon he's schlepping PC builds
        Actually making inference work across multiple AMD GPUs with tinygrad is pretty impressive, especially tensor parallel.

        Nearly no one does tensor parallel.

  7. 1 month ago
    Anonymous

    >he's irrelevant
    >it doesn't work
    >why would you use that hard drive?
    >why would you plug it in the wall like that?
    >what about that thing he did 20 years ago?
    holy jeezus, 4cope.org you homosexuals are pathetic.

  8. 1 month ago
    Anonymous

    what's doing the ai crunching I dont see a gpu or anything?

    • 1 month ago
      Anonymous

      6x7900XTX

  9. 1 month ago
    Anonymous

    I watched one stream of him (1) and he figured out AI basically sucked for math. How has he not moved on from AI?

  10. 1 month ago
    Anonymous

    moron here. Can someone explain to me why you can't just buy the parts and assemble the PC yourself? What is George's part in this?

    • 1 month ago
      Anonymous

      >What is George's part in this?
      he gets to make money

    • 1 month ago
      Anonymous

      If they have their own repository for Linux configs and dockers to make shit work out of the box, that's a frickton of work you're saving yourself.

    • 1 month ago
      Anonymous

      https://twitter.com/__tinygrad__/status/1764734675002810622

      He is trying to pester AMD into unfricking their shit.

      • 1 month ago
        Anonymous

        >https://twitter.com/__tinygrad__/status/1764734675002810622
        Just checkpoint and reset the card if it hangs.

        • 1 month ago
          Anonymous

          >Is your foot broken? Just limp!
          some people like to actually solve problems

    • 1 month ago
      Anonymous

      amd has good hardware but their software is lacking proper support, he trying to sell a package of amds hardware bundled with some software that works.
      Well at least that is what he claims, i am still unsure if he is a hack, gives me fishy vives

  11. 1 month ago
    Anonymous

    scam

  12. 1 month ago
    Anonymous

    can he solve cartpole yet

  13. 1 month ago
    Anonymous

    >15k rig to run a 70b model
    is this dude serious kek

  14. 1 month ago
    Anonymous

    good luck to george

    now maybe AMD will make a 48gb card
    6x48gb would be juicy...

  15. 1 month ago
    Anonymous

    what port does dns run on george?

Your email address will not be published. Required fields are marked *