Aussie living in the San Francisco Bay Area.
Coding since 1998.
.NET Foundation member. C# fan
https://d.sb/
Mastodon: @dan@d.sb

  • 1 Post
  • 2.58K Comments
Joined 3 years ago
cake
Cake day: June 14th, 2023

help-circle

  • Do you want to run TensorFlow Lite / LiteRT models? PyTorch Mobile? TensorRT? onnx? YOLO? vLLM? Something else? The recommendations will vary based on your use case.

    Google Coral was decent for TensorFlow Lite, but it’s EOL (end of life) now. I’ve got the dual TPU Mini PCIe version in my home server, via a PCIe adapter board. I use it for object detection with Blue Iris + CodeProject AI and it works pretty well for that use case.

    Hailo-8 is supposed to be like a more powerful version of the Coral, but I don’t have experience with it. It supports a bunch of frameworks: TensorFlow, TensorFlow Lite, Keras, PyTorch and ONNX. I’d be interested in hearing other people’s thoughts on it.

    I don’t know if any of these work over USB though. They’re usually internal devices. Google marketed the Coral USB as being for development and testing only, pointing people to the M.2 and PCIe versions for production usage.

    As for something totally different… There’s the Nvidia Jetson single board computer which supports TensorRT, but I don’t have experience with it either. I also think it’s a bit older too. You could also consider getting a newer mini PC with a AMD Ryzen AI processor in it, or an Nvidia DGX Spark.

    Google’s latest TPUs are only available in their cloud - they’re not selling the hardware to end users any more.






  • They’re closer to impingement ovens than convection ovens.

    Convection ovens (or “fan forced ovens” in some countries) use a fan to gently and evenly circulate the hot air, whereas impingement ovens and air fryers use higher velocity fans to blow the heat directly onto the food.



  • I’m surprised it took this long, given how insecure SMS and MMS are.

    On the other hand, I don’t think I know anyone that uses SMS regularly, so maybe it just wasn’t a priority? Pretty much the only SMS messages I get are automated. It’s more common to see people using either Messenger, WhatsApp, Signal, or Telegram (or iMessage in the USA but that’s mostly an outlier compared to the rest of the world).






  • the alternatives do not include a nationwide search as part of their features

    Yeah I think people would feel much better if the cameras were operated by the local police department, and they were the only ones that had access to it.

    ALPR (automatic license plate recognition) cameras have been around for a long time, but it previously wasn’t an issue because access to the data was restricted. Same with security CCTV cameras. Other jurisdictions had to subpoena the data rather than being able to instantly access everything.

    Flock’s cameras are much more than ALPR though. They make a profile of every car they see, and can track cars even if they don’t have license plates based on identifying features (dents, big scratches, bumper stickers, etc).






  • They destroy the books because it allows them to scan them bette

    That’s definitely one reason, but the copyright argument is also a part of it. The court explicitly said that their digitization is legal only if does not increase the number of copies of the book.

    There’s no need to do this legally - they could donate used books. The argument shows that the final product is transformative, so it doesn’t matter whether they keep the books or not.

    They have to keep the digital copy of the book because they add it to the training corpus for the LLM. Selling or donating the original physical book after doing that would void the fair use argument.

    LLMs can reproduce quite long passages of books, though I don’t think this changes the argument much, because it’s not reliable or useful.

    One of the tests that determines if it’s fair use or not is whether it can serve as a replacement for the original book. Pirated copies can, which is why they’re illegal. A summary like CliffNotes can’t. Even if the LLM can reproduce long passages, you can’t do that reliably (like you said) and it won’t work for all books.

    I always thought there was in obvious win where companies doing this could be forced to archive the scan publicly (after some period of time)

    I definitely agree with this. I think copyright law needs to be modernized to handle cases like this. I think the AI companies should be allowed to donate the digital copy to a library (like the Internet Archive) while still being allowed to keep their copy in their training corpus.