Uhhoh!
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
RSS Bot@lemmy.bestiver.seMB to Hacker News@lemmy.bestiver.seEnglish · 8 months ago

You can now train a 70B language model at home

www.answer.ai

external-link
message-square
5
link
fedilink
  • cross-posted to:
  • ai_@lemmy.world
6
external-link

You can now train a 70B language model at home

www.answer.ai

RSS Bot@lemmy.bestiver.seMB to Hacker News@lemmy.bestiver.seEnglish · 8 months ago
message-square
5
link
fedilink
  • cross-posted to:
  • ai_@lemmy.world
You can now train a 70b language model at home – Answer.AI
www.answer.ai
external-link
We’re releasing an open source system, based on FSDP and QLoRA, that can train a 70b model on two 24GB GPUs.

Comments

alert-triangle
You must log in or # to comment.
  • insufferableninja@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    2
    ·
    8 months ago

    And yet, I still won’t

  • fubarx@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    8 months ago

    They’re using fine-tuning on top of existing models. Still useful, but the headline implies creating foundation models, which is still the domain of big iron.

  • Kairos@lemmy.today
    link
    fedilink
    English
    arrow-up
    1
    ·
    8 months ago

    “Can”

  • Noxy@pawb.social
    link
    fedilink
    English
    arrow-up
    1
    ·
    8 months ago

    The fuck does 70B mean? 70 bytes?

    • howrar@lemmy.ca
      link
      fedilink
      English
      arrow-up
      6
      ·
      8 months ago

      70 billion parameters. It’s standard notation in the context of LLMs.

Hacker News@lemmy.bestiver.se

hackernews@lemmy.bestiver.se

Subscribe from Remote Instance

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !hackernews@lemmy.bestiver.se
lock
Community locked: only moderators can create posts. You can still comment on posts.

Posts from the RSS Feed of HackerNews.

The feed sometimes contains ads and posts that have been removed by the mod team at HN.

Source of the RSS Bot

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 461 users / day
  • 1.64K users / week
  • 4.03K users / month
  • 9.41K users / 6 months
  • 1 local subscriber
  • 4.55K subscribers
  • 23.1K Posts
  • 15.1K Comments
  • Modlog
  • mods:
  • patrick@lemmy.bestiver.se
  • RSS Bot@lemmy.bestiver.se
  • BE: 0.19.16
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org