Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up
startlux-models 's Collections
StartLux-Decision-v1.1 AutoThink
StartLux-Decision-v1.1 Instant
StartLux-Decision-v1
Massive Activations in Hybrid Linear Attention Models

Massive Activations in Hybrid Linear Attention Models

updated Aug 13

Official PAS, ISP, gating-ablation, and scale-study checkpoints for Massive Activations in Hybrid Linear Attention Models.

Upvote
3

  • startlux-models/gdn-340m-pas-fa-layer04-10b

    Text Generation • 0.4B • Updated Aug 13 • 24

  • startlux-models/gdn-340m-pas-fa-layer12-10b

    Text Generation • 0.4B • Updated Aug 13 • 22

  • startlux-models/gdn-340m-pas-fa-layer20-10b

    Text Generation • 0.4B • Updated Aug 13 • 22

  • startlux-models/gdn-nooutgate-340m-pas-fa-layer12-10b

    Text Generation • 0.4B • Updated Aug 13 • 24

  • startlux-models/gdn-gatedfa-340m-pas-fa-layer12-10b

    Text Generation • 0.4B • Updated Aug 13 • 25

  • startlux-models/gdn-1.3b-pas-fa-layer12-50b

    Text Generation • 1B • Updated Aug 13 • 17

  • startlux-models/gdn-340m-isp-hybrid-3to1-10b

    Text Generation • 0.4B • Updated Aug 13 • 26

  • startlux-models/gdn-nooutgate-340m-isp-hybrid-3to1-10b

    Text Generation • 0.4B • Updated Aug 13 • 22

  • startlux-models/gdn-gatedfa-340m-isp-hybrid-3to1-10b

    Text Generation • 0.4B • Updated Aug 13 • 25

  • startlux-models/gdn-1.3b-isp-hybrid-3to1-50b

    Text Generation • 1B • Updated Aug 13 • 21
Upvote
3
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs