• Fluffy Kitty Cat@slrpnk.net
    link
    fedilink
    English
    arrow-up
    3
    ·
    15 days ago

    Given how memory is the bottleneck especially at the very low end it makes me wonder if one bit quantization of an extremely large model would be a gigabyte per gigabyte of ram better