{"id":165,"date":"2024-01-30T02:37:27","date_gmt":"2024-01-30T02:37:27","guid":{"rendered":"https:\/\/e-muse.it\/blog\/?p=165"},"modified":"2025-07-03T00:36:49","modified_gmt":"2025-07-03T00:36:49","slug":"local-ai-linkpost","status":"publish","type":"post","link":"https:\/\/e-muse.it\/blog\/2024\/01\/30\/local-ai-linkpost\/","title":{"rendered":"Local AI Linkpost"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Links to models that you can run yourself. They call them Open Source, which is not exactly accurate, their licenses are more restrictive, but in practice you can used them, even for commercial applications, and you can poke around them quite a bit.<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Code Llama 70B, <a href=\"https:\/\/ai.meta.com\/resources\/models-and-libraries\/llama-downloads\/\">download<\/a>, the new version for Meta&#8217;s code-generation Large Language Model. Here it is <a href=\"https:\/\/huggingface.co\/codellama\/CodeLlama-70b-hf\">on huggingface<\/a>.<\/li>\n\n\n\n<li><a href=\"https:\/\/blog.rwkv.com\/p\/eagle-7b-soaring-past-transformers\">RWKV Eagle 7B<\/a>, the most interesting part is that architecturally it is not transformer-based, but it should be more energy-efficient.<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">We should probably write a tutorial on how to run these models locally, and on how they can be used productively. The latter is an open question, it is <a href=\"https:\/\/visualstudiomagazine.com\/articles\/2024\/01\/25\/copilot-research.aspx\">very easy to waste time<\/a>, and these things tend to be power hungry.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Links to models that you can run yourself. They call them Open Source, which is not exactly accurate, their licenses are more restrictive, but in practice you can used them, even for commercial applications, and you can poke around them quite a bit. We should probably write a tutorial on how to run these models [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"activitypub_content_warning":"","activitypub_content_visibility":"","activitypub_max_image_attachments":3,"activitypub_interaction_policy_quote":"anyone","activitypub_status":"","footnotes":""},"categories":[75,27],"tags":[29,31],"class_list":["post-165","post","type-post","status-publish","format-standard","hentry","category-link","category-tools","tag-ai","tag-open-source"],"_links":{"self":[{"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/posts\/165","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/comments?post=165"}],"version-history":[{"count":1,"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/posts\/165\/revisions"}],"predecessor-version":[{"id":166,"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/posts\/165\/revisions\/166"}],"wp:attachment":[{"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/media?parent=165"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/categories?post=165"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/e-muse.it\/blog\/wp-json\/wp\/v2\/tags?post=165"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}