[{"data":1,"prerenderedAt":617},["ShallowReactive",2],{"project-35470915":3},{"id":4,"name":5,"line":6,"line_source":7,"title":8,"url":9,"domain":10,"maker":11,"posted_at":12,"year":13,"points":14,"comments":15,"rank_in_year":16,"shown_in_year":17,"top":18,"tier":19,"category":20,"subcategory":21,"format":22,"keywords":23,"reception":27,"sentiment":28,"stance_mix":29,"scored_comments":34,"aspects":35,"strip":48,"post_text":49,"what":50,"said":91,"maker_in_thread":202,"shape":211,"grid":216,"attempts":579,"same_week":580,"maker_shows":18,"maker_hidden":609,"reader_version":610,"card":611},"35470915","Tabby","A self-hosted GitHub Copilot","title","Show HN: Tabby – A self-hosted GitHub Copilot","https:\u002F\u002Fgithub.com\u002FTabbyML\u002Ftabby","github.com","wsxiaoys",1680799217,2023,627,126,34,3109,2,"legend","dev_tools","code completion","other",[24,21,25,26],"self-hosted copilot","local llm","code assistant","mixed",0.048,{"positive":30,"neutral":31,"mixed":32,"critical":33},15,27,4,14,60,{"privacy":36,"execution":38,"docs":41,"pricing":42,"idea":43,"design":45,"performance":46},{"positive":18,"critical":37},0,{"positive":39,"critical":40},3,7,{"positive":37,"critical":39},{"positive":37,"critical":37},{"positive":44,"critical":18},5,{"positive":37,"critical":37},{"positive":37,"critical":47},1,[39,37,37,39,37,37,44,37,44,47,44,44,44,47,39,39,18,39,37,47,39,44,39,44,39,18,47,18,44,37,37,37,37,39,37,39,39,32,18,47],"I would like to introduce Tabby, which is a self-hosted alternative to GitHub Copilot that you can integrate into your hardware. While GitHub Copilot has made coding more efficient and less time-consuming by assisting developers with suggestions and completing code, it raises concerns around privacy and security.\n\nTabby is in its early stages, and we are excited to receive feedback from the community.\n\nIts Github repository is located here: https:\u002F\u002Fgithub.com\u002FTabbyML\u002Ftabby.\n\nWe have also deployed the latest docker image to Huggingface for a live demo: https:\u002F\u002Fhuggingface.co\u002Fspaces\u002FTabbyML\u002Ftabb",{"problem":51,"audience":57,"pricing":68,"motivation":69,"time_to_build":68,"stack":73,"openness":88,"stage":89,"team_size":90},{"value":52,"source":53,"evidence":54},"Copilot raises privacy and security concerns; teams want code completion they control","maker",[55],{"id":56},"post",{"value":58,"source":59,"evidence":60},"Developers and organisations wanting on-premises code completion","inferred",[61,65],{"id":62,"by":63,"text":64},"35480084","funnyfoobar","I think that this is a really cool project. Personally, I am working at a financial institution which is regulated, and the legal team + cyber are still evaluating if there would…",{"id":66,"by":11,"text":67},"35477985","Thank you, I was inspired by the brilliant ideas presented in the employer handbooks of Posthog and GitLab, as acknowledged in the career page.",null,{"value":70,"source":53,"evidence":71},"Privacy and control over code compared with GitHub Copilot",[72],{"id":56},[74,78,82],{"value":75,"source":53,"evidence":76},"Hugging Face Transformers",[77],{"id":56},{"value":79,"source":53,"evidence":80},"Triton FasterTransformer backend",[81],{"id":56},{"value":83,"source":53,"evidence":84},"GPT-J\u002FGPT-NeoX based models",[85],{"id":86,"by":11,"text":87},"35471598","We have tested Tabby using various open-source models based on GPT-J\u002FGPT-NeoX, including https:\u002F\u002Fhuggingface.co\u002FCarperAI\u002FFIM-NeoX-1.3B and…","open_source","beta","team",{"praise":92,"objections":113,"requests":142,"questions":167,"alternatives":190},[93,105],{"value":94,"source":95,"evidence":96},"Self-hosting addresses privacy and control concerns","commenter",[97,101],{"id":98,"by":99,"text":100},"35475126","colinsane","“privacy” sits in a broader sea that includes “control”, “customization” and “lock-in”. i’ve been using the GPT family of tools less than otherwise because they’re constantly…",{"id":102,"by":103,"text":104},"35471300","myin","Great to have a self-hosted solution, both for data privacy and quality improvement potentials.",{"value":106,"source":95,"evidence":107},"Good to see a self-hosted Copilot alternative",[108,112],{"id":109,"by":110,"text":111},"35474710","arco1991","Very interesting to have a self-hosted version of Copilot. Will definitely try this out.",{"id":62,"by":63,"text":64},[114,121,128,135],{"value":115,"source":95,"evidence":116},"Demo generated buggy binary search code",[117],{"id":118,"by":119,"text":120},"35480642","hddqsb","I'm glad to see projects like this. I had a look at the demo (https:\u002F\u002Fhuggingface.co\u002Fspaces\u002FTabbyML\u002Ftabby) and wasn't too impressed with the generated code for the default sample…",{"value":122,"source":95,"evidence":123},"Docker image unavailable for Apple Silicon",[124],{"id":125,"by":126,"text":127},"35472574","simonw","Anyone know of a quick workaround for this? ``` % docker run \\ -it --rm \\ -v .\u002Fdata:\u002Fdata \\ -v .\u002Fdata\u002Fhf_cache:\u002Fhome\u002Fapp\u002F.cache\u002Fhuggingface \\ -p 5000:5000 \\ -e…",{"value":129,"source":95,"evidence":130},"No training documentation in the introduction",[131],{"id":132,"by":133,"text":134},"35473890","uglycoyote","I'm confused about the premise here. The power of self-hosting such a thing is presumably that you would be able to train it on your own company's codebase as a corpus of…",{"value":136,"source":95,"evidence":137},"Name clashes with the existing Tabby project",[138],{"id":139,"by":140,"text":141},"35471995","lfkdev","This exakt name is already used by a big open-source projekt, https:\u002F\u002Fgithub.com\u002Feugeny\u002Ftabby (50k stars) maybe consider changing the name for better SEO",[143,154,162],{"value":144,"source":95,"evidence":145},"AMD GPU support",[146,150],{"id":147,"by":148,"text":149},"35475422","grudg3","Hi, will this work on AMD Gpu? I have plenty of VRAM available",{"id":151,"by":152,"text":153},"35504712","accelbred","Is AMD gpu support on the roadmap? I'm interested in this stuff but I won't be buying Nvidea cards.",{"value":155,"source":95,"evidence":156},"VS Code, Vim and IntelliJ extensions",[157,158],{"id":62,"by":63,"text":64},{"id":159,"by":160,"text":161},"35472945","jslakro","Considering it's an alpha version I think a VSCode extension is the missing part",{"value":163,"source":95,"evidence":164},"Ability to fine-tune on own codebase",[165,166],{"id":62,"by":63,"text":64},{"id":132,"by":133,"text":134},[168,179,183],{"value":169,"source":95,"evidence":170},"How does it compare to FauxPilot?",[171,175],{"id":172,"by":173,"text":174},"35471968","vikp","How does this compare to fauxpilot - https:\u002F\u002Fgithub.com\u002Ffauxpilot\u002Ffauxpilot? Fauxpilot also uses Triton with fastertransformers and GPT-J style models (codegen).",{"id":176,"by":177,"text":178},"35471700","syntaxing","What sort of resources do we need to run this, particularly VRAM? Also, how does this compare to Fauxpilot?",{"value":180,"source":95,"evidence":181},"What VRAM is required?",[182],{"id":176,"by":177,"text":178},{"value":184,"source":95,"evidence":185},"Will it run fast enough on Apple M1\u002FM2 laptops?",[186],{"id":187,"by":188,"text":189},"35475113","zoba","My assumption is that this would not be fast enough for practical use on M1\u002FM2 Macbooks. Is that correct?",[191,195],{"value":192,"source":95,"evidence":193},"FauxPilot",[194],{"id":172,"by":173,"text":174},{"value":196,"source":95,"evidence":197},"GitHub Copilot",[198],{"id":199,"by":200,"text":201},"35471933","DanHulton","Copilot has so far been pretty useful to me as a \"sometimes smarter intellisense\". It'll frequently correctly guess the arguments I want for a function (and their types), and…",{"comments":40,"answered":32,"key":203},[204,205,208],{"id":66,"text":67},{"id":206,"text":207},"35472035","Linked my replies to others' questions: [1], [2] [1] https:\u002F\u002Fnews.ycombinator.com\u002Fitem?id=35471882 [2] https:\u002F\u002Fnews.ycombinator.com\u002Fitem?id=35471390 I hope these can be of help…",{"id":209,"text":210},"35471390","Tabby collected the source code from the related repository and built them into a dataset. I already have some proof-of-concept pipelines built [1] and [2], but I still need some…",{"commenters":212,"max_depth":213,"maker_replies":40,"first_comment_mins":214,"lifespan_hours":215},93,6,23,73,[217,219,223,227,230,233,237,241,244,247,250,253,256,258,261,264,267,270,273,276,280,282,284,286,288,291,294,298,301,304,308,311,314,317,320,323,325,327,331,333,337,339,342,344,348,350,351,353,356,359,363,367,370,373,376,378,380,384,387,390,392,395,397,401,403,407,409,412,415,418,421,424,427,430,433,437,439,442,445,447,451,454,456,460,463,465,468,471,473,475,477,481,483,486,488,491,494,497,500,503,505,508,511,514,516,519,522,525,527,529,533,536,538,542,545,549,552,555,558,559,563,565,567,569,571,572,574,576],[199,37,44,218,200,37],"project\u002Fpositive\u002Fprivacy",[220,37,37,221,222,37],"35472352","commenter\u002Fneutral\u002Fnone","japhyr",[224,37,47,225,226,37],"35472766","project\u002Fcritical\u002Fexecution","greenie_beans",[228,37,37,221,229,37],"35473351","davnicwil",[231,37,37,221,232,37],"35473735","jrockway",[234,37,37,235,236,37],"35502088","commenter\u002Fneutral\u002Fdocs","tough",[238,37,37,239,240,37],"35473866","commenter\u002Fneutral\u002Fprivacy","yunwal",[242,37,37,239,243,37],"35473907","moonchrome",[245,37,37,239,246,37],"35475265","RussianCow",[248,37,39,249,243,37],"35480903","project\u002Fneutral\u002Fprivacy",[251,37,37,221,252,37],"35474456","littlestymaar",[254,37,37,221,255,37],"35478147","EntrePrescott",[257,37,37,221,236,37],"35502074",[259,37,37,239,260,37],"35474591","wongarsu",[262,37,37,239,263,37],"35474961","blibble",[265,37,37,239,266,37],"35476309","SquareWheel",[268,37,37,239,269,37],"35477163","joshspankit",[271,37,37,239,272,37],"35477758","jachee",[274,37,37,239,275,37],"35478225","noduerme",[277,37,37,278,279,37],"35482925","other\u002Fneutral\u002Fprivacy","CodexArcana",[281,37,37,278,275,37],"35500478",[98,37,44,283,99,37],"project\u002Fpositive\u002Fnone",[285,37,37,239,255,37],"35478087",[287,37,37,239,200,37],"35476606",[289,37,37,239,290,37],"35478361","pmontra",[292,37,44,283,293,37],"35474786","dgunay",[295,37,37,296,297,37],"35481809","other\u002Fneutral\u002Fnone","hoosieree",[299,37,37,296,300,37],"35482820","wing-_-nuts",[302,37,37,296,303,37],"35489129","trentnelson",[305,37,39,306,307,37],"35475594","project\u002Fmixed\u002Fexecution","Rapzid",[309,37,47,225,310,37],"35481799","adriand",[312,37,37,221,313,37],"35477444","unosama",[315,37,37,221,316,37],"35477922","mkaic",[318,37,44,283,319,37],"35478190","spenczar5",[321,37,39,306,322,37],"35478991","YeBanKo",[324,37,37,221,200,37],"35489259",[326,37,37,221,322,37],"35489923",[328,37,44,329,330,37],"35479143","project\u002Fpositive\u002Fexecution","silasdavis",[332,37,44,283,300,37],"35482748",[334,47,44,335,336,37],"35476416","maker\u002Fpositive\u002Fnone","the42thdoctor",[66,47,37,338,11,47],"maker\u002Fneutral\u002Fnone",[340,47,37,296,341,37],"35478370","redrove",[343,47,37,296,236,37],"35502103",[345,47,47,346,347,37],"35479642","maker\u002Fcritical\u002Fnone","brobinson",[172,18,39,349,173,37],"project\u002Fneutral\u002Fnone",[206,18,37,338,11,47],[132,39,39,352,133,37],"project\u002Fneutral\u002Fdocs",[354,39,37,296,355,37],"35474444","RhodesianHunter",[357,39,39,349,358,37],"35475115","sp332",[360,39,39,361,362,37],"35475509","maker\u002Fneutral\u002Fdocs","PantaloonFlames",[364,39,39,365,366,37],"35478244","project\u002Fneutral\u002Fpricing","bonestamp2",[368,39,39,352,369,37],"35475735","dror",[371,39,39,249,372,37],"35476082","computerex",[374,39,47,375,133,37],"35477293","project\u002Fcritical\u002Fidea",[377,39,37,221,372,37],"35479674",[62,32,39,379,63,37],"project\u002Fmixed\u002Fdesign",[381,44,37,382,383,37],"35471650","other\u002Fneutral\u002Fpricing","mska",[385,44,37,382,386,37],"35472061","ushakov",[388,44,37,382,389,37],"35472190","sebzim4500",[391,44,37,382,260,37],"35473645",[393,44,37,221,394,37],"35476420","passwordoops",[396,44,37,382,366,37],"35478254",[398,213,47,399,400,37],"35472607","project\u002Fcritical\u002Fdocs","nmstoker",[402,213,47,399,400,37],"35472831",[404,213,37,405,406,37],"35472970","commenter\u002Fneutral\u002Fidea","yieldcrv",[408,213,47,225,400,37],"35473142",[410,213,44,411,406,37],"35473289","project\u002Fpositive\u002Fidea",[413,213,44,411,414,37],"35479650","yreg",[416,213,44,329,417,37],"35476278","jauer",[419,213,39,349,420,37],"35478584","VadimPR",[422,213,39,349,423,37],"35483243","traverseda",[425,213,37,296,426,37],"35486185","kateklink",[428,213,39,306,429,37],"35501915","nacs",[431,40,37,296,432,37],"35478876","Nic0",[434,435,44,411,436,37],"35471252",8,"nathancahill",[209,435,37,438,11,47],"maker\u002Fneutral\u002Fexecution",[440,435,39,441,436,37],"35471770","project\u002Fneutral\u002Fperformance",[443,435,44,411,444,37],"35472029","skerit",[125,446,47,225,126,37],9,[448,446,39,449,450,37],"35472793","project\u002Fneutral\u002Fexecution","markng",[452,446,47,225,453,37],"35473010","andrewmunsell",[455,446,39,449,450,37],"35472901",[457,458,39,249,459,37],"35477111",10,"shaunxcode",[461,462,47,225,260,37],"35473809",11,[176,464,39,441,177,37],12,[466,464,37,467,11,47],"35471882","maker\u002Fneutral\u002Fperformance",[469,464,47,399,470,37],"35472464","moffkalast",[472,464,39,441,429,37],"35475070",[474,464,39,441,358,37],"35475206",[102,476,44,218,103,37],13,[478,33,39,479,480,37],"35471487","project\u002Fneutral\u002Fidea","akrymski",[86,33,37,482,11,47],"maker\u002Fneutral\u002Fidea",[484,30,37,296,485,37],"35471481","GartzenDeHaes",[487,30,37,296,480,37],"35471516",[489,30,37,296,490,37],"35472406","hn_user2",[492,30,37,296,493,37],"35471529","michaelmior",[495,30,37,296,496,37],"35473847","dalmo3",[498,30,37,296,499,37],"35471648","phamilton",[501,30,37,296,502,37],"35471748","in3d",[504,30,37,296,485,37],"35471850",[506,30,37,296,507,37],"35471872","egeozcan",[509,30,37,296,510,37],"35473002","riceart",[512,30,37,296,513,37],"35471956","lispisok",[515,30,37,296,243,37],"35472388",[517,30,37,296,518,37],"35472528","SkyPuncher",[520,30,37,296,521,37],"35474775","dpkirchner",[523,30,37,296,524,37],"35475349","anakaine",[159,526,39,352,160,37],16,[528,526,37,338,11,47],"35473019",[530,531,37,296,532,37],"35476999",17,"boringuser2",[534,531,37,296,535,37],"35477506","nextworddev",[537,531,37,296,532,37],"35477969",[539,540,39,249,541,37],"35476020",18,"ROFISH",[118,543,47,544,119,37],19,"project\u002Fcritical\u002Fperformance",[546,547,44,329,548,37],"35474758",20,"covi",[550,551,37,296,313,37],"35477432",21,[553,554,39,441,243,37],"35473963",22,[556,554,39,441,557,37],"35474997","atq2119",[109,214,44,411,110,37],[560,561,39,479,562,37],"35477570",24,"xvilka",[564,561,39,338,426,37],"35485997",[566,561,47,225,562,37],"35489288",[147,568,39,441,148,37],25,[151,570,39,441,152,37],26,[187,31,39,441,188,37],[139,573,47,375,140,37],28,[575,573,37,482,11,47],"35472085",[577,573,37,221,578,37],"35472282","boesboes",[],[581,586,591,596,600,604],{"id":582,"name":583,"points":584,"category":585},"35543668","Phind",1401,"ai",{"id":587,"name":588,"points":589,"category":590},"35471129","BrainPlsWork",329,"productivity",{"id":592,"name":593,"points":594,"category":595},"35524328","OpenOwl",220,"infrastructure",{"id":597,"name":598,"points":599,"category":20},"35483933","ChatGDB",189,{"id":601,"name":602,"points":603,"category":20},"35548778","twitter-api-client",183,{"id":605,"name":606,"points":607,"category":608},"35482636","NoiSQL",176,"creative",false,"v2",{"id":612,"name":5,"line":6,"ai":609,"cat":20,"year":13,"points":14,"comments":15,"rec":27,"s":613,"top":18,"kw":614,"maker":11,"domain":10,"tier":19,"attempts":37,"strip":615,"url":9,"mix":616,"praise":94,"objection":115,"sub":21},35470915,0.05,[24,21,25,26],"3003005051555133230135353212500003033421",[30,31,32,33],1794036633679]