[{"data":1,"prerenderedAt":226},["ShallowReactive",2],{"project-42451409":3},{"id":4,"name":5,"line":6,"line_source":7,"title":8,"url":9,"domain":10,"maker":11,"posted_at":12,"year":13,"points":14,"comments":15,"rank_in_year":16,"shown_in_year":17,"top":18,"tier":19,"category":20,"subcategory":21,"format":22,"keywords":23,"reception":29,"sentiment":30,"stance_mix":31,"scored_comments":34,"aspects":35,"strip":41,"post_text":43,"what":44,"said":82,"maker_in_thread":140,"shape":150,"grid":154,"attempts":186,"same_week":187,"maker_shows":217,"maker_hidden":218,"reader_version":219,"card":220},"42451409","openai-realtime-embedded-SDK","openai-realtime-embedded-SDK Build AI assistants on microcontrollers","title","Show HN: openai-realtime-embedded-SDK Build AI assistants on microcontrollers","https:\u002F\u002Fgithub.com\u002Fopenai\u002Fopenai-realtime-embedded-sdk","github.com","Sean-Der",1734536833,2024,63,14,1145,3515,33,"notable","languages","embedded sdk","library",[24,25,26,27,28],"esp32","webrtc","openai realtime","embedded ai","microcontroller","mixed",0.313,{"positive":32,"neutral":33,"mixed":33,"critical":33},3,1,6,{"docs":36,"execution":38,"idea":39},{"positive":37,"critical":37},0,{"positive":37,"critical":37},{"positive":40,"critical":33},2,[32,37,37,32,37,42,37,33,37,37,42,37,42,37],5,"Hi HN! This is an SDK for ESP32s (microcontrollers) that runs against OpenAI's new WebRTC service [0] My hope is that people can easily add AI to lots of 'real' devices. Wearable devices, speakers around the house, toys etc... You don't have to write any code, just buy a device and set some env variables.\n\nIf you have any feedback\u002Fquestions I would love to hear! I hope this kicks off a generation of new interesting devices. If you aren't familiar with WebRTC it can do some magical things. Check out WebRTC for the Curious[1] and would love to talk about all the cool things that does also.\n\n[0] ",{"problem":45,"audience":51,"pricing":62,"motivation":63,"time_to_build":62,"stack":67,"openness":80,"stage":81,"team_size":80},{"value":46,"source":47,"evidence":48},"Adding speech-to-speech AI to real devices built on microcontrollers","maker",[49],{"id":50},"post",{"value":52,"source":53,"evidence":54},"Hobbyists and developers building AI-enabled physical devices","inferred",[55,58],{"id":56,"by":11,"text":57},"42475063","Sorry I forgot to put use cases in! Here are the ones I am excited about. * Making a toy. I have had a lot of fun putting a silly\u002Fsarcastic voice in toys. My 4 year old thinks it…",{"id":59,"by":60,"text":61},"42477081","roland35","Favorited and starred! I wonder if the real power of this could be in integrating large low cost sensor networks? I think with things like video and audio it might make more…",null,{"value":64,"source":47,"evidence":65},"Make it easy to add AI to lots of real devices like wearables, speakers and toys",[66],{"id":50},[68,72,76],{"value":69,"source":47,"evidence":70},"ESP32",[71],{"id":50},{"value":73,"source":47,"evidence":74},"WebRTC",[75],{"id":50},{"value":77,"source":47,"evidence":78},"OpenAI Realtime API",[79],{"id":50},"unknown","beta",{"praise":83,"objections":103,"requests":122,"questions":131,"alternatives":139},[84,96],{"value":85,"source":86,"evidence":87},"Fun idea for toys and smart speakers","commenter",[88,92],{"id":89,"by":90,"text":91},"42474816","johanam","Love this! Excited to give it a try.",{"id":93,"by":94,"text":95},"42475201","jonathan-adly","Here is a nice use-case. Put this in a pharmacy - have people hit a button, and ask questions about over-the-counter medications. Really - any physical place where people are…",{"value":97,"source":86,"evidence":98},"Cool application of WebRTC to embedded space",[99],{"id":100,"by":101,"text":102},"42474916","kaycebasques","Took a bit of poking to figure out what the use case is. Doesn't seem to be mentioned in the README (usage section is empty) or the intro above. Looks like the main use case is…",[104,112,116],{"value":105,"source":86,"evidence":106},"README usage section was empty at launch",[107,108],{"id":100,"by":101,"text":102},{"id":109,"by":110,"text":111},"42476138","swatcoder","It doesn't help that this was posted to HN with the \"Usages\" section of the README left blank. That alone would probably have addressed your question. The submission is just a…",{"value":113,"source":86,"evidence":114},"Code practices fall short for good embedded work",[115],{"id":109,"by":110,"text":111},{"value":117,"source":86,"evidence":118},"Medical pharmacy use would face regulatory barriers",[119],{"id":120,"by":110,"text":121},"42476180","> Put this in a pharmacy - have people hit a button, and ask questions about over-the-counter medications. Even if you trust OpenAI's models more than your trained, certified,…",[123,127],{"value":124,"source":86,"evidence":125},"Add a FreeRTOS example or Zephyr integration",[126],{"id":59,"by":60,"text":61},{"value":128,"source":86,"evidence":129},"Present it as a library rather than an application",[130],{"id":109,"by":110,"text":111},[132],{"value":133,"source":86,"evidence":134},"What is the use case for this SDK",[135,136],{"id":100,"by":101,"text":102},{"id":137,"by":101,"text":138},"42475373","\"Use case\" perhaps wasn't the right word for me to use. Maybe \"applications\" would have been a better word. What this enables is speech-to-speech applications in embedded…",[],{"comments":141,"answered":33,"key":142},4,[143,144,147],{"id":56,"text":57},{"id":145,"text":146},"42476837","I will work on making it better! This was announced Tuesday [0] I still need to give it lots of love. Even though the README isn’t completely done, give it a chance I bet you can…",{"id":148,"text":149},"42477101","I’m very curious about what a LLM could deduce if you sent in lots of sensor data. I love my Airthings. It don’t know if it’s actionable, but it would be cool to see what…",{"commenters":151,"max_depth":42,"maker_replies":141,"first_comment_mins":152,"lifespan_hours":153},8,3175,59,[155,157,159,161,163,165,167,171,173,176,179,180,182,184],[100,37,32,156,101,37],"project\u002Fneutral\u002Fdocs",[56,37,37,158,11,33],"maker\u002Fpositive\u002Fidea",[137,37,37,160,101,37],"commenter\u002Fneutral\u002Fdocs",[109,37,32,162,110,37],"project\u002Fmixed\u002Fexecution",[145,37,37,164,11,33],"maker\u002Fneutral\u002Fdocs",[93,33,42,166,94,37],"project\u002Fpositive\u002Fidea",[168,33,37,169,170,37],"42475660","commenter\u002Fneutral\u002Fnone","pixelsort",[120,33,33,172,110,37],"project\u002Fcritical\u002Fidea",[174,33,37,169,175,37],"42476409","dymk",[177,33,37,178,110,37],"42476427","commenter\u002Fcritical\u002Fnone",[59,40,42,166,60,37],[148,40,37,181,11,33],"project\u002Fneutral\u002Fidea",[89,32,42,183,90,37],"project\u002Fpositive\u002Fnone",[185,32,37,158,11,33],"42475077",[],[188,193,198,203,208,213],{"id":189,"name":190,"points":191,"category":192},"42405046","Velofuso",797,"hardware",{"id":194,"name":195,"points":196,"category":197},"42398471","Quantus",279,"learning_science",{"id":199,"name":200,"points":201,"category":202},"42424508","SmartHome",268,"games",{"id":204,"name":205,"points":206,"category":207},"42417330","Buzee",229,"productivity",{"id":209,"name":210,"points":211,"category":212},"42399701","Kubernetes Spec Explorer",216,"dev_tools",{"id":214,"name":215,"points":216,"category":197},"42416258","Chord Nebula",215,19,false,"v2",{"id":221,"name":5,"line":6,"ai":218,"cat":20,"year":13,"points":14,"comments":15,"rec":29,"s":222,"top":18,"kw":223,"maker":11,"domain":10,"tier":19,"attempts":37,"strip":224,"url":9,"mix":225,"praise":85,"objection":105,"sub":21},42451409,0.31,[24,25,26,27,28],"30030501005050",[32,33,33,33],1794036665993]