Needle2

Its pretty significant you've got this working locally in wasm. Very cool. Re: robotics: I'm unsure how this could be helpful. It fails a pretty simple navigation prompt. X0:…

This is cool! While most of the industry focuses on the frontier of “intelligence” (function), a release like this represents the frontier of the other end of the spectrum…

Utterly Fascinating! For the longest time, I conceptualized LLM's as Text Input -> Text Output transformers, then later as Text Input -> Video Output transformers. Later still I…

Looks incredibly cool, although it ran at ~4 tok/s on my browser (I assume because I've disabled V8). I believe your numbers though. I always wanted to try using something like…

My first query: > Make it a little warmer in here. The reply: > "name": "set_thermostat", > "arguments": { > "temperature": 65, > "mode": "cool", > ... > "reasoning": "'warmer'…

> turn on the tv { "function_calls": [ { "name": "lock_door", "arguments": { "door": "tv" } } ], "confidence": 0.0158 } Very interesting, seems confidence is 0 when tool calls…

> Turn the lights down low in the bedroom Sets lights to 30% but also off > Turn the lights low in the bedroom Sets lights to on This is a cool idea but I think humans assume…

Specifying units seems to be unreliable; I tried adding a description to the set_thermostat temperature: ``` "temperature": { "type": "number", "description": "degrees…

> set lights on { "function_calls": [ { "name": "set_lights", "arguments": { "room": "bedroom", "state": "on" } } ], "confidence": 0 } is confidence 0 that its confident?

I tested with ``` import needle @needle.tool def add(a: int, b: int): "Add two numbers." return a + b agent = needle.Needle(tools=[add]) print(agent.run("calculate 1 +…

It seems to fail. I sent the prompt: “ 5° warmer” And it said: “ setting the temperature to 5°F”

Any plan to release on ollama?

Any instructions available for running this on an ESP32-S3 or P4 like the site says?

I tried using it on my x86_64 desktop. Could not use it. Then I tried using it on a raspberry pi 4. Did not work. This is specifically for 64 bit arm. I see no reason why you…

If you want Needle2 to rget lots of testing, become well known, etc - make a Home Assistant plugin.

This is cool. I definitely think the "micro" sized LLM space is underappreciated, so it's always good to see work like this. I foresee a paradigm in some contexts where you have…

Curious, why did you go down to 2bit rather than 4 bits? 4bit with folding the layers should arrive at the same size, but with better quality?

Congratulations. 28MB is impressive, I've not played around with actual queries/outputs. I'm wondering what is the overall thesis/plan here and where exactly the innovation lies?…

Congratulations. 28MB is impressive, I've not played around with actual queries/outputs. I'm wondering what is the overall thesis/plan here and where exactly the innovation lies?…

That's really cool - I was already thinking of compressing `functiongemma-270m-it` down to 1-2 bits so it would work flawlessly in the browser. Your `Fine-tuning` feature is even…