AI Code Detector
Dev tools
ai code detection
SHOW HN2025
How HN took it
5 positive, 19 neutral or asking, 3 mixed, 14 critical, out of 41 comments about the project. Thread score -0.28.
Performance: 0 for, 12 againstIdea: 3 for, 1 againstExecution: 1 for, 1 againstDocs: 1 for, 0 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Impressive results and useful for engineering leaders.
From 4 comments
As a leader this is actually really neat - going to give it a spin
mechen on HNJust tried. Actually quite impressed with how well it works. I avoid using AI to write code, I'm a little worried that the existence of detection tools like this will lead people…
ht-syseng on HNMy engineers didn’t know how much they used AI for vibe coding until I used Span. Can confirm we were all left with jaws on the floor. Now re-thinking my hiring plan for the next…
khanna_ayush on HNJust tried it out and it works :mind-blown:
mechen on HN
Objections
95% accuracy yields too many false positives for consequential use.
From 2 comments
A 95% accuracy is very low for this type of thing. People use this to enact administrative consequences. People's lives are ruined and 5% is too high of a false positive rate.…
kittikitti on HNI can detect AI-generated code with 100% accuracy, provided you give me an unlimited budget for false positives. It's a bit of a useless metric.
bigyabai on HN
Easy to evade by editing AI code to look human-written.
From 3 comments
I feel like code fed into this detector can be manipulated to increase false positives. The model probably learns patterns that are common in generated text (clean comments, AI…
mendeza on HNCould I use this to iterate over my AI generated code until it's not detectable anymore? So essentially the moment you publish this tool it stops working?
jensneuse on HNWhat if I just modify the code to misspell things that no AI would misspell?
jakderrida on HN
Gave wrong results on human and AI test code.
From 3 comments
It told me my ~10 year old js project was 50% AI generated. Yeah, this is more or less the same as "AI text detector" stuff that won't work reliably (but people who don't…
yamalight on HNVery cool! I wonder if it performs differently on actual “production” code versus random tests? I opened ChatGPT, typed a random non-sensical prompt, copy-pasted the response[1]…
simanyay on HNAnd false negatives. I just pasted 100% AI generated code and it told me it's only 40% AI written.
thirdacc on HN
Only supports TypeScript and Python; other languages missing.
From 2 comments
- The maker's post
Only Python, TypeScript and JavaScript? Well there go my vibe-coded elisp scripts. I guess it's impossible (or really hard) to train a language-agnostic classifier. Reference,…
mannicken on HN
Requests
Support for Java, Ruby, C# and C.
From 3 comments
Very cool piece of tech, I would suggest putting C on the priority list and then Java. Mainly because Unis and Colleges use one of them or both, so that would be a good use case
Alifatisk on HNTotally – we have support for Java, C#, and Ruby in the works. Edit: since you mentioned universities, are you thinking about AI detection for student work, e.g. like a…
johnsillings on HNGlad to hear Ruby is being in the list as well! When it comes to the unis, I was thinking of both AI detection for student work. I mean like plagiarism checkers are common…
Alifatisk on HN
CLI or CI/CD integration.
From 2 comments
Would be amazing to have a CLI tool that detects AI generated code (even add it as part of CI/CD pipelines). I'm tired of all the AI trash PRs
icemanx on HNIt is possible to use this via the command line today. I'll ask Henry to have a look & comment here (or grab a demo and leave a note, we'll give you some more details).
johnsillings on HN
Option to skip comments when analysing code.
From 1 comment
I wonder if you could add a toggle to only examine only source and skip comments.
jftuga on HN
Questions
What is the pricing and is it B2B or B2C?
From 2 comments
what will the pricing be? i guess this is just a super early demo, I want to hear your pricing plan. Also, is this B2B or B2C?
jimmydin7 on HNYou're saying "Understand and report on impact by AI coding tool". How can you drill down into per-coding assistant usage? Also, what's the pricing?
jjmarr on HN
What are precision and recall, and what is the false positive rate?
From 3 comments
Accuracy is a useless statistic: give us precision and recall.
samfriedman on HNI wonder how many false positives it has
p0w3n3d on HNRecall 91.5, F1 93.3
henryl on HN
Can it show usage per coding assistant?
From 1 comment
You're saying "Understand and report on impact by AI coding tool". How can you drill down into per-coding assistant usage? Also, what's the pricing?
jjmarr on HN