Show HN: Parsimony тАУ an open-source benchmark for how much code AI models add
рдкрд░рд┐рдЪрдп
Existing benchmarks measure solve rate and token output/cost, but don't punish excess code, which makes a codebase harder to work with in the long term. I wanted to measure this since it matters most for long-term projects.<p>Method: it takes the patches that benchmarks already publish (DeepSWE, SWE-bench Verified, SWE-bench Live) and counts "coding units": syntax elements like statements, calls, names and literals. I didn't use lines of code, so cramming code isn't
рд╕рдХрд╛рд░рд╛рддреНрдордХ рдмрд┐рдВрджреБ
рдирдХрд╛рд░рд╛рддреНрдордХ рдмрд┐рдВрджреБ
рд╕рд╛рдорд╛рдиреНрдп рдкреНрд░рд╢реНрди
O que ├й o Show HN: Parsimony тАУ an open-source benchmark for how much code AI models add?
O Show HN: Parsimony тАУ an open-source benchmark for how much code AI models add tem vers├гo gratuita?
Quais s├гo as melhores alternativas ao Show HN: Parsimony тАУ an open-source benchmark for how much code AI models add?
рдЖрдкрдХреЛ рдпреЗ рднреА рдкрд╕рдВрдж рдЖ рд╕рдХрддреЗ рд╣реИрдВ
ChatGPT
OpenAI рдХрд╛ AI рдЪреИрдЯ рдЕрд╕рд┐рд╕реНрдЯреЗрдВрдЯ
Windsurf
рдкреНрд░реЛрдЧреНрд░рд╛рдорд┐рдВрдЧ рдХреЗ рд▓рд┐рдП рдПрдХреАрдХреГрдд рдПрдЬреЗрдВрдЯ рдХреЗ рд╕рд╛рде IDE
Replit Agent
Replit рдкрд░ рдРрдкреНрд╕ рдмрдирд╛рдиреЗ рдФрд░ рдкреНрд░рдХрд╛рд╢рд┐рдд рдХрд░рдиреЗ рд╡рд╛рд▓рд╛ рдПрдЬреЗрдВрдЯ