News for hackers. Stuff that matters.

przadka

Show HN: Cheddar-bench – unsupervised benchmark for coding agents

https://github.com/przadka/cheddar-bench

I built a small benchmark to test CLI coding agents on blind bug detection.A challenger agent injects bugs and writes ground truth (`bugs.json`). A different reviewer agent audits the repo without seeing ground truth, and an LLM matcher scores bug-to-finding assignments.Current run: 50 repos, 150 challenges, 450 reviews, 2,603 injected bugs.Weighted detection: Claude 58.05%, Codex 37.84%,...

( Read More... | no comments | 3 points | on HN )
Re:The UX of Good Reading on Monday June 23, 2025 @03:05AM (#44353196)
did you read the post? because it looks like you did not
Re:The UX of Good Reading on Monday June 23, 2025 @02:18AM (#44352948)
hi there, I am the author of this post.

> commits those very sins:

you are wrong, let me explain:

1. There is nothing wrong with rhetorical questions per se - I just feel that LLMs often put them between sentences that do not require connection. I would even argue that any LLM would vote against putting the questions I wrote like this because they feel out of place. But I wanted them there.

2. "The solution isn't more polish—it's more humanity" isn't the pattern I'm referring to. The slop pattern is using "This isn't just X—it's Y" for emphasis reinforcement, like "This isn't just wrong—it's baffling." Mine is a simple contrast statement.

Thanks for the comment though - I'm glad a fellow human read it carefully enough to have an opinion on it! :)

Re:Ask HN: Who is hiring? (June 2025) on Tuesday June 03, 2025 @08:59AM (#44169533)
Reef Technologies | Senior Python Backend Engineer | REMOTE

We’re looking for Python backend engineers to work on a trustless supercluster of performance-proofed, GPU-enabled, sandboxed Docker container runners controlled by truly decentralized algorithms (not just PAXOS or RAFT).

Wow, that was a mouthful...

If you found it interesting, join Reef Technologies and tackle complex technical challenges like this on your own terms:

- Contribute from wherever you like - we are fully remote

- Set your own time commitment, as long as it’s at least 30h per week

- See how we work in our handbook: github.com/reef-technologies/handbook

- Influence the way we operate through our Sociocracy 3.0 decision-making process

Salary on a B2B contract:

- $45–$70 USD or 190–295 PLN per hour

- $7,560–$11,760 USD or 31,920–49,560 PLN per month if you work 40 hours per week (most of us work a bit less)

- Flexible work schedule (as measured with a time tracker)

- Rates are automatically adjusted for inflation twice a year

We're looking for someone with 5+ years of programming experience, including at least one year with Python (open source and significant personal projects count!).

So, what do you think? You don't even need a CV - just go to https://careers.reef.pl/?utm_source=hackernews and shoot a few quick commands to apply.

Contact: Email: [email protected]

Company Website: https://reef-technologies.com/

Re:Ask HN: Who is hiring? (May 2025) on Monday May 05, 2025 @03:49AM (#43892753)
Reef Technologies | Senior Python Backend Engineer | REMOTE

We’re looking for Python backend engineers to work on a trustless supercluster of performance-proofed, GPU-enabled, sandboxed Docker container runners controlled by truly decentralized algorithms (not just PAXOS or RAFT).

Wow, that was a mouthful...

If you found it interesting, join Reef Technologies and tackle complex technical challenges like this on your own terms:

- Contribute from wherever you like - we are fully remote

- Set your own time commitment, as long as it’s at least 30h per week

- See how we work in our handbook: github.com/reef-technologies/handbook

- Influence the way we operate through our Sociocracy 3.0 decision-making process

Salary on a B2B contract:

- $45–$70 USD or 190–295 PLN per hour

- $7,560–$11,760 USD or 31,920–49,560 PLN per month if you work 40 hours per week (most of us work a bit less)

- Flexible work schedule (as measured with a time tracker)

- Rates are automatically adjusted for inflation twice a year

We're looking for someone with 5+ years of programming experience, including at least one year with Python (open source and significant personal projects count!).

So, what do you think? You don't even need a CV - just go to https://careers.reef.pl/?utm_source=hackernews and shoot a few quick commands to apply.

Contact: Email: [email protected]

Company Website: https://reef-technologies.com/

Re:Ask HN: Who is hiring? (April 2025) on Thursday April 03, 2025 @04:32AM (#43566625)
Reef Technologies | Senior Python Backend Engineer | REMOTE | Full-time Salary: 45-70 USD per hour. As a full time staff member, we expect a commitment of 30 hours every week, but assuming 40 hours per week, you earn 7560-11760 USD a month. Hourly rates auto-adjusted for inflation.

We're all about the backend! As a fully remote Python software house, we comprise a small, agile team of senior engineers, each with at least five years of experience. We're known for delivering stable solutions and always accounting for edge cases, minimizing the need for urgent fixes.

- Full Remote Flexibility: Work from anywhere.

- Flexible Hours: Pick your own hours.

- Dynamic Projects: Work with startups globally on projects of your choice.

- Influence: Contribute to decisions and influence how we operate thanks to the Sociocracy 3.0 framework.

- Personal assistant for your non-work tasks.

- Multicultural environment with a voice for everyone.

Who Are We Looking For? Experienced Python engineer with at least 5 years of programming (not necessarily professional), including at least a year with Python. Must have a deep love for Python and the ability to come up with Pythonic solutions to problems.

How to Apply: We don't care about CVs. Just go to https://careers.reef.pl/?utm_source=hackernews and see what we're all about!

Contact: Email: [email protected] Company Website: https://reef-technologies.com/

Re:Vibe Coding Manifesto on Friday March 14, 2025 @01:43AM (#43359917)
The 'we' follows the tradition of the Agile Manifesto. This manifesto isn't about speaking for everyone - it's about capturing a movement happening in real-time. If these ideas resonate, you’re part of the 'we' too.
Re:Ask HN: Who is hiring? (March 2025) on Tuesday March 04, 2025 @11:24AM (#43256779)
Reef Technologies | Senior Python Backend Engineer | REMOTE | Full-time Salary: 45-70 USD per hour, or 7560-11760 USD a month (assuming 40 hours per week). Hourly rates auto-adjusted for inflation.

We're all about the backend! As a fully remote Python software house, we comprise a small, agile team of senior engineers, each with at least five years of experience. We're known for delivering stable solutions and always accounting for edge cases, minimizing the need for urgent fixes.

- Full Remote Flexibility: Work from anywhere.

- Flexible Hours: Pick your own hours.

- Dynamic Projects: Work with startups globally on projects of your choice.

- Influence: Contribute to decisions and influence how we operate thanks to the Sociocracy 3.0 framework.

- Personal assistant for your non-work tasks.

- Multicultural environment with a voice for everyone.

Who Are We Looking For? Experienced Python engineer with at least 5 years of programming (not necessarily professional), including at least a year with Python. Must have a deep love for Python and the ability to come up with Pythonic solutions to problems.

How to Apply: We don't care about CVs. Just go to https://careers.reef.pl/ and see what we're all about!

Contact: Email: [email protected] Company Website: https://reef-technologies.com/

Re:Ask HN: Who is hiring? (February 2025) on Wednesday February 05, 2025 @09:23AM (#42948842)
Reef Technologies | Senior Python Backend Engineer | REMOTE | Full-time Salary: 45-70 USD per hour, or 7560-11760 USD a month (assuming 40 hours per week). Hourly rates auto-adjusted for inflation.

We're all about the backend! As a fully remote Python software house, we comprise a small, agile team of senior engineers, each with at least five years of experience. We're known for delivering stable solutions and always accounting for edge cases, minimizing the need for urgent fixes.

- Full Remote Flexibility: Work from anywhere.

- Flexible Hours: Pick your own hours.

- Dynamic Projects: Work with startups globally on projects of your choice.

- Influence: Contribute to decisions and influence how we operate thanks to the Sociocracy 3.0 framework.

- Personal assistant for your non-work tasks.

- Multicultural environment with a voice for everyone.

Who Are We Looking For? Experienced Python engineer with at least 5 years of programming (not necessarily professional), including at least a year with Python. Must have a deep love for Python and the ability to come up with Pythonic solutions to problems.

How to Apply: We don't care about CVs. Just go to https://careers.reef.pl/ and see what we're all about!

Contact: Email: [email protected] Company Website: https://reef-technologies.com/

Re:I compared my daughter against SOTA models on math puzzles on Sunday February 02, 2025 @08:58AM (#42908667)
I tested o3, r1, 4o and other SOTA models against puzzles from an international math competition and compared their performance with my 11-year-old daughter's solutions. Full results include detailed conversations with each model and complete methodology.
Re:Ask HN: Who is hiring? (January 2025) on Monday January 06, 2025 @03:11AM (#42608706)
Reef Technologies | Senior Python Backend Engineer | REMOTE | Full-time Salary: 45-70 USD per hour, or 7560-11760 USD a month (assuming 40 hours per week). Hourly rates auto-adjusted for inflation.

We're all about the backend! As a fully remote Python software house, we comprise a small, agile team of senior engineers, each with at least five years of experience. We're known for delivering stable solutions and always accounting for edge cases, minimizing the need for urgent fixes.

- Full Remote Flexibility: Work from anywhere.

- Flexible Hours: Pick your own hours.

- Dynamic Projects: Work with startups globally on projects of your choice.

- Influence: Contribute to decisions and influence how we operate thanks to the Sociocracy 3.0 framework.

- Personal assistant for your non-work tasks.

- Multicultural environment with a voice for everyone.

Who Are We Looking For? Experienced Python engineer with at least 5 years of programming (not necessarily professional), including at least a year with Python. Must have a deep love for Python and the ability to come up with Pythonic solutions to problems.

How to Apply: We don't care about CVs. Just go to https://careers.reef.pl/ and see what we're all about!

Contact: Email: [email protected] Company Website: https://reef-technologies.com/

Re:Ask HN: Who is hiring? (December 2024) on Tuesday December 03, 2024 @12:19AM (#42303251)
Reef Technologies | Senior Python Backend Engineer | REMOTE | Full-time Salary: 45-70 USD per hour, or 7560-11760 USD a month (assuming 40 hours per week). Hourly rates typically adjusted annually.

We’re all about the backend! As a fully remote Python software house, we comprise a small, agile team of senior engineers, each with at least five years of experience. We're known for delivering stable solutions and always accounting for edge cases, minimizing the need for urgent fixes.

- Full Remote Flexibility: Work from anywhere.

- Flexible Hours: Pick your own hours, with only ~2 calls per week.

- Dynamic Projects: Work with startups globally on projects of your choice.

- Influence: Contribute to decisions and influence how we operate.

- Project Selection: Only accept projects you're interested in.

- No managers; thanks to the Sociocracy 3.0 framework, everyone's opinion is valued.

- Personal assistant for your non-work tasks.

- Multicultural environment with a voice for everyone.

Who Are We Looking For? Experienced Python engineer with at least 5 years of programming (not necessarily professional), including at least a year with Python. Must have a deep love for Python and the ability to come up with Pythonic solutions to problems.

How to Apply: Just go to https://careers.reef.pl/ and see what we’re all about! Do not send us CVs.

Contact: Email: [email protected] Company Website: https://reef-technologies.com/

Re:Ask HN: Who is hiring? (November 2024) on Tuesday November 05, 2024 @12:29PM (#42053487)
Reef Technologies | Senior Python Backend Engineer | REMOTE | Full-time Salary: 45-70 USD per hour, or 7560-11760 USD a month (assuming 40 hours per week). Hourly rates typically adjusted annually.

We’re all about the backend! As a fully remote Python software house, we comprise a small, agile team of senior engineers, each with at least five years of experience. We're known for delivering stable solutions and always accounting for edge cases, minimizing the need for urgent fixes.

- Full Remote Flexibility: Work from anywhere.

- Flexible Hours: Pick your own hours, with only ~2 calls per week.

- Dynamic Projects: Work with startups globally on projects of your choice.

- Influence: Contribute to decisions and influence how we operate.

- Project Selection: Only accept projects you're interested in.

- No managers; thanks to the Sociocracy 3.0 framework, everyone's opinion is valued.

- Personal assistant for your non-work tasks.

- Multicultural environment with a voice for everyone.

Who Are We Looking For? Experienced Python engineer with at least 5 years of programming (not necessarily professional), including at least a year with Python. Must have a deep love for Python and the ability to come up with Pythonic solutions to problems.

How to Apply: Just go to https://careers.reef.pl/ and see what we’re all about! Do not send us CVs.

Contact: Email: [email protected] Company Website: https://reef-technologies.com/

Re:Ask HN: Who is hiring? (October 2024) on Wednesday October 02, 2024 @11:53AM (#41721910)
Reef Technologies | Senior Python Backend Engineer | REMOTE | Full-time Salary: 45-70 USD per hour, or 7560-11760 USD a month (assuming 40 hours per week). Hourly rates typically adjusted annually.

We’re all about the backend! As a fully remote Python software house, we comprise a small, agile team of senior engineers, each with at least five years of experience. We're known for delivering stable solutions and always accounting for edge cases, minimizing the need for urgent fixes.

- Full Remote Flexibility: Work from anywhere.

- Flexible Hours: Pick your own hours, with only ~2 calls per week.

- Dynamic Projects: Work with startups globally on projects of your choice.

- Influence: Contribute to decisions and influence how we operate.

- Project Selection: Only accept projects you're interested in.

- No managers; thanks to the Sociocracy 3.0 framework, everyone's opinion is valued.

- Personal assistant for your non-work tasks.

- Multicultural environment with a voice for everyone.

Who Are We Looking For? Experienced Python engineer with at least 5 years of programming (not necessarily professional), including at least a year with Python. Must have a deep love for Python and the ability to come up with Pythonic solutions to problems.

How to Apply: Just go to https://careers.reef.pl/ and see what we’re all about! Do not send us CVs.

Contact: Email: [email protected] Company Website: https://reef-technologies.com/

Re:Ask HN: Who is hiring? (September 2024) on Tuesday September 03, 2024 @03:17AM (#41432189)
We do not. We cooperate on b2b/contractor basis.
Re:Ask HN: Who is hiring? (September 2024) on Tuesday September 03, 2024 @03:14AM (#41432168)
Thanks!
Re:Ask HN: Who is hiring? (September 2024) on Tuesday September 03, 2024 @03:14AM (#41432167)
<3
Re:Ask HN: Who is hiring? (September 2024) on Tuesday September 03, 2024 @03:14AM (#41432165)
Thank you!
Re:Ask HN: Who is hiring? (September 2024) on Monday September 02, 2024 @12:10PM (#41426616)
Reef Technologies | Senior Python Backend Engineer | REMOTE | Full-time Salary: 45-70 USD per hour, or 7560-11760 USD a month (assuming 40 hours per week). Hourly rates typically adjusted annually.

We’re all about the backend! As a fully remote Python software house, we comprise a small, agile team of senior engineers, each with at least five years of experience. We're known for delivering stable solutions and always accounting for edge cases, minimizing the need for urgent fixes.

- Full Remote Flexibility: Work from anywhere.

- Flexible Hours: Pick your own hours, with only ~2 calls per week.

- Dynamic Projects: Work with startups globally on projects of your choice.

- Influence: Contribute to decisions and influence how we operate.

- Project Selection: Only accept projects you're interested in.

- No managers; thanks to the Sociocracy 3.0 framework, everyone's opinion is valued.

- Personal assistant for your non-work tasks.

- Multicultural environment with a voice for everyone.

Who Are We Looking For? Experienced Python engineer with at least 5 years of programming (not necessarily professional), including at least a year with Python. Must have a deep love for Python and the ability to come up with Pythonic solutions to problems.

How to Apply: Just go to https://careers.reef.pl/ and see what we’re all about! Do not send us CVs.

Contact: Email: [email protected] Company Website: https://reef-technologies.com/

Re:Ask HN: Who is hiring? (August 2024) on Saturday August 03, 2024 @01:59AM (#41144936)
Reef Technologies | Senior Python Backend Engineer | REMOTE | Full-time Salary: 45-70 USD per hour, or 7560-11760 USD a month (assuming 40 hours per week). Hourly rates typically adjusted annually.

We’re all about the backend! As a fully remote Python software house, we comprise a small, agile team of senior engineers, each with at least five years of experience. We're known for delivering stable solutions and always accounting for edge cases, minimizing the need for urgent fixes.

- Full Remote Flexibility: Work from anywhere.

- Flexible Hours: Pick your own hours, with only ~2 calls per week.

- Dynamic Projects: Work with startups globally on projects of your choice.

- Influence: Contribute to decisions and influence how we operate.

- Project Selection: Only accept projects you're interested in.

- No managers; thanks to the Sociocracy 3.0 framework, everyone's opinion is valued.

- Personal assistant for your non-work tasks.

- Multicultural environment with a voice for everyone.

Who Are We Looking For? Experienced Python engineer with at least 5 years of programming (not necessarily professional), including at least a year with Python. Must have a deep love for Python and the ability to come up with Pythonic solutions to problems.

How to Apply: Just go to https://careers.reef.pl/ and see what we’re all about! Do not send us CVs.

Contact: Email: [email protected] Company Website: https://reef-technologies.com/

Re:Ask HN: Who is hiring? (July 2024) on Wednesday July 03, 2024 @09:42AM (#40865893)
Reef Technologies | Senior Python Backend Engineer | REMOTE | Full-time Salary: 45-70 USD per hour, or 7560-11760 USD a month (assuming 40 hours per week). Hourly rates typically adjusted annually.

We’re all about the backend! As a fully remote Python software house, we comprise a small, agile team of senior engineers, each with at least five years of experience. We're known for delivering stable solutions and always accounting for edge cases, minimizing the need for urgent fixes.

- Full Remote Flexibility: Work from anywhere.

- Flexible Hours: Pick your own hours, with only ~2 calls per week.

- Dynamic Projects: Work with startups globally on projects of your choice.

- Influence: Contribute to decisions and influence how we operate.

- Project Selection: Only accept projects you're interested in.

- No managers; thanks to the Sociocracy 3.0 framework, everyone's opinion is valued.

- Personal assistant for your non-work tasks.

- Multicultural environment with a voice for everyone.

Who Are We Looking For? Experienced Python engineer with at least 5 years of programming (not necessarily professional), including at least a year with Python. Must have a deep love for Python and the ability to come up with Pythonic solutions to problems.

How to Apply: Just go to https://careers.reef.pl/ and see what we’re all about! Do not send us CVs.

Contact: Email: [email protected] Company Website: https://reef-technologies.com/

Re:Ask HN: Who is hiring? (June 2024) on Wednesday June 12, 2024 @04:57AM (#40656001)
All three :) It is hard to find great developers, our services are in demand and we are expanding our team. Thanks for the comment!
Re:Ask HN: Who is hiring? (June 2024) on Wednesday June 05, 2024 @04:35AM (#40582707)
Thank you!
Re:Ask HN: Who is hiring? (June 2024) on Tuesday June 04, 2024 @03:06AM (#40571486)
Reef Technologies | Senior Python Backend Engineer | REMOTE | Full-time Salary: 45-70 USD per hour, or 7560-11760 USD a month (assuming 40 hours per week). Hourly rates typically adjusted annually.

We’re all about the backend! As a fully remote Python software house, we comprise a small, agile team of senior engineers, each with at least five years of experience. We're known for delivering stable solutions and always accounting for edge cases, minimizing the need for urgent fixes.

- Full Remote Flexibility: Work from anywhere.

- Flexible Hours: Pick your own hours, with only ~2 calls per week.

- Dynamic Projects: Work with startups globally on projects of your choice.

- Influence: Contribute to decisions and influence how we operate.

- Project Selection: Only accept projects you're interested in.

- No managers; thanks to the Sociocracy 3.0 framework, everyone's opinion is valued.

- Personal assistant for your non-work tasks.

- Multicultural environment with a voice for everyone.

Who Are We Looking For? Experienced Python engineer with at least 5 years of programming (not necessarily professional), including at least a year with Python. Must have a deep love for Python and the ability to come up with Pythonic solutions to problems.

How to Apply: Just go to https://careers.reef.pl/ and see what we’re all about! Do not send us CVs.

Contact: Email: [email protected] Company Website: https://reef-technologies.com/

Re:Ask HN: Who is hiring? (May 2024) on Tuesday May 07, 2024 @01:45AM (#40282744)
Thanks for your comment. As I wrote in another reply: The screenshot feature is enabled to allow team members to review their past activities for accurate tracking. Beyond that specific use, we don't review screenshots. We considered building an internal solution where screenshots would be stored locally, but ultimately decided Hubstaff meets our needs.
Re:Ask HN: Who is hiring? (May 2024) on Tuesday May 07, 2024 @01:44AM (#40282732)
Thanks for your comment. We understand that productive work isn’t limited to keyboard or mouse activity. Meetings, brainstorming sessions, or time spent problem-solving all count as billable hours and are accounted for accordingly in Hubstaff.

Older »