#mutation-generation

[ follow ]
fromHackernoon
1 year ago

How Prompt Complexity Affects GPT-3.5 Mutation Generation Accuracy | HackerNoon

The comparisons reveal that GPT-3.5 excels in bug detection with the highest rates on Defects4J and ConDefects, showcasing its powerful mutation generation capabilities.
Growth hacking
fromHackernoon
1 year ago

Mutation Testing with GPT and CodeLlama | HackerNoon

Mutation testing enhances software reliability by identifying weaknesses in test suites through strategic code mutations.
fromHackernoon
1 year ago

Comparing Costs, Usability and Results Diversity of Mutation Testing Techniques | HackerNoon

The analysis reveals that while GPT-3.5 and CodeLlama-30bInstruct generate a higher number of mutations, traditional methods are significantly faster with lower costs.
Scala
Scala
fromHackernoon
1 year ago

Evaluating GPT and Open-Source Models on Code Mutation Tasks | HackerNoon

Closed-source LLMs generally outperform open-source models in key metrics.
GPT-4 excels in usability while GPT-3.5 is best for rapid mutation generation.
[ Load more ]