Package io.codemodder.testutils.llm

Interface LLMVerifyingCodemodTestMixin

All Superinterfaces:

io.codemodder.testutils.CodemodTestMixin

public interface LLMVerifyingCodemodTestMixin
extends io.codemodder.testutils.CodemodTestMixin

A mixin for codemod tests that use the LLM framework to change the code.

Nested Class Summary

Nested Classes

Modifier and Type	Interface	Description
static final class	LLMVerifyingCodemodTestMixin.Assessment
static enum	LLMVerifyingCodemodTestMixin.AssessmentResult

Field Summary

Fields

Modifier and Type	Field	Description
static final String	SYSTEM_MESSAGE_TEMPLATE
static final String	USER_MESSAGE_TEMPLATE

Method Summary

Modifier and Type	Method	Description
String	getRequirementsPrompt()	If a codemod's changes don't exactly match the .java.after file, the LLM will use these requirements to assess whether the changes are similar enough to pass the test.
default void	verifyTransformedCode(Path before, Path expected, Path after)

Methods inherited from interface io.codemodder.testutils.CodemodTestMixin

generateTestCases

Field Details

SYSTEM_MESSAGE_TEMPLATE

static final String SYSTEM_MESSAGE_TEMPLATE

See Also:

• Constant Field Values

USER_MESSAGE_TEMPLATE

static final String USER_MESSAGE_TEMPLATE

See Also:

• Constant Field Values

Method Details

getRequirementsPrompt

String getRequirementsPrompt()

If a codemod's changes don't exactly match the .java.after file, the LLM will use these requirements to assess whether the changes are similar enough to pass the test.

verifyTransformedCode

default void verifyTransformedCode(Path before,
 Path expected,
 Path after)
                            throws IOException

Specified by:

verifyTransformedCode in interface io.codemodder.testutils.CodemodTestMixin

Throws:

IOException