inference • AI Agents Framework

inference: API reference for TrainModel.inference

inference

Method

This is a method of the TrainModel class in the train module.

Signature

def inference(instruction: Any, input_text: Any) -> Any

Parameters

instruction · Any · required

No description available.

input_text · Any · required

No description available.

Returns

Returns · Any

The result of the operation.

Uses

• FastLanguageModel.for_inference
• to
• apply_chat_template
• generate
• batch_decode

Source

View on GitHub

praisonai/train.py at line 266