函数 getLangchainStringEvaluator

参数

• type: "criteria" | "labeled_criteria"

  字符串评估器类型，可以是 "criteria" 或 "labeled_criteria
• options: EmbeddingDistanceEvalChainInput & {
      agentTools?: StructuredToolInterface<ZodObjectAny>[];
      chainOptions?: Partial<
          Omit<
              LLMEvalChainInput<
                  EvalOutputType,
                  BaseLanguageModelInterface<any, BaseLanguageModelCallOptions>,
              >,
              "llm",
          >,
      >;
      criteria?: CriteriaLike;
      llm?: BaseLanguageModelInterface<any, BaseLanguageModelCallOptions>;
  } & {
      formatEvaluatorInputs?: (
          run: Run,
          example: Example,
      ) => { prediction: string; input?: string; reference?: string };
  }

  加载评估器的选项

  • 可选agentTools?: StructuredToolInterface<ZodObjectAny>[]

    代理可用的工具列表，用于 TrajectoryEvalChain。

  • 可选chainOptions?: Partial<
        Omit<
            LLMEvalChainInput<
                EvalOutputType,
                BaseLanguageModelInterface<any, BaseLanguageModelCallOptions>,
            >,
            "llm",
        >,
    >

  • 可选criteria?: CriteriaLike

    评估器使用的标准。

  • 可选llm?: BaseLanguageModelInterface<any, BaseLanguageModelCallOptions>

  • 可选formatEvaluatorInputs?: (
        run: Run,
        example: Example,
    ) => { prediction: string; input?: string; reference?: string }