Introduction
Automatically uncover an optimized system prompt that will drive your system towards high performance
Farsight AI utilizes the leading approach for prompt optimization by incorporating the Prometheus prompt evaluation rubric to evaluate systems prompts and LLM prompt optimization using ORDO.
We automate the entire prompt generation and evaluation process. The system only requires shadow input traffic from your intended use case. Our prompt optimization process works by automating each of the following steps:
Generation of your use case description, an evaluation rubric, an example response based on the given shadow traffic.
Iterative generation of system prompts, improving each iteration by providing previous system prompts and scores.
Finally, we select the few best system prompts for your convenience.
Last updated