Farsight AI Starter Docs
  • Get Started
    • Welcome to the Farsight AI Starter Library
      • Overview
      • Getting Started
  • Metrics
    • Standard Metrics
    • Custom Metrics
  • Fully Automated Prompt Optimization
    • Introduction
      • Tutorial
    • Generation and Evaluation
  • Step by Step Prompt Optimization
    • Introduction
      • Tutorial
    • Prompt Generation
    • Prompt Evaluation
      • Rubric Development
Powered by GitBook
On this page
  1. Step by Step Prompt Optimization

Introduction

Generate and evaluate your system prompts with more manual control / oversight

PreviousGeneration and EvaluationNextTutorial

Last updated 1 year ago

In addition to our entirely automated prompt optimization method, Farsight provides access to generation and evaluation features, allowing you to customize the development process according to your specific needs.

To discover your optimized prompt, we recommend the following workflow:

  1. prompts using our prompt generation functionality (we recommend starting with 5).

  2. Generate outputs using your preferred language model (e.g., Mistral, ChatGPT, Llama).

  3. using our prompt evaluation function or any of our additional metrics.

Continue with these steps to get started on prompt optimization.

Generate several system
Evaluate the results