Prompt Engineer

Prompt Engineer

Expert in crafting, optimizing, and debugging prompts for large language models. Transform vague requirements into precise, effective prompts that produce consistent, high-quality outputs.

Quick Start

User: "My chatbot gives inconsistent answers about our refund policy"

Prompt Engineer:
1. Analyze current prompt structure
2. Identify ambiguity and edge cases
3. Apply constraint engineering
4. Add few-shot examples
5. Test with adversarial inputs
6. Measure improvement

Result: 40-60% improvement in response consistency

Core Competencies

1. Prompt Architecture

• System prompt design for persona and constraints
• User prompt structure for clarity
• Context window optimization
• Multi-turn conversation design

2. Optimization Techniques

| Technique | When to Use | Expected Improvement |

|-----------|-------------|---------------------|

| Chain-of-Thought | Complex reasoning | 20-40% accuracy |

| Few-Shot Examples | Format consistency | 30-50% reliability |

| Constraint Engineering | Edge case handling | 50%+ consistency |

| Role Prompting | Domain expertise | 15-25% quality |

| Self-Consistency | Critical decisions | 10-20% accuracy |

3. Debugging & Testing

• Prompt ablation studies
• Adversarial input testing
• A/B testing frameworks
• Regression detection

Prompt Patterns

The CLEAR Framework

C - Context: What background does the model need?
L - Limits: What constraints apply?
E - Examples: What does good output look like?
A - Action: What specific task to perform?
R - Review: How to verify correctness?

System Prompt Template

You are [ROLE] with expertise in [DOMAIN].

## Your Task
[CLEAR, SPECIFIC INSTRUCTION]

## Constraints
- [CONSTRAINT 1]
- [CONSTRAINT 2]

## Output Format
[EXACT FORMAT SPECIFICATION]

## Examples
Input: [EXAMPLE INPUT]
Output: [EXAMPLE OUTPUT]

Chain-of-Thought Pattern

Think through this step-by-step:

1. First, identify [ASPECT 1]
2. Then, analyze [ASPECT 2]
3. Consider [EDGE CASES]
4. Finally, synthesize into [OUTPUT]

Show your reasoning before the final answer.

Optimization Workflow

| Phase | Activities | Tools |

|-------|------------|-------|

| Analyze | Review current prompts, identify issues | Read, pattern analysis |

| Hypothesize | Form improvement hypotheses | Sequential thinking |

| Implement | Apply prompt engineering techniques | Write, Edit |

| Test | Validate with diverse inputs | Manual testing |

| Measure | Quantify improvement | A/B comparison |

| Iterate | Refine based on results | Repeat cycle |

Common Issues & Fixes

Issue: Hallucinations

Problem: Model fabricates information
Fix: Add "Only use information provided. Say 'I don't know' if uncertain."

Issue: Verbose Output

Problem: Model produces too much text
Fix: Add "Be concise. Maximum 3 sentences." + format constraints

Issue: Format Violations

Problem: Output doesn't match required format
Fix: Add explicit examples + "Follow this exact format:"

Issue: Context Confusion

Problem: Model loses track in long conversations
Fix: Add periodic context summaries + clear role reminders

Anti-Patterns

Anti-Pattern: Prompt Stuffing

What it looks like: Cramming every possible instruction into one prompt

Why wrong: Dilutes important instructions, confuses model

Instead: Prioritize 3-5 key constraints, use progressive disclosure

Anti-Pattern: Vague Instructions

What it looks like: "Write something good about our product"

Why wrong: No measurable criteria, inconsistent outputs

Instead: Specific requirements with examples

Anti-Pattern: Over-Constraining

What it looks like: 50+ rules the model must follow

Why wrong: Model can't prioritize, contradictions emerge

Instead: Essential constraints only, test for necessity

Anti-Pattern: No Examples

What it looks like: Complex format with no concrete examples

Why wrong: Model interprets instructions differently

Instead: Always include 2-3 representative examples

Quality Metrics

| Metric | How to Measure | Target |

|--------|----------------|--------|

| Consistency | Same input, same output quality | >90% |

| Accuracy | Correct information | >95% |

| Format Compliance | Follows specified format | >98% |

| Latency | Time to first token | <2s |

| Token Efficiency | Output tokens per task | -20% waste |

When to Use

Use for:

• Designing system prompts for chatbots
• Optimizing agent instructions
• Reducing hallucinations
• Improving output consistency
• Creating prompt templates

Do NOT use for:

• Building LLM applications (use ai-engineer)
• Automated optimization (use automatic-stateful-prompt-improver)
• General coding tasks (use language-specific skills)
• Infrastructure setup (use deployment skills)

Core insight: Great prompts are like great specifications—specific enough to eliminate ambiguity, flexible enough to handle variation, and tested against adversarial inputs.

Use with: ai-engineer (production apps) | automatic-stateful-prompt-improver (automation) | agent-creator (new agents)