Algo Rec Hybrid Agent Skill

Hybrid Recommendation System

Overview

Hybrid recommendation combines multiple strategies (CF, content-based, knowledge-based) to overcome individual method limitations. Common architectures: weighted, switching, cascade, feature augmentation, and meta-level. Complexity varies by architecture.

When to Use

Trigger conditions:

• Building a production recommendation system that must handle cold start AND personalization
• Single methods have known weaknesses for your use case
• Need to balance accuracy, diversity, and coverage

When NOT to use:

• When you have a single clean data source (start with the matching single method first)
• When system simplicity is more important than marginal accuracy gains

Algorithm

IRON LAW: Hybrid Adds Value ONLY With Complementary Strengths
Combining two systems with the SAME weakness amplifies the weakness.
CF fails on cold start + content-based fails on cold start = hybrid
STILL fails on cold start. Choose components that cover each other's gaps.

Phase 1: Input Validation

Identify available data: interaction history (for CF), item features (for content-based), contextual signals (time, device, location). Map data to method capabilities.

Gate: At least two complementary data sources available.

Phase 2: Core Algorithm

Weighted hybrid: Score = α × CF_score + β × CB_score. Tune weights via cross-validation.

Switching hybrid: Use CF when sufficient data exists; switch to content-based for cold start items/users.

Cascade hybrid: First stage filters (e.g., content-based), second stage ranks (e.g., CF) within filtered set.

Feature augmentation: Use one method's output as input features for another (e.g., CF embeddings as content features).

Phase 3: Verification

A/B test hybrid vs individual components. Measure: accuracy (NDCG, precision@K), coverage (% of catalog recommended), diversity (intra-list diversity).

Gate: Hybrid outperforms best individual component on primary metric.

Phase 4: Output

Return recommendations with source attribution for explainability.

Output Format

{
  "recommendations": [{"item_id": "789", "score": 0.91, "sources": {"cf": 0.85, "content": 0.95}, "method": "weighted"}],
  "metadata": {"architecture": "weighted", "weights": {"cf": 0.6, "content": 0.4}, "coverage": 0.78}
}

Examples

Sample I/O

Input: New user with 2 interactions + rich item feature catalog

Expected: Switching hybrid: content-based recommendations (insufficient CF data), transitioning to CF as interactions accumulate

Edge Cases

| Input | Expected | Why |

|-------|----------|-----|

| Completely new user + new item | Fall back to popularity | No data for either method |

| Methods disagree strongly | Depends on architecture | Weighted averages; cascade defers to second stage |

| One component returns empty | Other component takes over | Graceful degradation |

Gotchas

• Complexity cost: Each added component increases latency, maintenance, and debugging difficulty. Start simple, add complexity only when justified by metrics.
• Weight tuning: Static weights degrade over time. Retune periodically or use learned weights (e.g., a meta-model that predicts which component performs best per context).
• Evaluation is harder: You must evaluate the hybrid AND each component individually to understand contribution and detect regressions.
• Feature leakage: In feature augmentation, ensure the augmenting model's predictions don't leak test-set information during training.
• Diminishing returns: Going from one method to two gives the biggest lift. Adding a third rarely justifies the complexity.

References

• For architecture selection decision guide, see references/architecture-selection.md
• For A/B testing recommendation systems, see references/ab-testing-recs.md