All projects
V1 Delivered — YouTubeMulti-Channel Architecture in Progress

Competitive Intelligence Automation Platform

A YouTube-first, operator-triggered data and AI workflow that collects public competitor signals, structures and validates them, and produces traceable competitive-intelligence reports.

Freelance project delivered through HEMLE Consulting France for Les Préparations de l'Apothicaire.

  • Google Apps Script
  • Google Sheets
  • YouTube Data API v3
  • Claude Code
  • JSON
  • Markdown
  • Versioned prompt rules

01 · Overview

From public signals to traceable intelligence.

The Challenge

Digital competitor activity is dispersed across platforms and expensive to monitor consistently. The engineering challenge was to reduce repetitive collection and consolidation work without hiding missing data, failed collection cycles or the limits of AI interpretation.

The Vision

A multi-channel intelligence system built from isolated source collectors, a shared normalization model, persistent structured storage, a controlled AI analysis layer and repeatable reporting. Meta/Instagram and TikTok remain evaluated or planned channels, not delivered capabilities.

What I Delivered — V1

A YouTube-focused vertical slice covering collection, structured storage, validation, read-only AI analysis and local reporting. It is automated on demand rather than fully autonomous.

  • Modular Apps Script collector
  • Canonical normalization and deduplication
  • Raw and exploitable Sheets storage
  • Retries, quota handling and run logs
  • Read-only Claude analysis workflow
  • JSON snapshots and Markdown reports
  • Versioned analysis safeguards
  • Runbook and delivery documentation

02 · Architecture

V1 execution architecture

Collection and analysis are deliberately decoupled: Google handles data ingestion and storage; the local analysis workflow reads approved data without writing back.

YouTube Data API v3

Public channel and recent-video metadata.

Apps Script collector

API calls, retries, normalization and orchestration.

Google Sheets

Raw records, canonical records and execution logs.

Read-only analysis

Claude reads approved tabs without writing to Google.

JSON snapshots

Dated factual state for traceability and comparison.

Markdown report

Rule-constrained, traceable intelligence output.

03 · Data Pipeline

Deterministic processing before probabilistic analysis.

01

Ingest

02

Normalize

03

Deduplicate

04

Validate cycle

05

Snapshot

06

AI analysis

07

Report & log

Engineering Decisions

ED-01

Separate collection from analysis

Apps Script owns collection and Google writes; Claude reads in read-only mode and writes local outputs. Each side remains independently diagnosable.

ED-02

Preserve raw before canonical

Raw API objects are written before normalized records so processing can be investigated and replayed.

ED-03

Make absence explicit

Missing metrics stay null and are excluded from calculations instead of becoming invented zeroes.

ED-04

Design for traceability

Snapshots, content identifiers, run logs, report indexes and append-only journals connect claims to observed records.

ED-05

Constrain probabilistic analysis

Versioned rules separate facts, interpretations and recommendations, prevent unsupported causality and require human review for compliance.

04 · Quality & Reliability

Designed to fail visibly and preserve evidence.

Deduplication by content_uid
Three-attempt exponential backoff
Quota-specific failure handling
Per-competitor and global run logs
Empty/failed cycle alerts
Immutable dated snapshot archives
Read-only analysis access
Prompt and report-rule versioning

10 / 10

Prompt validation tests passed

Executed on fictitious data to validate specific analysis safeguards. One truncation case failed first, was corrected, then passed. This is not a claim of total system reliability, and sensitive compliance cases still need independent review.

Automation maturity

A credible path from assisted execution to orchestration.

01

Current V1

Automated on demand

YouTube collection and local report generation work after explicit operator triggers.

02

Next step

Operational validation

Formalize API, Sheets and trigger tests; exercise the complete panel and a second comparison cycle.

03

Target

Multi-channel orchestration

Coordinate qualified source collectors, unified data and recurring cross-channel reporting.

05 · Current Limitations

Boundaries are part of the architecture.

Stating what the system cannot yet do protects decision quality and makes the next engineering work explicit.

  • V1 covers YouTube public organic metadata only.
  • The operating workflow is started by a human and requires about 10 minutes per cycle.
  • Autonomous weekly scheduling exists in code but has not been formally validated.
  • The recorded real analysis cycle covered ten contents from one competitor.
  • Only one real snapshot was available, so real comparative trends were not tested.
  • Compliance interpretation requires independent pharmacist validation.

06 · Target Architecture

From a YouTube vertical slice to qualified multi-channel intelligence.

This is a documented design direction, not a claim that the multi-channel platform is already operational.

YouTube — implemented
Meta / Instagram — evaluated, access dependent
TikTok — V2 candidate, approval dependent
01Isolated source collectors
02Unified normalization
03Persistent structured storage
04AI analysis & compliance
05Cross-channel intelligence
06Industrialized reporting

Not claimed: Docker, Kubernetes, Terraform, queues, CI/CD or a specific cloud deployment. The source design does not commit to them.

CapabilityV1Target
YouTube collectionImplementedRetained
Meta / InstagramNot implementedEvaluated / planned
TikTokNot implementedV2 candidate
Operator triggerCurrentReduced through orchestration
AI report generationImplemented on demandExtended across sources
Cross-channel analysisNot availableTarget capability
Real cycle comparisonNot yet exercisedRecurring snapshot analysis

07 · My Contribution

Product ownership translated into engineering delivery.

  • Led product framing, scope and freelance delivery.
  • Directed system architecture, operating constraints and documentation.
  • Coordinated an AI-assisted implementation across collection, data handling, analysis rules and testing.
  • Reviewed and delivered the V1 code, runbook, security guidance and templates.

Used in V1

  • Google Apps Script
  • Google Sheets
  • YouTube Data API v3
  • Claude Code
  • JSON
  • Markdown
  • Versioned prompt rules

Planned / evaluated

  • Qualified Meta / Instagram connectors
  • TikTok Commercial Content API candidate
  • Unified multi-source data model
  • Metric snapshot history
  • Cross-channel analysis
  • Industrialized orchestration and reporting

Engineering Takeaways

  1. 01Ship a narrow vertical slice before broadening source coverage.
  2. 02Keep deterministic data processing separate from probabilistic interpretation.
  3. 03Treat missing data and failed cycles as explicit states.
  4. 04Traceability and human review are product capabilities, not documentation extras.