OnSite Copilot
OnSite Copilot is an AI platform that brings real-time, agentic assistance to the construction job site. The premise is simple: construction software has always served the back office, not the field. OnSite Copilot puts an AI copilot where teams already work — on their phones, on a wearable, and inside Procore — to catch safety hazards and schedule risks before they turn into rework.
As founder and CTO, I set the product direction and built the system end to end: a unified Python AI backend and a family of native clients across mobile, wearable, CAD, and the web.
The Problem
Months of ecosystem interviews kept surfacing one core pain: costly, avoidable rework. Errors compound when supervision is thin and projects grow more complex — and field workers have no AI tools built for their reality.
Who It's For
The copilot targets the two roles who own delivery and quality on every project — focusing on the moments where on-time scheduling and implementation quality are won or lost.
Existing tools only document progress after the fact. OnSite Copilot aims to prevent the bulk of these burdens before they compound.
The Product
OnSite Copilot is three integrated products on one AI backbone.
- Mobile Safety Copilot: An on-device computer-vision app that turns any phone into a safety monitor — detecting PPE violations and site hazards in real time, with instant alerts and a hands-free "Hey Copilot" voice assistant. Offline-first, so it works where connectivity doesn't.
- Procore Side Panel: An app embedded inside Procore that brings schedule intelligence to where project managers already work — one-click schedule validation, critical-path and risk analysis, and a natural-language interface for "what-if" scenarios.
- AI Backend Platform: The engine behind both — construction-aware LLMs, a RAG knowledge base for company standards and specs, and a multi-tenant, API-first design.
A Wearable Built for the Field
The safety copilot runs on a phone, but it's designed for a hands-free, head-mounted camera — so the AI sees what the worker sees, and the worker keeps both hands on the work. The companion app surfaces guidance on any nearby tablet or device.
Vision-Driven Site Understanding
The copilot doesn't just see pixels — it turns a captured site into a structured 3D model it can reason about. Drag the handle to compare the real scene with the AI's vision-driven reconstruction.
AI vision
Real sceneHow It Works
OnSite Copilot is, in effect, a "Grammarly for construction" — two complementary agentic workflows that catch errors before they compound.
See It in Action
For the full story, here's the OnSite Copilot pitch from the E14 hackathon:
A Three-Layer Agentic System
The platform is organized as three layers — sensing at the edge, integration into existing tools, and a construction-aware reasoning engine at the core — all served by one unified Python/FastAPI backend.