Coding Assessment Platform with Custom Compiler Engine
A full-stack coding assessment platform with real-time test execution, built from scratch, including a custom compiler engine that replaced a costly third-party service.
The Problem
An EdTech company was using a third-party service for their coding assessments. It worked, but the costs were climbing and they had no control over the execution environment. They wanted to bring the entire assessment platform in-house, from the student-facing UI to the code execution engine.
The scope was bigger than a typical build: the platform needed real-time code compilation and execution across multiple programming languages, with test case validation, scoring, and a clean student interface.
What We Built
A complete coding assessment platform with three major components:
- Student portal: a clean interface for taking coding assessments, with a built-in code editor, timer, and real-time feedback
- Admin module: for creating assessments, managing test cases, and reviewing results
- Custom compiler engine: the core technical achievement. An in-house code execution service that compiles and runs student code against test cases in a sandboxed environment
The compiler engine was built under direct guidance from our CTO when the team discovered that the third-party code execution service (OneCompiler) was too expensive at scale. Instead of accepting the cost, the team built their own, a decision that saved the client significant ongoing operational costs.
Tech Stack
- React + Vite + TypeScript: fast, type-safe frontend for the student and admin portals
- Firebase Cloud Functions + Node.js: serverless backend handling assessment logic, scoring, and code execution orchestration
- Firebase RTDB + Firestore: real-time database for live assessment state, Firestore for structured data
- Custom compiler engine: sandboxed code execution replacing OneCompiler, built to handle multiple languages at scale
How We Worked
This project started as a web application build (1 engineer) and expanded into a full assessment platform (3 engineers + 1 PM), a natural evolution as the client saw the quality of the initial delivery and expanded scope.
The compiler engine was the hardest piece. Building reliable, sandboxed code execution from scratch is non-trivial, security, timeout handling, multi-language support, and output validation all needed to work flawlessly for a production assessment platform.
The Result
The admission module is live and in production. The assessment module is in active development. The client is a repeat client: they started with the web app and came back for the full assessment platform, which speaks to the quality of the initial delivery.
Technical Deep Dives
How we think about the problem, the tech trade-offs we made, and what we'd do differently. Written by the engineers who shipped it.
How We Built a Coding Assessment Tool with AI Evaluation
How we built a coding platform with a custom compiler engine and AI evaluation. What broke with OneCompiler, how we scored code approaches, real build story.
Vibe Coding in Production: How We Use AI to Build AI
Our team ships AI products using AI coding tools every day. Here's what actually works, what breaks, and the workflows we've settled on after 6 months.
Want something like this built?
Tell us the problem. We'll tell you what 72 hours can produce.
Usually reply within hours, max 12. | Prefer a scheduled call? Book 30 min →
Tuesday Build Notes · 3-min read
One engineering tradeoff, every Tuesday.
From the engineers actually shipping. What we tried, what broke, what we'd do differently. Zero "5 AI trends to watch." Unsubscribe in one click.
Issue #1 lands the moment you subscribe: how we cut a client's LLM bill 60% without losing quality. The 3 model-routing rules we now use on every project.
✓ You're in. Issue #1 is on its way to your inbox.
Something went wrong. Email dharini@kalviumlabs.ai and we'll add you manually.