AI Engineering·Advanced~6h
Add a cross-encoder re-ranker to a RAG pipeline and prove it improves recall@k
Retrieve wide with embeddings, then re-rank with a real cross-encoder and measure the lift, not just eyeball it.
Linha do currículo
Built a two-stage RAG retrieval pipeline (bi-encoder recall + cross-encoder re-ranking) and measured a recall@5 and MRR improvement against a labeled eval set of 40+ query-passage pairs.
frame → route → prove4 verificações · prova
AI Engineering·Working~5h
Build a semantic cache for LLM calls and prove the cost, latency, and correctness tradeoffs
Cache by meaning, not exact string match — then prove it actually saves money without serving stale garbage.
Linha do currículo
Built a semantic LLM response cache with embedding-similarity keying and TTL/manual invalidation, measuring a 40%+ cache hit rate and cost/latency reduction across a 100-query mixed workload while catching over-eager false-positive cache hits.
frame → route → decide → prove4 verificações · prova
AI Engineering·Advanced~7h
Build a hallucination detector that flags ungrounded claims in LLM answers
Split the answer into claims, check each one against the retrieved context, and catch what the model made up.
Linha do currículo
Built a claim-level hallucination detector for a RAG pipeline that decomposes answers into atomic claims and checks each against retrieved context via entailment, catching 85%+ of injected false claims across a 30-example adversarial test set with a measured false-positive rate on true claims.
frame → route → decide → prove4 verificações · prova
AI Engineering·Working~5h
Build a function-calling router that rejects bad arguments before any tool runs
Route the request to the right tool, validate every argument against its schema, and never let a malformed call through.
Linha do currículo
Built a function-calling router with JSON-schema argument validation across 5+ tools, blocking 100% of malformed tool calls pre-execution and driving a self-correction retry loop, verified against a 25-case test suite of ambiguous and adversarial routing requests.
frame → route → decide → prove4 verificações · prova
Cloud·Advanced~6h
Blue-Green Deployment with Health-Gated Cutover
Deploy a green environment, gate traffic on real health checks, and roll back in one command.
Linha do currículo
Built a zero-downtime blue-green deployment pipeline with automated health-gated traffic cutover and sub-5-second rollback, verified with a chaos test that killed a bad deploy before it received a single request.
frame → route → decide → prove4 verificações · prova
Security·Working~5h
Role-Based Access Control, Enforced at the Boundary
Define roles and permissions once, enforce them at every route, and prove a lower-privilege user gets denied.
Linha do currículo
Designed and implemented a role-based access control layer with centralized middleware enforcement across 8+ protected endpoints, closing a privilege-escalation gap where lower-role users could previously call admin-only mutations directly.
frame → decide → prove4 verificações · prova
AI Engineering·Working~6h
Ground a chatbot in your own docs
A small RAG service: you index a folder of documents into a vector store, retrieve the top-k passages for a question, and have the model answer strictly from that context — citing the source and abstaining when the answer isn’t present. You finish with a service that turns "the model guessed" into "the model looked it up."
Linha do currículo
Built a retrieval-augmented Q&A service (chunking, embeddings, top-k retrieval, grounded generation with citations and abstention) and proved grounding with an automated faithfulness check.
frame → map → decide → prove3 verificações · prova
AI Engineering·Working~5h
Build an eval harness for your AI
A test suite for an AI feature: a golden set of real inputs with known-good answers, a scorer (rubric or judge) that grades each output, and a single aggregate score. You change a prompt and watch the number move — the way a real team ships model changes without breaking things.
Linha do currículo
Built an evaluation harness (golden set, rubric/LLM-judge scoring, aggregate metric with regression threshold) that gates prompt/model changes on measured quality.
frame → decide → prove3 verificações · prova
Backend·Applied~3h
A payment endpoint that can’t double-charge
A charge endpoint that stays correct when the network retries. You add an idempotency key, a store of handled keys, and a guard that makes a repeated request a no-op returning the original result — so three retries still charge the card once.
Linha do currículo
Designed and tested an idempotent payment endpoint (idempotency-key guard, exactly-once semantics under retries) with a suite proving repeat requests never double-charge.
frame → map → prove3 verificações · prova
AI Engineering·Advanced~7h
Build a tool-using agent with a human-approval guardrail
An agent that can act, but never fires the loaded gun without you signing off first.
Linha do currículo
Built a tool-using ReAct agent with a human-in-the-loop approval gate on side-effecting actions — logged reasoning traces, approval decisions, and denial handling for every irreversible tool call.
frame → route → decide → prove4 verificações · prova
AI Engineering·Working~5h
Build a structured-output extractor with schema-conformance guarantees
Make the model hand you valid JSON every single time, not just when it feels like it.
Linha do currículo
Built a structured-output extraction pipeline (schema-constrained generation + JSON Schema validation + automatic repair loop) achieving 100% schema conformance across a 30+ case stress-test suite including malformed and adversarial inputs.
frame → decide → prove4 verificações · prova
AI Engineering·Working~6h
Build a semantic search index and measure retrieval quality
Embeddings are cheap to generate and easy to get wrong — prove yours actually retrieves the right thing.
Linha do currículo
Built a semantic search index over 500+ real documents (chunking, embedding, vector index, ranked retrieval) and evaluated it against a hand-labeled ground-truth set, measuring recall@k/precision@k and benchmarking against a keyword-search baseline.
frame → map → decide → prove4 verificações · prova
Data·Working~5h
An ETL pipeline safe to run twice
Extract, transform, load — designed so a re-run, a retry, or a crash mid-load never duplicates a row.
Linha do currículo
Built an idempotent ETL pipeline (natural-key upsert, re-run-safe load step) and proved with automated tests that re-running the same batch, or resuming a crashed batch, never duplicates or double-counts rows.
frame → map → decide → prove4 verificações · prova
Frontend·Working~5h
Build an accessible autocomplete from scratch
No headless library. Just you, ARIA, and a screen reader that has to actually understand your widget.
Linha do currículo
Built a WCAG 2.2 AA accessible combobox from scratch (ARIA 1.2 pattern, roving `aria-activedescendant`, full keyboard nav, live-region announcements), verified with an automated axe-core suite plus a manual NVDA/VoiceOver pass.
frame → map → decide → prove4 verificações · prova
Cloud·Working~5h
Deploy infrastructure that can undo itself
Define your infra as code, deploy it for real, then prove you can roll back to the exact prior state.
Linha do currículo
Defined and deployed cloud infrastructure as code in Terraform (remote state, plan/apply workflow) and proved a controlled rollback to a prior state after a bad change, with before/after plan output as evidence.
frame → map → decide → prove4 verificações · prova
Security·Working~4h
Rotate a secret without anyone noticing
Move a hardcoded secret into a real secret store, then rotate it live with zero downtime.
Linha do currículo
Migrated a hardcoded application secret into a managed secret store, implemented runtime secret fetching with caching, and rotated the secret with zero downtime, verified by a git-history and log scan showing no plaintext secret exposure.
frame → decide → prove4 verificações · prova
Security·Working~6h
Build a login that survives an attack
Password hashing, sessions, CSRF protection, and rate limiting — then prove the common attacks fail.
Linha do currículo
Implemented a production-pattern auth flow (bcrypt/argon2 password hashing, signed sessions with expiry, CSRF protection via SameSite + token, rate-limited login) and validated it with attack scripts proving brute-force, session-fixation, and CSRF attempts all fail.
frame → map → decide → prove4 verificações · prova
Foundations·Applied~3h
Turn a mystery bug into an exact line and a reason
A program is silently wrong. Instrument it, isolate the exact failing line, explain why, then lock in the fix with a regression test.
Linha do currículo
Diagnosed a silent logic defect in an unfamiliar codebase to the exact failing line using systematic instrumentation (bisection, targeted logging), documented root cause, and shipped a fix with a regression test proven to fail on the original code.
frame → route → decide → prove4 verificações · prova