Ship
Instrumented client
A small library: schema, retry, stream, fallback, logs.
LLM API Integration
Treat the model as a flaky network service: timeouts, retries, streaming, fallbacks, cost per request, and a dashboard.
Created by Baljeet Dogra
Course Objectives
- Wrap a provider so a timeout is a typed error, not a hung request.
- Stream tokens to a client without losing cancellation.
- Fail over to a second provider without rewriting the product.
- Show p95 and cost per request on a live dashboard.
What you will produce
Ops
Cost dashboard
Tokens, latency, £ per request — live, not a spreadsheet after the bill.
4 weeks curriculum
Expand a part for the syllabus. Content stays searchable when closed.
01 The contract Week 1
Auth, models, tokens, rate limits. What the SDK hides.
- Keys
- Tokens
- Limits
- SDKs vs HTTP
02 Reliability Week 2
Timeouts, backoff, jitter, idempotency, streaming and cancellation.
- Retries
- Streaming
- Cancel
- Idempotency
03 Structure and fallback Week 3
JSON schemas, repair, a second provider, graceful degradation.
- Schemas
- Repair
- Fallback
- Degrade
04 Cost and ship Week 4
Attribution, budgets, a dashboard. Capstone: the client in a real endpoint.
- Cost
- Budgets
- Dashboard
- Capstone
Who this is for
Backend engineers
You know HTTP. The model still looks like magic in the business logic.
App developers
You call one SDK method. Production will not forgive that.
Prerequisites
- Python or TypeScript
- You have consumed a REST API
- You can deploy a small service or use a provided sandbox
Not a fit if
- Prompt-only playground courses
- People who have never shipped HTTP
Related: Prompt Engineering Mastery · Software Engineering Fundamentals
Questions
Which providers?
At least one frontier API and a second path so fallback is real. The course stays vendor-plural on purpose.
Is this Applied GenAI Engineering?
This is sprint 1 of that idea, in four weeks. The 28-week course continues through evals, RAG, agents and hardening.
Ready to start?
Four weeks to an LLM client you could put on call. Create an account to enrol.
Enrol now