Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 7 hours
Course Outline
From Text Generation to Typed Decisions
- The nature of decision model outputs.
- System one decisions compared to reasoning LLMs.
- Cost and latency profiles of bounded decisions.
The Open-Weight Decision Model Landscape
- AWS Labs’ Strands Decider 2B.
- The JEV and GEV open-weight families.
- Pplx-Decider, Liquid D1, and Clef.
- Differences in licensing and deployment.
Inside a Decision Model
- The LLM torso structure without a language modelling head.
- Pointer head scoring across candidate options.
- The origin of confidence scores.
Running Your First Decisions
- Local setup on CPU and consumer-grade GPUs.
- Formulating questions and option sets.
- Processing multiple questions in a single pass.
- Managing thresholds and fallback behaviors.
Judging Decision Quality
- JevBench and other decision benchmarks.
- The balance between accuracy and calibration.
- Brier score and the reliability of confidence.
- Tasks where decision models are not the optimal tool.
Requirements
- Basic familiarity with large language models and prompt-based applications.
- Proficiency with the command line and Python scripting.
- No prior machine learning training experience is required.
Audience
- AI engineers evaluating decision models for agent workflows.
- Software developers looking to replace LLM calls with bounded decisions.
- Solution and platform architects designing agent architectures.
- Technical product managers assessing decision model options.
