Grounded search

Search GenAIWiki

Search across models, tools, comparisons, tutorials, and glossary entries — with sources shown.

GenAIWiki

Grounded AI answer — wiki index sources only

Searching GenAIWiki index…

Full results from the index

All matches for “LLM benchmarks evaluation”, grouped by content type.

Prompts

Experiment Design for A/B LLM - Advanced

In-depth guide for designing A/B tests specifically for large language models.

Strong match

A/B Testing Experiment Design

A structured template to design A/B tests for LLM applications, ensuring consistency in experiment setup.

Strong match

Dataset Card Draft for LLM Training (Advanced)

An advanced template for creating detailed dataset cards focusing on comprehensive metadata for LLM training datasets.

Dataset Card Draft for LLM Training

Specific guidelines for creating dataset cards for LLM training datasets.

Technical Workshop Lesson Plan

An organized lesson plan template for conducting technical workshops on LLMs and their applications.

ML Interview Evaluation Framework

A structured rubric for evaluating candidates in machine learning roles.

Experiment Design for A/B LLM

A structured approach to designing experiments for A/B testing in language models.

Dataset Card Draft

A standardized template for documenting dataset characteristics, usage, and limitations for LLM training.

ML Role Interview Rubric

A structured rubric designed for evaluating candidates in machine learning roles.

ML Role Interview Evaluation Criteria

A detailed rubric for evaluating candidates for machine learning roles, focusing on technical and interpersonal skills.

Data Pipeline Debugging Protocol - Comprehensive

Evaluates candidates for machine learning positions based on technical and soft skills.

Machine Learning Interview Rubric for Candidates

A structured rubric for evaluating candidates in machine learning interviews, focusing on technical and soft skills.

Interview Rubric for ML Roles

Create a structured rubric for evaluating candidates in machine learning interviews.

Want a cited narrative answer?

Ask GenAIWiki →

Tutorials

Observability: Traces for LLM + Tool Spans

Implementing observability practices to trace interactions between large language models (LLMs) and external tools. Prerequisites include knowledge of observability tools and LLM architectures.

Strong match

Metadata Filters and ACL-Aware Retrieval in Legal Document Management

This tutorial outlines the implementation of metadata filters and Access Control List (ACL)-aware retrieval systems in legal document management applications. Prerequisites include knowledge of legal data structures and basic programming skills.

Strong match

Hybrid Search: BM25 + Dense Re-Ranking for Academic Research

This tutorial explores the integration of BM25 and dense re-ranking for enhancing academic search engines. Familiarity with information retrieval concepts is required.

Enhancing Observability with Traces for LLM and Tool Spans in Data Pipelines

This tutorial focuses on enhancing observability in data pipelines that utilize large language models (LLMs) by implementing tracing for both LLM and tool spans. Prerequisites include familiarity with observability concepts and experience with LLMs.

Models

Llama 3.1 405B Instruct

Meta’s largest open-weights instruct checkpoint in the Llama 3.1 family, aimed at strong reasoning and coding quality with a permissive license for research and customization. It is typically served on dedicated GPU clusters or via partners (cloud inference, on-prem) rather than a single vendor API.

Strong match

DeepSeek-V3

DeepSeek-V3 is a large-scale language model family noted for strong coding and math performance under open or research-friendly terms (verify the exact license for your deployment). Teams adopt it for cost-sensitive research, self-hosted inference, or comparison against frontier APIs.

Strong match

Amazon Titan Text Premier

Titan Text Premier is AWS’s managed text model for Bedrock workloads emphasizing integration with guardrails, knowledge bases, and private data patterns. It targets enterprise RAG and internal assistants rather than frontier creative writing.

Claude 3.5 Sonnet

Anthropic’s balanced Sonnet-tier model tuned for long-context reasoning, careful instruction following, and strong performance on coding and analysis workloads. It is a common enterprise choice on the Anthropic API and on AWS Bedrock when teams need large context for RAG and document review.

Tools

LlamaIndex

Data framework for LLM applications focused on ingestion pipelines, indexing, retrieval, and query orchestration over private and enterprise content sources.

Strong match

OpenAI Playground

Provider of widely used frontier model APIs for text, vision, and audio, with strong developer tooling and broad ecosystem adoption across production AI applications.

Strong match

Ollama

Local model runtime for running and serving open LLMs on developer machines and private infrastructure, with simple pull/run workflows and API access.

Groq

GroqCloud offers very low-latency, high-throughput LLM inference using Groq’s LPU-style hardware, with OpenAI-compatible APIs for select open and partner models aimed at interactive and batch production workloads.

LangChain

Application framework for orchestrating LLM workflows, tool calling, retrieval, and agents across multiple providers in Python and TypeScript ecosystems.